2023-09-21T00:04:43.724 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-21T00:04:43.725 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} --archive /home/teuthworker/archive/vshankar-2023-09-20_10:42:39-fs-wip-vshankar-testing-20230920.072635-testing-default-smithi/7399289 --verbose --name vshankar-2023-09-20_10:42:39-fs-wip-vshankar-testing-20230920.072635-testing-default-smithi --owner scheduled_vshankar@teuthology -- /home/teuthworker/archive/vshankar-2023-09-20_10:42:39-fs-wip-vshankar-testing-20230920.072635-testing-default-smithi/7399289/orig.config.yaml 2023-09-21T00:04:43.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T00:04:43.923 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-09-20_10:42:39-fs-wip-vshankar-testing-20230920.072635-testing-default-smithi/7399289 branch: wip-vshankar-testing-20230920.072635 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: vshankar@redhat.com first_in_suite: false job_id: '7399289' kernel: client: sha1: distro flavor: default kdb: true sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-09-20_10:42:39-fs-wip-vshankar-testing-20230920.072635-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-vshankar-testing-20230920.072635 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: bf8a061ff16ac1d393cf108f740d92dfa49f2e54 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: bf8a061ff16ac1d393cf108f740d92dfa49f2e54 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20230920.072635 sha1: bf8a061ff16ac1d393cf108f740d92dfa49f2e54 owner: scheduled_vshankar@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 2186 sha1: bf8a061ff16ac1d393cf108f740d92dfa49f2e54 sleep_before_teardown: 0 subset: 614/1024 suite: fs suite_branch: wip-vshankar-testing-20230920.072635 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bf8a061ff16ac1d393cf108f740d92dfa49f2e54/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bf8a061ff16ac1d393cf108f740d92dfa49f2e54 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi059.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi083.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-09-20_10:42:39 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1394 2023-09-21T00:04:43.923 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bf8a061ff16ac1d393cf108f740d92dfa49f2e54/qa; will attempt to use it 2023-09-21T00:04:43.924 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bf8a061ff16ac1d393cf108f740d92dfa49f2e54/qa/tasks 2023-09-21T00:04:43.924 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-09-21T00:04:43.926 INFO:teuthology.task.internal:Checking packages... 2023-09-21T00:04:43.951 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash 'bf8a061ff16ac1d393cf108f740d92dfa49f2e54' 2023-09-21T00:04:43.952 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-21T00:04:43.952 INFO:teuthology.packaging:ref: None 2023-09-21T00:04:43.953 INFO:teuthology.packaging:tag: None 2023-09-21T00:04:43.953 INFO:teuthology.packaging:branch: wip-vshankar-testing-20230920.072635 2023-09-21T00:04:43.953 INFO:teuthology.packaging:sha1: bf8a061ff16ac1d393cf108f740d92dfa49f2e54 2023-09-21T00:04:43.954 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-vshankar-testing-20230920.072635 2023-09-21T00:04:44.176 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6213.gbf8a061f 2023-09-21T00:04:44.177 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-09-21T00:04:44.214 INFO:teuthology.task.internal:no buildpackages task found 2023-09-21T00:04:44.214 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-09-21T00:04:44.335 INFO:teuthology.task.internal:Saving configuration 2023-09-21T00:04:44.354 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-09-21T00:04:44.366 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-21T00:04:44.392 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi059.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-09-20_10:42:39-fs-wip-vshankar-testing-20230920.072635-testing-default-smithi/7399289', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-20 23:59:38.984851', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-21T00:04:44.416 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi083.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-09-20_10:42:39-fs-wip-vshankar-testing-20230920.072635-testing-default-smithi/7399289', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-20 23:59:38.983344', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-21T00:04:44.416 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-09-21T00:04:44.438 INFO:teuthology.task.internal:roles: ubuntu@smithi059.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-09-21T00:04:44.438 INFO:teuthology.task.internal:roles: ubuntu@smithi083.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-09-21T00:04:44.439 INFO:teuthology.run_tasks:Running task console_log... 2023-09-21T00:04:44.513 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fee59930b80>, signals=[15]) 2023-09-21T00:04:44.515 INFO:teuthology.run_tasks:Running task internal.connect... 2023-09-21T00:04:44.548 INFO:teuthology.task.internal:Opening connections... 2023-09-21T00:04:44.548 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi059.front.sepia.ceph.com 2023-09-21T00:04:44.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T00:04:44.621 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi083.front.sepia.ceph.com 2023-09-21T00:04:44.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T00:04:44.689 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-09-21T00:04:44.739 DEBUG:teuthology.orchestra.run.smithi059:> uname -m 2023-09-21T00:04:44.761 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64 2023-09-21T00:04:44.761 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2023-09-21T00:04:44.821 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="Red Hat Enterprise Linux" 2023-09-21T00:04:44.822 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="8.6 (Ootpa)" 2023-09-21T00:04:44.822 INFO:teuthology.orchestra.run.smithi059.stdout:ID="rhel" 2023-09-21T00:04:44.822 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="fedora" 2023-09-21T00:04:44.822 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="8.6" 2023-09-21T00:04:44.823 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el8" 2023-09-21T00:04:44.823 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-21T00:04:44.823 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2023-09-21T00:04:44.823 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-21T00:04:44.823 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://www.redhat.com/" 2023-09-21T00:04:44.823 INFO:teuthology.orchestra.run.smithi059.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-21T00:04:44.824 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-21T00:04:44.824 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:04:44.824 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-21T00:04:44.824 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-21T00:04:44.824 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-21T00:04:44.825 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-21T00:04:44.825 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2023-09-21T00:04:44.846 DEBUG:teuthology.orchestra.run.smithi083:> uname -m 2023-09-21T00:04:44.866 INFO:teuthology.orchestra.run.smithi083.stdout:x86_64 2023-09-21T00:04:44.867 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release 2023-09-21T00:04:44.926 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="Red Hat Enterprise Linux" 2023-09-21T00:04:44.926 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="8.6 (Ootpa)" 2023-09-21T00:04:44.926 INFO:teuthology.orchestra.run.smithi083.stdout:ID="rhel" 2023-09-21T00:04:44.927 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE="fedora" 2023-09-21T00:04:44.927 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="8.6" 2023-09-21T00:04:44.927 INFO:teuthology.orchestra.run.smithi083.stdout:PLATFORM_ID="platform:el8" 2023-09-21T00:04:44.927 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-21T00:04:44.927 INFO:teuthology.orchestra.run.smithi083.stdout:ANSI_COLOR="0;31" 2023-09-21T00:04:44.928 INFO:teuthology.orchestra.run.smithi083.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-21T00:04:44.928 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://www.redhat.com/" 2023-09-21T00:04:44.928 INFO:teuthology.orchestra.run.smithi083.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-21T00:04:44.928 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-21T00:04:44.928 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-09-21T00:04:44.929 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-21T00:04:44.929 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-21T00:04:44.929 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-21T00:04:44.929 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-21T00:04:44.930 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2023-09-21T00:04:44.946 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-09-21T00:04:44.955 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-09-21T00:04:44.963 INFO:teuthology.task.internal:Checking for old test directory... 2023-09-21T00:04:44.964 DEBUG:teuthology.orchestra.run.smithi059:> test '!' -e /home/ubuntu/cephtest 2023-09-21T00:04:44.966 DEBUG:teuthology.orchestra.run.smithi083:> test '!' -e /home/ubuntu/cephtest 2023-09-21T00:04:44.984 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-09-21T00:04:45.003 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-09-21T00:04:45.003 DEBUG:teuthology.orchestra.run.smithi059:> test -z $(ls -A /var/lib/ceph) 2023-09-21T00:04:45.026 DEBUG:teuthology.orchestra.run.smithi083:> test -z $(ls -A /var/lib/ceph) 2023-09-21T00:04:45.053 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-09-21T00:04:45.105 INFO:teuthology.run_tasks:Running task kernel... 2023-09-21T00:04:45.126 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'} 2023-09-21T00:04:45.127 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-09-21T00:04:45.127 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-09-21T00:04:45.128 DEBUG:teuthology.orchestra.run.smithi059:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-21T00:04:45.129 DEBUG:teuthology.orchestra.run.smithi083:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-21T00:04:45.147 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-21T00:04:45.148 DEBUG:teuthology.orchestra.run.smithi083:> uname -r 2023-09-21T00:04:45.149 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-21T00:04:45.150 DEBUG:teuthology.orchestra.run.smithi059:> uname -r 2023-09-21T00:04:45.208 INFO:teuthology.orchestra.run.smithi083.stdout:4.18.0-372.9.1.el8.x86_64 2023-09-21T00:04:45.209 INFO:teuthology.task.kernel:Running kernel on smithi083: 4.18.0-372.9.1.el8.x86_64 2023-09-21T00:04:45.209 DEBUG:teuthology.orchestra.run.smithi083:> sudo yum install -y kernel 2023-09-21T00:04:45.210 INFO:teuthology.orchestra.run.smithi059.stdout:4.18.0-372.9.1.el8.x86_64 2023-09-21T00:04:45.210 INFO:teuthology.task.kernel:Running kernel on smithi059: 4.18.0-372.9.1.el8.x86_64 2023-09-21T00:04:45.211 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum install -y kernel 2023-09-21T00:04:46.410 INFO:teuthology.orchestra.run.smithi083.stdout:Updating Subscription Management repositories. 2023-09-21T00:04:46.411 INFO:teuthology.orchestra.run.smithi083.stdout:Unable to read consumer identity 2023-09-21T00:04:46.411 INFO:teuthology.orchestra.run.smithi059.stdout:Updating Subscription Management repositories. 2023-09-21T00:04:46.412 INFO:teuthology.orchestra.run.smithi059.stdout:Unable to read consumer identity 2023-09-21T00:04:47.754 INFO:teuthology.orchestra.run.smithi059.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-09-21T00:04:47.788 INFO:teuthology.orchestra.run.smithi083.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2023-09-21T00:04:49.013 INFO:teuthology.orchestra.run.smithi059.stdout:Extra Packages for Enterprise Linux 13 MB/s | 16 MB 00:01 2023-09-21T00:04:49.038 INFO:teuthology.orchestra.run.smithi083.stdout:Extra Packages for Enterprise Linux 13 MB/s | 16 MB 00:01 2023-09-21T00:04:52.589 INFO:teuthology.orchestra.run.smithi083.stdout:lab-extras 422 kB/s | 24 kB 00:00 2023-09-21T00:04:52.713 INFO:teuthology.orchestra.run.smithi059.stdout:lab-extras 414 kB/s | 24 kB 00:00 2023-09-21T00:04:53.266 INFO:teuthology.orchestra.run.smithi083.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-09-21T00:04:53.317 INFO:teuthology.orchestra.run.smithi083.stdout:Dependencies resolved. 2023-09-21T00:04:53.318 INFO:teuthology.orchestra.run.smithi083.stdout:Nothing to do. 2023-09-21T00:04:53.318 INFO:teuthology.orchestra.run.smithi083.stdout:Complete! 2023-09-21T00:04:53.424 INFO:teuthology.orchestra.run.smithi059.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-09-21T00:04:53.431 DEBUG:teuthology.orchestra.run.smithi083:> echo no | sudo yum reinstall kernel || true 2023-09-21T00:04:53.476 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2023-09-21T00:04:53.477 INFO:teuthology.orchestra.run.smithi059.stdout:Nothing to do. 2023-09-21T00:04:53.478 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2023-09-21T00:04:53.607 DEBUG:teuthology.orchestra.run.smithi059:> echo no | sudo yum reinstall kernel || true 2023-09-21T00:04:53.761 INFO:teuthology.orchestra.run.smithi083.stdout:Updating Subscription Management repositories. 2023-09-21T00:04:53.762 INFO:teuthology.orchestra.run.smithi083.stdout:Unable to read consumer identity 2023-09-21T00:04:54.002 INFO:teuthology.orchestra.run.smithi059.stdout:Updating Subscription Management repositories. 2023-09-21T00:04:54.002 INFO:teuthology.orchestra.run.smithi059.stdout:Unable to read consumer identity 2023-09-21T00:04:54.019 INFO:teuthology.orchestra.run.smithi083.stdout:Last metadata expiration check: 0:00:02 ago on Thu 21 Sep 2023 12:04:52 AM UTC. 2023-09-21T00:04:54.063 INFO:teuthology.orchestra.run.smithi083.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-09-21T00:04:54.111 INFO:teuthology.orchestra.run.smithi083.stderr:Error: No packages marked for reinstall. 2023-09-21T00:04:54.157 DEBUG:teuthology.orchestra.run.smithi083:> sudo yum reinstall -y kernel || true 2023-09-21T00:04:54.276 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:00:02 ago on Thu 21 Sep 2023 12:04:52 AM UTC. 2023-09-21T00:04:54.333 INFO:teuthology.orchestra.run.smithi059.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-09-21T00:04:54.365 INFO:teuthology.orchestra.run.smithi059.stderr:Error: No packages marked for reinstall. 2023-09-21T00:04:54.412 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum reinstall -y kernel || true 2023-09-21T00:04:54.486 INFO:teuthology.orchestra.run.smithi083.stdout:Updating Subscription Management repositories. 2023-09-21T00:04:54.486 INFO:teuthology.orchestra.run.smithi083.stdout:Unable to read consumer identity 2023-09-21T00:04:54.744 INFO:teuthology.orchestra.run.smithi083.stdout:Last metadata expiration check: 0:00:02 ago on Thu 21 Sep 2023 12:04:52 AM UTC. 2023-09-21T00:04:54.764 INFO:teuthology.orchestra.run.smithi059.stdout:Updating Subscription Management repositories. 2023-09-21T00:04:54.764 INFO:teuthology.orchestra.run.smithi059.stdout:Unable to read consumer identity 2023-09-21T00:04:54.788 INFO:teuthology.orchestra.run.smithi083.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-09-21T00:04:54.816 INFO:teuthology.orchestra.run.smithi083.stderr:Error: No packages marked for reinstall. 2023-09-21T00:04:54.867 DEBUG:teuthology.orchestra.run.smithi083:> rpm -q kernel | sort -rV | head -n 1 2023-09-21T00:04:54.948 INFO:teuthology.orchestra.run.smithi083.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-09-21T00:04:54.948 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-09-21T00:04:54.949 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-09-21T00:04:54.949 DEBUG:teuthology.parallel:result is None 2023-09-21T00:04:55.027 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:00:03 ago on Thu 21 Sep 2023 12:04:52 AM UTC. 2023-09-21T00:04:55.068 INFO:teuthology.orchestra.run.smithi059.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-09-21T00:04:55.087 INFO:teuthology.orchestra.run.smithi059.stderr:Error: No packages marked for reinstall. 2023-09-21T00:04:55.135 DEBUG:teuthology.orchestra.run.smithi059:> rpm -q kernel | sort -rV | head -n 1 2023-09-21T00:04:55.218 INFO:teuthology.orchestra.run.smithi059.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-09-21T00:04:55.219 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-09-21T00:04:55.219 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-09-21T00:04:55.220 DEBUG:teuthology.parallel:result is None 2023-09-21T00:04:55.220 INFO:teuthology.run_tasks:Running task internal.base... 2023-09-21T00:04:55.238 INFO:teuthology.task.internal:Creating test directory... 2023-09-21T00:04:55.238 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-21T00:04:55.240 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-21T00:04:55.257 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-09-21T00:04:55.267 INFO:teuthology.run_tasks:Running task internal.archive... 2023-09-21T00:04:55.277 INFO:teuthology.task.internal:Creating archive directory... 2023-09-21T00:04:55.277 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-21T00:04:55.297 DEBUG:teuthology.orchestra.run.smithi083:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-21T00:04:55.319 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-09-21T00:04:55.337 INFO:teuthology.task.internal:Enabling coredump saving... 2023-09-21T00:04:55.337 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-21T00:04:55.355 DEBUG:teuthology.orchestra.run.smithi083:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-21T00:04:55.381 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-21T00:04:55.395 INFO:teuthology.orchestra.run.smithi083.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-21T00:04:55.405 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-21T00:04:55.415 INFO:teuthology.orchestra.run.smithi083.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-21T00:04:55.416 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-09-21T00:04:55.424 INFO:teuthology.task.internal:Configuring sudo... 2023-09-21T00:04:55.424 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-21T00:04:55.449 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-21T00:04:55.482 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-09-21T00:04:55.492 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-09-21T00:04:55.492 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-21T00:04:55.517 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-21T00:04:55.538 DEBUG:teuthology.orchestra.run.smithi059:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-21T00:04:55.609 DEBUG:teuthology.orchestra.run.smithi059:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-21T00:04:55.674 DEBUG:teuthology.orchestra.run.smithi059:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-21T00:04:55.755 DEBUG:teuthology.orchestra.run.smithi059:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-21T00:04:55.800 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-21T00:04:55.801 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-21T00:04:55.868 DEBUG:teuthology.orchestra.run.smithi083:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-21T00:04:55.908 DEBUG:teuthology.orchestra.run.smithi083:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-21T00:04:55.966 DEBUG:teuthology.orchestra.run.smithi083:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-21T00:04:56.047 DEBUG:teuthology.orchestra.run.smithi083:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-21T00:04:56.090 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-09-21T00:04:56.090 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-21T00:04:56.157 DEBUG:teuthology.orchestra.run.smithi059:> sudo service rsyslog restart 2023-09-21T00:04:56.160 DEBUG:teuthology.orchestra.run.smithi083:> sudo service rsyslog restart 2023-09-21T00:04:56.240 INFO:teuthology.orchestra.run.smithi059.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-21T00:04:56.265 INFO:teuthology.orchestra.run.smithi083.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-21T00:04:56.592 INFO:teuthology.run_tasks:Running task internal.timer... 2023-09-21T00:04:56.935 INFO:teuthology.task.internal:Starting timer... 2023-09-21T00:04:56.936 INFO:teuthology.run_tasks:Running task pcp... 2023-09-21T00:04:56.953 INFO:teuthology.run_tasks:Running task selinux... 2023-09-21T00:04:56.967 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2023-09-21T00:04:56.968 DEBUG:teuthology.orchestra.run.smithi059:> sudo service auditd rotate 2023-09-21T00:04:57.029 INFO:teuthology.orchestra.run.smithi059.stdout:Rotating logs: 2023-09-21T00:04:57.031 DEBUG:teuthology.orchestra.run.smithi083:> sudo service auditd rotate 2023-09-21T00:04:57.092 INFO:teuthology.orchestra.run.smithi083.stdout:Rotating logs: 2023-09-21T00:04:57.094 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-09-21T00:04:57.094 DEBUG:teuthology.orchestra.run.smithi059:> /usr/sbin/getenforce 2023-09-21T00:04:57.120 INFO:teuthology.orchestra.run.smithi059.stdout:Permissive 2023-09-21T00:04:57.120 DEBUG:teuthology.orchestra.run.smithi083:> /usr/sbin/getenforce 2023-09-21T00:04:57.147 INFO:teuthology.orchestra.run.smithi083.stdout:Permissive 2023-09-21T00:04:57.147 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi059.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi083.front.sepia.ceph.com': 'permissive'} 2023-09-21T00:04:57.147 DEBUG:teuthology.orchestra.run.smithi059:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-21T00:04:57.187 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-21T00:04:57.188 DEBUG:teuthology.orchestra.run.smithi083:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-21T00:04:57.214 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-21T00:04:57.215 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-09-21T00:04:57.215 DEBUG:teuthology.orchestra.run.smithi059:> sudo /usr/sbin/setenforce permissive 2023-09-21T00:04:57.275 DEBUG:teuthology.orchestra.run.smithi083:> sudo /usr/sbin/setenforce permissive 2023-09-21T00:04:57.301 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-09-21T00:04:57.406 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-09-21T00:04:57.411 INFO:teuthology.repo_utils:Fetching main from origin 2023-09-21T00:04:57.520 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-09-21T00:04:57.537 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-09-21T00:04:57.538 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi059.front.sepia.ceph.com,smithi083.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-09-21T00:13:47.091 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi059.front.sepia.ceph.com'), Remote(name='ubuntu@smithi083.front.sepia.ceph.com')] 2023-09-21T00:13:47.123 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-09-21T00:13:47.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T00:13:47.193 DEBUG:teuthology.orchestra.run.smithi059:> true 2023-09-21T00:13:47.259 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-09-21T00:13:47.260 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-09-21T00:13:47.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T00:13:47.329 DEBUG:teuthology.orchestra.run.smithi083:> true 2023-09-21T00:13:47.398 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-09-21T00:13:47.399 INFO:teuthology.run_tasks:Running task clock... 2023-09-21T00:13:47.413 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-09-21T00:13:47.414 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-21T00:13:47.415 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-21T00:13:47.417 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-21T00:13:47.417 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-21T00:13:47.449 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-09-21T00:13:47.465 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-09-21T00:13:47.470 INFO:teuthology.orchestra.run.smithi083.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-09-21T00:13:47.484 INFO:teuthology.orchestra.run.smithi083.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-09-21T00:13:47.552 INFO:teuthology.orchestra.run.smithi059.stderr:sudo: ntpd: command not found 2023-09-21T00:13:47.562 INFO:teuthology.orchestra.run.smithi083.stderr:sudo: ntpd: command not found 2023-09-21T00:13:47.564 INFO:teuthology.orchestra.run.smithi059.stdout:506 Cannot talk to daemon 2023-09-21T00:13:47.573 INFO:teuthology.orchestra.run.smithi083.stdout:506 Cannot talk to daemon 2023-09-21T00:13:47.580 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-09-21T00:13:47.588 INFO:teuthology.orchestra.run.smithi083.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-09-21T00:13:47.594 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-09-21T00:13:47.601 INFO:teuthology.orchestra.run.smithi083.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-09-21T00:13:47.671 INFO:teuthology.orchestra.run.smithi059.stderr:bash: ntpq: command not found 2023-09-21T00:13:47.675 INFO:teuthology.orchestra.run.smithi059.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-21T00:13:47.675 INFO:teuthology.orchestra.run.smithi059.stdout:=============================================================================== 2023-09-21T00:13:47.675 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-21T00:13:47.675 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-21T00:13:47.676 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-21T00:13:47.676 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-21T00:13:47.677 INFO:teuthology.orchestra.run.smithi083.stderr:bash: ntpq: command not found 2023-09-21T00:13:47.680 INFO:teuthology.orchestra.run.smithi083.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-21T00:13:47.680 INFO:teuthology.orchestra.run.smithi083.stdout:=============================================================================== 2023-09-21T00:13:47.680 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-21T00:13:47.681 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-21T00:13:47.681 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-21T00:13:47.681 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-21T00:13:47.683 INFO:teuthology.run_tasks:Running task install... 2023-09-21T00:13:47.692 DEBUG:teuthology.task.install:project ceph 2023-09-21T00:13:47.692 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bf8a061ff16ac1d393cf108f740d92dfa49f2e54'}} 2023-09-21T00:13:47.693 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'bf8a061ff16ac1d393cf108f740d92dfa49f2e54'} 2023-09-21T00:13:47.693 INFO:teuthology.task.install:Using flavor: default 2023-09-21T00:13:47.699 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-09-21T00:13:47.699 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-09-21T00:13:47.700 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bf8a061ff16ac1d393cf108f740d92dfa49f2e54', 'tag': None, 'wait_for_package': False} 2023-09-21T00:13:47.700 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=bf8a061ff16ac1d393cf108f740d92dfa49f2e54 2023-09-21T00:13:47.702 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bf8a061ff16ac1d393cf108f740d92dfa49f2e54', 'tag': None, 'wait_for_package': False} 2023-09-21T00:13:47.702 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=bf8a061ff16ac1d393cf108f740d92dfa49f2e54 2023-09-21T00:13:47.862 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230920.072635/bf8a061ff16ac1d393cf108f740d92dfa49f2e54/centos/8/flavors/default/ 2023-09-21T00:13:47.863 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6213.gbf8a061f 2023-09-21T00:13:47.942 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230920.072635/bf8a061ff16ac1d393cf108f740d92dfa49f2e54/centos/8/flavors/default/ 2023-09-21T00:13:47.942 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6213.gbf8a061f 2023-09-21T00:13:47.966 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230920.072635/bf8a061ff16ac1d393cf108f740d92dfa49f2e54/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230920.072635/bf8a061ff16ac1d393cf108f740d92dfa49f2e54/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230920.072635/bf8a061ff16ac1d393cf108f740d92dfa49f2e54/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-09-21T00:13:47.967 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-09-21T00:13:47.967 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-09-21T00:13:47.995 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-09-21T00:13:47.996 DEBUG:teuthology.orchestra.run.smithi083:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bf8a061ff16ac1d393cf108f740d92dfa49f2e54/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-09-21T00:13:48.063 DEBUG:teuthology.orchestra.run.smithi083:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-09-21T00:13:48.113 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230920.072635/bf8a061ff16ac1d393cf108f740d92dfa49f2e54/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230920.072635/bf8a061ff16ac1d393cf108f740d92dfa49f2e54/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230920.072635/bf8a061ff16ac1d393cf108f740d92dfa49f2e54/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-09-21T00:13:48.113 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-21T00:13:48.113 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-09-21T00:13:48.140 DEBUG:teuthology.orchestra.run.smithi083:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-09-21T00:13:48.144 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-09-21T00:13:48.144 DEBUG:teuthology.orchestra.run.smithi059:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bf8a061ff16ac1d393cf108f740d92dfa49f2e54/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-09-21T00:13:48.206 INFO:teuthology.orchestra.run.smithi083.stdout:check_obsoletes = 1 2023-09-21T00:13:48.208 DEBUG:teuthology.orchestra.run.smithi083:> sudo yum clean all 2023-09-21T00:13:48.215 DEBUG:teuthology.orchestra.run.smithi059:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-09-21T00:13:48.297 DEBUG:teuthology.orchestra.run.smithi059:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-09-21T00:13:48.364 INFO:teuthology.orchestra.run.smithi059.stdout:check_obsoletes = 1 2023-09-21T00:13:48.366 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum clean all 2023-09-21T00:13:48.578 INFO:teuthology.orchestra.run.smithi083.stdout:Updating Subscription Management repositories. 2023-09-21T00:13:48.755 INFO:teuthology.orchestra.run.smithi059.stdout:Updating Subscription Management repositories. 2023-09-21T00:13:48.838 INFO:teuthology.orchestra.run.smithi083.stdout:44 files removed 2023-09-21T00:13:48.885 DEBUG:teuthology.orchestra.run.smithi083:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-09-21T00:13:48.999 INFO:teuthology.orchestra.run.smithi059.stdout:44 files removed 2023-09-21T00:13:49.047 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-09-21T00:13:49.214 INFO:teuthology.orchestra.run.smithi083.stdout:Updating Subscription Management repositories. 2023-09-21T00:13:49.399 INFO:teuthology.orchestra.run.smithi059.stdout:Updating Subscription Management repositories. 2023-09-21T00:13:49.967 INFO:teuthology.orchestra.run.smithi083.stdout:ceph packages for x86_64 201 kB/s | 81 kB 00:00 2023-09-21T00:13:50.054 INFO:teuthology.orchestra.run.smithi059.stdout:ceph packages for x86_64 266 kB/s | 81 kB 00:00 2023-09-21T00:13:50.267 INFO:teuthology.orchestra.run.smithi083.stdout:ceph noarch packages 35 kB/s | 9.4 kB 00:00 2023-09-21T00:13:50.329 INFO:teuthology.orchestra.run.smithi059.stdout:ceph noarch packages 39 kB/s | 9.4 kB 00:00 2023-09-21T00:13:50.618 INFO:teuthology.orchestra.run.smithi083.stdout:ceph source packages 4.5 kB/s | 1.5 kB 00:00 2023-09-21T00:13:50.697 INFO:teuthology.orchestra.run.smithi059.stdout:ceph source packages 4.3 kB/s | 1.5 kB 00:00 2023-09-21T00:13:50.760 INFO:teuthology.orchestra.run.smithi083.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2023-09-21T00:13:50.830 INFO:teuthology.orchestra.run.smithi059.stdout:Copr repo for python3-asyncssh owned by ceph 31 kB/s | 3.5 kB 00:00 2023-09-21T00:13:51.615 INFO:teuthology.orchestra.run.smithi059.stdout:Extra Packages for Enterprise Linux 21 MB/s | 16 MB 00:00 2023-09-21T00:13:52.246 INFO:teuthology.orchestra.run.smithi083.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2023-09-21T00:13:55.248 INFO:teuthology.orchestra.run.smithi059.stdout:lab-extras 449 kB/s | 24 kB 00:00 2023-09-21T00:13:55.778 INFO:teuthology.orchestra.run.smithi083.stdout:lab-extras 330 kB/s | 24 kB 00:00 2023-09-21T00:13:56.159 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 57 MB/s | 47 MB 00:00 2023-09-21T00:13:56.688 INFO:teuthology.orchestra.run.smithi083.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 63 MB/s | 53 MB 00:00 2023-09-21T00:14:04.518 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 59 MB/s | 53 MB 00:00 2023-09-21T00:14:04.756 INFO:teuthology.orchestra.run.smithi083.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 60 MB/s | 47 MB 00:00 2023-09-21T00:14:15.620 INFO:teuthology.orchestra.run.smithi083.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-21T00:14:15.621 INFO:teuthology.orchestra.run.smithi083.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-21T00:14:15.635 INFO:teuthology.orchestra.run.smithi083.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-09-21T00:14:15.636 INFO:teuthology.orchestra.run.smithi083.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-09-21T00:14:15.637 INFO:teuthology.orchestra.run.smithi083.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-09-21T00:14:15.639 INFO:teuthology.orchestra.run.smithi083.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-09-21T00:14:15.641 INFO:teuthology.orchestra.run.smithi083.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-09-21T00:14:15.644 INFO:teuthology.orchestra.run.smithi083.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-09-21T00:14:15.645 INFO:teuthology.orchestra.run.smithi083.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-09-21T00:14:15.774 INFO:teuthology.orchestra.run.smithi083.stdout:Dependencies resolved. 2023-09-21T00:14:15.786 INFO:teuthology.orchestra.run.smithi083.stdout:=========================================================================================================================== 2023-09-21T00:14:15.786 INFO:teuthology.orchestra.run.smithi083.stdout: Package Arch Version Repository Size 2023-09-21T00:14:15.787 INFO:teuthology.orchestra.run.smithi083.stdout:=========================================================================================================================== 2023-09-21T00:14:15.787 INFO:teuthology.orchestra.run.smithi083.stdout:Installing: 2023-09-21T00:14:15.787 INFO:teuthology.orchestra.run.smithi083.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-09-21T00:14:15.787 INFO:teuthology.orchestra.run.smithi083.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-09-21T00:14:15.787 INFO:teuthology.orchestra.run.smithi083.stdout: ceph x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 6.4 k 2023-09-21T00:14:15.788 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-base x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 5.4 M 2023-09-21T00:14:15.788 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-fuse x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 907 k 2023-09-21T00:14:15.788 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 167 k 2023-09-21T00:14:15.788 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 1.6 M 2023-09-21T00:14:15.789 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6213.gbf8a061f.el8 ceph-noarch 132 k 2023-09-21T00:14:15.789 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6213.gbf8a061f.el8 ceph-noarch 1.7 M 2023-09-21T00:14:15.789 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6213.gbf8a061f.el8 ceph-noarch 7.4 M 2023-09-21T00:14:15.789 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-rook noarch 2:18.0.0-6213.gbf8a061f.el8 ceph-noarch 47 k 2023-09-21T00:14:15.789 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-radosgw x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 14 M 2023-09-21T00:14:15.790 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-test x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 49 M 2023-09-21T00:14:15.790 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-volume noarch 2:18.0.0-6213.gbf8a061f.el8 ceph-noarch 261 k 2023-09-21T00:14:15.790 INFO:teuthology.orchestra.run.smithi083.stdout: cephadm noarch 2:18.0.0-6213.gbf8a061f.el8 ceph-noarch 179 k 2023-09-21T00:14:15.791 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-mirror x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 261 k 2023-09-21T00:14:15.791 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-top noarch 2:18.0.0-6213.gbf8a061f.el8 ceph-noarch 18 k 2023-09-21T00:14:15.791 INFO:teuthology.orchestra.run.smithi083.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-09-21T00:14:15.792 INFO:teuthology.orchestra.run.smithi083.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-09-21T00:14:15.792 INFO:teuthology.orchestra.run.smithi083.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-09-21T00:14:15.792 INFO:teuthology.orchestra.run.smithi083.stdout: libcephfs-devel x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 31 k 2023-09-21T00:14:15.793 INFO:teuthology.orchestra.run.smithi083.stdout: libcephfs2 x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 827 k 2023-09-21T00:14:15.793 INFO:teuthology.orchestra.run.smithi083.stdout: librados-devel x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 139 k 2023-09-21T00:14:15.793 INFO:teuthology.orchestra.run.smithi083.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-09-21T00:14:15.794 INFO:teuthology.orchestra.run.smithi083.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-09-21T00:14:15.794 INFO:teuthology.orchestra.run.smithi083.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-09-21T00:14:15.795 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-09-21T00:14:15.795 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-09-21T00:14:15.795 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-09-21T00:14:15.796 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cephfs x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 197 k 2023-09-21T00:14:15.796 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rados x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 371 k 2023-09-21T00:14:15.797 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rbd x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 364 k 2023-09-21T00:14:15.797 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rgw x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 106 k 2023-09-21T00:14:15.797 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-fuse x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 94 k 2023-09-21T00:14:15.798 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-mirror x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 3.6 M 2023-09-21T00:14:15.798 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-nbd x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 179 k 2023-09-21T00:14:15.798 INFO:teuthology.orchestra.run.smithi083.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-09-21T00:14:15.799 INFO:teuthology.orchestra.run.smithi083.stdout:Upgrading: 2023-09-21T00:14:15.799 INFO:teuthology.orchestra.run.smithi083.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-09-21T00:14:15.799 INFO:teuthology.orchestra.run.smithi083.stdout: librados2 x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 3.7 M 2023-09-21T00:14:15.800 INFO:teuthology.orchestra.run.smithi083.stdout: librbd1 x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 3.7 M 2023-09-21T00:14:15.800 INFO:teuthology.orchestra.run.smithi083.stdout:Installing dependencies: 2023-09-21T00:14:15.800 INFO:teuthology.orchestra.run.smithi083.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-09-21T00:14:15.801 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-common x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 23 M 2023-09-21T00:14:15.801 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6213.gbf8a061f.el8 ceph-noarch 23 k 2023-09-21T00:14:15.801 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mds x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 2.3 M 2023-09-21T00:14:15.801 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6213.gbf8a061f.el8 ceph-noarch 242 k 2023-09-21T00:14:15.801 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mon x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 4.6 M 2023-09-21T00:14:15.802 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-osd x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 18 M 2023-09-21T00:14:15.802 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6213.gbf8a061f.el8 ceph-noarch 15 k 2023-09-21T00:14:15.802 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-selinux x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 24 k 2023-09-21T00:14:15.803 INFO:teuthology.orchestra.run.smithi083.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-09-21T00:14:15.803 INFO:teuthology.orchestra.run.smithi083.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-09-21T00:14:15.803 INFO:teuthology.orchestra.run.smithi083.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-09-21T00:14:15.803 INFO:teuthology.orchestra.run.smithi083.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-09-21T00:14:15.804 INFO:teuthology.orchestra.run.smithi083.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-09-21T00:14:15.804 INFO:teuthology.orchestra.run.smithi083.stdout: libcephsqlite x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 184 k 2023-09-21T00:14:15.804 INFO:teuthology.orchestra.run.smithi083.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-09-21T00:14:15.804 INFO:teuthology.orchestra.run.smithi083.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-09-21T00:14:15.804 INFO:teuthology.orchestra.run.smithi083.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-09-21T00:14:15.805 INFO:teuthology.orchestra.run.smithi083.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-09-21T00:14:15.805 INFO:teuthology.orchestra.run.smithi083.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-09-21T00:14:15.805 INFO:teuthology.orchestra.run.smithi083.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-09-21T00:14:15.805 INFO:teuthology.orchestra.run.smithi083.stdout: libradosstriper1 x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 519 k 2023-09-21T00:14:15.805 INFO:teuthology.orchestra.run.smithi083.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-09-21T00:14:15.806 INFO:teuthology.orchestra.run.smithi083.stdout: librgw2 x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 6.9 M 2023-09-21T00:14:15.806 INFO:teuthology.orchestra.run.smithi083.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-09-21T00:14:15.806 INFO:teuthology.orchestra.run.smithi083.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-09-21T00:14:15.806 INFO:teuthology.orchestra.run.smithi083.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-09-21T00:14:15.807 INFO:teuthology.orchestra.run.smithi083.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-09-21T00:14:15.807 INFO:teuthology.orchestra.run.smithi083.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-09-21T00:14:15.807 INFO:teuthology.orchestra.run.smithi083.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-09-21T00:14:15.807 INFO:teuthology.orchestra.run.smithi083.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-09-21T00:14:15.807 INFO:teuthology.orchestra.run.smithi083.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-09-21T00:14:15.808 INFO:teuthology.orchestra.run.smithi083.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-09-21T00:14:15.808 INFO:teuthology.orchestra.run.smithi083.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-09-21T00:14:15.808 INFO:teuthology.orchestra.run.smithi083.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-09-21T00:14:15.808 INFO:teuthology.orchestra.run.smithi083.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-09-21T00:14:15.809 INFO:teuthology.orchestra.run.smithi083.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-09-21T00:14:15.809 INFO:teuthology.orchestra.run.smithi083.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-09-21T00:14:15.809 INFO:teuthology.orchestra.run.smithi083.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-09-21T00:14:15.809 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-09-21T00:14:15.809 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-argparse x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 45 k 2023-09-21T00:14:15.810 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-common x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 125 k 2023-09-21T00:14:15.810 INFO:teuthology.orchestra.run.smithi083.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-09-21T00:14:15.810 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-09-21T00:14:15.810 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-09-21T00:14:15.810 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-09-21T00:14:15.811 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-09-21T00:14:15.811 INFO:teuthology.orchestra.run.smithi083.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-09-21T00:14:15.811 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-09-21T00:14:15.811 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-09-21T00:14:15.811 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-09-21T00:14:15.812 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-09-21T00:14:15.812 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-09-21T00:14:15.812 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-09-21T00:14:15.812 INFO:teuthology.orchestra.run.smithi083.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-09-21T00:14:15.812 INFO:teuthology.orchestra.run.smithi083.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-09-21T00:14:15.812 INFO:teuthology.orchestra.run.smithi083.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-09-21T00:14:15.813 INFO:teuthology.orchestra.run.smithi083.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-09-21T00:14:15.813 INFO:teuthology.orchestra.run.smithi083.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-09-21T00:14:15.813 INFO:teuthology.orchestra.run.smithi083.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-09-21T00:14:15.813 INFO:teuthology.orchestra.run.smithi083.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-09-21T00:14:15.813 INFO:teuthology.orchestra.run.smithi083.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-09-21T00:14:15.813 INFO:teuthology.orchestra.run.smithi083.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-09-21T00:14:15.814 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-09-21T00:14:15.814 INFO:teuthology.orchestra.run.smithi083.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-09-21T00:14:15.814 INFO:teuthology.orchestra.run.smithi083.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-09-21T00:14:15.814 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-09-21T00:14:15.815 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-09-21T00:14:15.815 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-09-21T00:14:15.815 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-09-21T00:14:15.816 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-09-21T00:14:15.816 INFO:teuthology.orchestra.run.smithi083.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-09-21T00:14:15.817 INFO:teuthology.orchestra.run.smithi083.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-09-21T00:14:15.817 INFO:teuthology.orchestra.run.smithi083.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-09-21T00:14:15.817 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-09-21T00:14:15.818 INFO:teuthology.orchestra.run.smithi083.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-09-21T00:14:15.818 INFO:teuthology.orchestra.run.smithi083.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-09-21T00:14:15.819 INFO:teuthology.orchestra.run.smithi083.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-09-21T00:14:15.819 INFO:teuthology.orchestra.run.smithi083.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-09-21T00:14:15.819 INFO:teuthology.orchestra.run.smithi083.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-09-21T00:14:15.820 INFO:teuthology.orchestra.run.smithi083.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-09-21T00:14:15.820 INFO:teuthology.orchestra.run.smithi083.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-09-21T00:14:15.821 INFO:teuthology.orchestra.run.smithi083.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-09-21T00:14:15.821 INFO:teuthology.orchestra.run.smithi083.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-09-21T00:14:15.821 INFO:teuthology.orchestra.run.smithi083.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-09-21T00:14:15.822 INFO:teuthology.orchestra.run.smithi083.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-09-21T00:14:15.822 INFO:teuthology.orchestra.run.smithi083.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-09-21T00:14:15.822 INFO:teuthology.orchestra.run.smithi083.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-09-21T00:14:15.823 INFO:teuthology.orchestra.run.smithi083.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-09-21T00:14:15.823 INFO:teuthology.orchestra.run.smithi083.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-09-21T00:14:15.824 INFO:teuthology.orchestra.run.smithi083.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-09-21T00:14:15.824 INFO:teuthology.orchestra.run.smithi083.stdout:Enabling module streams: 2023-09-21T00:14:15.824 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql 10 2023-09-21T00:14:15.825 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-09-21T00:14:15.825 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction Summary 2023-09-21T00:14:15.826 INFO:teuthology.orchestra.run.smithi083.stdout:=========================================================================================================================== 2023-09-21T00:14:15.826 INFO:teuthology.orchestra.run.smithi083.stdout:Install 128 Packages 2023-09-21T00:14:15.826 INFO:teuthology.orchestra.run.smithi083.stdout:Upgrade 3 Packages 2023-09-21T00:14:15.827 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-09-21T00:14:15.828 INFO:teuthology.orchestra.run.smithi083.stdout:Total download size: 208 M 2023-09-21T00:14:15.828 INFO:teuthology.orchestra.run.smithi083.stdout:Downloading Packages: 2023-09-21T00:14:16.157 INFO:teuthology.orchestra.run.smithi083.stdout:(1/131): ceph-18.0.0-6213.gbf8a061f.el8.x86_64. 34 kB/s | 6.4 kB 00:00 2023-09-21T00:14:16.352 INFO:teuthology.orchestra.run.smithi059.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-21T00:14:16.353 INFO:teuthology.orchestra.run.smithi059.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-21T00:14:16.368 INFO:teuthology.orchestra.run.smithi059.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-09-21T00:14:16.369 INFO:teuthology.orchestra.run.smithi059.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-09-21T00:14:16.370 INFO:teuthology.orchestra.run.smithi059.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-09-21T00:14:16.372 INFO:teuthology.orchestra.run.smithi059.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-09-21T00:14:16.374 INFO:teuthology.orchestra.run.smithi059.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-09-21T00:14:16.377 INFO:teuthology.orchestra.run.smithi059.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-09-21T00:14:16.378 INFO:teuthology.orchestra.run.smithi059.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-09-21T00:14:16.449 INFO:teuthology.orchestra.run.smithi083.stdout:(2/131): ceph-fuse-18.0.0-6213.gbf8a061f.el8.x8 3.0 MB/s | 907 kB 00:00 2023-09-21T00:14:16.527 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2023-09-21T00:14:16.540 INFO:teuthology.orchestra.run.smithi059.stdout:=========================================================================================================================== 2023-09-21T00:14:16.541 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2023-09-21T00:14:16.541 INFO:teuthology.orchestra.run.smithi059.stdout:=========================================================================================================================== 2023-09-21T00:14:16.541 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2023-09-21T00:14:16.541 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-09-21T00:14:16.541 INFO:teuthology.orchestra.run.smithi059.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-09-21T00:14:16.542 INFO:teuthology.orchestra.run.smithi059.stdout: ceph x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 6.4 k 2023-09-21T00:14:16.542 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-base x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 5.4 M 2023-09-21T00:14:16.542 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-fuse x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 907 k 2023-09-21T00:14:16.542 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 167 k 2023-09-21T00:14:16.543 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 1.6 M 2023-09-21T00:14:16.543 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6213.gbf8a061f.el8 ceph-noarch 132 k 2023-09-21T00:14:16.543 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6213.gbf8a061f.el8 ceph-noarch 1.7 M 2023-09-21T00:14:16.543 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6213.gbf8a061f.el8 ceph-noarch 7.4 M 2023-09-21T00:14:16.543 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-rook noarch 2:18.0.0-6213.gbf8a061f.el8 ceph-noarch 47 k 2023-09-21T00:14:16.544 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-radosgw x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 14 M 2023-09-21T00:14:16.544 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-test x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 49 M 2023-09-21T00:14:16.544 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-volume noarch 2:18.0.0-6213.gbf8a061f.el8 ceph-noarch 261 k 2023-09-21T00:14:16.544 INFO:teuthology.orchestra.run.smithi059.stdout: cephadm noarch 2:18.0.0-6213.gbf8a061f.el8 ceph-noarch 179 k 2023-09-21T00:14:16.544 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-mirror x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 261 k 2023-09-21T00:14:16.545 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-top noarch 2:18.0.0-6213.gbf8a061f.el8 ceph-noarch 18 k 2023-09-21T00:14:16.545 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-09-21T00:14:16.545 INFO:teuthology.orchestra.run.smithi059.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-09-21T00:14:16.545 INFO:teuthology.orchestra.run.smithi059.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-09-21T00:14:16.545 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs-devel x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 31 k 2023-09-21T00:14:16.546 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs2 x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 827 k 2023-09-21T00:14:16.546 INFO:teuthology.orchestra.run.smithi059.stdout: librados-devel x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 139 k 2023-09-21T00:14:16.546 INFO:teuthology.orchestra.run.smithi059.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-09-21T00:14:16.546 INFO:teuthology.orchestra.run.smithi059.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-09-21T00:14:16.546 INFO:teuthology.orchestra.run.smithi059.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-09-21T00:14:16.547 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-09-21T00:14:16.547 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-09-21T00:14:16.547 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-09-21T00:14:16.547 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cephfs x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 197 k 2023-09-21T00:14:16.547 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rados x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 371 k 2023-09-21T00:14:16.548 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rbd x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 364 k 2023-09-21T00:14:16.548 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rgw x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 106 k 2023-09-21T00:14:16.548 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-fuse x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 94 k 2023-09-21T00:14:16.548 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-mirror x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 3.6 M 2023-09-21T00:14:16.548 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-nbd x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 179 k 2023-09-21T00:14:16.549 INFO:teuthology.orchestra.run.smithi059.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-09-21T00:14:16.549 INFO:teuthology.orchestra.run.smithi059.stdout:Upgrading: 2023-09-21T00:14:16.549 INFO:teuthology.orchestra.run.smithi059.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-09-21T00:14:16.549 INFO:teuthology.orchestra.run.smithi059.stdout: librados2 x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 3.7 M 2023-09-21T00:14:16.549 INFO:teuthology.orchestra.run.smithi059.stdout: librbd1 x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 3.7 M 2023-09-21T00:14:16.550 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2023-09-21T00:14:16.550 INFO:teuthology.orchestra.run.smithi059.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-09-21T00:14:16.550 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-common x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 23 M 2023-09-21T00:14:16.550 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6213.gbf8a061f.el8 ceph-noarch 23 k 2023-09-21T00:14:16.550 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mds x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 2.3 M 2023-09-21T00:14:16.551 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6213.gbf8a061f.el8 ceph-noarch 242 k 2023-09-21T00:14:16.551 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mon x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 4.6 M 2023-09-21T00:14:16.551 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-osd x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 18 M 2023-09-21T00:14:16.551 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6213.gbf8a061f.el8 ceph-noarch 15 k 2023-09-21T00:14:16.551 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-selinux x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 24 k 2023-09-21T00:14:16.552 INFO:teuthology.orchestra.run.smithi059.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-09-21T00:14:16.552 INFO:teuthology.orchestra.run.smithi059.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-09-21T00:14:16.552 INFO:teuthology.orchestra.run.smithi059.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-09-21T00:14:16.552 INFO:teuthology.orchestra.run.smithi059.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-09-21T00:14:16.552 INFO:teuthology.orchestra.run.smithi059.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-09-21T00:14:16.553 INFO:teuthology.orchestra.run.smithi059.stdout: libcephsqlite x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 184 k 2023-09-21T00:14:16.553 INFO:teuthology.orchestra.run.smithi059.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-09-21T00:14:16.553 INFO:teuthology.orchestra.run.smithi059.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-09-21T00:14:16.553 INFO:teuthology.orchestra.run.smithi059.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-09-21T00:14:16.553 INFO:teuthology.orchestra.run.smithi059.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-09-21T00:14:16.553 INFO:teuthology.orchestra.run.smithi059.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-09-21T00:14:16.554 INFO:teuthology.orchestra.run.smithi059.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-09-21T00:14:16.554 INFO:teuthology.orchestra.run.smithi059.stdout: libradosstriper1 x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 519 k 2023-09-21T00:14:16.554 INFO:teuthology.orchestra.run.smithi059.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-09-21T00:14:16.554 INFO:teuthology.orchestra.run.smithi059.stdout: librgw2 x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 6.9 M 2023-09-21T00:14:16.555 INFO:teuthology.orchestra.run.smithi059.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-09-21T00:14:16.555 INFO:teuthology.orchestra.run.smithi059.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-09-21T00:14:16.555 INFO:teuthology.orchestra.run.smithi059.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-09-21T00:14:16.555 INFO:teuthology.orchestra.run.smithi059.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-09-21T00:14:16.555 INFO:teuthology.orchestra.run.smithi059.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-09-21T00:14:16.556 INFO:teuthology.orchestra.run.smithi059.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-09-21T00:14:16.556 INFO:teuthology.orchestra.run.smithi059.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-09-21T00:14:16.556 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-09-21T00:14:16.556 INFO:teuthology.orchestra.run.smithi059.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-09-21T00:14:16.556 INFO:teuthology.orchestra.run.smithi059.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-09-21T00:14:16.557 INFO:teuthology.orchestra.run.smithi059.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-09-21T00:14:16.557 INFO:teuthology.orchestra.run.smithi059.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-09-21T00:14:16.557 INFO:teuthology.orchestra.run.smithi059.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-09-21T00:14:16.557 INFO:teuthology.orchestra.run.smithi059.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-09-21T00:14:16.557 INFO:teuthology.orchestra.run.smithi059.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-09-21T00:14:16.557 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-09-21T00:14:16.558 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-argparse x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 45 k 2023-09-21T00:14:16.558 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-common x86_64 2:18.0.0-6213.gbf8a061f.el8 ceph 125 k 2023-09-21T00:14:16.558 INFO:teuthology.orchestra.run.smithi059.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-09-21T00:14:16.558 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-09-21T00:14:16.558 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-09-21T00:14:16.559 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-09-21T00:14:16.559 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-09-21T00:14:16.559 INFO:teuthology.orchestra.run.smithi059.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-09-21T00:14:16.559 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-09-21T00:14:16.559 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-09-21T00:14:16.560 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-09-21T00:14:16.560 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-09-21T00:14:16.560 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-09-21T00:14:16.560 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-09-21T00:14:16.560 INFO:teuthology.orchestra.run.smithi059.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-09-21T00:14:16.560 INFO:teuthology.orchestra.run.smithi059.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-09-21T00:14:16.561 INFO:teuthology.orchestra.run.smithi059.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-09-21T00:14:16.561 INFO:teuthology.orchestra.run.smithi059.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-09-21T00:14:16.561 INFO:teuthology.orchestra.run.smithi059.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-09-21T00:14:16.561 INFO:teuthology.orchestra.run.smithi059.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-09-21T00:14:16.561 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-09-21T00:14:16.562 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-09-21T00:14:16.562 INFO:teuthology.orchestra.run.smithi059.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-09-21T00:14:16.562 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-09-21T00:14:16.562 INFO:teuthology.orchestra.run.smithi059.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-09-21T00:14:16.562 INFO:teuthology.orchestra.run.smithi059.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-09-21T00:14:16.563 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-09-21T00:14:16.563 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-09-21T00:14:16.563 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-09-21T00:14:16.563 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-09-21T00:14:16.563 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-09-21T00:14:16.564 INFO:teuthology.orchestra.run.smithi059.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-09-21T00:14:16.564 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-09-21T00:14:16.564 INFO:teuthology.orchestra.run.smithi059.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-09-21T00:14:16.564 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-09-21T00:14:16.564 INFO:teuthology.orchestra.run.smithi059.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-09-21T00:14:16.565 INFO:teuthology.orchestra.run.smithi059.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-09-21T00:14:16.565 INFO:teuthology.orchestra.run.smithi059.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-09-21T00:14:16.565 INFO:teuthology.orchestra.run.smithi059.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-09-21T00:14:16.565 INFO:teuthology.orchestra.run.smithi059.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-09-21T00:14:16.565 INFO:teuthology.orchestra.run.smithi059.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-09-21T00:14:16.566 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-09-21T00:14:16.566 INFO:teuthology.orchestra.run.smithi059.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-09-21T00:14:16.566 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-09-21T00:14:16.566 INFO:teuthology.orchestra.run.smithi059.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-09-21T00:14:16.567 INFO:teuthology.orchestra.run.smithi059.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-09-21T00:14:16.567 INFO:teuthology.orchestra.run.smithi059.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-09-21T00:14:16.567 INFO:teuthology.orchestra.run.smithi059.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-09-21T00:14:16.567 INFO:teuthology.orchestra.run.smithi059.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-09-21T00:14:16.567 INFO:teuthology.orchestra.run.smithi059.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-09-21T00:14:16.568 INFO:teuthology.orchestra.run.smithi059.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-09-21T00:14:16.568 INFO:teuthology.orchestra.run.smithi059.stdout:Enabling module streams: 2023-09-21T00:14:16.568 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql 10 2023-09-21T00:14:16.568 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:14:16.568 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2023-09-21T00:14:16.568 INFO:teuthology.orchestra.run.smithi059.stdout:=========================================================================================================================== 2023-09-21T00:14:16.569 INFO:teuthology.orchestra.run.smithi059.stdout:Install 128 Packages 2023-09-21T00:14:16.569 INFO:teuthology.orchestra.run.smithi059.stdout:Upgrade 3 Packages 2023-09-21T00:14:16.569 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:14:16.570 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 208 M 2023-09-21T00:14:16.570 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2023-09-21T00:14:16.582 INFO:teuthology.orchestra.run.smithi083.stdout:(3/131): ceph-base-18.0.0-6213.gbf8a061f.el8.x8 8.8 MB/s | 5.4 MB 00:00 2023-09-21T00:14:16.633 INFO:teuthology.orchestra.run.smithi083.stdout:(4/131): ceph-immutable-object-cache-18.0.0-621 912 kB/s | 167 kB 00:00 2023-09-21T00:14:16.818 INFO:teuthology.orchestra.run.smithi083.stdout:(5/131): ceph-mds-18.0.0-6213.gbf8a061f.el8.x86 10 MB/s | 2.3 MB 00:00 2023-09-21T00:14:17.008 INFO:teuthology.orchestra.run.smithi083.stdout:(6/131): ceph-mgr-18.0.0-6213.gbf8a061f.el8.x86 4.3 MB/s | 1.6 MB 00:00 2023-09-21T00:14:17.128 INFO:teuthology.orchestra.run.smithi059.stdout:(1/131): ceph-18.0.0-6213.gbf8a061f.el8.x86_64. 25 kB/s | 6.4 kB 00:00 2023-09-21T00:14:17.183 INFO:teuthology.orchestra.run.smithi083.stdout:(7/131): ceph-mon-18.0.0-6213.gbf8a061f.el8.x86 13 MB/s | 4.6 MB 00:00 2023-09-21T00:14:17.919 INFO:teuthology.orchestra.run.smithi059.stdout:(2/131): ceph-fuse-18.0.0-6213.gbf8a061f.el8.x8 1.1 MB/s | 907 kB 00:00 2023-09-21T00:14:18.120 INFO:teuthology.orchestra.run.smithi059.stdout:(3/131): ceph-immutable-object-cache-18.0.0-621 838 kB/s | 167 kB 00:00 2023-09-21T00:14:18.653 INFO:teuthology.orchestra.run.smithi059.stdout:(4/131): ceph-base-18.0.0-6213.gbf8a061f.el8.x8 3.0 MB/s | 5.4 MB 00:01 2023-09-21T00:14:18.995 INFO:teuthology.orchestra.run.smithi059.stdout:(5/131): ceph-mgr-18.0.0-6213.gbf8a061f.el8.x86 4.7 MB/s | 1.6 MB 00:00 2023-09-21T00:14:19.017 INFO:teuthology.orchestra.run.smithi083.stdout:(8/131): ceph-radosgw-18.0.0-6213.gbf8a061f.el8 7.6 MB/s | 14 MB 00:01 2023-09-21T00:14:19.076 INFO:teuthology.orchestra.run.smithi083.stdout:(9/131): ceph-selinux-18.0.0-6213.gbf8a061f.el8 418 kB/s | 24 kB 00:00 2023-09-21T00:14:19.078 INFO:teuthology.orchestra.run.smithi059.stdout:(6/131): ceph-mds-18.0.0-6213.gbf8a061f.el8.x86 2.4 MB/s | 2.3 MB 00:00 2023-09-21T00:14:19.679 INFO:teuthology.orchestra.run.smithi059.stdout:(7/131): ceph-mon-18.0.0-6213.gbf8a061f.el8.x86 6.8 MB/s | 4.6 MB 00:00 2023-09-21T00:14:20.126 INFO:teuthology.orchestra.run.smithi083.stdout:(10/131): ceph-common-18.0.0-6213.gbf8a061f.el8 5.4 MB/s | 23 MB 00:04 2023-09-21T00:14:20.453 INFO:teuthology.orchestra.run.smithi083.stdout:(11/131): cephfs-mirror-18.0.0-6213.gbf8a061f.e 799 kB/s | 261 kB 00:00 2023-09-21T00:14:20.635 INFO:teuthology.orchestra.run.smithi083.stdout:(12/131): ceph-osd-18.0.0-6213.gbf8a061f.el8.x8 4.9 MB/s | 18 MB 00:03 2023-09-21T00:14:20.652 INFO:teuthology.orchestra.run.smithi083.stdout:(13/131): libcephfs-devel-18.0.0-6213.gbf8a061f 156 kB/s | 31 kB 00:00 2023-09-21T00:14:20.752 INFO:teuthology.orchestra.run.smithi083.stdout:(14/131): libcephsqlite-18.0.0-6213.gbf8a061f.e 1.8 MB/s | 184 kB 00:00 2023-09-21T00:14:20.852 INFO:teuthology.orchestra.run.smithi083.stdout:(15/131): librados-devel-18.0.0-6213.gbf8a061f. 1.4 MB/s | 139 kB 00:00 2023-09-21T00:14:20.886 INFO:teuthology.orchestra.run.smithi083.stdout:(16/131): libcephfs2-18.0.0-6213.gbf8a061f.el8. 3.2 MB/s | 827 kB 00:00 2023-09-21T00:14:21.036 INFO:teuthology.orchestra.run.smithi083.stdout:(17/131): libradosstriper1-18.0.0-6213.gbf8a061 2.8 MB/s | 519 kB 00:00 2023-09-21T00:14:21.071 INFO:teuthology.orchestra.run.smithi059.stdout:(8/131): ceph-radosgw-18.0.0-6213.gbf8a061f.el8 10 MB/s | 14 MB 00:01 2023-09-21T00:14:21.095 INFO:teuthology.orchestra.run.smithi083.stdout:(18/131): python3-ceph-argparse-18.0.0-6213.gbf 766 kB/s | 45 kB 00:00 2023-09-21T00:14:21.146 INFO:teuthology.orchestra.run.smithi059.stdout:(9/131): ceph-selinux-18.0.0-6213.gbf8a061f.el8 326 kB/s | 24 kB 00:00 2023-09-21T00:14:21.178 INFO:teuthology.orchestra.run.smithi083.stdout:(19/131): python3-ceph-common-18.0.0-6213.gbf8a 1.5 MB/s | 125 kB 00:00 2023-09-21T00:14:21.279 INFO:teuthology.orchestra.run.smithi083.stdout:(20/131): python3-cephfs-18.0.0-6213.gbf8a061f. 1.9 MB/s | 197 kB 00:00 2023-09-21T00:14:21.471 INFO:teuthology.orchestra.run.smithi083.stdout:(21/131): python3-rados-18.0.0-6213.gbf8a061f.e 1.9 MB/s | 371 kB 00:00 2023-09-21T00:14:21.663 INFO:teuthology.orchestra.run.smithi083.stdout:(22/131): python3-rbd-18.0.0-6213.gbf8a061f.el8 1.9 MB/s | 364 kB 00:00 2023-09-21T00:14:21.763 INFO:teuthology.orchestra.run.smithi083.stdout:(23/131): python3-rgw-18.0.0-6213.gbf8a061f.el8 1.0 MB/s | 106 kB 00:00 2023-09-21T00:14:21.863 INFO:teuthology.orchestra.run.smithi083.stdout:(24/131): rbd-fuse-18.0.0-6213.gbf8a061f.el8.x8 937 kB/s | 94 kB 00:00 2023-09-21T00:14:22.071 INFO:teuthology.orchestra.run.smithi059.stdout:(10/131): ceph-common-18.0.0-6213.gbf8a061f.el8 4.3 MB/s | 23 MB 00:05 2023-09-21T00:14:22.271 INFO:teuthology.orchestra.run.smithi059.stdout:(11/131): cephfs-mirror-18.0.0-6213.gbf8a061f.e 1.3 MB/s | 261 kB 00:00 2023-09-21T00:14:22.372 INFO:teuthology.orchestra.run.smithi059.stdout:(12/131): libcephfs-devel-18.0.0-6213.gbf8a061f 309 kB/s | 31 kB 00:00 2023-09-21T00:14:22.522 INFO:teuthology.orchestra.run.smithi083.stdout:(25/131): librgw2-18.0.0-6213.gbf8a061f.el8.x86 4.2 MB/s | 6.9 MB 00:01 2023-09-21T00:14:22.597 INFO:teuthology.orchestra.run.smithi083.stdout:(26/131): rbd-nbd-18.0.0-6213.gbf8a061f.el8.x86 2.3 MB/s | 179 kB 00:00 2023-09-21T00:14:22.665 INFO:teuthology.orchestra.run.smithi083.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6213.g 346 kB/s | 23 kB 00:00 2023-09-21T00:14:22.689 INFO:teuthology.orchestra.run.smithi059.stdout:(13/131): ceph-osd-18.0.0-6213.gbf8a061f.el8.x8 5.0 MB/s | 18 MB 00:03 2023-09-21T00:14:22.722 INFO:teuthology.orchestra.run.smithi059.stdout:(14/131): libcephfs2-18.0.0-6213.gbf8a061f.el8. 2.3 MB/s | 827 kB 00:00 2023-09-21T00:14:22.754 INFO:teuthology.orchestra.run.smithi083.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6213.gbf8a061 1.5 MB/s | 132 kB 00:00 2023-09-21T00:14:22.781 INFO:teuthology.orchestra.run.smithi059.stdout:(15/131): libcephsqlite-18.0.0-6213.gbf8a061f.e 2.0 MB/s | 184 kB 00:00 2023-09-21T00:14:22.806 INFO:teuthology.orchestra.run.smithi059.stdout:(16/131): librados-devel-18.0.0-6213.gbf8a061f. 1.6 MB/s | 139 kB 00:00 2023-09-21T00:14:22.957 INFO:teuthology.orchestra.run.smithi059.stdout:(17/131): libradosstriper1-18.0.0-6213.gbf8a061 2.9 MB/s | 519 kB 00:00 2023-09-21T00:14:22.965 INFO:teuthology.orchestra.run.smithi083.stdout:(29/131): rbd-mirror-18.0.0-6213.gbf8a061f.el8. 3.3 MB/s | 3.6 MB 00:01 2023-09-21T00:14:23.040 INFO:teuthology.orchestra.run.smithi059.stdout:(18/131): python3-ceph-argparse-18.0.0-6213.gbf 538 kB/s | 45 kB 00:00 2023-09-21T00:14:23.149 INFO:teuthology.orchestra.run.smithi059.stdout:(19/131): python3-ceph-common-18.0.0-6213.gbf8a 1.1 MB/s | 125 kB 00:00 2023-09-21T00:14:23.224 INFO:teuthology.orchestra.run.smithi083.stdout:(30/131): ceph-mgr-dashboard-18.0.0-6213.gbf8a0 3.7 MB/s | 1.7 MB 00:00 2023-09-21T00:14:23.274 INFO:teuthology.orchestra.run.smithi059.stdout:(20/131): python3-cephfs-18.0.0-6213.gbf8a061f. 1.5 MB/s | 197 kB 00:00 2023-09-21T00:14:23.383 INFO:teuthology.orchestra.run.smithi083.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6213.gbf 1.5 MB/s | 242 kB 00:00 2023-09-21T00:14:23.391 INFO:teuthology.orchestra.run.smithi059.stdout:(21/131): python3-rados-18.0.0-6213.gbf8a061f.e 3.1 MB/s | 371 kB 00:00 2023-09-21T00:14:23.466 INFO:teuthology.orchestra.run.smithi083.stdout:(32/131): ceph-mgr-rook-18.0.0-6213.gbf8a061f.e 569 kB/s | 47 kB 00:00 2023-09-21T00:14:23.492 INFO:teuthology.orchestra.run.smithi059.stdout:(22/131): python3-rbd-18.0.0-6213.gbf8a061f.el8 3.6 MB/s | 364 kB 00:00 2023-09-21T00:14:23.558 INFO:teuthology.orchestra.run.smithi083.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6213.gb 159 kB/s | 15 kB 00:00 2023-09-21T00:14:23.584 INFO:teuthology.orchestra.run.smithi059.stdout:(23/131): python3-rgw-18.0.0-6213.gbf8a061f.el8 1.1 MB/s | 106 kB 00:00 2023-09-21T00:14:23.659 INFO:teuthology.orchestra.run.smithi083.stdout:(34/131): ceph-volume-18.0.0-6213.gbf8a061f.el8 2.5 MB/s | 261 kB 00:00 2023-09-21T00:14:23.692 INFO:teuthology.orchestra.run.smithi059.stdout:(24/131): rbd-fuse-18.0.0-6213.gbf8a061f.el8.x8 866 kB/s | 94 kB 00:00 2023-09-21T00:14:23.759 INFO:teuthology.orchestra.run.smithi083.stdout:(35/131): cephadm-18.0.0-6213.gbf8a061f.el8.noa 1.8 MB/s | 179 kB 00:00 2023-09-21T00:14:23.859 INFO:teuthology.orchestra.run.smithi083.stdout:(36/131): cephfs-top-18.0.0-6213.gbf8a061f.el8. 181 kB/s | 18 kB 00:00 2023-09-21T00:14:24.326 INFO:teuthology.orchestra.run.smithi059.stdout:(25/131): librgw2-18.0.0-6213.gbf8a061f.el8.x86 4.5 MB/s | 6.9 MB 00:01 2023-09-21T00:14:24.410 INFO:teuthology.orchestra.run.smithi059.stdout:(26/131): rbd-mirror-18.0.0-6213.gbf8a061f.el8. 5.0 MB/s | 3.6 MB 00:00 2023-09-21T00:14:24.435 INFO:teuthology.orchestra.run.smithi059.stdout:(27/131): rbd-nbd-18.0.0-6213.gbf8a061f.el8.x86 1.6 MB/s | 179 kB 00:00 2023-09-21T00:14:24.493 INFO:teuthology.orchestra.run.smithi059.stdout:(28/131): ceph-grafana-dashboards-18.0.0-6213.g 276 kB/s | 23 kB 00:00 2023-09-21T00:14:24.527 INFO:teuthology.orchestra.run.smithi059.stdout:(29/131): ceph-mgr-cephadm-18.0.0-6213.gbf8a061 1.4 MB/s | 132 kB 00:00 2023-09-21T00:14:24.861 INFO:teuthology.orchestra.run.smithi059.stdout:(30/131): ceph-mgr-dashboard-18.0.0-6213.gbf8a0 4.8 MB/s | 1.7 MB 00:00 2023-09-21T00:14:24.961 INFO:teuthology.orchestra.run.smithi059.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6213.gbf 2.4 MB/s | 242 kB 00:00 2023-09-21T00:14:25.185 INFO:teuthology.orchestra.run.smithi083.stdout:(37/131): ceph-mgr-diskprediction-local-18.0.0- 3.3 MB/s | 7.4 MB 00:02 2023-09-21T00:14:25.360 INFO:teuthology.orchestra.run.smithi083.stdout:(38/131): gperftools-libs-2.7-9.el8.x86_64.rpm 204 kB/s | 306 kB 00:01 2023-09-21T00:14:25.453 INFO:teuthology.orchestra.run.smithi059.stdout:(32/131): ceph-test-18.0.0-6213.gbf8a061f.el8.x 11 MB/s | 49 MB 00:04 2023-09-21T00:14:25.478 INFO:teuthology.orchestra.run.smithi059.stdout:(33/131): ceph-mgr-rook-18.0.0-6213.gbf8a061f.e 92 kB/s | 47 kB 00:00 2023-09-21T00:14:25.512 INFO:teuthology.orchestra.run.smithi059.stdout:(34/131): ceph-prometheus-alerts-18.0.0-6213.gb 250 kB/s | 15 kB 00:00 2023-09-21T00:14:25.571 INFO:teuthology.orchestra.run.smithi059.stdout:(35/131): cephadm-18.0.0-6213.gbf8a061f.el8.noa 3.0 MB/s | 179 kB 00:00 2023-09-21T00:14:25.596 INFO:teuthology.orchestra.run.smithi059.stdout:(36/131): ceph-volume-18.0.0-6213.gbf8a061f.el8 2.2 MB/s | 261 kB 00:00 2023-09-21T00:14:25.610 INFO:teuthology.orchestra.run.smithi083.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 300 kB/s | 75 kB 00:00 2023-09-21T00:14:25.638 INFO:teuthology.orchestra.run.smithi059.stdout:(37/131): cephfs-top-18.0.0-6213.gbf8a061f.el8. 271 kB/s | 18 kB 00:00 2023-09-21T00:14:25.838 INFO:teuthology.orchestra.run.smithi059.stdout:(38/131): ceph-mgr-diskprediction-local-18.0.0- 5.7 MB/s | 7.4 MB 00:01 2023-09-21T00:14:25.863 INFO:teuthology.orchestra.run.smithi059.stdout:(39/131): liboath-2.6.2-3.el8.x86_64.rpm 261 kB/s | 59 kB 00:00 2023-09-21T00:14:25.972 INFO:teuthology.orchestra.run.smithi059.stdout:(40/131): gperftools-libs-2.7-9.el8.x86_64.rpm 815 kB/s | 306 kB 00:00 2023-09-21T00:14:25.997 INFO:teuthology.orchestra.run.smithi059.stdout:(41/131): libunwind-1.3.1-3.el8.x86_64.rpm 473 kB/s | 75 kB 00:00 2023-09-21T00:14:26.060 INFO:teuthology.orchestra.run.smithi083.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 1.0 MB/s | 476 kB 00:00 2023-09-21T00:14:26.114 INFO:teuthology.orchestra.run.smithi059.stdout:(42/131): python3-asyncssh-2.7.0-2.el8.noarch.r 1.9 MB/s | 476 kB 00:00 2023-09-21T00:14:26.148 INFO:teuthology.orchestra.run.smithi059.stdout:(43/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 249 kB/s | 44 kB 00:00 2023-09-21T00:14:26.198 INFO:teuthology.orchestra.run.smithi059.stdout:(44/131): python3-beautifulsoup4-4.6.3-2.el8.1. 924 kB/s | 185 kB 00:00 2023-09-21T00:14:26.215 INFO:teuthology.orchestra.run.smithi059.stdout:(45/131): python3-cachetools-3.1.1-4.el8.noarch 328 kB/s | 33 kB 00:00 2023-09-21T00:14:26.219 INFO:teuthology.orchestra.run.smithi083.stdout:(41/131): liboath-2.6.2-3.el8.x86_64.rpm 57 kB/s | 59 kB 00:01 2023-09-21T00:14:26.278 INFO:teuthology.orchestra.run.smithi083.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 201 kB/s | 44 kB 00:00 2023-09-21T00:14:26.319 INFO:teuthology.orchestra.run.smithi059.stdout:(46/131): python3-certifi-2018.10.15-7.el8.noar 95 kB/s | 16 kB 00:00 2023-09-21T00:14:26.449 INFO:teuthology.orchestra.run.smithi059.stdout:(47/131): python3-cherrypy-18.4.0-1.el8.noarch. 1.6 MB/s | 384 kB 00:00 2023-09-21T00:14:26.474 INFO:teuthology.orchestra.run.smithi059.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 523 kB/s | 81 kB 00:00 2023-09-21T00:14:26.491 INFO:teuthology.orchestra.run.smithi059.stdout:(49/131): python3-cheroot-8.5.2-1.el8.noarch.rp 589 kB/s | 173 kB 00:00 2023-09-21T00:14:26.503 INFO:teuthology.orchestra.run.smithi083.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 147 kB/s | 33 kB 00:00 2023-09-21T00:14:26.542 INFO:teuthology.orchestra.run.smithi059.stdout:(50/131): python3-jaraco-6.2-6.el8.noarch.rpm 120 kB/s | 11 kB 00:00 2023-09-21T00:14:26.567 INFO:teuthology.orchestra.run.smithi059.stdout:(51/131): python3-jaraco-functools-2.0-4.el8.no 191 kB/s | 18 kB 00:00 2023-09-21T00:14:26.709 INFO:teuthology.orchestra.run.smithi059.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 292 kB/s | 49 kB 00:00 2023-09-21T00:14:26.720 INFO:teuthology.orchestra.run.smithi083.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 75 kB/s | 16 kB 00:00 2023-09-21T00:14:26.726 INFO:teuthology.orchestra.run.smithi059.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 370 kB/s | 59 kB 00:00 2023-09-21T00:14:26.812 INFO:teuthology.orchestra.run.smithi083.stdout:(45/131): python3-beautifulsoup4-4.6.3-2.el8.1. 313 kB/s | 185 kB 00:00 2023-09-21T00:14:26.826 INFO:teuthology.orchestra.run.smithi059.stdout:(54/131): python3-kubernetes-11.0.0-6.el8.noarc 3.5 MB/s | 1.2 MB 00:00 2023-09-21T00:14:26.876 INFO:teuthology.orchestra.run.smithi059.stdout:(55/131): python3-natsort-7.1.1-2.el8.noarch.rp 361 kB/s | 60 kB 00:00 2023-09-21T00:14:26.968 INFO:teuthology.orchestra.run.smithi059.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 110 kB/s | 16 kB 00:00 2023-09-21T00:14:26.978 INFO:teuthology.orchestra.run.smithi083.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 668 kB/s | 173 kB 00:00 2023-09-21T00:14:27.044 INFO:teuthology.orchestra.run.smithi059.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 201 kB/s | 34 kB 00:00 2023-09-21T00:14:27.166 INFO:teuthology.orchestra.run.smithi059.stdout:(58/131): python3-pecan-1.3.2-9.el8.noarch.rpm 643 kB/s | 283 kB 00:00 2023-09-21T00:14:27.212 INFO:teuthology.orchestra.run.smithi083.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 348 kB/s | 81 kB 00:00 2023-09-21T00:14:27.333 INFO:teuthology.orchestra.run.smithi059.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 539 kB/s | 196 kB 00:00 2023-09-21T00:14:27.361 INFO:teuthology.orchestra.run.smithi059.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 96 kB/s | 19 kB 00:00 2023-09-21T00:14:27.370 INFO:teuthology.orchestra.run.smithi083.stdout:(48/131): python3-cherrypy-18.4.0-1.el8.noarch. 689 kB/s | 384 kB 00:00 2023-09-21T00:14:27.386 INFO:teuthology.orchestra.run.smithi059.stdout:(61/131): python3-rsa-4.9-2.el8.noarch.rpm 187 kB/s | 64 kB 00:00 2023-09-21T00:14:27.437 INFO:teuthology.orchestra.run.smithi059.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 231 kB/s | 24 kB 00:00 2023-09-21T00:14:27.504 INFO:teuthology.orchestra.run.smithi059.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 206 kB/s | 29 kB 00:00 2023-09-21T00:14:27.529 INFO:teuthology.orchestra.run.smithi059.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 194 kB/s | 27 kB 00:00 2023-09-21T00:14:27.655 INFO:teuthology.orchestra.run.smithi059.stdout:(65/131): python3-websocket-client-0.56.0-5.el8 490 kB/s | 61 kB 00:00 2023-09-21T00:14:27.771 INFO:teuthology.orchestra.run.smithi059.stdout:(66/131): python3-waitress-1.4.3-1.el8.noarch.r 764 kB/s | 255 kB 00:00 2023-09-21T00:14:27.821 INFO:teuthology.orchestra.run.smithi059.stdout:(67/131): python3-webob-1.8.5-1.el8.1.noarch.rp 793 kB/s | 251 kB 00:00 2023-09-21T00:14:27.872 INFO:teuthology.orchestra.run.smithi083.stdout:(49/131): ceph-test-18.0.0-6213.gbf8a061f.el8.x 5.6 MB/s | 49 MB 00:08 2023-09-21T00:14:27.872 INFO:teuthology.orchestra.run.smithi059.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 393 kB/s | 85 kB 00:00 2023-09-21T00:14:27.897 INFO:teuthology.orchestra.run.smithi059.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-09-21T00:14:27.905 INFO:teuthology.orchestra.run.smithi083.stdout:(50/131): python3-jaraco-6.2-6.el8.noarch.rpm 16 kB/s | 11 kB 00:00 2023-09-21T00:14:27.922 INFO:teuthology.orchestra.run.smithi059.stdout:(70/131): python3-zc-lockfile-2.0-2.el8.noarch. 152 kB/s | 23 kB 00:00 2023-09-21T00:14:27.930 INFO:teuthology.orchestra.run.smithi083.stdout:(51/131): python3-jaraco-functools-2.0-4.el8.no 31 kB/s | 18 kB 00:00 2023-09-21T00:14:27.998 INFO:teuthology.orchestra.run.smithi059.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.4 MB/s | 110 kB 00:00 2023-09-21T00:14:28.040 INFO:teuthology.orchestra.run.smithi059.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-09-21T00:14:28.081 INFO:teuthology.orchestra.run.smithi059.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-09-21T00:14:28.123 INFO:teuthology.orchestra.run.smithi059.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2023-09-21T00:14:28.147 INFO:teuthology.orchestra.run.smithi083.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 201 kB/s | 49 kB 00:00 2023-09-21T00:14:28.165 INFO:teuthology.orchestra.run.smithi059.stdout:(75/131): python3-markupsafe-0.23-19.el8.x86_64 939 kB/s | 39 kB 00:00 2023-09-21T00:14:28.216 INFO:teuthology.orchestra.run.smithi059.stdout:(76/131): bison-3.0.4-10.el8.x86_64.rpm 13 MB/s | 688 kB 00:00 2023-09-21T00:14:28.275 INFO:teuthology.orchestra.run.smithi059.stdout:(77/131): python3-jinja2-2.10.1-3.el8.noarch.rp 9.0 MB/s | 538 kB 00:00 2023-09-21T00:14:28.323 INFO:teuthology.orchestra.run.smithi083.stdout:(53/131): python3-kubernetes-11.0.0-6.el8.noarc 2.6 MB/s | 1.2 MB 00:00 2023-09-21T00:14:28.333 INFO:teuthology.orchestra.run.smithi059.stdout:(78/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-09-21T00:14:28.384 INFO:teuthology.orchestra.run.smithi059.stdout:(79/131): thrift-0.13.0-2.el8.x86_64.rpm 3.1 MB/s | 1.7 MB 00:00 2023-09-21T00:14:28.409 INFO:teuthology.orchestra.run.smithi059.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 2.4 MB/s | 187 kB 00:00 2023-09-21T00:14:28.576 INFO:teuthology.orchestra.run.smithi059.stdout:(81/131): python3-scipy-1.0.0-21.module+el8.5.0 20 MB/s | 14 MB 00:00 2023-09-21T00:14:28.590 INFO:teuthology.orchestra.run.smithi083.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 138 kB/s | 60 kB 00:00 2023-09-21T00:14:28.601 INFO:teuthology.orchestra.run.smithi059.stdout:(82/131): automake-1.16.1-7.el8.noarch.rpm 3.2 MB/s | 713 kB 00:00 2023-09-21T00:14:28.615 INFO:teuthology.orchestra.run.smithi083.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 968 kB/s | 283 kB 00:00 2023-09-21T00:14:28.626 INFO:teuthology.orchestra.run.smithi059.stdout:(83/131): python3-jsonpatch-1.21-2.el8.noarch.r 530 kB/s | 27 kB 00:00 2023-09-21T00:14:28.660 INFO:teuthology.orchestra.run.smithi059.stdout:(84/131): flex-2.6.1-9.el8.x86_64.rpm 5.3 MB/s | 320 kB 00:00 2023-09-21T00:14:28.685 INFO:teuthology.orchestra.run.smithi059.stdout:(85/131): python3-prettytable-0.7.2-14.el8.noar 751 kB/s | 44 kB 00:00 2023-09-21T00:14:28.735 INFO:teuthology.orchestra.run.smithi059.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 8.9 MB/s | 457 kB 00:00 2023-09-21T00:14:28.810 INFO:teuthology.orchestra.run.smithi059.stdout:(87/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 3.0 MB/s | 225 kB 00:00 2023-09-21T00:14:28.815 INFO:teuthology.orchestra.run.smithi083.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 69 kB/s | 16 kB 00:00 2023-09-21T00:14:28.840 INFO:teuthology.orchestra.run.smithi083.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 149 kB/s | 34 kB 00:00 2023-09-21T00:14:28.852 INFO:teuthology.orchestra.run.smithi059.stdout:(88/131): uuid-1.6.2-43.el8.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2023-09-21T00:14:28.919 INFO:teuthology.orchestra.run.smithi059.stdout:(89/131): python3-babel-2.5.1-7.el8.noarch.rpm 9.5 MB/s | 4.8 MB 00:00 2023-09-21T00:14:28.978 INFO:teuthology.orchestra.run.smithi059.stdout:(90/131): python3-numpy-1.14.3-10.el8.x86_64.rp 12 MB/s | 3.7 MB 00:00 2023-09-21T00:14:28.995 INFO:teuthology.orchestra.run.smithi059.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 266 kB/s | 20 kB 00:00 2023-09-21T00:14:28.999 INFO:teuthology.orchestra.run.smithi083.stdout:(58/131): python3-more-itertools-7.2.0-3.el8.no 55 kB/s | 59 kB 00:01 2023-09-21T00:14:29.020 INFO:teuthology.orchestra.run.smithi059.stdout:(92/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 755 kB/s | 126 kB 00:00 2023-09-21T00:14:29.037 INFO:teuthology.orchestra.run.smithi059.stdout:(93/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.7 MB/s | 103 kB 00:00 2023-09-21T00:14:29.058 INFO:teuthology.orchestra.run.smithi083.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 296 kB/s | 64 kB 00:00 2023-09-21T00:14:29.088 INFO:teuthology.orchestra.run.smithi059.stdout:(94/131): libtool-2.4.6-25.el8.x86_64.rpm 7.5 MB/s | 709 kB 00:00 2023-09-21T00:14:29.091 INFO:teuthology.orchestra.run.smithi083.stdout:(60/131): python3-routes-2.4.1-12.el8.noarch.rp 712 kB/s | 196 kB 00:00 2023-09-21T00:14:29.113 INFO:teuthology.orchestra.run.smithi059.stdout:(95/131): libpq-13.5-1.el8.x86_64.rpm 2.6 MB/s | 198 kB 00:00 2023-09-21T00:14:29.155 INFO:teuthology.orchestra.run.smithi059.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.7 MB/s | 202 kB 00:00 2023-09-21T00:14:29.196 INFO:teuthology.orchestra.run.smithi059.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.4 MB/s | 354 kB 00:00 2023-09-21T00:14:29.267 INFO:teuthology.orchestra.run.smithi083.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 70 kB/s | 19 kB 00:00 2023-09-21T00:14:29.292 INFO:teuthology.orchestra.run.smithi083.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 102 kB/s | 24 kB 00:00 2023-09-21T00:14:29.313 INFO:teuthology.orchestra.run.smithi059.stdout:(98/131): openblas-threads-0.3.15-3.el8.x86_64. 17 MB/s | 4.9 MB 00:00 2023-09-21T00:14:29.317 INFO:teuthology.orchestra.run.smithi083.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 130 kB/s | 29 kB 00:00 2023-09-21T00:14:29.389 INFO:teuthology.orchestra.run.smithi059.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 16 MB/s | 4.7 MB 00:00 2023-09-21T00:14:29.431 INFO:teuthology.orchestra.run.smithi059.stdout:(100/131): postgresql-contrib-10.21-2.module+el 6.7 MB/s | 808 kB 00:00 2023-09-21T00:14:29.464 INFO:teuthology.orchestra.run.smithi059.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2023-09-21T00:14:29.506 INFO:teuthology.orchestra.run.smithi059.stdout:(102/131): postgresql-10.21-2.module+el8.6.0+15 13 MB/s | 1.5 MB 00:00 2023-09-21T00:14:29.532 INFO:teuthology.orchestra.run.smithi059.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 2.9 MB/s | 200 kB 00:00 2023-09-21T00:14:29.534 INFO:teuthology.orchestra.run.smithi083.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 1.0 MB/s | 255 kB 00:00 2023-09-21T00:14:29.557 INFO:teuthology.orchestra.run.smithi059.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 848 kB/s | 43 kB 00:00 2023-09-21T00:14:29.560 INFO:teuthology.orchestra.run.smithi083.stdout:(65/131): python3-trustme-0.6.0-4.el8.noarch.rp 94 kB/s | 27 kB 00:00 2023-09-21T00:14:29.574 INFO:teuthology.orchestra.run.smithi059.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 5.1 MB/s | 220 kB 00:00 2023-09-21T00:14:29.599 INFO:teuthology.orchestra.run.smithi059.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 1.1 MB/s | 48 kB 00:00 2023-09-21T00:14:29.610 INFO:teuthology.orchestra.run.smithi083.stdout:(66/131): python3-webob-1.8.5-1.el8.1.noarch.rp 859 kB/s | 251 kB 00:00 2023-09-21T00:14:29.624 INFO:teuthology.orchestra.run.smithi059.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-09-21T00:14:29.650 INFO:teuthology.orchestra.run.smithi059.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 846 kB/s | 43 kB 00:00 2023-09-21T00:14:29.675 INFO:teuthology.orchestra.run.smithi059.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.1 MB/s | 109 kB 00:00 2023-09-21T00:14:29.701 INFO:teuthology.orchestra.run.smithi059.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.4 MB/s | 229 kB 00:00 2023-09-21T00:14:29.760 INFO:teuthology.orchestra.run.smithi083.stdout:(67/131): python3-websocket-client-0.56.0-5.el8 271 kB/s | 61 kB 00:00 2023-09-21T00:14:29.767 INFO:teuthology.orchestra.run.smithi059.stdout:(111/131): postgresql-server-10.21-2.module+el8 8.9 MB/s | 5.1 MB 00:00 2023-09-21T00:14:29.818 INFO:teuthology.orchestra.run.smithi059.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 160 kB/s | 19 kB 00:00 2023-09-21T00:14:29.836 INFO:teuthology.orchestra.run.smithi083.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 102 kB/s | 23 kB 00:00 2023-09-21T00:14:29.843 INFO:teuthology.orchestra.run.smithi059.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 2.0 MB/s | 155 kB 00:00 2023-09-21T00:14:29.861 INFO:teuthology.orchestra.run.smithi083.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-09-21T00:14:29.877 INFO:teuthology.orchestra.run.smithi059.stdout:(114/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 2.7 MB/s | 560 kB 00:00 2023-09-21T00:14:29.902 INFO:teuthology.orchestra.run.smithi059.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 305 kB/s | 18 kB 00:00 2023-09-21T00:14:29.911 INFO:teuthology.orchestra.run.smithi083.stdout:(70/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 939 kB/s | 47 kB 00:00 2023-09-21T00:14:29.936 INFO:teuthology.orchestra.run.smithi059.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 4.6 MB/s | 559 kB 00:00 2023-09-21T00:14:29.945 INFO:teuthology.orchestra.run.smithi083.stdout:(71/131): python3-webtest-2.0.33-1.el8.noarch.r 222 kB/s | 85 kB 00:00 2023-09-21T00:14:29.961 INFO:teuthology.orchestra.run.smithi059.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.0 MB/s | 238 kB 00:00 2023-09-21T00:14:29.970 INFO:teuthology.orchestra.run.smithi083.stdout:(72/131): libselinux-devel-2.9-5.el8.x86_64.rpm 3.3 MB/s | 200 kB 00:00 2023-09-21T00:14:29.986 INFO:teuthology.orchestra.run.smithi059.stdout:(118/131): pcre2-devel-10.32-2.el8.x86_64.rpm 5.4 MB/s | 605 kB 00:00 2023-09-21T00:14:30.011 INFO:teuthology.orchestra.run.smithi059.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.4 MB/s | 72 kB 00:00 2023-09-21T00:14:30.012 INFO:teuthology.orchestra.run.smithi083.stdout:(73/131): python3-jwt-1.6.1-2.el8.noarch.rpm 638 kB/s | 43 kB 00:00 2023-09-21T00:14:30.028 INFO:teuthology.orchestra.run.smithi059.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.9 MB/s | 83 kB 00:00 2023-09-21T00:14:30.037 INFO:teuthology.orchestra.run.smithi083.stdout:(74/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 3.5 MB/s | 220 kB 00:00 2023-09-21T00:14:30.053 INFO:teuthology.orchestra.run.smithi059.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.4 MB/s | 60 kB 00:00 2023-09-21T00:14:30.062 INFO:teuthology.orchestra.run.smithi083.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 962 kB/s | 48 kB 00:00 2023-09-21T00:14:30.079 INFO:teuthology.orchestra.run.smithi059.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-09-21T00:14:30.079 INFO:teuthology.orchestra.run.smithi083.stdout:(76/131): libsepol-devel-2.9-3.el8.x86_64.rpm 2.0 MB/s | 87 kB 00:00 2023-09-21T00:14:30.096 INFO:teuthology.orchestra.run.smithi083.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 1.2 MB/s | 43 kB 00:00 2023-09-21T00:14:30.104 INFO:teuthology.orchestra.run.smithi059.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-09-21T00:14:30.122 INFO:teuthology.orchestra.run.smithi083.stdout:(78/131): python3-pycparser-2.14-14.el8.noarch. 2.5 MB/s | 109 kB 00:00 2023-09-21T00:14:30.129 INFO:teuthology.orchestra.run.smithi059.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 765 kB/s | 39 kB 00:00 2023-09-21T00:14:30.147 INFO:teuthology.orchestra.run.smithi083.stdout:(79/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2023-09-21T00:14:30.163 INFO:teuthology.orchestra.run.smithi059.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 11 MB/s | 644 kB 00:00 2023-09-21T00:14:30.188 INFO:teuthology.orchestra.run.smithi059.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.9 MB/s | 171 kB 00:00 2023-09-21T00:14:30.189 INFO:teuthology.orchestra.run.smithi083.stdout:(80/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 8.2 MB/s | 560 kB 00:00 2023-09-21T00:14:30.206 INFO:teuthology.orchestra.run.smithi083.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 320 kB/s | 19 kB 00:00 2023-09-21T00:14:30.213 INFO:teuthology.orchestra.run.smithi059.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.7 MB/s | 138 kB 00:00 2023-09-21T00:14:30.231 INFO:teuthology.orchestra.run.smithi083.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 3.6 MB/s | 155 kB 00:00 2023-09-21T00:14:30.264 INFO:teuthology.orchestra.run.smithi059.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 7.1 MB/s | 2.3 MB 00:00 2023-09-21T00:14:30.282 INFO:teuthology.orchestra.run.smithi083.stdout:(83/131): thrift-0.13.0-2.el8.x86_64.rpm 3.3 MB/s | 1.7 MB 00:00 2023-09-21T00:14:30.307 INFO:teuthology.orchestra.run.smithi083.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 238 kB/s | 18 kB 00:00 2023-09-21T00:14:30.322 INFO:teuthology.orchestra.run.smithi059.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-09-21T00:14:30.341 INFO:teuthology.orchestra.run.smithi083.stdout:(85/131): python3-cryptography-3.2.1-5.el8.x86_ 4.1 MB/s | 559 kB 00:00 2023-09-21T00:14:30.366 INFO:teuthology.orchestra.run.smithi083.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.4 MB/s | 238 kB 00:00 2023-09-21T00:14:30.399 INFO:teuthology.orchestra.run.smithi083.stdout:(87/131): pcre2-devel-10.32-2.el8.x86_64.rpm 5.0 MB/s | 605 kB 00:00 2023-09-21T00:14:30.441 INFO:teuthology.orchestra.run.smithi083.stdout:(88/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 961 kB/s | 72 kB 00:00 2023-09-21T00:14:30.467 INFO:teuthology.orchestra.run.smithi083.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 1.2 MB/s | 83 kB 00:00 2023-09-21T00:14:30.492 INFO:teuthology.orchestra.run.smithi083.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 1.2 MB/s | 60 kB 00:00 2023-09-21T00:14:30.517 INFO:teuthology.orchestra.run.smithi083.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.9 MB/s | 98 kB 00:00 2023-09-21T00:14:30.543 INFO:teuthology.orchestra.run.smithi083.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-09-21T00:14:30.568 INFO:teuthology.orchestra.run.smithi083.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 768 kB/s | 39 kB 00:00 2023-09-21T00:14:30.610 INFO:teuthology.orchestra.run.smithi083.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 9.4 MB/s | 644 kB 00:00 2023-09-21T00:14:30.635 INFO:teuthology.orchestra.run.smithi083.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.5 MB/s | 171 kB 00:00 2023-09-21T00:14:30.660 INFO:teuthology.orchestra.run.smithi083.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.7 MB/s | 138 kB 00:00 2023-09-21T00:14:30.698 INFO:teuthology.orchestra.run.smithi059.stdout:(130/131): librbd1-18.0.0-6213.gbf8a061f.el8.x8 7.7 MB/s | 3.7 MB 00:00 2023-09-21T00:14:30.719 INFO:teuthology.orchestra.run.smithi083.stdout:(97/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 6.1 MB/s | 2.3 MB 00:00 2023-09-21T00:14:30.745 INFO:teuthology.orchestra.run.smithi083.stdout:(98/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.3 MB/s | 110 kB 00:00 2023-09-21T00:14:30.756 INFO:teuthology.orchestra.run.smithi059.stdout:(131/131): librados2-18.0.0-6213.gbf8a061f.el8. 6.5 MB/s | 3.7 MB 00:00 2023-09-21T00:14:30.759 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2023-09-21T00:14:30.759 INFO:teuthology.orchestra.run.smithi059.stdout:Total 15 MB/s | 208 MB 00:14 2023-09-21T00:14:30.770 INFO:teuthology.orchestra.run.smithi083.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.1 MB/s | 54 kB 00:00 2023-09-21T00:14:30.795 INFO:teuthology.orchestra.run.smithi083.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 5.1 MB/s | 259 kB 00:00 2023-09-21T00:14:30.829 INFO:teuthology.orchestra.run.smithi083.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-09-21T00:14:30.854 INFO:teuthology.orchestra.run.smithi083.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 661 kB/s | 39 kB 00:00 2023-09-21T00:14:30.896 INFO:teuthology.orchestra.run.smithi083.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 10 MB/s | 688 kB 00:00 2023-09-21T00:14:30.930 INFO:teuthology.orchestra.run.smithi083.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 7.0 MB/s | 538 kB 00:00 2023-09-21T00:14:30.955 INFO:teuthology.orchestra.run.smithi083.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-09-21T00:14:30.972 INFO:teuthology.orchestra.run.smithi083.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2023-09-21T00:14:31.006 INFO:teuthology.orchestra.run.smithi083.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 14 MB/s | 713 kB 00:00 2023-09-21T00:14:31.039 INFO:teuthology.orchestra.run.smithi083.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 799 kB/s | 27 kB 00:00 2023-09-21T00:14:31.081 INFO:teuthology.orchestra.run.smithi083.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-09-21T00:14:31.106 INFO:teuthology.orchestra.run.smithi083.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.7 MB/s | 44 kB 00:00 2023-09-21T00:14:31.223 INFO:teuthology.orchestra.run.smithi083.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 19 MB/s | 4.8 MB 00:00 2023-09-21T00:14:31.265 INFO:teuthology.orchestra.run.smithi083.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 11 MB/s | 457 kB 00:00 2023-09-21T00:14:31.307 INFO:teuthology.orchestra.run.smithi083.stdout:(113/131): python3-numpy-f2py-1.14.3-10.el8.x86 5.3 MB/s | 225 kB 00:00 2023-09-21T00:14:31.366 INFO:teuthology.orchestra.run.smithi083.stdout:(114/131): python3-numpy-1.14.3-10.el8.x86_64.r 14 MB/s | 3.7 MB 00:00 2023-09-21T00:14:31.383 INFO:teuthology.orchestra.run.smithi083.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 851 kB/s | 64 kB 00:00 2023-09-21T00:14:31.408 INFO:teuthology.orchestra.run.smithi083.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 3.0 MB/s | 126 kB 00:00 2023-09-21T00:14:31.425 INFO:teuthology.orchestra.run.smithi083.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 478 kB/s | 20 kB 00:00 2023-09-21T00:14:31.451 INFO:teuthology.orchestra.run.smithi083.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.4 MB/s | 103 kB 00:00 2023-09-21T00:14:31.492 INFO:teuthology.orchestra.run.smithi083.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 10 MB/s | 709 kB 00:00 2023-09-21T00:14:31.534 INFO:teuthology.orchestra.run.smithi083.stdout:(120/131): libpq-13.5-1.el8.x86_64.rpm 4.6 MB/s | 198 kB 00:00 2023-09-21T00:14:31.627 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2023-09-21T00:14:31.668 INFO:teuthology.orchestra.run.smithi083.stdout:(121/131): python3-scipy-1.0.0-21.module+el8.5. 13 MB/s | 14 MB 00:01 2023-09-21T00:14:31.710 INFO:teuthology.orchestra.run.smithi083.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-09-21T00:14:31.752 INFO:teuthology.orchestra.run.smithi083.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-09-21T00:14:31.761 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2023-09-21T00:14:31.761 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2023-09-21T00:14:31.828 INFO:teuthology.orchestra.run.smithi083.stdout:(124/131): openblas-threads-0.3.15-3.el8.x86_64 13 MB/s | 4.9 MB 00:00 2023-09-21T00:14:31.911 INFO:teuthology.orchestra.run.smithi083.stdout:(125/131): openblas-0.3.15-3.el8.x86_64.rpm 13 MB/s | 4.7 MB 00:00 2023-09-21T00:14:31.944 INFO:teuthology.orchestra.run.smithi083.stdout:(126/131): postgresql-contrib-10.21-2.module+el 6.8 MB/s | 808 kB 00:00 2023-09-21T00:14:32.003 INFO:teuthology.orchestra.run.smithi083.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 16 MB/s | 1.5 MB 00:00 2023-09-21T00:14:32.079 INFO:teuthology.orchestra.run.smithi083.stdout:(128/131): postgresql-server-10.21-2.module+el8 16 MB/s | 5.1 MB 00:00 2023-09-21T00:14:32.129 INFO:teuthology.orchestra.run.smithi083.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-09-21T00:14:33.163 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2023-09-21T00:14:33.168 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2023-09-21T00:14:34.512 INFO:teuthology.orchestra.run.smithi083.stdout:(130/131): librbd1-18.0.0-6213.gbf8a061f.el8.x8 1.5 MB/s | 3.7 MB 00:02 2023-09-21T00:14:36.246 INFO:teuthology.orchestra.run.smithi083.stdout:(131/131): librados2-18.0.0-6213.gbf8a061f.el8. 884 kB/s | 3.7 MB 00:04 2023-09-21T00:14:36.250 INFO:teuthology.orchestra.run.smithi083.stdout:-------------------------------------------------------------------------------- 2023-09-21T00:14:36.250 INFO:teuthology.orchestra.run.smithi083.stdout:Total 10 MB/s | 208 MB 00:20 2023-09-21T00:14:37.071 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction check 2023-09-21T00:14:37.191 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction check succeeded. 2023-09-21T00:14:37.192 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction test 2023-09-21T00:14:38.305 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction test succeeded. 2023-09-21T00:14:38.309 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction 2023-09-21T00:14:38.329 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2023-09-21T00:14:38.616 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-09-21T00:14:38.810 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-09-21T00:14:39.019 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-09-21T00:14:39.217 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-09-21T00:14:39.347 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-09-21T00:14:39.534 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-09-21T00:14:39.964 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-09-21T00:14:40.217 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : librados2-2:18.0.0-6213.gbf8a061f.el8.x86_64 6/134 2023-09-21T00:14:40.669 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librados2-2:18.0.0-6213.gbf8a061f.el8.x86_64 6/134 2023-09-21T00:14:40.884 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : librbd1-2:18.0.0-6213.gbf8a061f.el8.x86_64 7/134 2023-09-21T00:14:41.007 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librbd1-2:18.0.0-6213.gbf8a061f.el8.x86_64 7/134 2023-09-21T00:14:41.225 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephfs2-2:18.0.0-6213.gbf8a061f.el8.x86_64 8/134 2023-09-21T00:14:41.322 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libcephfs2-2:18.0.0-6213.gbf8a061f.el8.x86_64 8/134 2023-09-21T00:14:41.552 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rados-2:18.0.0-6213.gbf8a061f.el8.x86_64 9/134 2023-09-21T00:14:41.825 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-09-21T00:14:42.004 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-09-21T00:14:42.436 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-09-21T00:14:42.717 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-09-21T00:14:42.900 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephsqlite-2:18.0.0-6213.gbf8a061f.el8.x86_64 14/134 2023-09-21T00:14:43.000 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6213.gbf8a061f.el8.x86_64 14/134 2023-09-21T00:14:43.208 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libradosstriper1-2:18.0.0-6213.gbf8a061f.el8.x86 15/134 2023-09-21T00:14:43.261 INFO:teuthology.orchestra.run.smithi083.stdout: Preparing : 1/1 2023-09-21T00:14:43.301 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6213.gbf8a061f.el8.x86 15/134 2023-09-21T00:14:43.425 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-09-21T00:14:43.441 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-09-21T00:14:43.625 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-09-21T00:14:43.794 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-09-21T00:14:43.796 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-09-21T00:14:43.924 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-09-21T00:14:43.925 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-09-21T00:14:44.127 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-09-21T00:14:44.534 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-09-21T00:14:44.580 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-09-21T00:14:44.775 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-09-21T00:14:45.102 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : librados2-2:18.0.0-6213.gbf8a061f.el8.x86_64 5/134 2023-09-21T00:14:45.411 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-09-21T00:14:45.511 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librados2-2:18.0.0-6213.gbf8a061f.el8.x86_64 5/134 2023-09-21T00:14:45.591 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-09-21T00:14:45.718 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : librbd1-2:18.0.0-6213.gbf8a061f.el8.x86_64 6/134 2023-09-21T00:14:45.873 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librbd1-2:18.0.0-6213.gbf8a061f.el8.x86_64 6/134 2023-09-21T00:14:46.077 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libcephfs2-2:18.0.0-6213.gbf8a061f.el8.x86_64 7/134 2023-09-21T00:14:46.176 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libcephfs2-2:18.0.0-6213.gbf8a061f.el8.x86_64 7/134 2023-09-21T00:14:46.348 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-rados-2:18.0.0-6213.gbf8a061f.el8.x86_64 8/134 2023-09-21T00:14:46.377 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-09-21T00:14:46.527 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-09-21T00:14:46.629 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-09-21T00:14:46.801 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-09-21T00:14:46.882 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-09-21T00:14:47.004 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-09-21T00:14:47.079 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-09-21T00:14:47.273 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-09-21T00:14:47.394 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-09-21T00:14:47.485 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-09-21T00:14:47.667 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-09-21T00:14:47.739 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-09-21T00:14:47.851 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libcephsqlite-2:18.0.0-6213.gbf8a061f.el8.x86_64 14/134 2023-09-21T00:14:47.915 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-ceph-common-2:18.0.0-6213.gbf8a061f.el8. 26/134 2023-09-21T00:14:47.962 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6213.gbf8a061f.el8.x86_64 14/134 2023-09-21T00:14:48.054 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-ceph-argparse-2:18.0.0-6213.gbf8a061f.el 27/134 2023-09-21T00:14:48.152 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libradosstriper1-2:18.0.0-6213.gbf8a061f.el8.x86 15/134 2023-09-21T00:14:48.284 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6213.gbf8a061f.el8.x86 15/134 2023-09-21T00:14:48.471 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-09-21T00:14:48.640 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-09-21T00:14:48.801 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-09-21T00:14:48.968 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-09-21T00:14:49.054 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cephfs-2:18.0.0-6213.gbf8a061f.el8.x86_6 28/134 2023-09-21T00:14:49.100 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-09-21T00:14:49.227 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-09-21T00:14:49.702 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-09-21T00:14:49.840 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-09-21T00:14:49.956 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-09-21T00:14:50.010 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-09-21T00:14:50.214 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-09-21T00:14:50.417 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-09-21T00:14:50.608 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-09-21T00:14:50.793 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-09-21T00:14:51.507 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-09-21T00:14:51.766 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-09-21T00:14:51.965 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-09-21T00:14:52.169 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-09-21T00:14:52.303 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-09-21T00:14:52.349 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-ceph-common-2:18.0.0-6213.gbf8a061f.el8. 26/134 2023-09-21T00:14:52.488 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-ceph-argparse-2:18.0.0-6213.gbf8a061f.el 27/134 2023-09-21T00:14:52.627 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-09-21T00:14:52.738 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cephfs-2:18.0.0-6213.gbf8a061f.el8.x86_6 28/134 2023-09-21T00:14:52.848 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-09-21T00:14:52.951 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-09-21T00:14:53.045 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-09-21T00:14:53.223 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rbd-2:18.0.0-6213.gbf8a061f.el8.x86_64 36/134 2023-09-21T00:14:53.370 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librados-devel-2:18.0.0-6213.gbf8a061f.el8.x86_6 37/134 2023-09-21T00:14:53.556 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-09-21T00:14:53.710 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-09-21T00:14:53.885 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-09-21T00:14:54.062 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-09-21T00:14:54.259 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-09-21T00:14:54.484 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-09-21T00:14:54.714 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-09-21T00:14:54.887 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-09-21T00:14:55.161 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-09-21T00:14:55.385 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-09-21T00:14:55.668 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-09-21T00:14:55.709 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-09-21T00:14:55.897 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-09-21T00:14:56.047 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-09-21T00:14:56.233 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-09-21T00:14:56.301 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-09-21T00:14:56.523 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-09-21T00:14:56.632 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-09-21T00:14:56.761 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-09-21T00:14:56.832 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-09-21T00:14:56.943 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-09-21T00:14:57.091 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-09-21T00:14:57.122 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-rbd-2:18.0.0-6213.gbf8a061f.el8.x86_64 36/134 2023-09-21T00:14:57.272 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-09-21T00:14:57.273 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : librados-devel-2:18.0.0-6213.gbf8a061f.el8.x86_6 37/134 2023-09-21T00:14:57.429 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-09-21T00:14:57.432 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-09-21T00:14:57.576 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-09-21T00:14:57.750 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-09-21T00:14:57.802 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-09-21T00:14:57.803 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-09-21T00:14:58.014 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-09-21T00:14:58.112 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-09-21T00:14:58.253 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-09-21T00:14:58.348 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-09-21T00:14:58.409 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-09-21T00:14:58.490 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-09-21T00:14:58.687 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-09-21T00:14:58.697 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-09-21T00:14:58.872 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-09-21T00:14:58.887 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-09-21T00:14:59.059 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-09-21T00:14:59.062 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-09-21T00:14:59.231 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-09-21T00:14:59.235 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-09-21T00:14:59.292 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-09-21T00:14:59.411 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-09-21T00:14:59.550 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-09-21T00:14:59.570 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-09-21T00:14:59.753 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-09-21T00:14:59.791 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-09-21T00:14:59.890 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-09-21T00:14:59.972 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-09-21T00:14:59.978 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-09-21T00:15:00.199 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-09-21T00:15:00.314 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-09-21T00:15:00.358 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-09-21T00:15:00.558 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-09-21T00:15:00.618 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-09-21T00:15:00.740 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-09-21T00:15:00.836 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-09-21T00:15:01.002 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-09-21T00:15:01.079 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-09-21T00:15:01.231 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-09-21T00:15:01.321 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-09-21T00:15:01.403 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-09-21T00:15:01.586 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-09-21T00:15:01.633 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-09-21T00:15:01.786 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-09-21T00:15:01.857 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-09-21T00:15:02.004 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-09-21T00:15:02.080 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-09-21T00:15:02.187 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-09-21T00:15:02.271 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-09-21T00:15:02.343 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-09-21T00:15:02.456 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-09-21T00:15:02.529 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-09-21T00:15:02.628 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-09-21T00:15:02.741 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-09-21T00:15:02.944 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-09-21T00:15:02.961 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-09-21T00:15:03.154 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-09-21T00:15:03.222 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-09-21T00:15:03.402 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-09-21T00:15:03.454 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-09-21T00:15:03.673 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-09-21T00:15:03.692 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-09-21T00:15:03.840 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-09-21T00:15:03.849 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-09-21T00:15:04.018 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-09-21T00:15:04.093 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-09-21T00:15:04.308 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-09-21T00:15:04.523 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-09-21T00:15:04.686 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-09-21T00:15:04.842 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-09-21T00:15:05.065 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-09-21T00:15:05.201 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-09-21T00:15:05.268 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-09-21T00:15:05.445 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-09-21T00:15:05.459 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-09-21T00:15:05.610 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-09-21T00:15:05.699 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-09-21T00:15:05.780 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-09-21T00:15:05.987 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-09-21T00:15:06.025 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-09-21T00:15:06.203 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-09-21T00:15:06.297 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-09-21T00:15:06.388 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-09-21T00:15:06.493 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-09-21T00:15:06.678 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-09-21T00:15:06.915 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-09-21T00:15:07.090 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-09-21T00:15:07.290 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-09-21T00:15:07.354 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-09-21T00:15:07.547 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librgw2-2:18.0.0-6213.gbf8a061f.el8.x86_64 92/134 2023-09-21T00:15:07.623 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librgw2-2:18.0.0-6213.gbf8a061f.el8.x86_64 92/134 2023-09-21T00:15:07.789 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rgw-2:18.0.0-6213.gbf8a061f.el8.x86_64 93/134 2023-09-21T00:15:08.390 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-09-21T00:15:08.643 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-09-21T00:15:08.906 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-09-21T00:15:09.199 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-09-21T00:15:09.476 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-09-21T00:15:09.700 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-09-21T00:15:10.528 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-09-21T00:15:10.698 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : librgw2-2:18.0.0-6213.gbf8a061f.el8.x86_64 92/134 2023-09-21T00:15:10.774 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librgw2-2:18.0.0-6213.gbf8a061f.el8.x86_64 92/134 2023-09-21T00:15:10.974 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-rgw-2:18.0.0-6213.gbf8a061f.el8.x86_64 93/134 2023-09-21T00:15:11.763 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-common-2:18.0.0-6213.gbf8a061f.el8.x86_64 94/134 2023-09-21T00:15:12.014 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-common-2:18.0.0-6213.gbf8a061f.el8.x86_64 94/134 2023-09-21T00:15:12.659 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-common-2:18.0.0-6213.gbf8a061f.el8.x86_64 94/134 2023-09-21T00:15:12.944 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-base-2:18.0.0-6213.gbf8a061f.el8.x86_64 95/134 2023-09-21T00:15:13.026 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-base-2:18.0.0-6213.gbf8a061f.el8.x86_64 95/134 2023-09-21T00:15:13.181 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-selinux-2:18.0.0-6213.gbf8a061f.el8.x86_64 96/134 2023-09-21T00:15:14.712 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-common-2:18.0.0-6213.gbf8a061f.el8.x86_64 94/134 2023-09-21T00:15:14.948 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-common-2:18.0.0-6213.gbf8a061f.el8.x86_64 94/134 2023-09-21T00:15:15.557 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-common-2:18.0.0-6213.gbf8a061f.el8.x86_64 94/134 2023-09-21T00:15:15.845 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-base-2:18.0.0-6213.gbf8a061f.el8.x86_64 95/134 2023-09-21T00:15:15.909 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-base-2:18.0.0-6213.gbf8a061f.el8.x86_64 95/134 2023-09-21T00:15:16.557 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-selinux-2:18.0.0-6213.gbf8a061f.el8.x86_64 96/134 2023-09-21T00:15:32.614 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6213.gbf8a061f.el8.x86_64 96/134 2023-09-21T00:15:32.615 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /sys 2023-09-21T00:15:32.615 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /proc 2023-09-21T00:15:32.615 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /dev 2023-09-21T00:15:32.616 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /run 2023-09-21T00:15:32.616 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /mnt 2023-09-21T00:15:32.616 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /var/tmp 2023-09-21T00:15:32.616 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /home 2023-09-21T00:15:32.617 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /tmp 2023-09-21T00:15:32.617 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /dev 2023-09-21T00:15:32.618 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:15:32.969 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-volume-2:18.0.0-6213.gbf8a061f.el8.noarch 97/134 2023-09-21T00:15:34.668 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-volume-2:18.0.0-6213.gbf8a061f.el8.noarch 97/134 2023-09-21T00:15:34.825 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-osd-2:18.0.0-6213.gbf8a061f.el8.x86_64 98/134 2023-09-21T00:15:35.059 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-osd-2:18.0.0-6213.gbf8a061f.el8.x86_64 98/134 2023-09-21T00:15:35.211 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mds-2:18.0.0-6213.gbf8a061f.el8.x86_64 99/134 2023-09-21T00:15:35.292 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6213.gbf8a061f.el8.x86_64 96/134 2023-09-21T00:15:35.293 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /sys 2023-09-21T00:15:35.293 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /proc 2023-09-21T00:15:35.293 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /dev 2023-09-21T00:15:35.293 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /run 2023-09-21T00:15:35.294 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /mnt 2023-09-21T00:15:35.294 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /var/tmp 2023-09-21T00:15:35.294 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /home 2023-09-21T00:15:35.294 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /tmp 2023-09-21T00:15:35.294 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /dev 2023-09-21T00:15:35.295 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-09-21T00:15:35.628 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-volume-2:18.0.0-6213.gbf8a061f.el8.noarch 97/134 2023-09-21T00:15:35.694 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mds-2:18.0.0-6213.gbf8a061f.el8.x86_64 99/134 2023-09-21T00:15:35.902 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mon-2:18.0.0-6213.gbf8a061f.el8.x86_64 100/134 2023-09-21T00:15:35.920 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mon-2:18.0.0-6213.gbf8a061f.el8.x86_64 100/134 2023-09-21T00:15:37.208 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-volume-2:18.0.0-6213.gbf8a061f.el8.noarch 97/134 2023-09-21T00:15:37.401 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-osd-2:18.0.0-6213.gbf8a061f.el8.x86_64 98/134 2023-09-21T00:15:37.622 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-osd-2:18.0.0-6213.gbf8a061f.el8.x86_64 98/134 2023-09-21T00:15:37.770 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mds-2:18.0.0-6213.gbf8a061f.el8.x86_64 99/134 2023-09-21T00:15:37.812 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: cephadm-2:18.0.0-6213.gbf8a061f.el8.noarch 101/134 2023-09-21T00:15:37.994 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : cephadm-2:18.0.0-6213.gbf8a061f.el8.noarch 101/134 2023-09-21T00:15:38.125 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6213.gbf8a061f.e 102/134 2023-09-21T00:15:38.224 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mds-2:18.0.0-6213.gbf8a061f.el8.x86_64 99/134 2023-09-21T00:15:38.328 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6213.gbf8a061f. 103/134 2023-09-21T00:15:38.378 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mon-2:18.0.0-6213.gbf8a061f.el8.x86_64 100/134 2023-09-21T00:15:38.394 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mon-2:18.0.0-6213.gbf8a061f.el8.x86_64 100/134 2023-09-21T00:15:38.526 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6213.gbf8a061f.el8.noa 104/134 2023-09-21T00:15:38.753 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6213.gbf8a061f.el8.noa 104/134 2023-09-21T00:15:39.074 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6213.gbf8a061f.el8.n 105/134 2023-09-21T00:15:40.097 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6213.gbf8a061f.el8.n 105/134 2023-09-21T00:15:40.123 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: cephadm-2:18.0.0-6213.gbf8a061f.el8.noarch 101/134 2023-09-21T00:15:40.243 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6213.gbf8 106/134 2023-09-21T00:15:40.311 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : cephadm-2:18.0.0-6213.gbf8a061f.el8.noarch 101/134 2023-09-21T00:15:40.340 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6213.gbf8 106/134 2023-09-21T00:15:40.453 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6213.gbf8a061f.e 102/134 2023-09-21T00:15:40.660 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6213.gbf8a061f. 103/134 2023-09-21T00:15:40.742 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6213.gbf8a061f.el 107/134 2023-09-21T00:15:40.844 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6213.gbf8a061f.el8.noa 104/134 2023-09-21T00:15:40.908 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-2:18.0.0-6213.gbf8a061f.el8.x86_64 108/134 2023-09-21T00:15:40.944 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6213.gbf8a061f.el8.x86_64 108/134 2023-09-21T00:15:41.060 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6213.gbf8a061f.el8.noa 104/134 2023-09-21T00:15:41.151 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-rook-2:18.0.0-6213.gbf8a061f.el8.noarch 109/134 2023-09-21T00:15:41.163 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6213.gbf8a061f.el8.noarch 109/134 2023-09-21T00:15:41.400 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6213.gbf8a061f.el8.n 105/134 2023-09-21T00:15:42.359 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6213.gbf8a061f.el8.n 105/134 2023-09-21T00:15:42.511 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6213.gbf8 106/134 2023-09-21T00:15:42.570 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-2:18.0.0-6213.gbf8a061f.el8.x86_64 110/134 2023-09-21T00:15:42.602 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6213.gbf8 106/134 2023-09-21T00:15:42.786 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-radosgw-2:18.0.0-6213.gbf8a061f.el8.x86_64 111/134 2023-09-21T00:15:42.827 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6213.gbf8a061f.el8.x86_64 111/134 2023-09-21T00:15:42.984 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6213.gbf8a0 112/134 2023-09-21T00:15:42.999 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6213.gbf8a061f.el 107/134 2023-09-21T00:15:43.028 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6213.gbf8a0 112/134 2023-09-21T00:15:43.183 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-2:18.0.0-6213.gbf8a061f.el8.x86_64 108/134 2023-09-21T00:15:43.184 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : cephfs-mirror-2:18.0.0-6213.gbf8a061f.el8.x86_64 113/134 2023-09-21T00:15:43.218 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6213.gbf8a061f.el8.x86_64 108/134 2023-09-21T00:15:43.378 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-rook-2:18.0.0-6213.gbf8a061f.el8.noarch 109/134 2023-09-21T00:15:43.388 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6213.gbf8a061f.el8.noarch 109/134 2023-09-21T00:15:43.566 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6213.gbf8a061f.el8.x86_64 113/134 2023-09-21T00:15:43.743 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-mirror-2:18.0.0-6213.gbf8a061f.el8.x86_64 114/134 2023-09-21T00:15:44.697 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-2:18.0.0-6213.gbf8a061f.el8.x86_64 110/134 2023-09-21T00:15:44.918 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-radosgw-2:18.0.0-6213.gbf8a061f.el8.x86_64 111/134 2023-09-21T00:15:44.952 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6213.gbf8a061f.el8.x86_64 111/134 2023-09-21T00:15:45.136 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6213.gbf8a0 112/134 2023-09-21T00:15:45.177 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6213.gbf8a0 112/134 2023-09-21T00:15:45.336 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : cephfs-mirror-2:18.0.0-6213.gbf8a061f.el8.x86_64 113/134 2023-09-21T00:15:45.695 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6213.gbf8a061f.el8.x86_64 113/134 2023-09-21T00:15:45.911 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : rbd-mirror-2:18.0.0-6213.gbf8a061f.el8.x86_64 114/134 2023-09-21T00:15:48.740 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6213.gbf8a061f.el8.x86_64 114/134 2023-09-21T00:15:49.060 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-test-2:18.0.0-6213.gbf8a061f.el8.x86_64 115/134 2023-09-21T00:15:49.217 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-09-21T00:15:49.422 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-09-21T00:15:50.356 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-09-21T00:15:50.580 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6213.gbf8a061f.el8.x86_64 114/134 2023-09-21T00:15:50.703 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-09-21T00:15:50.920 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-fuse-2:18.0.0-6213.gbf8a061f.el8.x86_64 119/134 2023-09-21T00:15:51.129 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-09-21T00:15:51.346 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephfs-devel-2:18.0.0-6213.gbf8a061f.el8.x86_ 121/134 2023-09-21T00:15:51.443 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-test-2:18.0.0-6213.gbf8a061f.el8.x86_64 115/134 2023-09-21T00:15:51.501 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-09-21T00:15:51.754 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-09-21T00:15:51.927 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-fuse-2:18.0.0-6213.gbf8a061f.el8.x86_64 117/134 2023-09-21T00:15:52.198 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-09-21T00:15:52.351 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-09-21T00:15:52.547 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-09-21T00:15:52.805 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-09-21T00:15:52.981 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libcephfs-devel-2:18.0.0-6213.gbf8a061f.el8.x86_ 121/134 2023-09-21T00:15:53.135 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-09-21T00:15:53.947 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-09-21T00:15:54.176 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-09-21T00:15:54.193 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-09-21T00:15:54.392 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : cephfs-top-2:18.0.0-6213.gbf8a061f.el8.noarch 124/134 2023-09-21T00:15:54.650 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-fuse-2:18.0.0-6213.gbf8a061f.el8.x86_64 125/134 2023-09-21T00:15:54.951 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-nbd-2:18.0.0-6213.gbf8a061f.el8.x86_64 126/134 2023-09-21T00:15:55.259 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-09-21T00:15:55.366 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-09-21T00:15:55.424 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-09-21T00:15:55.433 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-09-21T00:15:55.609 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-09-21T00:15:55.622 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-09-21T00:15:55.627 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-09-21T00:15:55.824 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : cephfs-top-2:18.0.0-6213.gbf8a061f.el8.noarch 124/134 2023-09-21T00:15:55.824 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-09-21T00:15:55.912 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-09-21T00:15:56.133 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-09-21T00:15:56.133 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : rbd-fuse-2:18.0.0-6213.gbf8a061f.el8.x86_64 125/134 2023-09-21T00:15:56.146 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-09-21T00:15:56.146 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-09-21T00:15:56.369 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-09-21T00:15:56.369 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-09-21T00:15:56.409 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : rbd-nbd-2:18.0.0-6213.gbf8a061f.el8.x86_64 126/134 2023-09-21T00:15:56.615 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-09-21T00:15:56.790 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-09-21T00:15:56.823 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-09-21T00:15:56.975 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-09-21T00:15:57.055 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-09-21T00:15:57.242 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-09-21T00:15:57.254 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-09-21T00:15:57.344 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-09-21T00:15:57.345 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-2:18.0.0-6213.gbf8a061f.el8.x86_64 1/134 2023-09-21T00:15:57.345 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-base-2:18.0.0-6213.gbf8a061f.el8.x86_64 2/134 2023-09-21T00:15:57.345 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-common-2:18.0.0-6213.gbf8a061f.el8.x86_64 3/134 2023-09-21T00:15:57.345 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-fuse-2:18.0.0-6213.gbf8a061f.el8.x86_64 4/134 2023-09-21T00:15:57.346 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6213.gbf8a0 5/134 2023-09-21T00:15:57.346 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mds-2:18.0.0-6213.gbf8a061f.el8.x86_64 6/134 2023-09-21T00:15:57.346 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-2:18.0.0-6213.gbf8a061f.el8.x86_64 7/134 2023-09-21T00:15:57.346 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mon-2:18.0.0-6213.gbf8a061f.el8.x86_64 8/134 2023-09-21T00:15:57.346 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-osd-2:18.0.0-6213.gbf8a061f.el8.x86_64 9/134 2023-09-21T00:15:57.347 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-radosgw-2:18.0.0-6213.gbf8a061f.el8.x86_64 10/134 2023-09-21T00:15:57.347 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-selinux-2:18.0.0-6213.gbf8a061f.el8.x86_64 11/134 2023-09-21T00:15:57.347 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-test-2:18.0.0-6213.gbf8a061f.el8.x86_64 12/134 2023-09-21T00:15:57.347 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : cephfs-mirror-2:18.0.0-6213.gbf8a061f.el8.x86_64 13/134 2023-09-21T00:15:57.347 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephfs-devel-2:18.0.0-6213.gbf8a061f.el8.x86_ 14/134 2023-09-21T00:15:57.348 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephfs2-2:18.0.0-6213.gbf8a061f.el8.x86_64 15/134 2023-09-21T00:15:57.348 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephsqlite-2:18.0.0-6213.gbf8a061f.el8.x86_64 16/134 2023-09-21T00:15:57.348 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados-devel-2:18.0.0-6213.gbf8a061f.el8.x86_6 17/134 2023-09-21T00:15:57.348 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libradosstriper1-2:18.0.0-6213.gbf8a061f.el8.x86 18/134 2023-09-21T00:15:57.348 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librgw2-2:18.0.0-6213.gbf8a061f.el8.x86_64 19/134 2023-09-21T00:15:57.349 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6213.gbf8a061f.el 20/134 2023-09-21T00:15:57.349 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ceph-common-2:18.0.0-6213.gbf8a061f.el8. 21/134 2023-09-21T00:15:57.349 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cephfs-2:18.0.0-6213.gbf8a061f.el8.x86_6 22/134 2023-09-21T00:15:57.349 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rados-2:18.0.0-6213.gbf8a061f.el8.x86_64 23/134 2023-09-21T00:15:57.349 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rbd-2:18.0.0-6213.gbf8a061f.el8.x86_64 24/134 2023-09-21T00:15:57.350 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rgw-2:18.0.0-6213.gbf8a061f.el8.x86_64 25/134 2023-09-21T00:15:57.350 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-fuse-2:18.0.0-6213.gbf8a061f.el8.x86_64 26/134 2023-09-21T00:15:57.350 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-mirror-2:18.0.0-6213.gbf8a061f.el8.x86_64 27/134 2023-09-21T00:15:57.361 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-nbd-2:18.0.0-6213.gbf8a061f.el8.x86_64 28/134 2023-09-21T00:15:57.361 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6213.gbf8a061f. 29/134 2023-09-21T00:15:57.362 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6213.gbf8a061f.el8.noa 30/134 2023-09-21T00:15:57.362 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6213.gbf8a061f.el8.n 31/134 2023-09-21T00:15:57.362 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6213.gbf8 32/134 2023-09-21T00:15:57.362 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6213.gbf8a061f.el 33/134 2023-09-21T00:15:57.362 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6213.gbf8a061f.el8.noarch 34/134 2023-09-21T00:15:57.363 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6213.gbf8a061f.e 35/134 2023-09-21T00:15:57.363 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-volume-2:18.0.0-6213.gbf8a061f.el8.noarch 36/134 2023-09-21T00:15:57.363 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : cephadm-2:18.0.0-6213.gbf8a061f.el8.noarch 37/134 2023-09-21T00:15:57.363 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : cephfs-top-2:18.0.0-6213.gbf8a061f.el8.noarch 38/134 2023-09-21T00:15:57.364 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-09-21T00:15:57.364 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-09-21T00:15:57.364 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-09-21T00:15:57.364 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-09-21T00:15:57.364 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-09-21T00:15:57.365 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-09-21T00:15:57.365 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-09-21T00:15:57.365 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-09-21T00:15:57.365 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-09-21T00:15:57.366 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-09-21T00:15:57.366 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-09-21T00:15:57.366 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-09-21T00:15:57.366 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-09-21T00:15:57.367 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-09-21T00:15:57.367 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-09-21T00:15:57.367 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-09-21T00:15:57.367 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-09-21T00:15:57.367 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-09-21T00:15:57.368 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-09-21T00:15:57.368 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-09-21T00:15:57.368 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-09-21T00:15:57.368 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-09-21T00:15:57.368 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-09-21T00:15:57.369 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-09-21T00:15:57.369 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-09-21T00:15:57.369 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-09-21T00:15:57.369 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-09-21T00:15:57.369 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-09-21T00:15:57.370 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-09-21T00:15:57.370 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-09-21T00:15:57.370 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-09-21T00:15:57.370 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-09-21T00:15:57.370 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-09-21T00:15:57.370 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-09-21T00:15:57.371 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-09-21T00:15:57.371 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-09-21T00:15:57.371 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-09-21T00:15:57.371 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-09-21T00:15:57.371 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-09-21T00:15:57.372 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-09-21T00:15:57.372 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-09-21T00:15:57.372 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-09-21T00:15:57.372 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-09-21T00:15:57.372 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-09-21T00:15:57.373 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-09-21T00:15:57.373 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-09-21T00:15:57.373 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-09-21T00:15:57.373 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-09-21T00:15:57.373 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-09-21T00:15:57.374 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-09-21T00:15:57.374 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-09-21T00:15:57.374 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-09-21T00:15:57.374 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-09-21T00:15:57.374 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-09-21T00:15:57.375 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-09-21T00:15:57.375 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-09-21T00:15:57.375 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-09-21T00:15:57.375 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-09-21T00:15:57.375 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-09-21T00:15:57.376 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-09-21T00:15:57.376 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-09-21T00:15:57.376 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-09-21T00:15:57.376 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-09-21T00:15:57.376 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-09-21T00:15:57.377 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-09-21T00:15:57.377 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-09-21T00:15:57.377 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-09-21T00:15:57.377 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-09-21T00:15:57.377 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-09-21T00:15:57.377 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-09-21T00:15:57.378 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-09-21T00:15:57.378 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-09-21T00:15:57.378 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-09-21T00:15:57.378 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-09-21T00:15:57.378 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-09-21T00:15:57.379 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-09-21T00:15:57.379 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-09-21T00:15:57.379 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-09-21T00:15:57.379 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-09-21T00:15:57.379 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-09-21T00:15:57.380 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-09-21T00:15:57.380 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-09-21T00:15:57.380 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-09-21T00:15:57.380 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-09-21T00:15:57.380 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-09-21T00:15:57.381 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-09-21T00:15:57.381 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-09-21T00:15:57.381 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-09-21T00:15:57.381 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-09-21T00:15:57.381 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-09-21T00:15:57.382 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados2-2:18.0.0-6213.gbf8a061f.el8.x86_64 129/134 2023-09-21T00:15:57.382 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-09-21T00:15:57.382 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librbd1-2:18.0.0-6213.gbf8a061f.el8.x86_64 131/134 2023-09-21T00:15:57.382 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-09-21T00:15:57.382 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-09-21T00:15:57.417 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-09-21T00:15:57.425 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-09-21T00:15:57.569 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-09-21T00:15:57.570 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-09-21T00:15:57.736 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-09-21T00:15:57.737 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-09-21T00:15:57.947 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-09-21T00:15:58.157 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-09-21T00:15:58.657 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-09-21T00:15:58.658 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-2:18.0.0-6213.gbf8a061f.el8.x86_64 1/134 2023-09-21T00:15:58.658 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-base-2:18.0.0-6213.gbf8a061f.el8.x86_64 2/134 2023-09-21T00:15:58.658 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-common-2:18.0.0-6213.gbf8a061f.el8.x86_64 3/134 2023-09-21T00:15:58.658 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-fuse-2:18.0.0-6213.gbf8a061f.el8.x86_64 4/134 2023-09-21T00:15:58.658 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6213.gbf8a0 5/134 2023-09-21T00:15:58.659 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mds-2:18.0.0-6213.gbf8a061f.el8.x86_64 6/134 2023-09-21T00:15:58.659 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-2:18.0.0-6213.gbf8a061f.el8.x86_64 7/134 2023-09-21T00:15:58.659 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mon-2:18.0.0-6213.gbf8a061f.el8.x86_64 8/134 2023-09-21T00:15:58.659 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-osd-2:18.0.0-6213.gbf8a061f.el8.x86_64 9/134 2023-09-21T00:15:58.659 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-radosgw-2:18.0.0-6213.gbf8a061f.el8.x86_64 10/134 2023-09-21T00:15:58.660 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-selinux-2:18.0.0-6213.gbf8a061f.el8.x86_64 11/134 2023-09-21T00:15:58.660 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-test-2:18.0.0-6213.gbf8a061f.el8.x86_64 12/134 2023-09-21T00:15:58.660 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : cephfs-mirror-2:18.0.0-6213.gbf8a061f.el8.x86_64 13/134 2023-09-21T00:15:58.660 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libcephfs-devel-2:18.0.0-6213.gbf8a061f.el8.x86_ 14/134 2023-09-21T00:15:58.660 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libcephfs2-2:18.0.0-6213.gbf8a061f.el8.x86_64 15/134 2023-09-21T00:15:58.661 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libcephsqlite-2:18.0.0-6213.gbf8a061f.el8.x86_64 16/134 2023-09-21T00:15:58.661 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librados-devel-2:18.0.0-6213.gbf8a061f.el8.x86_6 17/134 2023-09-21T00:15:58.661 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libradosstriper1-2:18.0.0-6213.gbf8a061f.el8.x86 18/134 2023-09-21T00:15:58.661 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librgw2-2:18.0.0-6213.gbf8a061f.el8.x86_64 19/134 2023-09-21T00:15:58.661 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6213.gbf8a061f.el 20/134 2023-09-21T00:15:58.661 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-ceph-common-2:18.0.0-6213.gbf8a061f.el8. 21/134 2023-09-21T00:15:58.662 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cephfs-2:18.0.0-6213.gbf8a061f.el8.x86_6 22/134 2023-09-21T00:15:58.662 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-rados-2:18.0.0-6213.gbf8a061f.el8.x86_64 23/134 2023-09-21T00:15:58.662 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-rbd-2:18.0.0-6213.gbf8a061f.el8.x86_64 24/134 2023-09-21T00:15:58.662 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-rgw-2:18.0.0-6213.gbf8a061f.el8.x86_64 25/134 2023-09-21T00:15:58.662 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : rbd-fuse-2:18.0.0-6213.gbf8a061f.el8.x86_64 26/134 2023-09-21T00:15:58.663 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : rbd-mirror-2:18.0.0-6213.gbf8a061f.el8.x86_64 27/134 2023-09-21T00:15:58.663 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : rbd-nbd-2:18.0.0-6213.gbf8a061f.el8.x86_64 28/134 2023-09-21T00:15:58.663 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6213.gbf8a061f. 29/134 2023-09-21T00:15:58.663 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6213.gbf8a061f.el8.noa 30/134 2023-09-21T00:15:58.673 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6213.gbf8a061f.el8.n 31/134 2023-09-21T00:15:58.673 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6213.gbf8 32/134 2023-09-21T00:15:58.673 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6213.gbf8a061f.el 33/134 2023-09-21T00:15:58.674 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6213.gbf8a061f.el8.noarch 34/134 2023-09-21T00:15:58.674 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6213.gbf8a061f.e 35/134 2023-09-21T00:15:58.674 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-volume-2:18.0.0-6213.gbf8a061f.el8.noarch 36/134 2023-09-21T00:15:58.674 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : cephadm-2:18.0.0-6213.gbf8a061f.el8.noarch 37/134 2023-09-21T00:15:58.674 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : cephfs-top-2:18.0.0-6213.gbf8a061f.el8.noarch 38/134 2023-09-21T00:15:58.675 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-09-21T00:15:58.675 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-09-21T00:15:58.675 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-09-21T00:15:58.675 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-09-21T00:15:58.675 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-09-21T00:15:58.676 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-09-21T00:15:58.676 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-09-21T00:15:58.676 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-09-21T00:15:58.676 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-09-21T00:15:58.676 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-09-21T00:15:58.677 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-09-21T00:15:58.677 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-09-21T00:15:58.677 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-09-21T00:15:58.677 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-09-21T00:15:58.677 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-09-21T00:15:58.678 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-09-21T00:15:58.678 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-09-21T00:15:58.678 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-09-21T00:15:58.678 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-09-21T00:15:58.678 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-09-21T00:15:58.679 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-09-21T00:15:58.679 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-09-21T00:15:58.679 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-09-21T00:15:58.679 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-09-21T00:15:58.680 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-09-21T00:15:58.680 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-09-21T00:15:58.680 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-09-21T00:15:58.680 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-09-21T00:15:58.680 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-09-21T00:15:58.681 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-09-21T00:15:58.681 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-09-21T00:15:58.681 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-09-21T00:15:58.681 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-09-21T00:15:58.681 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-09-21T00:15:58.681 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-09-21T00:15:58.682 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-09-21T00:15:58.682 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-09-21T00:15:58.682 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-09-21T00:15:58.682 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-09-21T00:15:58.682 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-09-21T00:15:58.683 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-09-21T00:15:58.683 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-09-21T00:15:58.683 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-09-21T00:15:58.683 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-09-21T00:15:58.683 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-09-21T00:15:58.684 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-09-21T00:15:58.684 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-09-21T00:15:58.684 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-09-21T00:15:58.684 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-09-21T00:15:58.684 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-09-21T00:15:58.685 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-09-21T00:15:58.685 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-09-21T00:15:58.685 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-09-21T00:15:58.685 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-09-21T00:15:58.685 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-09-21T00:15:58.685 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-09-21T00:15:58.686 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-09-21T00:15:58.686 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-09-21T00:15:58.686 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-09-21T00:15:58.686 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-09-21T00:15:58.686 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-09-21T00:15:58.687 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-09-21T00:15:58.687 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-09-21T00:15:58.687 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-09-21T00:15:58.687 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-09-21T00:15:58.687 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-09-21T00:15:58.688 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-09-21T00:15:58.688 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-09-21T00:15:58.688 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-09-21T00:15:58.688 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-09-21T00:15:58.688 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-09-21T00:15:58.688 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-09-21T00:15:58.689 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-09-21T00:15:58.689 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-09-21T00:15:58.689 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-09-21T00:15:58.689 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-09-21T00:15:58.690 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-09-21T00:15:58.690 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-09-21T00:15:58.690 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-09-21T00:15:58.690 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-09-21T00:15:58.690 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-09-21T00:15:58.691 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-09-21T00:15:58.691 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-09-21T00:15:58.691 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-09-21T00:15:58.691 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-09-21T00:15:58.691 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-09-21T00:15:58.692 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-09-21T00:15:58.692 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-09-21T00:15:58.692 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-09-21T00:15:58.692 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-09-21T00:15:58.692 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librados2-2:18.0.0-6213.gbf8a061f.el8.x86_64 129/134 2023-09-21T00:15:58.693 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-09-21T00:15:58.693 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librbd1-2:18.0.0-6213.gbf8a061f.el8.x86_64 131/134 2023-09-21T00:15:58.693 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-09-21T00:15:58.693 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-09-21T00:16:00.069 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-09-21T00:16:00.070 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:01:56 ago on Thu 21 Sep 2023 12:14:04 AM UTC. 2023-09-21T00:16:01.416 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-09-21T00:16:01.416 INFO:teuthology.orchestra.run.smithi083.stdout:Last metadata expiration check: 0:01:57 ago on Thu 21 Sep 2023 12:14:04 AM UTC. 2023-09-21T00:16:02.762 INFO:teuthology.orchestra.run.smithi059.stdout:Installed products updated. 2023-09-21T00:16:03.005 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:16:03.061 INFO:teuthology.orchestra.run.smithi059.stdout:Upgraded: 2023-09-21T00:16:03.061 INFO:teuthology.orchestra.run.smithi059.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-09-21T00:16:03.062 INFO:teuthology.orchestra.run.smithi059.stdout: librados2-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:03.062 INFO:teuthology.orchestra.run.smithi059.stdout: librbd1-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:03.062 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2023-09-21T00:16:03.062 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-09-21T00:16:03.063 INFO:teuthology.orchestra.run.smithi059.stdout: automake-1.16.1-7.el8.noarch 2023-09-21T00:16:03.063 INFO:teuthology.orchestra.run.smithi059.stdout: bison-3.0.4-10.el8.x86_64 2023-09-21T00:16:03.063 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:03.063 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-base-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:03.063 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-common-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:03.063 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-fuse-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:03.064 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-grafana-dashboards-2:18.0.0-6213.gbf8a061f.el8.noarch 2023-09-21T00:16:03.064 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-immutable-object-cache-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:03.064 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mds-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:03.064 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:03.064 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-cephadm-2:18.0.0-6213.gbf8a061f.el8.noarch 2023-09-21T00:16:03.065 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-dashboard-2:18.0.0-6213.gbf8a061f.el8.noarch 2023-09-21T00:16:03.065 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6213.gbf8a061f.el8.noarch 2023-09-21T00:16:03.065 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-modules-core-2:18.0.0-6213.gbf8a061f.el8.noarch 2023-09-21T00:16:03.065 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-rook-2:18.0.0-6213.gbf8a061f.el8.noarch 2023-09-21T00:16:03.065 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mon-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:03.066 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-osd-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:03.066 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-prometheus-alerts-2:18.0.0-6213.gbf8a061f.el8.noarch 2023-09-21T00:16:03.066 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-radosgw-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:03.066 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-selinux-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:03.067 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-test-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:03.067 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-volume-2:18.0.0-6213.gbf8a061f.el8.noarch 2023-09-21T00:16:03.067 INFO:teuthology.orchestra.run.smithi059.stdout: cephadm-2:18.0.0-6213.gbf8a061f.el8.noarch 2023-09-21T00:16:03.067 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-mirror-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:03.067 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-top-2:18.0.0-6213.gbf8a061f.el8.noarch 2023-09-21T00:16:03.067 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-09-21T00:16:03.068 INFO:teuthology.orchestra.run.smithi059.stdout: flex-2.6.1-9.el8.x86_64 2023-09-21T00:16:03.068 INFO:teuthology.orchestra.run.smithi059.stdout: fuse-2.9.7-15.el8.x86_64 2023-09-21T00:16:03.068 INFO:teuthology.orchestra.run.smithi059.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-09-21T00:16:03.068 INFO:teuthology.orchestra.run.smithi059.stdout: jq-1.6-3.el8.x86_64 2023-09-21T00:16:03.068 INFO:teuthology.orchestra.run.smithi059.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-09-21T00:16:03.069 INFO:teuthology.orchestra.run.smithi059.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-09-21T00:16:03.069 INFO:teuthology.orchestra.run.smithi059.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-09-21T00:16:03.069 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs-devel-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:03.069 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs2-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:03.069 INFO:teuthology.orchestra.run.smithi059.stdout: libcephsqlite-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:03.070 INFO:teuthology.orchestra.run.smithi059.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-09-21T00:16:03.070 INFO:teuthology.orchestra.run.smithi059.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-09-21T00:16:03.070 INFO:teuthology.orchestra.run.smithi059.stdout: liboath-2.6.2-3.el8.x86_64 2023-09-21T00:16:03.070 INFO:teuthology.orchestra.run.smithi059.stdout: libpq-13.5-1.el8.x86_64 2023-09-21T00:16:03.070 INFO:teuthology.orchestra.run.smithi059.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-09-21T00:16:03.071 INFO:teuthology.orchestra.run.smithi059.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-09-21T00:16:03.071 INFO:teuthology.orchestra.run.smithi059.stdout: librados-devel-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:03.071 INFO:teuthology.orchestra.run.smithi059.stdout: libradosstriper1-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:03.071 INFO:teuthology.orchestra.run.smithi059.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-09-21T00:16:03.071 INFO:teuthology.orchestra.run.smithi059.stdout: librgw2-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:03.072 INFO:teuthology.orchestra.run.smithi059.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-09-21T00:16:03.072 INFO:teuthology.orchestra.run.smithi059.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-09-21T00:16:03.072 INFO:teuthology.orchestra.run.smithi059.stdout: libtool-2.4.6-25.el8.x86_64 2023-09-21T00:16:03.072 INFO:teuthology.orchestra.run.smithi059.stdout: libunwind-1.3.1-3.el8.x86_64 2023-09-21T00:16:03.072 INFO:teuthology.orchestra.run.smithi059.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-09-21T00:16:03.073 INFO:teuthology.orchestra.run.smithi059.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-09-21T00:16:03.073 INFO:teuthology.orchestra.run.smithi059.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-09-21T00:16:03.073 INFO:teuthology.orchestra.run.smithi059.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-09-21T00:16:03.073 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-0.3.15-3.el8.x86_64 2023-09-21T00:16:03.073 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-09-21T00:16:03.074 INFO:teuthology.orchestra.run.smithi059.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-09-21T00:16:03.074 INFO:teuthology.orchestra.run.smithi059.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-09-21T00:16:03.074 INFO:teuthology.orchestra.run.smithi059.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-09-21T00:16:03.074 INFO:teuthology.orchestra.run.smithi059.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-09-21T00:16:03.075 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-09-21T00:16:03.075 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-09-21T00:16:03.075 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-09-21T00:16:03.075 INFO:teuthology.orchestra.run.smithi059.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-09-21T00:16:03.075 INFO:teuthology.orchestra.run.smithi059.stdout: python3-babel-2.5.1-7.el8.noarch 2023-09-21T00:16:03.076 INFO:teuthology.orchestra.run.smithi059.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-09-21T00:16:03.076 INFO:teuthology.orchestra.run.smithi059.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-09-21T00:16:03.076 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-09-21T00:16:03.076 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-argparse-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:03.077 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-common-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:03.077 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cephfs-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:03.077 INFO:teuthology.orchestra.run.smithi059.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-09-21T00:16:03.077 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-09-21T00:16:03.077 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-09-21T00:16:03.077 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-09-21T00:16:03.078 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-09-21T00:16:03.078 INFO:teuthology.orchestra.run.smithi059.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-09-21T00:16:03.078 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-6.2-6.el8.noarch 2023-09-21T00:16:03.078 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-09-21T00:16:03.079 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-09-21T00:16:03.079 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-09-21T00:16:03.079 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-09-21T00:16:03.079 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-09-21T00:16:03.079 INFO:teuthology.orchestra.run.smithi059.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-09-21T00:16:03.079 INFO:teuthology.orchestra.run.smithi059.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-09-21T00:16:03.080 INFO:teuthology.orchestra.run.smithi059.stdout: python3-mako-1.0.6-13.el8.noarch 2023-09-21T00:16:03.080 INFO:teuthology.orchestra.run.smithi059.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-09-21T00:16:03.080 INFO:teuthology.orchestra.run.smithi059.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-09-21T00:16:03.080 INFO:teuthology.orchestra.run.smithi059.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-09-21T00:16:03.081 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-09-21T00:16:03.081 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-09-21T00:16:03.081 INFO:teuthology.orchestra.run.smithi059.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-09-21T00:16:03.081 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-09-21T00:16:03.081 INFO:teuthology.orchestra.run.smithi059.stdout: python3-portend-2.6-1.el8.noarch 2023-09-21T00:16:03.082 INFO:teuthology.orchestra.run.smithi059.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-09-21T00:16:03.082 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-09-21T00:16:03.082 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-09-21T00:16:03.082 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-09-21T00:16:03.083 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pycparser-2.14-14.el8.noarch 2023-09-21T00:16:03.083 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pytz-2017.2-9.el8.noarch 2023-09-21T00:16:03.083 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rados-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:03.083 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rbd-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:03.083 INFO:teuthology.orchestra.run.smithi059.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-09-21T00:16:03.084 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-09-21T00:16:03.084 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rgw-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:03.084 INFO:teuthology.orchestra.run.smithi059.stdout: python3-routes-2.4.1-12.el8.noarch 2023-09-21T00:16:03.084 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rsa-4.9-2.el8.noarch 2023-09-21T00:16:03.084 INFO:teuthology.orchestra.run.smithi059.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-09-21T00:16:03.084 INFO:teuthology.orchestra.run.smithi059.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-09-21T00:16:03.085 INFO:teuthology.orchestra.run.smithi059.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-09-21T00:16:03.085 INFO:teuthology.orchestra.run.smithi059.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-09-21T00:16:03.085 INFO:teuthology.orchestra.run.smithi059.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-09-21T00:16:03.085 INFO:teuthology.orchestra.run.smithi059.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-09-21T00:16:03.085 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-09-21T00:16:03.086 INFO:teuthology.orchestra.run.smithi059.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-09-21T00:16:03.086 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-09-21T00:16:03.086 INFO:teuthology.orchestra.run.smithi059.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-09-21T00:16:03.086 INFO:teuthology.orchestra.run.smithi059.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-09-21T00:16:03.086 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-fuse-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:03.087 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-mirror-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:03.087 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-nbd-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:03.087 INFO:teuthology.orchestra.run.smithi059.stdout: socat-1.7.4.1-1.el8.x86_64 2023-09-21T00:16:03.087 INFO:teuthology.orchestra.run.smithi059.stdout: thrift-0.13.0-2.el8.x86_64 2023-09-21T00:16:03.088 INFO:teuthology.orchestra.run.smithi059.stdout: uuid-1.6.2-43.el8.x86_64 2023-09-21T00:16:03.088 INFO:teuthology.orchestra.run.smithi059.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-09-21T00:16:03.088 INFO:teuthology.orchestra.run.smithi059.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-09-21T00:16:03.088 INFO:teuthology.orchestra.run.smithi059.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-09-21T00:16:03.088 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:16:03.089 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2023-09-21T00:16:03.299 DEBUG:teuthology.parallel:result is None 2023-09-21T00:16:04.092 INFO:teuthology.orchestra.run.smithi083.stdout:Installed products updated. 2023-09-21T00:16:04.321 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-09-21T00:16:04.322 INFO:teuthology.orchestra.run.smithi083.stdout:Upgraded: 2023-09-21T00:16:04.322 INFO:teuthology.orchestra.run.smithi083.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-09-21T00:16:04.322 INFO:teuthology.orchestra.run.smithi083.stdout: librados2-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:04.323 INFO:teuthology.orchestra.run.smithi083.stdout: librbd1-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:04.323 INFO:teuthology.orchestra.run.smithi083.stdout:Installed: 2023-09-21T00:16:04.323 INFO:teuthology.orchestra.run.smithi083.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-09-21T00:16:04.324 INFO:teuthology.orchestra.run.smithi083.stdout: automake-1.16.1-7.el8.noarch 2023-09-21T00:16:04.324 INFO:teuthology.orchestra.run.smithi083.stdout: bison-3.0.4-10.el8.x86_64 2023-09-21T00:16:04.324 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:04.324 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-base-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:04.325 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-common-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:04.325 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-fuse-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:04.325 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-grafana-dashboards-2:18.0.0-6213.gbf8a061f.el8.noarch 2023-09-21T00:16:04.326 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-immutable-object-cache-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:04.326 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mds-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:04.326 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:04.326 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-cephadm-2:18.0.0-6213.gbf8a061f.el8.noarch 2023-09-21T00:16:04.327 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-dashboard-2:18.0.0-6213.gbf8a061f.el8.noarch 2023-09-21T00:16:04.327 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6213.gbf8a061f.el8.noarch 2023-09-21T00:16:04.327 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-modules-core-2:18.0.0-6213.gbf8a061f.el8.noarch 2023-09-21T00:16:04.327 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-rook-2:18.0.0-6213.gbf8a061f.el8.noarch 2023-09-21T00:16:04.328 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mon-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:04.328 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-osd-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:04.328 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-prometheus-alerts-2:18.0.0-6213.gbf8a061f.el8.noarch 2023-09-21T00:16:04.328 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-radosgw-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:04.329 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-selinux-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:04.329 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-test-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:04.329 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-volume-2:18.0.0-6213.gbf8a061f.el8.noarch 2023-09-21T00:16:04.329 INFO:teuthology.orchestra.run.smithi083.stdout: cephadm-2:18.0.0-6213.gbf8a061f.el8.noarch 2023-09-21T00:16:04.329 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-mirror-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:04.330 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-top-2:18.0.0-6213.gbf8a061f.el8.noarch 2023-09-21T00:16:04.330 INFO:teuthology.orchestra.run.smithi083.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-09-21T00:16:04.330 INFO:teuthology.orchestra.run.smithi083.stdout: flex-2.6.1-9.el8.x86_64 2023-09-21T00:16:04.330 INFO:teuthology.orchestra.run.smithi083.stdout: fuse-2.9.7-15.el8.x86_64 2023-09-21T00:16:04.331 INFO:teuthology.orchestra.run.smithi083.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-09-21T00:16:04.331 INFO:teuthology.orchestra.run.smithi083.stdout: jq-1.6-3.el8.x86_64 2023-09-21T00:16:04.331 INFO:teuthology.orchestra.run.smithi083.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-09-21T00:16:04.331 INFO:teuthology.orchestra.run.smithi083.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-09-21T00:16:04.331 INFO:teuthology.orchestra.run.smithi083.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-09-21T00:16:04.331 INFO:teuthology.orchestra.run.smithi083.stdout: libcephfs-devel-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:04.332 INFO:teuthology.orchestra.run.smithi083.stdout: libcephfs2-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:04.332 INFO:teuthology.orchestra.run.smithi083.stdout: libcephsqlite-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:04.332 INFO:teuthology.orchestra.run.smithi083.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-09-21T00:16:04.332 INFO:teuthology.orchestra.run.smithi083.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-09-21T00:16:04.332 INFO:teuthology.orchestra.run.smithi083.stdout: liboath-2.6.2-3.el8.x86_64 2023-09-21T00:16:04.333 INFO:teuthology.orchestra.run.smithi083.stdout: libpq-13.5-1.el8.x86_64 2023-09-21T00:16:04.333 INFO:teuthology.orchestra.run.smithi083.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-09-21T00:16:04.333 INFO:teuthology.orchestra.run.smithi083.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-09-21T00:16:04.333 INFO:teuthology.orchestra.run.smithi083.stdout: librados-devel-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:04.333 INFO:teuthology.orchestra.run.smithi083.stdout: libradosstriper1-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:04.334 INFO:teuthology.orchestra.run.smithi083.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-09-21T00:16:04.334 INFO:teuthology.orchestra.run.smithi083.stdout: librgw2-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:04.334 INFO:teuthology.orchestra.run.smithi083.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-09-21T00:16:04.334 INFO:teuthology.orchestra.run.smithi083.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-09-21T00:16:04.335 INFO:teuthology.orchestra.run.smithi083.stdout: libtool-2.4.6-25.el8.x86_64 2023-09-21T00:16:04.335 INFO:teuthology.orchestra.run.smithi083.stdout: libunwind-1.3.1-3.el8.x86_64 2023-09-21T00:16:04.335 INFO:teuthology.orchestra.run.smithi083.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-09-21T00:16:04.335 INFO:teuthology.orchestra.run.smithi083.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-09-21T00:16:04.336 INFO:teuthology.orchestra.run.smithi083.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-09-21T00:16:04.336 INFO:teuthology.orchestra.run.smithi083.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-09-21T00:16:04.337 INFO:teuthology.orchestra.run.smithi083.stdout: openblas-0.3.15-3.el8.x86_64 2023-09-21T00:16:04.337 INFO:teuthology.orchestra.run.smithi083.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-09-21T00:16:04.337 INFO:teuthology.orchestra.run.smithi083.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-09-21T00:16:04.338 INFO:teuthology.orchestra.run.smithi083.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-09-21T00:16:04.338 INFO:teuthology.orchestra.run.smithi083.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-09-21T00:16:04.338 INFO:teuthology.orchestra.run.smithi083.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-09-21T00:16:04.338 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-09-21T00:16:04.339 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-09-21T00:16:04.339 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-09-21T00:16:04.339 INFO:teuthology.orchestra.run.smithi083.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-09-21T00:16:04.340 INFO:teuthology.orchestra.run.smithi083.stdout: python3-babel-2.5.1-7.el8.noarch 2023-09-21T00:16:04.340 INFO:teuthology.orchestra.run.smithi083.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-09-21T00:16:04.340 INFO:teuthology.orchestra.run.smithi083.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-09-21T00:16:04.340 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-09-21T00:16:04.341 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-argparse-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:04.341 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-common-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:04.341 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cephfs-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:04.341 INFO:teuthology.orchestra.run.smithi083.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-09-21T00:16:04.342 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-09-21T00:16:04.342 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-09-21T00:16:04.342 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-09-21T00:16:04.343 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-09-21T00:16:04.343 INFO:teuthology.orchestra.run.smithi083.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-09-21T00:16:04.343 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-6.2-6.el8.noarch 2023-09-21T00:16:04.343 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-09-21T00:16:04.344 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-09-21T00:16:04.344 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-09-21T00:16:04.344 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-09-21T00:16:04.344 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-09-21T00:16:04.345 INFO:teuthology.orchestra.run.smithi083.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-09-21T00:16:04.345 INFO:teuthology.orchestra.run.smithi083.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-09-21T00:16:04.345 INFO:teuthology.orchestra.run.smithi083.stdout: python3-mako-1.0.6-13.el8.noarch 2023-09-21T00:16:04.345 INFO:teuthology.orchestra.run.smithi083.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-09-21T00:16:04.346 INFO:teuthology.orchestra.run.smithi083.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-09-21T00:16:04.346 INFO:teuthology.orchestra.run.smithi083.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-09-21T00:16:04.346 INFO:teuthology.orchestra.run.smithi083.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-09-21T00:16:04.347 INFO:teuthology.orchestra.run.smithi083.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-09-21T00:16:04.347 INFO:teuthology.orchestra.run.smithi083.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-09-21T00:16:04.347 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-09-21T00:16:04.348 INFO:teuthology.orchestra.run.smithi083.stdout: python3-portend-2.6-1.el8.noarch 2023-09-21T00:16:04.348 INFO:teuthology.orchestra.run.smithi083.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-09-21T00:16:04.348 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-09-21T00:16:04.349 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-09-21T00:16:04.349 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-09-21T00:16:04.349 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pycparser-2.14-14.el8.noarch 2023-09-21T00:16:04.350 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pytz-2017.2-9.el8.noarch 2023-09-21T00:16:04.350 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rados-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:04.350 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rbd-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:04.351 INFO:teuthology.orchestra.run.smithi083.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-09-21T00:16:04.351 INFO:teuthology.orchestra.run.smithi083.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-09-21T00:16:04.351 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rgw-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:04.352 INFO:teuthology.orchestra.run.smithi083.stdout: python3-routes-2.4.1-12.el8.noarch 2023-09-21T00:16:04.352 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rsa-4.9-2.el8.noarch 2023-09-21T00:16:04.352 INFO:teuthology.orchestra.run.smithi083.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-09-21T00:16:04.352 INFO:teuthology.orchestra.run.smithi083.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-09-21T00:16:04.353 INFO:teuthology.orchestra.run.smithi083.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-09-21T00:16:04.353 INFO:teuthology.orchestra.run.smithi083.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-09-21T00:16:04.353 INFO:teuthology.orchestra.run.smithi083.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-09-21T00:16:04.354 INFO:teuthology.orchestra.run.smithi083.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-09-21T00:16:04.354 INFO:teuthology.orchestra.run.smithi083.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-09-21T00:16:04.354 INFO:teuthology.orchestra.run.smithi083.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-09-21T00:16:04.355 INFO:teuthology.orchestra.run.smithi083.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-09-21T00:16:04.355 INFO:teuthology.orchestra.run.smithi083.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-09-21T00:16:04.355 INFO:teuthology.orchestra.run.smithi083.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-09-21T00:16:04.356 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-fuse-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:04.356 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-mirror-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:04.356 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-nbd-2:18.0.0-6213.gbf8a061f.el8.x86_64 2023-09-21T00:16:04.357 INFO:teuthology.orchestra.run.smithi083.stdout: socat-1.7.4.1-1.el8.x86_64 2023-09-21T00:16:04.357 INFO:teuthology.orchestra.run.smithi083.stdout: thrift-0.13.0-2.el8.x86_64 2023-09-21T00:16:04.357 INFO:teuthology.orchestra.run.smithi083.stdout: uuid-1.6.2-43.el8.x86_64 2023-09-21T00:16:04.358 INFO:teuthology.orchestra.run.smithi083.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-09-21T00:16:04.358 INFO:teuthology.orchestra.run.smithi083.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-09-21T00:16:04.358 INFO:teuthology.orchestra.run.smithi083.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-09-21T00:16:04.359 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-09-21T00:16:04.359 INFO:teuthology.orchestra.run.smithi083.stdout:Complete! 2023-09-21T00:16:04.505 DEBUG:teuthology.parallel:result is None 2023-09-21T00:16:04.506 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=bf8a061ff16ac1d393cf108f740d92dfa49f2e54 2023-09-21T00:16:04.885 DEBUG:teuthology.orchestra.run.smithi059:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-09-21T00:16:04.914 INFO:teuthology.orchestra.run.smithi059.stdout:18.0.0-6213.gbf8a061f.el8 2023-09-21T00:16:04.915 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6213.gbf8a061f.el8 2023-09-21T00:16:04.915 INFO:teuthology.task.install:The correct ceph version 18.0.0-6213.gbf8a061f is installed. 2023-09-21T00:16:04.916 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=bf8a061ff16ac1d393cf108f740d92dfa49f2e54 2023-09-21T00:16:05.109 DEBUG:teuthology.orchestra.run.smithi083:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-09-21T00:16:05.136 INFO:teuthology.orchestra.run.smithi083.stdout:18.0.0-6213.gbf8a061f.el8 2023-09-21T00:16:05.137 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6213.gbf8a061f.el8 2023-09-21T00:16:05.137 INFO:teuthology.task.install:The correct ceph version 18.0.0-6213.gbf8a061f is installed. 2023-09-21T00:16:05.137 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-09-21T00:16:05.138 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-21T00:16:05.138 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-21T00:16:05.189 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-09-21T00:16:05.189 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-21T00:16:05.233 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-09-21T00:16:05.234 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-21T00:16:05.234 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/daemon-helper 2023-09-21T00:16:05.265 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-21T00:16:05.335 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-09-21T00:16:05.335 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/usr/bin/daemon-helper 2023-09-21T00:16:05.364 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-21T00:16:05.434 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-09-21T00:16:05.435 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-21T00:16:05.435 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-21T00:16:05.466 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-21T00:16:05.535 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-09-21T00:16:05.535 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-21T00:16:05.564 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-21T00:16:05.632 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-09-21T00:16:05.632 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-21T00:16:05.633 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/stdin-killer 2023-09-21T00:16:05.662 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-21T00:16:05.732 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-09-21T00:16:05.732 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/usr/bin/stdin-killer 2023-09-21T00:16:05.760 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-21T00:16:05.827 INFO:teuthology.run_tasks:Running task ceph... 2023-09-21T00:16:05.900 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-09-21T00:16:05.901 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 777 /var/log/ceph 2023-09-21T00:16:05.904 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 777 /var/log/ceph 2023-09-21T00:16:05.931 INFO:tasks.ceph:Disabling ceph logrotate... 2023-09-21T00:16:05.932 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /etc/logrotate.d/ceph 2023-09-21T00:16:05.973 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f -- /etc/logrotate.d/ceph 2023-09-21T00:16:06.000 INFO:tasks.ceph:Creating extra log directories... 2023-09-21T00:16:06.000 DEBUG:teuthology.orchestra.run.smithi059:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-09-21T00:16:06.042 DEBUG:teuthology.orchestra.run.smithi083:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-09-21T00:16:06.077 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-09-21T00:16:06.077 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-09-21T00:16:06.078 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-09-21T00:16:06.078 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-21T00:16:06.078 DEBUG:teuthology.orchestra.run.smithi059:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-09-21T00:16:06.126 DEBUG:teuthology.orchestra.run.smithi059:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-09-21T00:16:06.279 DEBUG:teuthology.orchestra.run.smithi059:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-09-21T00:16:06.306 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-09-21T00:16:06.307 DEBUG:teuthology.orchestra.run.smithi083:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-09-21T00:16:06.324 DEBUG:teuthology.orchestra.run.smithi083:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-09-21T00:16:06.464 DEBUG:teuthology.orchestra.run.smithi083:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-09-21T00:16:06.501 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-09-21T00:16:06.502 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-09-21T00:16:06.502 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-09-20_10:42:39-fs-wip-vshankar-testing-20230920.072635-testing-default-smithi/7399289', 'branch': 'wip-vshankar-testing-20230920.072635', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7399289', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-09-20_10:42:39-fs-wip-vshankar-testing-20230920.072635-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20230920.072635'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'bf8a061ff16ac1d393cf108f740d92dfa49f2e54'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'bf8a061ff16ac1d393cf108f740d92dfa49f2e54'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20230920.072635', 'sha1': 'bf8a061ff16ac1d393cf108f740d92dfa49f2e54'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 2186, 'sha1': 'bf8a061ff16ac1d393cf108f740d92dfa49f2e54', 'sleep_before_teardown': 0, 'subset': '614/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20230920.072635', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bf8a061ff16ac1d393cf108f740d92dfa49f2e54/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bf8a061ff16ac1d393cf108f740d92dfa49f2e54', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi059.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', 'smithi083.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'bf8a061ff16ac1d393cf108f740d92dfa49f2e54'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'bf8a061ff16ac1d393cf108f740d92dfa49f2e54', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-09-20_10:42:39', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.1394'} 2023-09-21T00:16:06.503 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-09-21T00:16:06.505 DEBUG:teuthology.orchestra.run.smithi083:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-09-21T00:16:06.548 DEBUG:teuthology.orchestra.run.smithi059:> sudo install -d -m0777 -- /var/run/ceph 2023-09-21T00:16:06.563 DEBUG:teuthology.orchestra.run.smithi083:> sudo install -d -m0777 -- /var/run/ceph 2023-09-21T00:16:06.613 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-21T00:16:06.614 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/scratch_devs of=/dev/stdout 2023-09-21T00:16:06.646 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-21T00:16:06.647 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_1 2023-09-21T00:16:06.704 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-21T00:16:06.705 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-21T00:16:06.705 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 6h/6d Inode: 391200 Links: 1 2023-09-21T00:16:06.705 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-21T00:16:06.705 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2023-09-21T00:16:06.706 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2023-09-21 00:15:57.028486417 +0000 2023-09-21T00:16:06.706 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2023-09-21 00:13:17.350016353 +0000 2023-09-21T00:16:06.706 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2023-09-21 00:13:17.350016353 +0000 2023-09-21T00:16:06.706 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: - 2023-09-21T00:16:06.707 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-21T00:16:06.771 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2023-09-21T00:16:06.771 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2023-09-21T00:16:06.771 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000243844 s, 2.1 MB/s 2023-09-21T00:16:06.772 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-21T00:16:06.831 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_2 2023-09-21T00:16:06.889 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-21T00:16:06.890 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-21T00:16:06.890 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 6h/6d Inode: 390276 Links: 1 2023-09-21T00:16:06.890 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-21T00:16:06.890 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2023-09-21T00:16:06.890 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2023-09-21 00:15:57.028486417 +0000 2023-09-21T00:16:06.891 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2023-09-21 00:13:17.876009972 +0000 2023-09-21T00:16:06.891 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2023-09-21 00:13:17.876009972 +0000 2023-09-21T00:16:06.891 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: - 2023-09-21T00:16:06.891 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-21T00:16:06.955 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2023-09-21T00:16:06.956 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2023-09-21T00:16:06.956 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000199899 s, 2.6 MB/s 2023-09-21T00:16:06.957 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-21T00:16:07.015 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_3 2023-09-21T00:16:07.073 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-21T00:16:07.073 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-21T00:16:07.073 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 6h/6d Inode: 388418 Links: 1 2023-09-21T00:16:07.073 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-21T00:16:07.074 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2023-09-21T00:16:07.074 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2023-09-21 00:15:57.029486405 +0000 2023-09-21T00:16:07.074 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2023-09-21 00:13:18.382003833 +0000 2023-09-21T00:16:07.074 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2023-09-21 00:13:18.382003833 +0000 2023-09-21T00:16:07.075 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: - 2023-09-21T00:16:07.075 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-21T00:16:07.138 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2023-09-21T00:16:07.139 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2023-09-21T00:16:07.139 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000221746 s, 2.3 MB/s 2023-09-21T00:16:07.140 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-21T00:16:07.198 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_4 2023-09-21T00:16:07.256 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-21T00:16:07.256 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-21T00:16:07.256 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 6h/6d Inode: 391290 Links: 1 2023-09-21T00:16:07.256 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-21T00:16:07.257 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2023-09-21T00:16:07.257 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2023-09-21 00:15:57.029486405 +0000 2023-09-21T00:16:07.257 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2023-09-21 00:13:18.879997791 +0000 2023-09-21T00:16:07.257 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2023-09-21 00:13:18.879997791 +0000 2023-09-21T00:16:07.257 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: - 2023-09-21T00:16:07.258 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-21T00:16:07.321 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2023-09-21T00:16:07.322 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2023-09-21T00:16:07.322 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000207924 s, 2.5 MB/s 2023-09-21T00:16:07.323 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-21T00:16:07.381 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-21T00:16:07.381 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-09-21T00:16:07.381 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/scratch_devs of=/dev/stdout 2023-09-21T00:16:07.400 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-21T00:16:07.401 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_1 2023-09-21T00:16:07.459 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-21T00:16:07.459 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-21T00:16:07.459 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 6h/6d Inode: 391229 Links: 1 2023-09-21T00:16:07.460 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-21T00:16:07.460 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:device_t:s0 2023-09-21T00:16:07.460 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2023-09-21 00:15:58.363762425 +0000 2023-09-21T00:16:07.460 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2023-09-21 00:13:07.550440810 +0000 2023-09-21T00:16:07.460 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2023-09-21 00:13:07.550440810 +0000 2023-09-21T00:16:07.461 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: - 2023-09-21T00:16:07.461 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-21T00:16:07.527 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2023-09-21T00:16:07.527 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2023-09-21T00:16:07.528 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000258268 s, 2.0 MB/s 2023-09-21T00:16:07.529 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-21T00:16:07.588 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_2 2023-09-21T00:16:07.647 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-21T00:16:07.648 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-21T00:16:07.648 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 6h/6d Inode: 388465 Links: 1 2023-09-21T00:16:07.648 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-21T00:16:07.648 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:device_t:s0 2023-09-21T00:16:07.648 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2023-09-21 00:15:58.363762425 +0000 2023-09-21T00:16:07.649 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2023-09-21 00:13:08.213425198 +0000 2023-09-21T00:16:07.649 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2023-09-21 00:13:08.213425198 +0000 2023-09-21T00:16:07.649 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: - 2023-09-21T00:16:07.649 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-21T00:16:07.714 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2023-09-21T00:16:07.714 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2023-09-21T00:16:07.716 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000278367 s, 1.8 MB/s 2023-09-21T00:16:07.719 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-21T00:16:07.777 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_3 2023-09-21T00:16:07.834 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-21T00:16:07.835 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-21T00:16:07.835 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 6h/6d Inode: 392282 Links: 1 2023-09-21T00:16:07.835 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-21T00:16:07.835 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:device_t:s0 2023-09-21T00:16:07.835 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2023-09-21 00:15:58.363762425 +0000 2023-09-21T00:16:07.835 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2023-09-21 00:13:08.713413424 +0000 2023-09-21T00:16:07.836 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2023-09-21 00:13:08.713413424 +0000 2023-09-21T00:16:07.836 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: - 2023-09-21T00:16:07.836 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-21T00:16:07.900 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2023-09-21T00:16:07.901 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2023-09-21T00:16:07.901 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.00023041 s, 2.2 MB/s 2023-09-21T00:16:07.902 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-21T00:16:07.961 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_4 2023-09-21T00:16:08.018 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-21T00:16:08.018 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-21T00:16:08.018 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 6h/6d Inode: 383725 Links: 1 2023-09-21T00:16:08.019 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-21T00:16:08.019 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:device_t:s0 2023-09-21T00:16:08.019 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2023-09-21 00:15:58.363762425 +0000 2023-09-21T00:16:08.019 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2023-09-21 00:13:09.208401768 +0000 2023-09-21T00:16:08.019 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2023-09-21 00:13:09.208401768 +0000 2023-09-21T00:16:08.019 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: - 2023-09-21T00:16:08.020 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-21T00:16:08.082 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2023-09-21T00:16:08.083 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2023-09-21T00:16:08.083 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000190668 s, 2.7 MB/s 2023-09-21T00:16:08.084 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-21T00:16:08.142 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-21T00:16:08.143 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi059.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi083.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-09-21T00:16:08.143 INFO:tasks.ceph:Generating config... 2023-09-21T00:16:08.144 INFO:tasks.ceph:[client] client mount timeout = 600 2023-09-21T00:16:08.145 INFO:tasks.ceph:[client] debug client = 20 2023-09-21T00:16:08.145 INFO:tasks.ceph:[client] debug ms = 1 2023-09-21T00:16:08.145 INFO:tasks.ceph:[client] pid file = 2023-09-21T00:16:08.146 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-09-21T00:16:08.146 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-09-21T00:16:08.146 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-09-21T00:16:08.146 INFO:tasks.ceph:[mds] debug mds = 20 2023-09-21T00:16:08.147 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-09-21T00:16:08.147 INFO:tasks.ceph:[mds] debug ms = 1 2023-09-21T00:16:08.147 INFO:tasks.ceph:[mds] mds debug frag = True 2023-09-21T00:16:08.148 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-09-21T00:16:08.148 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-09-21T00:16:08.148 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-09-21T00:16:08.148 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-09-21T00:16:08.149 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-09-21T00:16:08.149 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-09-21T00:16:08.149 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-09-21T00:16:08.150 INFO:tasks.ceph:[mgr] debug ms = 1 2023-09-21T00:16:08.150 INFO:tasks.ceph:[mon] debug mon = 20 2023-09-21T00:16:08.150 INFO:tasks.ceph:[mon] debug ms = 1 2023-09-21T00:16:08.150 INFO:tasks.ceph:[mon] debug paxos = 20 2023-09-21T00:16:08.151 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-09-21T00:16:08.151 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-09-21T00:16:08.151 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-09-21T00:16:08.151 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-09-21T00:16:08.152 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-09-21T00:16:08.152 INFO:tasks.ceph:[osd] debug ms = 1 2023-09-21T00:16:08.152 INFO:tasks.ceph:[osd] debug osd = 20 2023-09-21T00:16:08.152 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-09-21T00:16:08.153 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-09-21T00:16:08.153 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-09-21T00:16:08.153 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-09-21T00:16:08.154 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-09-21T00:16:08.154 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-09-21T00:16:08.154 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-09-21T00:16:08.154 INFO:tasks.ceph:Setting up mon.a... 2023-09-21T00:16:08.155 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-09-21T00:16:08.226 INFO:teuthology.orchestra.run.smithi059.stdout:creating /etc/ceph/ceph.keyring 2023-09-21T00:16:08.229 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-09-21T00:16:08.280 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-21T00:16:08.308 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.59'), ('mon.b', '172.21.15.83'), ('mon.c', '[v2:172.21.15.83:3301,v1:172.21.15.83:6790]')] 2023-09-21T00:16:08.309 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.59,172.21.15.83,[v2:172.21.15.83:3301,v1:172.21.15.83:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-09-21T00:16:08.310 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-21T00:16:08.310 DEBUG:teuthology.orchestra.run.smithi059:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-09-21T00:16:08.366 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.59 --add b 172.21.15.83 --addv c '[v2:172.21.15.83:3301,v1:172.21.15.83:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-09-21T00:16:08.457 INFO:teuthology.orchestra.run.smithi059.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-09-21T00:16:08.457 INFO:teuthology.orchestra.run.smithi059.stdout:monmaptool: generated fsid dd69925c-6e25-42fe-880b-2f60fc6f384b 2023-09-21T00:16:08.458 INFO:teuthology.orchestra.run.smithi059.stdout:setting min_mon_release = pacific 2023-09-21T00:16:08.458 INFO:teuthology.orchestra.run.smithi059.stdout:epoch 0 2023-09-21T00:16:08.458 INFO:teuthology.orchestra.run.smithi059.stdout:fsid dd69925c-6e25-42fe-880b-2f60fc6f384b 2023-09-21T00:16:08.458 INFO:teuthology.orchestra.run.smithi059.stdout:last_changed 2023-09-21T00:16:08.456976+0000 2023-09-21T00:16:08.458 INFO:teuthology.orchestra.run.smithi059.stdout:created 2023-09-21T00:16:08.456976+0000 2023-09-21T00:16:08.459 INFO:teuthology.orchestra.run.smithi059.stdout:min_mon_release 16 (pacific) 2023-09-21T00:16:08.459 INFO:teuthology.orchestra.run.smithi059.stdout:election_strategy: 1 2023-09-21T00:16:08.459 INFO:teuthology.orchestra.run.smithi059.stdout:0: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.a 2023-09-21T00:16:08.459 INFO:teuthology.orchestra.run.smithi059.stdout:1: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.b 2023-09-21T00:16:08.460 INFO:teuthology.orchestra.run.smithi059.stdout:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2023-09-21T00:16:08.460 INFO:teuthology.orchestra.run.smithi059.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-09-21T00:16:08.461 DEBUG:teuthology.orchestra.run.smithi059:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-09-21T00:16:08.479 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID dd69925c-6e25-42fe-880b-2f60fc6f384b... 2023-09-21T00:16:08.480 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-09-21T00:16:08.522 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-09-21T00:16:08.567 INFO:teuthology.orchestra.run.smithi059.stdout:[global] 2023-09-21T00:16:08.567 INFO:teuthology.orchestra.run.smithi059.stdout: chdir = "" 2023-09-21T00:16:08.567 INFO:teuthology.orchestra.run.smithi059.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-09-21T00:16:08.568 INFO:teuthology.orchestra.run.smithi059.stdout: auth supported = cephx 2023-09-21T00:16:08.568 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:16:08.568 INFO:teuthology.orchestra.run.smithi059.stdout: filestore xattr use omap = true 2023-09-21T00:16:08.568 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:16:08.568 INFO:teuthology.orchestra.run.smithi059.stdout: mon clock drift allowed = 1.000 2023-09-21T00:16:08.569 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:16:08.569 INFO:teuthology.orchestra.run.smithi059.stdout: osd crush chooseleaf type = 0 2023-09-21T00:16:08.569 INFO:teuthology.orchestra.run.smithi059.stdout: auth debug = true 2023-09-21T00:16:08.569 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:16:08.569 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on old message = true 2023-09-21T00:16:08.570 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on bug = true 2023-09-21T00:16:08.570 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:16:08.570 INFO:teuthology.orchestra.run.smithi059.stdout: mon max pg per osd = 10000 # >= luminous 2023-09-21T00:16:08.570 INFO:teuthology.orchestra.run.smithi059.stdout: mon pg warn max object skew = 0 2023-09-21T00:16:08.570 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:16:08.570 INFO:teuthology.orchestra.run.smithi059.stdout: # disable pg_autoscaler by default for new pools 2023-09-21T00:16:08.571 INFO:teuthology.orchestra.run.smithi059.stdout: osd_pool_default_pg_autoscale_mode = off 2023-09-21T00:16:08.571 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:16:08.571 INFO:teuthology.orchestra.run.smithi059.stdout: osd pool default size = 2 2023-09-21T00:16:08.571 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:16:08.571 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd allow primary affinity = true 2023-09-21T00:16:08.572 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd allow pg remap = true 2023-09-21T00:16:08.572 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on legacy crush tunables = false 2023-09-21T00:16:08.572 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on crush straw calc version zero = false 2023-09-21T00:16:08.572 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on no sortbitwise = false 2023-09-21T00:16:08.572 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on osd down out interval zero = false 2023-09-21T00:16:08.573 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on too few osds = false 2023-09-21T00:16:08.573 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-09-21T00:16:08.573 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_pool_no_redundancy = false 2023-09-21T00:16:08.573 INFO:teuthology.orchestra.run.smithi059.stdout: mon_allow_pool_size_one = true 2023-09-21T00:16:08.573 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:16:08.573 INFO:teuthology.orchestra.run.smithi059.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-09-21T00:16:08.574 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:16:08.574 INFO:teuthology.orchestra.run.smithi059.stdout: osd default data pool replay window = 5 2023-09-21T00:16:08.574 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:16:08.574 INFO:teuthology.orchestra.run.smithi059.stdout: mon allow pool delete = true 2023-09-21T00:16:08.574 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:16:08.575 INFO:teuthology.orchestra.run.smithi059.stdout: mon cluster log file level = debug 2023-09-21T00:16:08.575 INFO:teuthology.orchestra.run.smithi059.stdout: debug asserts on shutdown = true 2023-09-21T00:16:08.575 INFO:teuthology.orchestra.run.smithi059.stdout: mon health detail to clog = false 2023-09-21T00:16:08.575 INFO:teuthology.orchestra.run.smithi059.stdout: mon host = "172.21.15.59,172.21.15.83,[v2:172.21.15.83:3301,v1:172.21.15.83:6790]" 2023-09-21T00:16:08.575 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on skipped message = False 2023-09-21T00:16:08.576 INFO:teuthology.orchestra.run.smithi059.stdout: fsid = dd69925c-6e25-42fe-880b-2f60fc6f384b 2023-09-21T00:16:08.576 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:16:08.576 INFO:teuthology.orchestra.run.smithi059.stdout:[osd] 2023-09-21T00:16:08.576 INFO:teuthology.orchestra.run.smithi059.stdout: osd journal size = 100 2023-09-21T00:16:08.576 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:16:08.576 INFO:teuthology.orchestra.run.smithi059.stdout: osd scrub load threshold = 5.0 2023-09-21T00:16:08.577 INFO:teuthology.orchestra.run.smithi059.stdout: osd scrub max interval = 600 2023-09-21T00:16:08.577 INFO:teuthology.orchestra.run.smithi059.stdout: osd mclock profile = high_recovery_ops 2023-09-21T00:16:08.577 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:16:08.577 INFO:teuthology.orchestra.run.smithi059.stdout: osd recover clone overlap = true 2023-09-21T00:16:08.577 INFO:teuthology.orchestra.run.smithi059.stdout: osd recovery max chunk = 1048576 2023-09-21T00:16:08.578 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:16:08.578 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug shutdown = true 2023-09-21T00:16:08.578 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug op order = true 2023-09-21T00:16:08.578 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug verify stray on activate = true 2023-09-21T00:16:08.578 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:16:08.579 INFO:teuthology.orchestra.run.smithi059.stdout: osd open classes on start = true 2023-09-21T00:16:08.579 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug pg log writeout = true 2023-09-21T00:16:08.579 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:16:08.579 INFO:teuthology.orchestra.run.smithi059.stdout: osd deep scrub update digest min age = 30 2023-09-21T00:16:08.580 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:16:08.580 INFO:teuthology.orchestra.run.smithi059.stdout: osd map max advance = 10 2023-09-21T00:16:08.580 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:16:08.580 INFO:teuthology.orchestra.run.smithi059.stdout: journal zero on create = true 2023-09-21T00:16:08.580 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:16:08.581 INFO:teuthology.orchestra.run.smithi059.stdout: filestore ondisk finisher threads = 3 2023-09-21T00:16:08.581 INFO:teuthology.orchestra.run.smithi059.stdout: filestore apply finisher threads = 3 2023-09-21T00:16:08.581 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:16:08.581 INFO:teuthology.orchestra.run.smithi059.stdout: bdev debug aio = true 2023-09-21T00:16:08.581 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug misdirected ops = true 2023-09-21T00:16:08.582 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore block size = 96636764160 2023-09-21T00:16:08.582 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore fsck on mount = True 2023-09-21T00:16:08.582 INFO:teuthology.orchestra.run.smithi059.stdout: debug bluefs = 20 2023-09-21T00:16:08.582 INFO:teuthology.orchestra.run.smithi059.stdout: debug bluestore = 20 2023-09-21T00:16:08.583 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2023-09-21T00:16:08.584 INFO:teuthology.orchestra.run.smithi059.stdout: debug osd = 20 2023-09-21T00:16:08.584 INFO:teuthology.orchestra.run.smithi059.stdout: debug rocksdb = 10 2023-09-21T00:16:08.584 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd backfillfull_ratio = 0.85 2023-09-21T00:16:08.584 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd full ratio = 0.9 2023-09-21T00:16:08.584 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd nearfull ratio = 0.8 2023-09-21T00:16:08.585 INFO:teuthology.orchestra.run.smithi059.stdout: osd failsafe full ratio = 0.95 2023-09-21T00:16:08.585 INFO:teuthology.orchestra.run.smithi059.stdout: osd objectstore = bluestore 2023-09-21T00:16:08.585 INFO:teuthology.orchestra.run.smithi059.stdout: osd op complaint time = 180 2023-09-21T00:16:08.585 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:16:08.585 INFO:teuthology.orchestra.run.smithi059.stdout:[mgr] 2023-09-21T00:16:08.586 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2023-09-21T00:16:08.586 INFO:teuthology.orchestra.run.smithi059.stdout: debug mgr = 20 2023-09-21T00:16:08.586 INFO:teuthology.orchestra.run.smithi059.stdout: debug mon = 20 2023-09-21T00:16:08.586 INFO:teuthology.orchestra.run.smithi059.stdout: debug auth = 20 2023-09-21T00:16:08.586 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min pgs per osd = 4 2023-09-21T00:16:08.587 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min bytes per osd = 10 2023-09-21T00:16:08.587 INFO:teuthology.orchestra.run.smithi059.stdout: mgr/telemetry/nag = false 2023-09-21T00:16:08.588 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:16:08.588 INFO:teuthology.orchestra.run.smithi059.stdout:[mon] 2023-09-21T00:16:08.588 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2023-09-21T00:16:08.588 INFO:teuthology.orchestra.run.smithi059.stdout: debug mon = 20 2023-09-21T00:16:08.589 INFO:teuthology.orchestra.run.smithi059.stdout: debug paxos = 20 2023-09-21T00:16:08.589 INFO:teuthology.orchestra.run.smithi059.stdout: debug auth = 20 2023-09-21T00:16:08.589 INFO:teuthology.orchestra.run.smithi059.stdout: mon data avail warn = 5 2023-09-21T00:16:08.589 INFO:teuthology.orchestra.run.smithi059.stdout: mon mgr mkfs grace = 240 2023-09-21T00:16:08.589 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min pgs per osd = 4 2023-09-21T00:16:08.589 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd reporter subtree level = osd 2023-09-21T00:16:08.590 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd prime pg temp = true 2023-09-21T00:16:08.590 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min bytes per osd = 10 2023-09-21T00:16:08.590 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:16:08.590 INFO:teuthology.orchestra.run.smithi059.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-09-21T00:16:08.591 INFO:teuthology.orchestra.run.smithi059.stdout: auth mon ticket ttl = 660 # 11m 2023-09-21T00:16:08.591 INFO:teuthology.orchestra.run.smithi059.stdout: auth service ticket ttl = 240 # 4m 2023-09-21T00:16:08.591 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:16:08.591 INFO:teuthology.orchestra.run.smithi059.stdout: # don't complain about insecure global_id in the test suite 2023-09-21T00:16:08.591 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-09-21T00:16:08.591 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-09-21T00:16:08.592 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:16:08.592 INFO:teuthology.orchestra.run.smithi059.stdout: # 1m isn't quite enough 2023-09-21T00:16:08.592 INFO:teuthology.orchestra.run.smithi059.stdout: mon_down_mkfs_grace = 2m 2023-09-21T00:16:08.592 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:16:08.592 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_filestore_osds = false 2023-09-21T00:16:08.593 INFO:teuthology.orchestra.run.smithi059.stdout: mon op complaint time = 120 2023-09-21T00:16:08.593 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:16:08.593 INFO:teuthology.orchestra.run.smithi059.stdout:[client] 2023-09-21T00:16:08.593 INFO:teuthology.orchestra.run.smithi059.stdout: rgw cache enabled = true 2023-09-21T00:16:08.593 INFO:teuthology.orchestra.run.smithi059.stdout: rgw enable ops log = true 2023-09-21T00:16:08.594 INFO:teuthology.orchestra.run.smithi059.stdout: rgw enable usage log = true 2023-09-21T00:16:08.594 INFO:teuthology.orchestra.run.smithi059.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-09-21T00:16:08.594 INFO:teuthology.orchestra.run.smithi059.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-09-21T00:16:08.594 INFO:teuthology.orchestra.run.smithi059.stdout: client mount timeout = 600 2023-09-21T00:16:08.594 INFO:teuthology.orchestra.run.smithi059.stdout: debug client = 20 2023-09-21T00:16:08.595 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2023-09-21T00:16:08.595 INFO:teuthology.orchestra.run.smithi059.stdout: pid file = "" 2023-09-21T00:16:08.595 INFO:teuthology.orchestra.run.smithi059.stdout: rados mon op timeout = 900 2023-09-21T00:16:08.595 INFO:teuthology.orchestra.run.smithi059.stdout: rados osd op timeout = 900 2023-09-21T00:16:08.595 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.a] 2023-09-21T00:16:08.596 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.b] 2023-09-21T00:16:08.596 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.c] 2023-09-21T00:16:08.596 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.a] 2023-09-21T00:16:08.596 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.c] 2023-09-21T00:16:08.596 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.b] 2023-09-21T00:16:08.597 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.d] 2023-09-21T00:16:08.597 INFO:teuthology.orchestra.run.smithi059.stdout:[mds] 2023-09-21T00:16:08.597 INFO:teuthology.orchestra.run.smithi059.stdout: debug mds = 20 2023-09-21T00:16:08.597 INFO:teuthology.orchestra.run.smithi059.stdout: debug mds balancer = 20 2023-09-21T00:16:08.597 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2023-09-21T00:16:08.598 INFO:teuthology.orchestra.run.smithi059.stdout: mds debug frag = True 2023-09-21T00:16:08.598 INFO:teuthology.orchestra.run.smithi059.stdout: mds debug scatterstat = True 2023-09-21T00:16:08.598 INFO:teuthology.orchestra.run.smithi059.stdout: mds op complaint time = 180 2023-09-21T00:16:08.598 INFO:teuthology.orchestra.run.smithi059.stdout: mds verify scatter = True 2023-09-21T00:16:08.598 INFO:teuthology.orchestra.run.smithi059.stdout: osd op complaint time = 180 2023-09-21T00:16:08.598 INFO:teuthology.orchestra.run.smithi059.stdout: rados mon op timeout = 900 2023-09-21T00:16:08.599 INFO:teuthology.orchestra.run.smithi059.stdout: rados osd op timeout = 900 2023-09-21T00:16:08.600 INFO:teuthology.orchestra.run.smithi083.stdout:[global] 2023-09-21T00:16:08.601 INFO:teuthology.orchestra.run.smithi083.stdout: chdir = "" 2023-09-21T00:16:08.601 INFO:teuthology.orchestra.run.smithi083.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-09-21T00:16:08.601 INFO:teuthology.orchestra.run.smithi083.stdout: auth supported = cephx 2023-09-21T00:16:08.601 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-09-21T00:16:08.601 INFO:teuthology.orchestra.run.smithi083.stdout: filestore xattr use omap = true 2023-09-21T00:16:08.602 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-09-21T00:16:08.602 INFO:teuthology.orchestra.run.smithi083.stdout: mon clock drift allowed = 1.000 2023-09-21T00:16:08.602 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-09-21T00:16:08.602 INFO:teuthology.orchestra.run.smithi083.stdout: osd crush chooseleaf type = 0 2023-09-21T00:16:08.602 INFO:teuthology.orchestra.run.smithi083.stdout: auth debug = true 2023-09-21T00:16:08.603 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-09-21T00:16:08.603 INFO:teuthology.orchestra.run.smithi083.stdout: ms die on old message = true 2023-09-21T00:16:08.603 INFO:teuthology.orchestra.run.smithi083.stdout: ms die on bug = true 2023-09-21T00:16:08.603 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-09-21T00:16:08.603 INFO:teuthology.orchestra.run.smithi083.stdout: mon max pg per osd = 10000 # >= luminous 2023-09-21T00:16:08.604 INFO:teuthology.orchestra.run.smithi083.stdout: mon pg warn max object skew = 0 2023-09-21T00:16:08.604 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-09-21T00:16:08.604 INFO:teuthology.orchestra.run.smithi083.stdout: # disable pg_autoscaler by default for new pools 2023-09-21T00:16:08.604 INFO:teuthology.orchestra.run.smithi083.stdout: osd_pool_default_pg_autoscale_mode = off 2023-09-21T00:16:08.605 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-09-21T00:16:08.605 INFO:teuthology.orchestra.run.smithi083.stdout: osd pool default size = 2 2023-09-21T00:16:08.605 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-09-21T00:16:08.605 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd allow primary affinity = true 2023-09-21T00:16:08.605 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd allow pg remap = true 2023-09-21T00:16:08.606 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on legacy crush tunables = false 2023-09-21T00:16:08.606 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on crush straw calc version zero = false 2023-09-21T00:16:08.606 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on no sortbitwise = false 2023-09-21T00:16:08.606 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on osd down out interval zero = false 2023-09-21T00:16:08.606 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on too few osds = false 2023-09-21T00:16:08.607 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-09-21T00:16:08.607 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_pool_no_redundancy = false 2023-09-21T00:16:08.608 INFO:teuthology.orchestra.run.smithi083.stdout: mon_allow_pool_size_one = true 2023-09-21T00:16:08.608 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-09-21T00:16:08.608 INFO:teuthology.orchestra.run.smithi083.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-09-21T00:16:08.608 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-09-21T00:16:08.608 INFO:teuthology.orchestra.run.smithi083.stdout: osd default data pool replay window = 5 2023-09-21T00:16:08.609 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-09-21T00:16:08.609 INFO:teuthology.orchestra.run.smithi083.stdout: mon allow pool delete = true 2023-09-21T00:16:08.609 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-09-21T00:16:08.609 INFO:teuthology.orchestra.run.smithi083.stdout: mon cluster log file level = debug 2023-09-21T00:16:08.609 INFO:teuthology.orchestra.run.smithi083.stdout: debug asserts on shutdown = true 2023-09-21T00:16:08.610 INFO:teuthology.orchestra.run.smithi083.stdout: mon health detail to clog = false 2023-09-21T00:16:08.610 INFO:teuthology.orchestra.run.smithi083.stdout: mon host = "172.21.15.59,172.21.15.83,[v2:172.21.15.83:3301,v1:172.21.15.83:6790]" 2023-09-21T00:16:08.610 INFO:teuthology.orchestra.run.smithi083.stdout: ms die on skipped message = False 2023-09-21T00:16:08.610 INFO:teuthology.orchestra.run.smithi083.stdout: fsid = dd69925c-6e25-42fe-880b-2f60fc6f384b 2023-09-21T00:16:08.610 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-09-21T00:16:08.611 INFO:teuthology.orchestra.run.smithi083.stdout:[osd] 2023-09-21T00:16:08.611 INFO:teuthology.orchestra.run.smithi083.stdout: osd journal size = 100 2023-09-21T00:16:08.611 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-09-21T00:16:08.611 INFO:teuthology.orchestra.run.smithi083.stdout: osd scrub load threshold = 5.0 2023-09-21T00:16:08.611 INFO:teuthology.orchestra.run.smithi083.stdout: osd scrub max interval = 600 2023-09-21T00:16:08.612 INFO:teuthology.orchestra.run.smithi083.stdout: osd mclock profile = high_recovery_ops 2023-09-21T00:16:08.612 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-09-21T00:16:08.612 INFO:teuthology.orchestra.run.smithi083.stdout: osd recover clone overlap = true 2023-09-21T00:16:08.612 INFO:teuthology.orchestra.run.smithi083.stdout: osd recovery max chunk = 1048576 2023-09-21T00:16:08.612 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-09-21T00:16:08.613 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug shutdown = true 2023-09-21T00:16:08.613 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug op order = true 2023-09-21T00:16:08.614 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug verify stray on activate = true 2023-09-21T00:16:08.614 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-09-21T00:16:08.614 INFO:teuthology.orchestra.run.smithi083.stdout: osd open classes on start = true 2023-09-21T00:16:08.614 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug pg log writeout = true 2023-09-21T00:16:08.614 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-09-21T00:16:08.615 INFO:teuthology.orchestra.run.smithi083.stdout: osd deep scrub update digest min age = 30 2023-09-21T00:16:08.615 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-09-21T00:16:08.615 INFO:teuthology.orchestra.run.smithi083.stdout: osd map max advance = 10 2023-09-21T00:16:08.615 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-09-21T00:16:08.615 INFO:teuthology.orchestra.run.smithi083.stdout: journal zero on create = true 2023-09-21T00:16:08.616 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-09-21T00:16:08.616 INFO:teuthology.orchestra.run.smithi083.stdout: filestore ondisk finisher threads = 3 2023-09-21T00:16:08.616 INFO:teuthology.orchestra.run.smithi083.stdout: filestore apply finisher threads = 3 2023-09-21T00:16:08.616 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-09-21T00:16:08.616 INFO:teuthology.orchestra.run.smithi083.stdout: bdev debug aio = true 2023-09-21T00:16:08.616 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug misdirected ops = true 2023-09-21T00:16:08.617 INFO:teuthology.orchestra.run.smithi083.stdout: bluestore block size = 96636764160 2023-09-21T00:16:08.617 INFO:teuthology.orchestra.run.smithi083.stdout: bluestore fsck on mount = True 2023-09-21T00:16:08.617 INFO:teuthology.orchestra.run.smithi083.stdout: debug bluefs = 20 2023-09-21T00:16:08.617 INFO:teuthology.orchestra.run.smithi083.stdout: debug bluestore = 20 2023-09-21T00:16:08.617 INFO:teuthology.orchestra.run.smithi083.stdout: debug ms = 1 2023-09-21T00:16:08.618 INFO:teuthology.orchestra.run.smithi083.stdout: debug osd = 20 2023-09-21T00:16:08.618 INFO:teuthology.orchestra.run.smithi083.stdout: debug rocksdb = 10 2023-09-21T00:16:08.618 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd backfillfull_ratio = 0.85 2023-09-21T00:16:08.618 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd full ratio = 0.9 2023-09-21T00:16:08.618 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd nearfull ratio = 0.8 2023-09-21T00:16:08.619 INFO:teuthology.orchestra.run.smithi083.stdout: osd failsafe full ratio = 0.95 2023-09-21T00:16:08.619 INFO:teuthology.orchestra.run.smithi083.stdout: osd objectstore = bluestore 2023-09-21T00:16:08.619 INFO:teuthology.orchestra.run.smithi083.stdout: osd op complaint time = 180 2023-09-21T00:16:08.620 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-09-21T00:16:08.620 INFO:teuthology.orchestra.run.smithi083.stdout:[mgr] 2023-09-21T00:16:08.620 INFO:teuthology.orchestra.run.smithi083.stdout: debug ms = 1 2023-09-21T00:16:08.620 INFO:teuthology.orchestra.run.smithi083.stdout: debug mgr = 20 2023-09-21T00:16:08.620 INFO:teuthology.orchestra.run.smithi083.stdout: debug mon = 20 2023-09-21T00:16:08.621 INFO:teuthology.orchestra.run.smithi083.stdout: debug auth = 20 2023-09-21T00:16:08.621 INFO:teuthology.orchestra.run.smithi083.stdout: mon reweight min pgs per osd = 4 2023-09-21T00:16:08.621 INFO:teuthology.orchestra.run.smithi083.stdout: mon reweight min bytes per osd = 10 2023-09-21T00:16:08.622 INFO:teuthology.orchestra.run.smithi083.stdout: mgr/telemetry/nag = false 2023-09-21T00:16:08.622 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-09-21T00:16:08.622 INFO:teuthology.orchestra.run.smithi083.stdout:[mon] 2023-09-21T00:16:08.622 INFO:teuthology.orchestra.run.smithi083.stdout: debug ms = 1 2023-09-21T00:16:08.623 INFO:teuthology.orchestra.run.smithi083.stdout: debug mon = 20 2023-09-21T00:16:08.623 INFO:teuthology.orchestra.run.smithi083.stdout: debug paxos = 20 2023-09-21T00:16:08.623 INFO:teuthology.orchestra.run.smithi083.stdout: debug auth = 20 2023-09-21T00:16:08.623 INFO:teuthology.orchestra.run.smithi083.stdout: mon data avail warn = 5 2023-09-21T00:16:08.624 INFO:teuthology.orchestra.run.smithi083.stdout: mon mgr mkfs grace = 240 2023-09-21T00:16:08.624 INFO:teuthology.orchestra.run.smithi083.stdout: mon reweight min pgs per osd = 4 2023-09-21T00:16:08.624 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd reporter subtree level = osd 2023-09-21T00:16:08.624 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd prime pg temp = true 2023-09-21T00:16:08.624 INFO:teuthology.orchestra.run.smithi083.stdout: mon reweight min bytes per osd = 10 2023-09-21T00:16:08.625 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-09-21T00:16:08.625 INFO:teuthology.orchestra.run.smithi083.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-09-21T00:16:08.625 INFO:teuthology.orchestra.run.smithi083.stdout: auth mon ticket ttl = 660 # 11m 2023-09-21T00:16:08.625 INFO:teuthology.orchestra.run.smithi083.stdout: auth service ticket ttl = 240 # 4m 2023-09-21T00:16:08.625 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-09-21T00:16:08.626 INFO:teuthology.orchestra.run.smithi083.stdout: # don't complain about insecure global_id in the test suite 2023-09-21T00:16:08.626 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-09-21T00:16:08.626 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-09-21T00:16:08.626 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-09-21T00:16:08.626 INFO:teuthology.orchestra.run.smithi083.stdout: # 1m isn't quite enough 2023-09-21T00:16:08.626 INFO:teuthology.orchestra.run.smithi083.stdout: mon_down_mkfs_grace = 2m 2023-09-21T00:16:08.627 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-09-21T00:16:08.627 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_filestore_osds = false 2023-09-21T00:16:08.627 INFO:teuthology.orchestra.run.smithi083.stdout: mon op complaint time = 120 2023-09-21T00:16:08.627 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-09-21T00:16:08.627 INFO:teuthology.orchestra.run.smithi083.stdout:[client] 2023-09-21T00:16:08.628 INFO:teuthology.orchestra.run.smithi083.stdout: rgw cache enabled = true 2023-09-21T00:16:08.628 INFO:teuthology.orchestra.run.smithi083.stdout: rgw enable ops log = true 2023-09-21T00:16:08.628 INFO:teuthology.orchestra.run.smithi083.stdout: rgw enable usage log = true 2023-09-21T00:16:08.628 INFO:teuthology.orchestra.run.smithi083.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-09-21T00:16:08.628 INFO:teuthology.orchestra.run.smithi083.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-09-21T00:16:08.629 INFO:teuthology.orchestra.run.smithi083.stdout: client mount timeout = 600 2023-09-21T00:16:08.629 INFO:teuthology.orchestra.run.smithi083.stdout: debug client = 20 2023-09-21T00:16:08.629 INFO:teuthology.orchestra.run.smithi083.stdout: debug ms = 1 2023-09-21T00:16:08.629 INFO:teuthology.orchestra.run.smithi083.stdout: pid file = "" 2023-09-21T00:16:08.629 INFO:teuthology.orchestra.run.smithi083.stdout: rados mon op timeout = 900 2023-09-21T00:16:08.629 INFO:teuthology.orchestra.run.smithi083.stdout: rados osd op timeout = 900 2023-09-21T00:16:08.631 INFO:teuthology.orchestra.run.smithi083.stdout:[mon.a] 2023-09-21T00:16:08.632 INFO:teuthology.orchestra.run.smithi083.stdout:[mon.b] 2023-09-21T00:16:08.632 INFO:teuthology.orchestra.run.smithi083.stdout:[mon.c] 2023-09-21T00:16:08.633 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.a] 2023-09-21T00:16:08.633 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.c] 2023-09-21T00:16:08.633 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.b] 2023-09-21T00:16:08.634 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.d] 2023-09-21T00:16:08.634 INFO:teuthology.orchestra.run.smithi083.stdout:[mds] 2023-09-21T00:16:08.634 INFO:teuthology.orchestra.run.smithi083.stdout: debug mds = 20 2023-09-21T00:16:08.634 INFO:teuthology.orchestra.run.smithi083.stdout: debug mds balancer = 20 2023-09-21T00:16:08.635 INFO:teuthology.orchestra.run.smithi083.stdout: debug ms = 1 2023-09-21T00:16:08.635 INFO:teuthology.orchestra.run.smithi083.stdout: mds debug frag = True 2023-09-21T00:16:08.635 INFO:teuthology.orchestra.run.smithi083.stdout: mds debug scatterstat = True 2023-09-21T00:16:08.635 INFO:teuthology.orchestra.run.smithi083.stdout: mds op complaint time = 180 2023-09-21T00:16:08.636 INFO:teuthology.orchestra.run.smithi083.stdout: mds verify scatter = True 2023-09-21T00:16:08.636 INFO:teuthology.orchestra.run.smithi083.stdout: osd op complaint time = 180 2023-09-21T00:16:08.636 INFO:teuthology.orchestra.run.smithi083.stdout: rados mon op timeout = 900 2023-09-21T00:16:08.636 INFO:teuthology.orchestra.run.smithi083.stdout: rados osd op timeout = 900 2023-09-21T00:16:08.637 INFO:tasks.ceph:Creating admin key on mon.a... 2023-09-21T00:16:08.637 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-09-21T00:16:08.699 INFO:tasks.ceph:Copying monmap to all nodes... 2023-09-21T00:16:08.699 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-21T00:16:08.700 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-09-21T00:16:08.717 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-21T00:16:08.717 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-09-21T00:16:08.773 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi059.front.sepia.ceph.com 2023-09-21T00:16:08.774 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-21T00:16:08.774 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/ceph/ceph.keyring 2023-09-21T00:16:08.774 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-21T00:16:08.851 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-21T00:16:08.851 DEBUG:teuthology.orchestra.run.smithi059:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-09-21T00:16:08.907 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi083.front.sepia.ceph.com 2023-09-21T00:16:08.908 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-09-21T00:16:08.909 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/ceph/ceph.keyring 2023-09-21T00:16:08.909 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-21T00:16:08.945 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-09-21T00:16:08.946 DEBUG:teuthology.orchestra.run.smithi083:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-09-21T00:16:09.002 INFO:tasks.ceph:Setting up mon nodes... 2023-09-21T00:16:09.003 INFO:tasks.ceph:Setting up mgr nodes... 2023-09-21T00:16:09.003 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-09-21T00:16:09.058 INFO:teuthology.orchestra.run.smithi059.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-09-21T00:16:09.061 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-09-21T00:16:09.126 INFO:teuthology.orchestra.run.smithi083.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-09-21T00:16:09.127 INFO:tasks.ceph:Setting up mds nodes... 2023-09-21T00:16:09.127 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-09-21T00:16:09.184 INFO:teuthology.orchestra.run.smithi059.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-09-21T00:16:09.187 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-09-21T00:16:09.215 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-09-21T00:16:09.311 INFO:teuthology.orchestra.run.smithi059.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-09-21T00:16:09.312 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-09-21T00:16:09.340 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-09-21T00:16:09.392 INFO:teuthology.orchestra.run.smithi083.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-09-21T00:16:09.395 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-09-21T00:16:09.421 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-09-21T00:16:09.515 INFO:teuthology.orchestra.run.smithi083.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-09-21T00:16:09.517 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-09-21T00:16:09.543 INFO:tasks.ceph_client:Setting up client nodes... 2023-09-21T00:16:09.544 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-09-21T00:16:09.589 INFO:teuthology.orchestra.run.smithi059.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-09-21T00:16:09.603 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-09-21T00:16:09.647 INFO:teuthology.orchestra.run.smithi059.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-09-21T00:16:09.660 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-09-21T00:16:09.703 INFO:teuthology.orchestra.run.smithi083.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-09-21T00:16:09.716 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-09-21T00:16:09.798 INFO:teuthology.orchestra.run.smithi083.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-09-21T00:16:09.811 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-09-21T00:16:09.811 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi059.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi083.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-09-21T00:16:09.812 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-09-21T00:16:09.840 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-21T00:16:09.840 INFO:tasks.ceph:role: osd.0 2023-09-21T00:16:09.841 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi059.front.sepia.ceph.com 2023-09-21T00:16:09.841 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-09-21T00:16:09.915 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-09-21T00:16:09.916 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-21T00:16:09.916 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-21T00:16:09.916 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-21T00:16:09.916 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-21T00:16:09.916 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2023-09-21T00:16:09.917 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-21T00:16:09.917 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-21T00:16:09.917 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-21T00:16:09.917 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-21T00:16:10.350 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2023-09-21T00:16:10.352 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2023-09-21T00:16:10.353 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-09-21T00:16:10.534 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-09-21T00:16:10.570 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-09-21T00:16:10.639 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-21T00:16:10.640 INFO:tasks.ceph:role: osd.1 2023-09-21T00:16:10.640 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi059.front.sepia.ceph.com 2023-09-21T00:16:10.641 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-09-21T00:16:10.715 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-09-21T00:16:10.716 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-21T00:16:10.716 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-21T00:16:10.716 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-21T00:16:10.716 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-21T00:16:10.717 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2023-09-21T00:16:10.717 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-21T00:16:10.717 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-21T00:16:10.717 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-21T00:16:10.717 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-21T00:16:11.138 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2023-09-21T00:16:11.140 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2023-09-21T00:16:11.140 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-09-21T00:16:11.246 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-09-21T00:16:11.282 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-09-21T00:16:11.353 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-21T00:16:11.353 INFO:tasks.ceph:role: osd.2 2023-09-21T00:16:11.353 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi059.front.sepia.ceph.com 2023-09-21T00:16:11.354 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-09-21T00:16:11.430 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-09-21T00:16:11.430 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-21T00:16:11.430 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-21T00:16:11.430 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-21T00:16:11.431 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-21T00:16:11.431 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2023-09-21T00:16:11.431 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-21T00:16:11.431 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-21T00:16:11.431 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-21T00:16:11.432 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-21T00:16:11.878 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2023-09-21T00:16:11.881 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2023-09-21T00:16:11.881 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-09-21T00:16:12.056 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-09-21T00:16:12.095 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-09-21T00:16:12.166 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-21T00:16:12.166 INFO:tasks.ceph:role: osd.3 2023-09-21T00:16:12.166 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi059.front.sepia.ceph.com 2023-09-21T00:16:12.167 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-09-21T00:16:12.244 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-09-21T00:16:12.244 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-21T00:16:12.244 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-21T00:16:12.244 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-21T00:16:12.245 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-21T00:16:12.245 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2023-09-21T00:16:12.245 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-21T00:16:12.245 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-21T00:16:12.245 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-21T00:16:12.246 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-21T00:16:12.676 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2023-09-21T00:16:12.678 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2023-09-21T00:16:12.678 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-09-21T00:16:12.851 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-09-21T00:16:12.888 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-21T00:16:12.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:12.996+0000 7f759658e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-09-21T00:16:12.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:12.997+0000 7f759658e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-09-21T00:16:12.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:12.997+0000 7f759658e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-21T00:16:12.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:12.997+0000 7f759658e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-21T00:16:12.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:12.997+0000 7f759658e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-21T00:16:12.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:12.997+0000 7f759658e640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-09-21T00:16:15.866 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-09-21T00:16:15.898 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-21T00:16:15.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:15.992+0000 7f696353b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-09-21T00:16:15.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:15.992+0000 7f696353b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-09-21T00:16:15.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:15.992+0000 7f696353b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-21T00:16:15.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:15.992+0000 7f696353b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-21T00:16:15.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:15.992+0000 7f696353b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-21T00:16:15.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:15.993+0000 7f696353b640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-09-21T00:16:18.863 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-09-21T00:16:18.898 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-21T00:16:18.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:18.991+0000 7fa5e44eb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-09-21T00:16:18.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:18.991+0000 7fa5e44eb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-09-21T00:16:18.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:18.991+0000 7fa5e44eb640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-21T00:16:18.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:18.991+0000 7fa5e44eb640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-21T00:16:18.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:18.991+0000 7fa5e44eb640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-21T00:16:18.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:18.992+0000 7fa5e44eb640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-09-21T00:16:21.862 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-09-21T00:16:21.896 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-21T00:16:21.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:21.988+0000 7f69586bd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-09-21T00:16:21.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:21.989+0000 7f69586bd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-09-21T00:16:21.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:21.989+0000 7f69586bd640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-09-21T00:16:21.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:21.989+0000 7f69586bd640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-09-21T00:16:21.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:21.989+0000 7f69586bd640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-09-21T00:16:21.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:21.989+0000 7f69586bd640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-09-21T00:16:24.866 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-09-21T00:16:24.899 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-09-21T00:16:24.933 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-21T00:16:24.933 INFO:tasks.ceph:role: osd.4 2023-09-21T00:16:24.933 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi083.front.sepia.ceph.com 2023-09-21T00:16:24.934 DEBUG:teuthology.orchestra.run.smithi083:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-09-21T00:16:25.010 INFO:teuthology.orchestra.run.smithi083.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-09-21T00:16:25.011 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-21T00:16:25.011 INFO:teuthology.orchestra.run.smithi083.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-21T00:16:25.012 INFO:teuthology.orchestra.run.smithi083.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-21T00:16:25.012 INFO:teuthology.orchestra.run.smithi083.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-21T00:16:25.012 INFO:teuthology.orchestra.run.smithi083.stdout: = sunit=0 swidth=0 blks 2023-09-21T00:16:25.013 INFO:teuthology.orchestra.run.smithi083.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-21T00:16:25.013 INFO:teuthology.orchestra.run.smithi083.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-21T00:16:25.014 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-21T00:16:25.014 INFO:teuthology.orchestra.run.smithi083.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-21T00:16:25.449 INFO:teuthology.orchestra.run.smithi083.stdout:Discarding blocks...Done. 2023-09-21T00:16:25.451 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi083.front.sepia.ceph.com -o noatime 2023-09-21T00:16:25.451 DEBUG:teuthology.orchestra.run.smithi083:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-09-21T00:16:25.648 DEBUG:teuthology.orchestra.run.smithi083:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-09-21T00:16:25.685 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-09-21T00:16:25.754 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-21T00:16:25.755 INFO:tasks.ceph:role: osd.5 2023-09-21T00:16:25.755 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi083.front.sepia.ceph.com 2023-09-21T00:16:25.755 DEBUG:teuthology.orchestra.run.smithi083:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-09-21T00:16:25.830 INFO:teuthology.orchestra.run.smithi083.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-09-21T00:16:25.830 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-21T00:16:25.830 INFO:teuthology.orchestra.run.smithi083.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-21T00:16:25.831 INFO:teuthology.orchestra.run.smithi083.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-21T00:16:25.831 INFO:teuthology.orchestra.run.smithi083.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-21T00:16:25.831 INFO:teuthology.orchestra.run.smithi083.stdout: = sunit=0 swidth=0 blks 2023-09-21T00:16:25.831 INFO:teuthology.orchestra.run.smithi083.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-21T00:16:25.831 INFO:teuthology.orchestra.run.smithi083.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-21T00:16:25.832 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-21T00:16:25.832 INFO:teuthology.orchestra.run.smithi083.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-21T00:16:26.247 INFO:teuthology.orchestra.run.smithi083.stdout:Discarding blocks...Done. 2023-09-21T00:16:26.249 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi083.front.sepia.ceph.com -o noatime 2023-09-21T00:16:26.249 DEBUG:teuthology.orchestra.run.smithi083:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-09-21T00:16:26.353 DEBUG:teuthology.orchestra.run.smithi083:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-09-21T00:16:26.386 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-09-21T00:16:26.455 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-21T00:16:26.455 INFO:tasks.ceph:role: osd.6 2023-09-21T00:16:26.456 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi083.front.sepia.ceph.com 2023-09-21T00:16:26.456 DEBUG:teuthology.orchestra.run.smithi083:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-09-21T00:16:26.531 INFO:teuthology.orchestra.run.smithi083.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-09-21T00:16:26.531 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-21T00:16:26.531 INFO:teuthology.orchestra.run.smithi083.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-21T00:16:26.532 INFO:teuthology.orchestra.run.smithi083.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-21T00:16:26.532 INFO:teuthology.orchestra.run.smithi083.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-21T00:16:26.532 INFO:teuthology.orchestra.run.smithi083.stdout: = sunit=0 swidth=0 blks 2023-09-21T00:16:26.532 INFO:teuthology.orchestra.run.smithi083.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-21T00:16:26.532 INFO:teuthology.orchestra.run.smithi083.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-21T00:16:26.533 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-21T00:16:26.533 INFO:teuthology.orchestra.run.smithi083.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-21T00:16:26.974 INFO:teuthology.orchestra.run.smithi083.stdout:Discarding blocks...Done. 2023-09-21T00:16:26.976 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi083.front.sepia.ceph.com -o noatime 2023-09-21T00:16:26.976 DEBUG:teuthology.orchestra.run.smithi083:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-09-21T00:16:27.142 DEBUG:teuthology.orchestra.run.smithi083:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-09-21T00:16:27.177 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-09-21T00:16:27.246 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-21T00:16:27.247 INFO:tasks.ceph:role: osd.7 2023-09-21T00:16:27.247 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi083.front.sepia.ceph.com 2023-09-21T00:16:27.247 DEBUG:teuthology.orchestra.run.smithi083:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-09-21T00:16:27.321 INFO:teuthology.orchestra.run.smithi083.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-09-21T00:16:27.322 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-21T00:16:27.322 INFO:teuthology.orchestra.run.smithi083.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-21T00:16:27.322 INFO:teuthology.orchestra.run.smithi083.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-21T00:16:27.323 INFO:teuthology.orchestra.run.smithi083.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-21T00:16:27.323 INFO:teuthology.orchestra.run.smithi083.stdout: = sunit=0 swidth=0 blks 2023-09-21T00:16:27.323 INFO:teuthology.orchestra.run.smithi083.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-21T00:16:27.323 INFO:teuthology.orchestra.run.smithi083.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-21T00:16:27.323 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-21T00:16:27.323 INFO:teuthology.orchestra.run.smithi083.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-21T00:16:27.756 INFO:teuthology.orchestra.run.smithi083.stdout:Discarding blocks...Done. 2023-09-21T00:16:27.758 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi083.front.sepia.ceph.com -o noatime 2023-09-21T00:16:27.758 DEBUG:teuthology.orchestra.run.smithi083:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-09-21T00:16:27.944 DEBUG:teuthology.orchestra.run.smithi083:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-09-21T00:16:27.978 DEBUG:teuthology.orchestra.run.smithi083:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-21T00:16:28.087 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:28.086+0000 7f87d27eb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-09-21T00:16:28.088 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:28.087+0000 7f87d27eb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-09-21T00:16:28.088 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:28.087+0000 7f87d27eb640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-09-21T00:16:28.088 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:28.087+0000 7f87d27eb640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-09-21T00:16:28.089 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:28.087+0000 7f87d27eb640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-09-21T00:16:28.089 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:28.088+0000 7f87d27eb640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-09-21T00:16:30.947 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-09-21T00:16:30.979 DEBUG:teuthology.orchestra.run.smithi083:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-21T00:16:31.070 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:31.068+0000 7f91966ba640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-09-21T00:16:31.071 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:31.068+0000 7f91966ba640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-09-21T00:16:31.071 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:31.068+0000 7f91966ba640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-09-21T00:16:31.071 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:31.068+0000 7f91966ba640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-09-21T00:16:31.071 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:31.068+0000 7f91966ba640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-09-21T00:16:31.072 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:31.068+0000 7f91966ba640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-09-21T00:16:33.933 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-09-21T00:16:33.965 DEBUG:teuthology.orchestra.run.smithi083:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-21T00:16:34.058 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:34.055+0000 7fa5a7f7e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-09-21T00:16:34.058 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:34.056+0000 7fa5a7f7e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-09-21T00:16:34.058 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:34.056+0000 7fa5a7f7e640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-09-21T00:16:34.059 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:34.056+0000 7fa5a7f7e640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-09-21T00:16:34.059 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:34.056+0000 7fa5a7f7e640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-09-21T00:16:34.059 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:34.056+0000 7fa5a7f7e640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-09-21T00:16:36.504 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:16:36.507 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:16:36.921 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-09-21T00:16:36.952 DEBUG:teuthology.orchestra.run.smithi083:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-21T00:16:37.042 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:37.041+0000 7fe835ea3640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-09-21T00:16:37.043 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:37.041+0000 7fe835ea3640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-09-21T00:16:37.043 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:37.041+0000 7fe835ea3640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-09-21T00:16:37.043 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:37.041+0000 7fe835ea3640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-09-21T00:16:37.043 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:37.041+0000 7fe835ea3640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-09-21T00:16:37.044 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:37.042+0000 7fe835ea3640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-09-21T00:16:39.905 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-09-21T00:16:39.941 INFO:tasks.ceph:Reading keys from all nodes... 2023-09-21T00:16:39.941 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-21T00:16:39.942 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-09-21T00:16:39.974 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-21T00:16:39.975 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-09-21T00:16:40.046 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-21T00:16:40.046 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-09-21T00:16:40.118 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-21T00:16:40.119 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-09-21T00:16:40.189 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-21T00:16:40.189 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-09-21T00:16:40.258 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-21T00:16:40.259 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-09-21T00:16:40.329 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-21T00:16:40.329 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-09-21T00:16:40.398 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-09-21T00:16:40.399 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-09-21T00:16:40.430 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-09-21T00:16:40.431 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-09-21T00:16:40.501 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-09-21T00:16:40.501 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-09-21T00:16:40.570 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-09-21T00:16:40.570 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-09-21T00:16:40.639 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-09-21T00:16:40.639 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-09-21T00:16:40.707 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-09-21T00:16:40.708 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-09-21T00:16:40.775 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-09-21T00:16:40.776 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-09-21T00:16:40.843 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-21T00:16:40.844 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-09-21T00:16:40.865 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-21T00:16:40.866 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-09-21T00:16:40.931 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-09-21T00:16:40.932 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-09-21T00:16:40.954 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-09-21T00:16:40.954 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-09-21T00:16:41.011 INFO:tasks.ceph:Adding keys to all mons... 2023-09-21T00:16:41.012 DEBUG:teuthology.orchestra.run.smithi059:> sudo tee -a /etc/ceph/ceph.keyring 2023-09-21T00:16:41.014 DEBUG:teuthology.orchestra.run.smithi083:> sudo tee -a /etc/ceph/ceph.keyring 2023-09-21T00:16:41.055 INFO:teuthology.orchestra.run.smithi059.stdout:[mgr.y] 2023-09-21T00:16:41.055 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQBJiwtliA59AxAAY2guFGI8Yu3PZylz8SCj5g== 2023-09-21T00:16:41.056 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.a] 2023-09-21T00:16:41.056 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQBJiwtlw0D+ChAAWfcndBINTMXjx+hl+CSizA== 2023-09-21T00:16:41.056 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.c] 2023-09-21T00:16:41.056 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQBJiwtl4SZ2EhAAf597HcUEY3SYJsl63hTxlw== 2023-09-21T00:16:41.056 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.0] 2023-09-21T00:16:41.057 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQBMiwtljCl3OxAAlNRfHJ4T3itWD1mIjDFbHw== 2023-09-21T00:16:41.057 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.1] 2023-09-21T00:16:41.057 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQBPiwtlaqA0OxAA7e3B6okqEmKPgmROIWPjjQ== 2023-09-21T00:16:41.057 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.2] 2023-09-21T00:16:41.057 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQBSiwtlhzwkOxAAuTVjW095MdBpNBwmiQ9jNA== 2023-09-21T00:16:41.058 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.3] 2023-09-21T00:16:41.058 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQBViwtllM3+OhAANZQ3XCplUbMwMuwz1EzTOw== 2023-09-21T00:16:41.058 INFO:teuthology.orchestra.run.smithi059.stdout:[mgr.x] 2023-09-21T00:16:41.058 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQBJiwtlCfhmBxAAXsEbdz8lcIAeprDYoD11rw== 2023-09-21T00:16:41.059 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.b] 2023-09-21T00:16:41.059 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQBJiwtlCZZuFxAAUEckIhIAwgw2pM6+lr3evA== 2023-09-21T00:16:41.059 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.d] 2023-09-21T00:16:41.059 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQBJiwtleyWzHhAA3sdBK+gE6tcuXwVflkkgqg== 2023-09-21T00:16:41.060 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.4] 2023-09-21T00:16:41.060 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQBciwtlx8s1BRAABZhHLkVd3RqIuaGiUNvN5w== 2023-09-21T00:16:41.060 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.5] 2023-09-21T00:16:41.060 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQBfiwtl4VgsBBAAcKu8F4OdWkgJTcyps7Q7Eg== 2023-09-21T00:16:41.061 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.6] 2023-09-21T00:16:41.061 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQBiiwtlwvpyAxAATqz42Ry1jrYUNB/L0irmuA== 2023-09-21T00:16:41.061 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.7] 2023-09-21T00:16:41.061 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQBliwtlxKqFAhAAwQLX/F6vM4vKGMrcHGhdbQ== 2023-09-21T00:16:41.062 INFO:teuthology.orchestra.run.smithi059.stdout:[client.0] 2023-09-21T00:16:41.062 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQBJiwtlXkIrIxAAhtDnCTE6nihKV14aqR/afg== 2023-09-21T00:16:41.062 INFO:teuthology.orchestra.run.smithi059.stdout:[client.2] 2023-09-21T00:16:41.062 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQBJiwtlglecJhAAPPz7tn6HVHQPEuxtRq8BdQ== 2023-09-21T00:16:41.063 INFO:teuthology.orchestra.run.smithi059.stdout:[client.1] 2023-09-21T00:16:41.063 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQBJiwtlUFb0KRAAcCweHS3wKHtVlWpG5YnRmw== 2023-09-21T00:16:41.063 INFO:teuthology.orchestra.run.smithi059.stdout:[client.3] 2023-09-21T00:16:41.063 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQBJiwtl78SdLxAA7Ub9eUe/K5DuRCQocyzOfw== 2023-09-21T00:16:41.078 INFO:teuthology.orchestra.run.smithi083.stdout:[mgr.y] 2023-09-21T00:16:41.078 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQBJiwtliA59AxAAY2guFGI8Yu3PZylz8SCj5g== 2023-09-21T00:16:41.078 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.a] 2023-09-21T00:16:41.078 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQBJiwtlw0D+ChAAWfcndBINTMXjx+hl+CSizA== 2023-09-21T00:16:41.079 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.c] 2023-09-21T00:16:41.079 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQBJiwtl4SZ2EhAAf597HcUEY3SYJsl63hTxlw== 2023-09-21T00:16:41.079 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.0] 2023-09-21T00:16:41.079 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQBMiwtljCl3OxAAlNRfHJ4T3itWD1mIjDFbHw== 2023-09-21T00:16:41.079 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.1] 2023-09-21T00:16:41.080 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQBPiwtlaqA0OxAA7e3B6okqEmKPgmROIWPjjQ== 2023-09-21T00:16:41.080 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.2] 2023-09-21T00:16:41.080 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQBSiwtlhzwkOxAAuTVjW095MdBpNBwmiQ9jNA== 2023-09-21T00:16:41.080 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.3] 2023-09-21T00:16:41.080 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQBViwtllM3+OhAANZQ3XCplUbMwMuwz1EzTOw== 2023-09-21T00:16:41.081 INFO:teuthology.orchestra.run.smithi083.stdout:[mgr.x] 2023-09-21T00:16:41.081 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQBJiwtlCfhmBxAAXsEbdz8lcIAeprDYoD11rw== 2023-09-21T00:16:41.081 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.b] 2023-09-21T00:16:41.081 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQBJiwtlCZZuFxAAUEckIhIAwgw2pM6+lr3evA== 2023-09-21T00:16:41.081 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.d] 2023-09-21T00:16:41.082 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQBJiwtleyWzHhAA3sdBK+gE6tcuXwVflkkgqg== 2023-09-21T00:16:41.082 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.4] 2023-09-21T00:16:41.082 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQBciwtlx8s1BRAABZhHLkVd3RqIuaGiUNvN5w== 2023-09-21T00:16:41.082 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.5] 2023-09-21T00:16:41.082 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQBfiwtl4VgsBBAAcKu8F4OdWkgJTcyps7Q7Eg== 2023-09-21T00:16:41.083 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.6] 2023-09-21T00:16:41.083 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQBiiwtlwvpyAxAATqz42Ry1jrYUNB/L0irmuA== 2023-09-21T00:16:41.083 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.7] 2023-09-21T00:16:41.083 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQBliwtlxKqFAhAAwQLX/F6vM4vKGMrcHGhdbQ== 2023-09-21T00:16:41.083 INFO:teuthology.orchestra.run.smithi083.stdout:[client.0] 2023-09-21T00:16:41.083 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQBJiwtlXkIrIxAAhtDnCTE6nihKV14aqR/afg== 2023-09-21T00:16:41.084 INFO:teuthology.orchestra.run.smithi083.stdout:[client.2] 2023-09-21T00:16:41.084 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQBJiwtlglecJhAAPPz7tn6HVHQPEuxtRq8BdQ== 2023-09-21T00:16:41.084 INFO:teuthology.orchestra.run.smithi083.stdout:[client.1] 2023-09-21T00:16:41.084 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQBJiwtlUFb0KRAAcCweHS3wKHtVlWpG5YnRmw== 2023-09-21T00:16:41.084 INFO:teuthology.orchestra.run.smithi083.stdout:[client.3] 2023-09-21T00:16:41.085 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQBJiwtl78SdLxAA7Ub9eUe/K5DuRCQocyzOfw== 2023-09-21T00:16:41.086 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-21T00:16:41.107 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-21T00:16:41.179 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-21T00:16:41.182 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-21T00:16:41.242 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-21T00:16:41.244 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-21T00:16:41.302 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-21T00:16:41.305 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-21T00:16:41.359 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-21T00:16:41.362 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-21T00:16:41.415 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-21T00:16:41.417 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-21T00:16:41.470 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-21T00:16:41.472 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-21T00:16:41.525 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-21T00:16:41.527 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-21T00:16:41.580 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-21T00:16:41.583 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-21T00:16:41.639 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-21T00:16:41.643 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-21T00:16:41.699 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-21T00:16:41.701 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-21T00:16:41.755 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-21T00:16:41.757 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-21T00:16:41.810 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-21T00:16:41.813 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-21T00:16:41.865 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-21T00:16:41.868 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-21T00:16:41.921 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-21T00:16:41.924 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-21T00:16:41.980 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-21T00:16:41.983 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-21T00:16:42.039 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-21T00:16:42.042 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-21T00:16:42.098 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-21T00:16:42.101 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-21T00:16:42.157 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-09-21T00:16:42.158 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-09-21T00:16:42.185 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-21T00:16:42.285 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-09-21T00:16:42.313 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-09-21T00:16:42.339 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-21T00:16:42.438 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-09-21T00:16:42.464 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-09-21T00:16:42.531 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-21T00:16:42.628 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-09-21T00:16:42.655 DEBUG:teuthology.orchestra.run.smithi059:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-09-21T00:16:42.657 DEBUG:teuthology.orchestra.run.smithi083:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-09-21T00:16:42.711 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-09-21T00:16:42.712 INFO:tasks.ceph.mon.a:Restarting daemon 2023-09-21T00:16:42.712 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-09-21T00:16:42.715 INFO:tasks.ceph.mon.a:Started 2023-09-21T00:16:42.716 INFO:tasks.ceph.mon.b:Restarting daemon 2023-09-21T00:16:42.716 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-09-21T00:16:42.754 INFO:tasks.ceph.mon.b:Started 2023-09-21T00:16:42.755 INFO:tasks.ceph.mon.c:Restarting daemon 2023-09-21T00:16:42.755 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-09-21T00:16:42.757 INFO:tasks.ceph.mon.c:Started 2023-09-21T00:16:42.757 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-09-21T00:16:42.758 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-09-21T00:16:42.758 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-09-21T00:16:42.760 INFO:tasks.ceph.mgr.y:Started 2023-09-21T00:16:42.761 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-09-21T00:16:42.761 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-09-21T00:16:42.763 INFO:tasks.ceph.mgr.x:Started 2023-09-21T00:16:42.763 INFO:tasks.ceph:Setting crush tunables to default 2023-09-21T00:16:42.764 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd crush tunables default 2023-09-21T00:16:42.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:42.888+0000 7f5ca7b4f700 1 Processor -- start 2023-09-21T00:16:42.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:42.888+0000 7f5ca7b4f700 1 -- start start 2023-09-21T00:16:42.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:42.889+0000 7f5ca7b4f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5ca0161b60 0x7f5ca00700f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:42.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:42.889+0000 7f5ca7b4f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ca0070630 0x7f5ca00ced30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:42.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:42.889+0000 7f5ca7b4f700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5ca00cf270 0x7f5ca015a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:42.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:42.889+0000 7f5ca7b4f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ca00cf700 con 0x7f5ca0161b60 2023-09-21T00:16:42.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:42.889+0000 7f5ca7b4f700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ca015e850 con 0x7f5ca00cf270 2023-09-21T00:16:42.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:42.889+0000 7f5ca7b4f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca015df20 con 0x7f5ca0070630 2023-09-21T00:16:42.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:42.889+0000 7f5ca58eb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5ca0161b60 0x7f5ca00700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:42.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:42.889+0000 7f5ca58eb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5ca0161b60 0x7f5ca00700f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50422/0 (socket says 172.21.15.59:50422) 2023-09-21T00:16:42.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:42.889+0000 7f5ca58eb700 1 -- 172.21.15.59:0/1047767281 learned_addr learned my addr 172.21.15.59:0/1047767281 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:16:42.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:42.889+0000 7f5ca50ea700 1 --2- 172.21.15.59:0/1047767281 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ca0070630 0x7f5ca00ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:42.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:42.889+0000 7f5ca60ec700 1 --2- 172.21.15.59:0/1047767281 >> v2:172.21.15.83:3300/0 conn(0x7f5ca00cf270 0x7f5ca015a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:42.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:42.889+0000 7f5ca58eb700 1 -- 172.21.15.59:0/1047767281 >> v2:172.21.15.59:3300/0 conn(0x7f5ca0161b60 msgr2=0x7f5ca00700f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-21T00:16:42.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:42.889+0000 7f5ca58eb700 1 -- 172.21.15.59:0/1047767281 >> v2:172.21.15.59:3300/0 conn(0x7f5ca0161b60 msgr2=0x7f5ca00700f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-21T00:16:42.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:42.889+0000 7f5ca58eb700 1 --2- 172.21.15.59:0/1047767281 >> v2:172.21.15.59:3300/0 conn(0x7f5ca0161b60 0x7f5ca00700f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-21T00:16:42.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:42.889+0000 7f5ca50ea700 1 -- 172.21.15.59:0/1047767281 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ca0070630 msgr2=0x7f5ca00ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-09-21T00:16:42.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:42.889+0000 7f5ca50ea700 1 -- 172.21.15.59:0/1047767281 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ca0070630 msgr2=0x7f5ca00ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-21T00:16:42.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:42.889+0000 7f5ca58eb700 1 --2- 172.21.15.59:0/1047767281 >> v2:172.21.15.59:3300/0 conn(0x7f5ca0161b60 0x7f5ca00700f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-21T00:16:42.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:42.889+0000 7f5ca50ea700 1 --2- 172.21.15.59:0/1047767281 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ca0070630 0x7f5ca00ced30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-21T00:16:42.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:42.889+0000 7f5ca50ea700 1 --2- 172.21.15.59:0/1047767281 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ca0070630 0x7f5ca00ced30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-21T00:16:42.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:42.889+0000 7f5ca60ec700 1 -- 172.21.15.59:0/1047767281 >> v2:172.21.15.83:3300/0 conn(0x7f5ca00cf270 msgr2=0x7f5ca015a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-09-21T00:16:42.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:42.889+0000 7f5ca60ec700 1 -- 172.21.15.59:0/1047767281 >> v2:172.21.15.83:3300/0 conn(0x7f5ca00cf270 msgr2=0x7f5ca015a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-21T00:16:42.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:42.889+0000 7f5ca60ec700 1 --2- 172.21.15.59:0/1047767281 >> v2:172.21.15.83:3300/0 conn(0x7f5ca00cf270 0x7f5ca015a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-21T00:16:42.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:42.889+0000 7f5ca60ec700 1 --2- 172.21.15.59:0/1047767281 >> v2:172.21.15.83:3300/0 conn(0x7f5ca00cf270 0x7f5ca015a7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-21T00:16:43.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.090+0000 7f5ca58eb700 1 --2- 172.21.15.59:0/1047767281 >> v2:172.21.15.59:3300/0 conn(0x7f5ca0161b60 0x7f5ca00700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:43.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.090+0000 7f5ca50ea700 1 --2- 172.21.15.59:0/1047767281 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ca0070630 0x7f5ca00ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:43.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.090+0000 7f5ca60ec700 1 --2- 172.21.15.59:0/1047767281 >> v2:172.21.15.83:3300/0 conn(0x7f5ca00cf270 0x7f5ca015a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:43.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.090+0000 7f5ca58eb700 1 -- 172.21.15.59:0/1047767281 >> v2:172.21.15.59:3300/0 conn(0x7f5ca0161b60 msgr2=0x7f5ca00700f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-21T00:16:43.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.090+0000 7f5ca58eb700 1 -- 172.21.15.59:0/1047767281 >> v2:172.21.15.59:3300/0 conn(0x7f5ca0161b60 msgr2=0x7f5ca00700f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-21T00:16:43.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.090+0000 7f5ca58eb700 1 --2- 172.21.15.59:0/1047767281 >> v2:172.21.15.59:3300/0 conn(0x7f5ca0161b60 0x7f5ca00700f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-21T00:16:43.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.090+0000 7f5ca58eb700 1 --2- 172.21.15.59:0/1047767281 >> v2:172.21.15.59:3300/0 conn(0x7f5ca0161b60 0x7f5ca00700f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-09-21T00:16:43.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.090+0000 7f5ca50ea700 1 -- 172.21.15.59:0/1047767281 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ca0070630 msgr2=0x7f5ca00ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-09-21T00:16:43.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.090+0000 7f5ca50ea700 1 -- 172.21.15.59:0/1047767281 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ca0070630 msgr2=0x7f5ca00ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-21T00:16:43.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.090+0000 7f5ca50ea700 1 --2- 172.21.15.59:0/1047767281 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ca0070630 0x7f5ca00ced30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-21T00:16:43.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.090+0000 7f5ca50ea700 1 --2- 172.21.15.59:0/1047767281 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ca0070630 0x7f5ca00ced30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-09-21T00:16:43.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.090+0000 7f5ca60ec700 1 -- 172.21.15.59:0/1047767281 >> v2:172.21.15.83:3300/0 conn(0x7f5ca00cf270 msgr2=0x7f5ca015a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-09-21T00:16:43.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.090+0000 7f5ca60ec700 1 -- 172.21.15.59:0/1047767281 >> v2:172.21.15.83:3300/0 conn(0x7f5ca00cf270 msgr2=0x7f5ca015a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-21T00:16:43.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.090+0000 7f5ca60ec700 1 --2- 172.21.15.59:0/1047767281 >> v2:172.21.15.83:3300/0 conn(0x7f5ca00cf270 0x7f5ca015a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-21T00:16:43.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.090+0000 7f5ca60ec700 1 --2- 172.21.15.59:0/1047767281 >> v2:172.21.15.83:3300/0 conn(0x7f5ca00cf270 0x7f5ca015a7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-09-21T00:16:43.210 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-09-21T00:16:43.209+0000 7f546869e200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-21T00:16:43.215 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-09-21T00:16:43.213+0000 7f95ffd18200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-21T00:16:43.275 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-09-21T00:16:43.274+0000 7f546869e200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-21T00:16:43.283 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-09-21T00:16:43.282+0000 7f95ffd18200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-21T00:16:43.350 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-09-21T00:16:43.349+0000 7f546869e200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-21T00:16:43.363 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-09-21T00:16:43.361+0000 7f95ffd18200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-21T00:16:43.427 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-09-21T00:16:43.426+0000 7f546869e200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-21T00:16:43.445 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-09-21T00:16:43.443+0000 7f95ffd18200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-21T00:16:43.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.491+0000 7f5ca58eb700 1 --2- 172.21.15.59:0/1047767281 >> v2:172.21.15.59:3300/0 conn(0x7f5ca0161b60 0x7f5ca00700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:43.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.491+0000 7f5ca50ea700 1 --2- 172.21.15.59:0/1047767281 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ca0070630 0x7f5ca00ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:43.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.491+0000 7f5ca60ec700 1 --2- 172.21.15.59:0/1047767281 >> v2:172.21.15.83:3300/0 conn(0x7f5ca00cf270 0x7f5ca015a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:43.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.491+0000 7f5ca58eb700 1 -- 172.21.15.59:0/1047767281 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ca0070630 msgr2=0x7f5ca00ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:16:43.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.491+0000 7f5ca58eb700 1 --2- 172.21.15.59:0/1047767281 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ca0070630 0x7f5ca00ced30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:43.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.491+0000 7f5ca58eb700 1 -- 172.21.15.59:0/1047767281 >> v2:172.21.15.83:3300/0 conn(0x7f5ca00cf270 msgr2=0x7f5ca015a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:16:43.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.491+0000 7f5ca58eb700 1 --2- 172.21.15.59:0/1047767281 >> v2:172.21.15.83:3300/0 conn(0x7f5ca00cf270 0x7f5ca015a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:43.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.491+0000 7f5ca58eb700 1 -- 172.21.15.59:0/1047767281 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca015e200 con 0x7f5ca0161b60 2023-09-21T00:16:43.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.491+0000 7f5ca60ec700 1 --2- 172.21.15.59:0/1047767281 >> v2:172.21.15.83:3300/0 conn(0x7f5ca00cf270 0x7f5ca015a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T00:16:43.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.491+0000 7f5ca58eb700 1 --2- 172.21.15.59:0/1047767281 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ca0161b60 0x7f5ca00700f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5ca00d0c10 tx=0x7f5c98009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7197d6c688cd65a4 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:16:43.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.491+0000 7f5ca48e9700 1 -- 172.21.15.59:0/1047767281 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c98004020 con 0x7f5ca0161b60 2023-09-21T00:16:43.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.491+0000 7f5ca48e9700 1 -- 172.21.15.59:0/1047767281 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9800c050 con 0x7f5ca0161b60 2023-09-21T00:16:43.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.491+0000 7f5ca48e9700 1 -- 172.21.15.59:0/1047767281 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c980043a0 con 0x7f5ca0161b60 2023-09-21T00:16:43.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.492+0000 7f5ca7b4f700 1 -- 172.21.15.59:0/1047767281 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ca0161b60 msgr2=0x7f5ca00700f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:43.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.492+0000 7f5ca7b4f700 1 --2- 172.21.15.59:0/1047767281 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ca0161b60 0x7f5ca00700f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5ca00d0c10 tx=0x7f5c98009c50 comp rx=0 tx=0).stop 2023-09-21T00:16:43.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.492+0000 7f5ca7b4f700 1 -- 172.21.15.59:0/1047767281 shutdown_connections 2023-09-21T00:16:43.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.492+0000 7f5ca7b4f700 1 --2- 172.21.15.59:0/1047767281 >> v2:172.21.15.83:3300/0 conn(0x7f5ca00cf270 0x7f5ca015a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:43.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.492+0000 7f5ca7b4f700 1 --2- 172.21.15.59:0/1047767281 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ca0161b60 0x7f5ca00700f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:43.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.492+0000 7f5ca7b4f700 1 --2- 172.21.15.59:0/1047767281 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ca0070630 0x7f5ca00ced30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:43.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.492+0000 7f5ca7b4f700 1 -- 172.21.15.59:0/1047767281 >> 172.21.15.59:0/1047767281 conn(0x7f5ca00d1160 msgr2=0x7f5ca00d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:16:43.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.492+0000 7f5ca7b4f700 1 -- 172.21.15.59:0/1047767281 shutdown_connections 2023-09-21T00:16:43.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.492+0000 7f5ca7b4f700 1 -- 172.21.15.59:0/1047767281 wait complete. 2023-09-21T00:16:43.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.494+0000 7f5ca7b4f700 1 Processor -- start 2023-09-21T00:16:43.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.494+0000 7f5ca7b4f700 1 -- start start 2023-09-21T00:16:43.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.494+0000 7f5ca7b4f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ca0070630 0x7f5ca00cbe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:43.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.494+0000 7f5ca7b4f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ca00cf270 0x7f5ca00c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:43.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.494+0000 7f5ca7b4f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ca0161b60 0x7f5ca01507c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:43.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.494+0000 7f5ca7b4f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca00c9810 con 0x7f5ca0161b60 2023-09-21T00:16:43.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.494+0000 7f5ca7b4f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca0150d00 con 0x7f5ca00cf270 2023-09-21T00:16:43.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.494+0000 7f5ca7b4f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca00c9a70 con 0x7f5ca0070630 2023-09-21T00:16:43.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.495+0000 7f5ca60ec700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ca0161b60 0x7f5ca01507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:43.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.495+0000 7f5ca58eb700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ca0070630 0x7f5ca00cbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:43.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.495+0000 7f5ca60ec700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ca0161b60 0x7f5ca01507c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50462/0 (socket says 172.21.15.59:50462) 2023-09-21T00:16:43.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.495+0000 7f5ca60ec700 1 -- 172.21.15.59:0/407621591 learned_addr learned my addr 172.21.15.59:0/407621591 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:16:43.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.495+0000 7f5ca50ea700 1 --2- 172.21.15.59:0/407621591 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ca00cf270 0x7f5ca00c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:43.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.495+0000 7f5ca60ec700 1 -- 172.21.15.59:0/407621591 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ca0070630 msgr2=0x7f5ca00cbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:43.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.495+0000 7f5ca60ec700 1 --2- 172.21.15.59:0/407621591 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ca0070630 0x7f5ca00cbe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:43.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.495+0000 7f5ca60ec700 1 -- 172.21.15.59:0/407621591 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ca00cf270 msgr2=0x7f5ca00c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:43.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.495+0000 7f5ca60ec700 1 --2- 172.21.15.59:0/407621591 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ca00cf270 0x7f5ca00c92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:43.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.495+0000 7f5ca60ec700 1 -- 172.21.15.59:0/407621591 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c90009640 con 0x7f5ca0161b60 2023-09-21T00:16:43.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.495+0000 7f5ca50ea700 1 --2- 172.21.15.59:0/407621591 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ca00cf270 0x7f5ca00c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T00:16:43.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.495+0000 7f5ca58eb700 1 --2- 172.21.15.59:0/407621591 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ca0070630 0x7f5ca00cbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T00:16:43.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.495+0000 7f5ca60ec700 1 --2- 172.21.15.59:0/407621591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ca0161b60 0x7f5ca01507c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5c900049d0 tx=0x7f5c90007610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:16:43.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.495+0000 7f5c9e7fc700 1 -- 172.21.15.59:0/407621591 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c900097d0 con 0x7f5ca0161b60 2023-09-21T00:16:43.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.495+0000 7f5c9e7fc700 1 -- 172.21.15.59:0/407621591 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9000f040 con 0x7f5ca0161b60 2023-09-21T00:16:43.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.495+0000 7f5ca7b4f700 1 -- 172.21.15.59:0/407621591 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c980095d0 con 0x7f5ca0161b60 2023-09-21T00:16:43.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.495+0000 7f5c9e7fc700 1 -- 172.21.15.59:0/407621591 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c900166a0 con 0x7f5ca0161b60 2023-09-21T00:16:43.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.495+0000 7f5ca7b4f700 1 -- 172.21.15.59:0/407621591 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ca00ca030 con 0x7f5ca0161b60 2023-09-21T00:16:43.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.495+0000 7f5c9e7fc700 1 -- 172.21.15.59:0/407621591 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5c90016b00 con 0x7f5ca0161b60 2023-09-21T00:16:43.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.495+0000 7f5c9e7fc700 1 -- 172.21.15.59:0/407621591 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5c9001fd80 con 0x7f5ca0161b60 2023-09-21T00:16:43.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.496+0000 7f5ca7b4f700 1 -- 172.21.15.59:0/407621591 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ca0067e50 con 0x7f5ca0161b60 2023-09-21T00:16:43.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.499+0000 7f5c9e7fc700 1 -- 172.21.15.59:0/407621591 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f5c9001a020 con 0x7f5ca0161b60 2023-09-21T00:16:43.570 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-09-21T00:16:43.569+0000 7f546869e200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-21T00:16:43.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.575+0000 7f5ca7b4f700 1 -- 172.21.15.59:0/407621591 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f5ca0070c80 con 0x7f5ca0161b60 2023-09-21T00:16:43.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.578+0000 7f5c9e7fc700 1 -- 172.21.15.59:0/407621591 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f5c9002c090 con 0x7f5ca0161b60 2023-09-21T00:16:43.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.579+0000 7f5ca7b4f700 1 -- 172.21.15.59:0/407621591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ca0161b60 msgr2=0x7f5ca01507c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:43.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.579+0000 7f5ca7b4f700 1 --2- 172.21.15.59:0/407621591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ca0161b60 0x7f5ca01507c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5c900049d0 tx=0x7f5c90007610 comp rx=0 tx=0).stop 2023-09-21T00:16:43.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.579+0000 7f5ca7b4f700 1 -- 172.21.15.59:0/407621591 shutdown_connections 2023-09-21T00:16:43.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.579+0000 7f5ca7b4f700 1 --2- 172.21.15.59:0/407621591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ca0161b60 0x7f5ca01507c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:43.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.579+0000 7f5ca7b4f700 1 --2- 172.21.15.59:0/407621591 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5ca0070630 0x7f5ca00cbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:43.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.579+0000 7f5ca7b4f700 1 --2- 172.21.15.59:0/407621591 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ca00cf270 0x7f5ca00c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:43.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.579+0000 7f5ca7b4f700 1 -- 172.21.15.59:0/407621591 >> 172.21.15.59:0/407621591 conn(0x7f5ca00d1160 msgr2=0x7f5ca00b5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:16:43.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.579+0000 7f5ca7b4f700 1 -- 172.21.15.59:0/407621591 shutdown_connections 2023-09-21T00:16:43.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:43.579+0000 7f5ca7b4f700 1 -- 172.21.15.59:0/407621591 wait complete. 2023-09-21T00:16:43.583 INFO:teuthology.orchestra.run.smithi059.stderr:adjusted tunables profile to default 2023-09-21T00:16:43.593 INFO:tasks.ceph:check_enable_crimson: False 2023-09-21T00:16:43.593 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-09-21T00:16:43.593 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-21T00:16:43.594 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-09-21T00:16:43.598 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-09-21T00:16:43.596+0000 7f95ffd18200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-21T00:16:43.621 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-21T00:16:43.622 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-09-21T00:16:43.689 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-21T00:16:43.689 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-09-21T00:16:43.756 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-21T00:16:43.756 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-09-21T00:16:43.822 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-09-21T00:16:43.822 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-09-21T00:16:43.848 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-09-21T00:16:43.849 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-09-21T00:16:43.915 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-09-21T00:16:43.915 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-09-21T00:16:43.963 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-09-21T00:16:43.962+0000 7f546869e200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-21T00:16:43.981 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-09-21T00:16:43.981 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-09-21T00:16:44.042 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-09-21T00:16:44.040+0000 7f95ffd18200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-21T00:16:44.048 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new d4b18344-74c0-4f75-920b-7a9247e48914 0 2023-09-21T00:16:44.086 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-09-21T00:16:44.085+0000 7f546869e200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-21T00:16:44.164 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-09-21T00:16:44.162+0000 7f95ffd18200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-21T00:16:44.176 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-09-21T00:16:44.175+0000 7f546869e200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-21T00:16:44.207 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.206+0000 7f836ac9e700 1 Processor -- start 2023-09-21T00:16:44.207 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.206+0000 7f836ac9e700 1 -- start start 2023-09-21T00:16:44.210 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.206+0000 7f836ac9e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f836415d520 0x7f83640cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:44.210 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.206+0000 7f836ac9e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8364072030 0x7f836406ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:44.210 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.206+0000 7f836ac9e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f836415d900 con 0x7f836406a780 2023-09-21T00:16:44.210 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.206+0000 7f836ac9e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83640724c0 con 0x7f8364072030 2023-09-21T00:16:44.210 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.206+0000 7f836ac9e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f836406b140 con 0x7f836415d520 2023-09-21T00:16:44.211 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.206+0000 7f8368a3a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f836415d520 0x7f83640cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:44.211 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.207+0000 7f8368a3a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f836415d520 0x7f83640cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.83:56262/0 (socket says 172.21.15.83:56262) 2023-09-21T00:16:44.211 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.207+0000 7f8368a3a700 1 -- 172.21.15.83:0/1500992925 learned_addr learned my addr 172.21.15.83:0/1500992925 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-09-21T00:16:44.211 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.207+0000 7f836923b700 1 --2- 172.21.15.83:0/1500992925 >> v2:172.21.15.59:3300/0 conn(0x7f8364072030 0x7f836406ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:44.212 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.207+0000 7f8368a3a700 1 -- 172.21.15.83:0/1500992925 >> v2:172.21.15.59:3300/0 conn(0x7f8364072030 msgr2=0x7f836406ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:16:44.212 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.207+0000 7f8368a3a700 1 --2- 172.21.15.83:0/1500992925 >> v2:172.21.15.59:3300/0 conn(0x7f8364072030 0x7f836406ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:44.212 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.207+0000 7f8368a3a700 1 -- 172.21.15.83:0/1500992925 >> v1:172.21.15.59:6789/0 conn(0x7f836406a780 legacy=0x7f8364071920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:44.212 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.207+0000 7f8368a3a700 1 -- 172.21.15.83:0/1500992925 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83640cdcb0 con 0x7f836415d520 2023-09-21T00:16:44.212 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.207+0000 7f8368a3a700 1 --2- 172.21.15.83:0/1500992925 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f836415d520 0x7f83640cea70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f83580098f0 tx=0x7f8358009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45e987f9b61748ee server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:16:44.212 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.207+0000 7f83637fe700 1 -- 172.21.15.83:0/1500992925 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8358011830 con 0x7f836415d520 2023-09-21T00:16:44.213 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.207+0000 7f83637fe700 1 -- 172.21.15.83:0/1500992925 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8358011990 con 0x7f836415d520 2023-09-21T00:16:44.213 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.207+0000 7f83637fe700 1 -- 172.21.15.83:0/1500992925 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8358011d20 con 0x7f836415d520 2023-09-21T00:16:44.213 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.208+0000 7f836ac9e700 1 -- 172.21.15.83:0/1500992925 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f836415d520 msgr2=0x7f83640cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:44.213 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.208+0000 7f836ac9e700 1 --2- 172.21.15.83:0/1500992925 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f836415d520 0x7f83640cea70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f83580098f0 tx=0x7f8358009c00 comp rx=0 tx=0).stop 2023-09-21T00:16:44.213 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.208+0000 7f836ac9e700 1 -- 172.21.15.83:0/1500992925 shutdown_connections 2023-09-21T00:16:44.214 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.208+0000 7f836ac9e700 1 --2- 172.21.15.83:0/1500992925 >> v2:172.21.15.59:3300/0 conn(0x7f8364072030 0x7f836406ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:44.214 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.208+0000 7f836ac9e700 1 --2- 172.21.15.83:0/1500992925 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f836415d520 0x7f83640cea70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:44.214 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.208+0000 7f836ac9e700 1 -- 172.21.15.83:0/1500992925 >> 172.21.15.83:0/1500992925 conn(0x7f83640d0040 msgr2=0x7f83640d0420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:16:44.214 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.208+0000 7f836ac9e700 1 -- 172.21.15.83:0/1500992925 shutdown_connections 2023-09-21T00:16:44.214 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.208+0000 7f836ac9e700 1 -- 172.21.15.83:0/1500992925 wait complete. 2023-09-21T00:16:44.215 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.209+0000 7f836ac9e700 1 Processor -- start 2023-09-21T00:16:44.215 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.209+0000 7f836ac9e700 1 -- start start 2023-09-21T00:16:44.217 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.210+0000 7f836ac9e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f836406a780 0x7f8364160a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:44.218 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.210+0000 7f836ac9e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8364072030 0x7f83640c7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:44.218 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.210+0000 7f836ac9e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f836415d520 0x7f8364154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:44.218 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.210+0000 7f836ac9e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8364155050 con 0x7f836415d520 2023-09-21T00:16:44.218 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.210+0000 7f836ac9e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836415ea90 con 0x7f836406a780 2023-09-21T00:16:44.219 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.210+0000 7f836ac9e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f836415e4d0 con 0x7f8364072030 2023-09-21T00:16:44.219 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.210+0000 7f8368a3a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f836406a780 0x7f8364160a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:44.219 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.210+0000 7f8363fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8364072030 0x7f83640c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:44.219 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.210+0000 7f8368a3a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f836406a780 0x7f8364160a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:36486/0 (socket says 172.21.15.83:36486) 2023-09-21T00:16:44.219 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.210+0000 7f8368a3a700 1 -- 172.21.15.83:0/3092965683 learned_addr learned my addr 172.21.15.83:0/3092965683 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-09-21T00:16:44.220 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.210+0000 7f836923b700 1 --2- 172.21.15.83:0/3092965683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f836415d520 0x7f8364154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:44.220 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.210+0000 7f8363fff700 1 -- 172.21.15.83:0/3092965683 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f836406a780 msgr2=0x7f8364160a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:44.220 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.210+0000 7f8363fff700 1 --2- 172.21.15.83:0/3092965683 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f836406a780 0x7f8364160a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:44.220 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.210+0000 7f8363fff700 1 -- 172.21.15.83:0/3092965683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f836415d520 msgr2=0x7f8364154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:44.220 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.210+0000 7f8363fff700 1 --2- 172.21.15.83:0/3092965683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f836415d520 0x7f8364154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:44.220 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.210+0000 7f8363fff700 1 -- 172.21.15.83:0/3092965683 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8358009550 con 0x7f8364072030 2023-09-21T00:16:44.221 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.210+0000 7f8368a3a700 1 --2- 172.21.15.83:0/3092965683 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f836406a780 0x7f8364160a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T00:16:44.221 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.210+0000 7f8363fff700 1 --2- 172.21.15.83:0/3092965683 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8364072030 0x7f83640c7110 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8350000f60 tx=0x7f835000c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:16:44.221 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.211+0000 7f83617fa700 1 -- 172.21.15.83:0/3092965683 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83500052d0 con 0x7f8364072030 2023-09-21T00:16:44.221 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.211+0000 7f83617fa700 1 -- 172.21.15.83:0/3092965683 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8350005430 con 0x7f8364072030 2023-09-21T00:16:44.222 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.211+0000 7f836ac9e700 1 -- 172.21.15.83:0/3092965683 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f836415e7b0 con 0x7f8364072030 2023-09-21T00:16:44.222 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.211+0000 7f83617fa700 1 -- 172.21.15.83:0/3092965683 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83500038c0 con 0x7f8364072030 2023-09-21T00:16:44.222 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.211+0000 7f836ac9e700 1 -- 172.21.15.83:0/3092965683 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83640b4df0 con 0x7f8364072030 2023-09-21T00:16:44.222 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.211+0000 7f83617fa700 1 -- 172.21.15.83:0/3092965683 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8350003d20 con 0x7f8364072030 2023-09-21T00:16:44.222 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.211+0000 7f83617fa700 1 -- 172.21.15.83:0/3092965683 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f835001c780 con 0x7f8364072030 2023-09-21T00:16:44.223 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.211+0000 7f836ac9e700 1 -- 172.21.15.83:0/3092965683 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8364066fd0 con 0x7f8364072030 2023-09-21T00:16:44.223 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.214+0000 7f83617fa700 1 -- 172.21.15.83:0/3092965683 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f8350017070 con 0x7f8364072030 2023-09-21T00:16:44.256 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-09-21T00:16:44.254+0000 7f95ffd18200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-21T00:16:44.261 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-09-21T00:16:44.260+0000 7f546869e200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-21T00:16:44.299 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.298+0000 7f836ac9e700 1 -- 172.21.15.83:0/3092965683 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d4b18344-74c0-4f75-920b-7a9247e48914", "id": 0} v 0) v1 -- 0x7f83641531b0 con 0x7f8364072030 2023-09-21T00:16:44.307 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.306+0000 7f83617fa700 1 -- 172.21.15.83:0/3092965683 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d4b18344-74c0-4f75-920b-7a9247e48914", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f83641531b0 con 0x7f8364072030 2023-09-21T00:16:44.308 INFO:teuthology.orchestra.run.smithi083.stdout:0 2023-09-21T00:16:44.309 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.306+0000 7f836ac9e700 1 -- 172.21.15.83:0/3092965683 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8364072030 msgr2=0x7f83640c7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:44.309 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.306+0000 7f836ac9e700 1 --2- 172.21.15.83:0/3092965683 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8364072030 0x7f83640c7110 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8350000f60 tx=0x7f835000c730 comp rx=0 tx=0).stop 2023-09-21T00:16:44.309 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.307+0000 7f836ac9e700 1 -- 172.21.15.83:0/3092965683 shutdown_connections 2023-09-21T00:16:44.310 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.307+0000 7f836ac9e700 1 --2- 172.21.15.83:0/3092965683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f836415d520 0x7f8364154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:44.310 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.307+0000 7f836ac9e700 1 --2- 172.21.15.83:0/3092965683 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f836406a780 0x7f8364160a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:44.311 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.307+0000 7f836ac9e700 1 --2- 172.21.15.83:0/3092965683 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8364072030 0x7f83640c7110 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:44.311 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.307+0000 7f836ac9e700 1 -- 172.21.15.83:0/3092965683 >> 172.21.15.83:0/3092965683 conn(0x7f83640d0040 msgr2=0x7f83640cea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:16:44.311 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.307+0000 7f836ac9e700 1 -- 172.21.15.83:0/3092965683 shutdown_connections 2023-09-21T00:16:44.311 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.307+0000 7f836ac9e700 1 -- 172.21.15.83:0/3092965683 wait complete. 2023-09-21T00:16:44.320 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new 80940d50-a248-4e64-a282-7ffcdad790ac 1 2023-09-21T00:16:44.341 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-09-21T00:16:44.339+0000 7f95ffd18200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-21T00:16:44.442 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.441+0000 7f2d6ed4f700 1 Processor -- start 2023-09-21T00:16:44.442 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.441+0000 7f2d6ed4f700 1 -- start start 2023-09-21T00:16:44.449 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.442+0000 7f2d6ed4f700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2d6815a340 0x7f2d6815eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:44.450 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.442+0000 7f2d6ed4f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2d68072690 0x7f2d680cf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:44.450 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.442+0000 7f2d6ed4f700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d6815b560 con 0x7f2d680cb8d0 2023-09-21T00:16:44.450 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.442+0000 7f2d6ed4f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d6815b380 con 0x7f2d68072690 2023-09-21T00:16:44.450 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.442+0000 7f2d6ed4f700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d6815e690 con 0x7f2d6815a340 2023-09-21T00:16:44.451 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.442+0000 7f2d6caeb700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2d6815a340 0x7f2d6815eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:44.451 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.442+0000 7f2d6caeb700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2d6815a340 0x7f2d6815eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:36492/0 (socket says 172.21.15.83:36492) 2023-09-21T00:16:44.451 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.442+0000 7f2d6d2ec700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f2d680cb8d0 0x7f2d680cbce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:39542/0 (socket says 172.21.15.83:39542) 2023-09-21T00:16:44.452 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.442+0000 7f2d6caeb700 1 -- 172.21.15.83:0/3449002791 learned_addr learned my addr 172.21.15.83:0/3449002791 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-09-21T00:16:44.452 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.442+0000 7f2d67fff700 1 --2- 172.21.15.83:0/3449002791 >> v2:172.21.15.59:3300/0 conn(0x7f2d68072690 0x7f2d680cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:44.452 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.443+0000 7f2d6caeb700 1 -- 172.21.15.83:0/3449002791 >> v2:172.21.15.59:3300/0 conn(0x7f2d68072690 msgr2=0x7f2d680cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:16:44.452 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.443+0000 7f2d6caeb700 1 --2- 172.21.15.83:0/3449002791 >> v2:172.21.15.59:3300/0 conn(0x7f2d68072690 0x7f2d680cf980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:44.453 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.443+0000 7f2d6caeb700 1 -- 172.21.15.83:0/3449002791 >> v1:172.21.15.83:6789/0 conn(0x7f2d680cb8d0 legacy=0x7f2d680cbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:44.453 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.443+0000 7f2d6caeb700 1 -- 172.21.15.83:0/3449002791 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d6815dfd0 con 0x7f2d6815a340 2023-09-21T00:16:44.453 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.443+0000 7f2d677fe700 1 -- 172.21.15.83:0/3449002791 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3057248090 0 0) 0x7f2d6815b560 con 0x7f2d680cb8d0 2023-09-21T00:16:44.454 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.443+0000 7f2d6caeb700 1 --2- 172.21.15.83:0/3449002791 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d6815a340 0x7f2d6815eab0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2d68062480 tx=0x7f2d5c00be70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48b1b4a572d03981 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:16:44.454 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.443+0000 7f2d677fe700 1 -- 172.21.15.83:0/3449002791 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c00dc70 con 0x7f2d6815a340 2023-09-21T00:16:44.454 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.443+0000 7f2d677fe700 1 -- 172.21.15.83:0/3449002791 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d5c00ddd0 con 0x7f2d6815a340 2023-09-21T00:16:44.454 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.443+0000 7f2d677fe700 1 -- 172.21.15.83:0/3449002791 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c010690 con 0x7f2d6815a340 2023-09-21T00:16:44.455 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.443+0000 7f2d6ed4f700 1 -- 172.21.15.83:0/3449002791 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d6815a340 msgr2=0x7f2d6815eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:44.455 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.443+0000 7f2d6ed4f700 1 --2- 172.21.15.83:0/3449002791 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d6815a340 0x7f2d6815eab0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2d68062480 tx=0x7f2d5c00be70 comp rx=0 tx=0).stop 2023-09-21T00:16:44.456 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.444+0000 7f2d6ed4f700 1 -- 172.21.15.83:0/3449002791 shutdown_connections 2023-09-21T00:16:44.456 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.444+0000 7f2d6ed4f700 1 --2- 172.21.15.83:0/3449002791 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d6815a340 0x7f2d6815eab0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:44.456 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.444+0000 7f2d6ed4f700 1 --2- 172.21.15.83:0/3449002791 >> v2:172.21.15.59:3300/0 conn(0x7f2d68072690 0x7f2d680cf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:44.456 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.444+0000 7f2d6ed4f700 1 -- 172.21.15.83:0/3449002791 >> 172.21.15.83:0/3449002791 conn(0x7f2d680ccae0 msgr2=0x7f2d680ccef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:16:44.457 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.444+0000 7f2d6ed4f700 1 -- 172.21.15.83:0/3449002791 shutdown_connections 2023-09-21T00:16:44.457 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.444+0000 7f2d6ed4f700 1 -- 172.21.15.83:0/3449002791 wait complete. 2023-09-21T00:16:44.457 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.445+0000 7f2d6ed4f700 1 Processor -- start 2023-09-21T00:16:44.458 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.445+0000 7f2d6ed4f700 1 -- start start 2023-09-21T00:16:44.458 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.446+0000 7f2d6ed4f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d68072690 0x7f2d68151720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:44.458 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.446+0000 7f2d6ed4f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2d680cb8d0 0x7f2d680c5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:44.459 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.446+0000 7f2d6ed4f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d6815a340 0x7f2d680b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:44.459 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.446+0000 7f2d6ed4f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d68155450 con 0x7f2d68072690 2023-09-21T00:16:44.459 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.446+0000 7f2d6ed4f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d681556a0 con 0x7f2d6815a340 2023-09-21T00:16:44.459 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.446+0000 7f2d6ed4f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d68155980 con 0x7f2d680cb8d0 2023-09-21T00:16:44.460 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.446+0000 7f2d67fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2d680cb8d0 0x7f2d680c5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:44.460 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.446+0000 7f2d6d2ec700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d6815a340 0x7f2d680b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:44.460 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.446+0000 7f2d67fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2d680cb8d0 0x7f2d680c5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.83:56282/0 (socket says 172.21.15.83:56282) 2023-09-21T00:16:44.461 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.446+0000 7f2d6d2ec700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d6815a340 0x7f2d680b3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:36502/0 (socket says 172.21.15.83:36502) 2023-09-21T00:16:44.461 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.446+0000 7f2d67fff700 1 -- 172.21.15.83:0/3460652536 learned_addr learned my addr 172.21.15.83:0/3460652536 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-09-21T00:16:44.461 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.446+0000 7f2d6caeb700 1 --2- 172.21.15.83:0/3460652536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d68072690 0x7f2d68151720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:44.462 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.446+0000 7f2d67fff700 1 -- 172.21.15.83:0/3460652536 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d6815a340 msgr2=0x7f2d680b3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:44.462 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.446+0000 7f2d67fff700 1 --2- 172.21.15.83:0/3460652536 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d6815a340 0x7f2d680b3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:44.462 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.446+0000 7f2d67fff700 1 -- 172.21.15.83:0/3460652536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d68072690 msgr2=0x7f2d68151720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:44.463 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.446+0000 7f2d67fff700 1 --2- 172.21.15.83:0/3460652536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d68072690 0x7f2d68151720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:44.463 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.446+0000 7f2d67fff700 1 -- 172.21.15.83:0/3460652536 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d5c00b7f0 con 0x7f2d680cb8d0 2023-09-21T00:16:44.463 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.446+0000 7f2d6d2ec700 1 --2- 172.21.15.83:0/3460652536 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d6815a340 0x7f2d680b3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T00:16:44.464 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.446+0000 7f2d67fff700 1 --2- 172.21.15.83:0/3460652536 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2d680cb8d0 0x7f2d680c5210 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2d5400e870 tx=0x7f2d5400eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:16:44.464 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.446+0000 7f2d657fa700 1 -- 172.21.15.83:0/3460652536 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d54009590 con 0x7f2d680cb8d0 2023-09-21T00:16:44.464 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.446+0000 7f2d657fa700 1 -- 172.21.15.83:0/3460652536 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d54013680 con 0x7f2d680cb8d0 2023-09-21T00:16:44.465 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.446+0000 7f2d6ed4f700 1 -- 172.21.15.83:0/3460652536 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d68155c60 con 0x7f2d680cb8d0 2023-09-21T00:16:44.465 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.446+0000 7f2d657fa700 1 -- 172.21.15.83:0/3460652536 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d540139f0 con 0x7f2d680cb8d0 2023-09-21T00:16:44.465 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.446+0000 7f2d6ed4f700 1 -- 172.21.15.83:0/3460652536 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d68151c60 con 0x7f2d680cb8d0 2023-09-21T00:16:44.466 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.447+0000 7f2d657fa700 1 -- 172.21.15.83:0/3460652536 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2d54005a20 con 0x7f2d680cb8d0 2023-09-21T00:16:44.466 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.447+0000 7f2d657fa700 1 -- 172.21.15.83:0/3460652536 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f2d5401c800 con 0x7f2d680cb8d0 2023-09-21T00:16:44.466 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.447+0000 7f2d6ed4f700 1 -- 172.21.15.83:0/3460652536 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d68067e50 con 0x7f2d680cb8d0 2023-09-21T00:16:44.467 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.449+0000 7f2d657fa700 1 -- 172.21.15.83:0/3460652536 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f2d54021060 con 0x7f2d680cb8d0 2023-09-21T00:16:44.534 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.533+0000 7f2d6ed4f700 1 -- 172.21.15.83:0/3460652536 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd new", "uuid": "80940d50-a248-4e64-a282-7ffcdad790ac", "id": 1} v 0) v1 -- 0x7f2d680cd820 con 0x7f2d680cb8d0 2023-09-21T00:16:44.542 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.541+0000 7f2d657fa700 1 -- 172.21.15.83:0/3460652536 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "80940d50-a248-4e64-a282-7ffcdad790ac", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2d54017070 con 0x7f2d680cb8d0 2023-09-21T00:16:44.542 INFO:teuthology.orchestra.run.smithi083.stdout:1 2023-09-21T00:16:44.543 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.541+0000 7f2d6ed4f700 1 -- 172.21.15.83:0/3460652536 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2d680cb8d0 msgr2=0x7f2d680c5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:44.543 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.541+0000 7f2d6ed4f700 1 --2- 172.21.15.83:0/3460652536 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2d680cb8d0 0x7f2d680c5210 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2d5400e870 tx=0x7f2d5400eb80 comp rx=0 tx=0).stop 2023-09-21T00:16:44.543 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.542+0000 7f2d6ed4f700 1 -- 172.21.15.83:0/3460652536 shutdown_connections 2023-09-21T00:16:44.544 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.542+0000 7f2d6ed4f700 1 --2- 172.21.15.83:0/3460652536 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d6815a340 0x7f2d680b3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:44.544 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.542+0000 7f2d6ed4f700 1 --2- 172.21.15.83:0/3460652536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d68072690 0x7f2d68151720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:44.544 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.542+0000 7f2d6ed4f700 1 --2- 172.21.15.83:0/3460652536 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2d680cb8d0 0x7f2d680c5210 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:44.544 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.542+0000 7f2d6ed4f700 1 -- 172.21.15.83:0/3460652536 >> 172.21.15.83:0/3460652536 conn(0x7f2d680ccae0 msgr2=0x7f2d680afc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:16:44.544 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.542+0000 7f2d6ed4f700 1 -- 172.21.15.83:0/3460652536 shutdown_connections 2023-09-21T00:16:44.545 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.542+0000 7f2d6ed4f700 1 -- 172.21.15.83:0/3460652536 wait complete. 2023-09-21T00:16:44.554 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new 55f2eceb-c54a-4879-a6ce-968c1c548b5d 2 2023-09-21T00:16:44.673 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.672+0000 7f0ff9649700 1 Processor -- start 2023-09-21T00:16:44.673 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.672+0000 7f0ff9649700 1 -- start start 2023-09-21T00:16:44.676 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.673+0000 7f0ff9649700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0ff415d520 0x7f0ff40cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:44.676 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.673+0000 7f0ff9649700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0ff406a780 0x7f0ff406ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:44.676 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.673+0000 7f0ff9649700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ff415d900 con 0x7f0ff4071920 2023-09-21T00:16:44.676 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.673+0000 7f0ff9649700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff406b170 con 0x7f0ff415d520 2023-09-21T00:16:44.677 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.673+0000 7f0ff9649700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff4072480 con 0x7f0ff406a780 2023-09-21T00:16:44.677 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.673+0000 7f0ff27fc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0ff406a780 0x7f0ff406ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:44.677 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.673+0000 7f0ff37fe700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f0ff4071920 0x7f0ff4071d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:39554/0 (socket says 172.21.15.83:39554) 2023-09-21T00:16:44.677 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.673+0000 7f0ff27fc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0ff406a780 0x7f0ff406ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:36504/0 (socket says 172.21.15.83:36504) 2023-09-21T00:16:44.678 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.673+0000 7f0ff37fe700 1 -- 172.21.15.83:0/3528546391 learned_addr learned my addr 172.21.15.83:0/3528546391 (peer_addr_for_me v1:172.21.15.83:0/0) 2023-09-21T00:16:44.678 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.673+0000 7f0ff2ffd700 1 --2- 172.21.15.83:0/3528546391 >> v2:172.21.15.59:3300/0 conn(0x7f0ff415d520 0x7f0ff40cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:44.678 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.673+0000 7f0ff27fc700 1 -- 172.21.15.83:0/3528546391 >> v2:172.21.15.59:3300/0 conn(0x7f0ff415d520 msgr2=0x7f0ff40cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:16:44.678 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.673+0000 7f0ff27fc700 1 --2- 172.21.15.83:0/3528546391 >> v2:172.21.15.59:3300/0 conn(0x7f0ff415d520 0x7f0ff40cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:44.678 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.673+0000 7f0ff27fc700 1 -- 172.21.15.83:0/3528546391 >> v1:172.21.15.83:6789/0 conn(0x7f0ff4071920 legacy=0x7f0ff4071d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:44.679 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.673+0000 7f0ff27fc700 1 -- 172.21.15.83:0/3528546391 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff40cdcb0 con 0x7f0ff406a780 2023-09-21T00:16:44.679 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.673+0000 7f0ff27fc700 1 --2- 172.21.15.83:0/3528546391 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ff406a780 0x7f0ff406ac30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0ff406b860 tx=0x7f0fe8009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5756bad6a1136b server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:16:44.679 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.673+0000 7f0ff1ffb700 1 -- 172.21.15.83:0/3528546391 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe8011830 con 0x7f0ff406a780 2023-09-21T00:16:44.679 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.673+0000 7f0ff1ffb700 1 -- 172.21.15.83:0/3528546391 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe8011990 con 0x7f0ff406a780 2023-09-21T00:16:44.679 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.673+0000 7f0ff1ffb700 1 -- 172.21.15.83:0/3528546391 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe8011d20 con 0x7f0ff406a780 2023-09-21T00:16:44.680 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.674+0000 7f0ff9649700 1 -- 172.21.15.83:0/3528546391 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ff406a780 msgr2=0x7f0ff406ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:44.680 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.674+0000 7f0ff9649700 1 --2- 172.21.15.83:0/3528546391 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ff406a780 0x7f0ff406ac30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0ff406b860 tx=0x7f0fe8009b20 comp rx=0 tx=0).stop 2023-09-21T00:16:44.680 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.674+0000 7f0ff9649700 1 -- 172.21.15.83:0/3528546391 shutdown_connections 2023-09-21T00:16:44.680 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.674+0000 7f0ff9649700 1 --2- 172.21.15.83:0/3528546391 >> v2:172.21.15.59:3300/0 conn(0x7f0ff415d520 0x7f0ff40cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:44.681 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.674+0000 7f0ff9649700 1 --2- 172.21.15.83:0/3528546391 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ff406a780 0x7f0ff406ac30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:44.681 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.674+0000 7f0ff9649700 1 -- 172.21.15.83:0/3528546391 >> 172.21.15.83:0/3528546391 conn(0x7f0ff40d0040 msgr2=0x7f0ff40d0420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:16:44.682 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.674+0000 7f0ff9649700 1 -- 172.21.15.83:0/3528546391 shutdown_connections 2023-09-21T00:16:44.682 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.674+0000 7f0ff9649700 1 -- 172.21.15.83:0/3528546391 wait complete. 2023-09-21T00:16:44.685 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.676+0000 7f0ff9649700 1 Processor -- start 2023-09-21T00:16:44.685 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.676+0000 7f0ff9649700 1 -- start start 2023-09-21T00:16:44.685 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.676+0000 7f0ff9649700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ff406a780 0x7f0ff4160960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:44.686 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.676+0000 7f0ff9649700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ff4071920 0x7f0ff415e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:44.686 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.676+0000 7f0ff9649700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ff415d520 0x7f0ff40c8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:44.686 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.676+0000 7f0ff9649700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff4160ea0 con 0x7f0ff4071920 2023-09-21T00:16:44.687 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.676+0000 7f0ff9649700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff41f68c0 con 0x7f0ff406a780 2023-09-21T00:16:44.687 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.676+0000 7f0ff9649700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff41f6ba0 con 0x7f0ff415d520 2023-09-21T00:16:44.687 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.676+0000 7f0ff2ffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ff406a780 0x7f0ff4160960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:44.687 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.676+0000 7f0ff2ffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ff406a780 0x7f0ff4160960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:36510/0 (socket says 172.21.15.83:36510) 2023-09-21T00:16:44.687 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.676+0000 7f0ff2ffd700 1 -- 172.21.15.83:0/3332061376 learned_addr learned my addr 172.21.15.83:0/3332061376 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-09-21T00:16:44.688 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.676+0000 7f0ff37fe700 1 --2- 172.21.15.83:0/3332061376 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ff415d520 0x7f0ff40c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:44.688 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.676+0000 7f0ff27fc700 1 --2- 172.21.15.83:0/3332061376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ff4071920 0x7f0ff415e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:44.688 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.677+0000 7f0ff2ffd700 1 -- 172.21.15.83:0/3332061376 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ff415d520 msgr2=0x7f0ff40c8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:44.688 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.677+0000 7f0ff2ffd700 1 --2- 172.21.15.83:0/3332061376 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ff415d520 0x7f0ff40c8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:44.688 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.677+0000 7f0ff2ffd700 1 -- 172.21.15.83:0/3332061376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ff4071920 msgr2=0x7f0ff415e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:44.689 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.677+0000 7f0ff2ffd700 1 --2- 172.21.15.83:0/3332061376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ff4071920 0x7f0ff415e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:44.689 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.677+0000 7f0ff2ffd700 1 -- 172.21.15.83:0/3332061376 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe80094a0 con 0x7f0ff406a780 2023-09-21T00:16:44.689 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.677+0000 7f0ff27fc700 1 --2- 172.21.15.83:0/3332061376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ff4071920 0x7f0ff415e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T00:16:44.689 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.677+0000 7f0ff2ffd700 1 --2- 172.21.15.83:0/3332061376 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ff406a780 0x7f0ff4160960 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0fe400e9b0 tx=0x7f0fe400ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:16:44.690 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.677+0000 7f0fdb7fe700 1 -- 172.21.15.83:0/3332061376 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe4009710 con 0x7f0ff406a780 2023-09-21T00:16:44.690 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.677+0000 7f0fdb7fe700 1 -- 172.21.15.83:0/3332061376 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe400ee50 con 0x7f0ff406a780 2023-09-21T00:16:44.690 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.677+0000 7f0ff9649700 1 -- 172.21.15.83:0/3332061376 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff41f6e80 con 0x7f0ff406a780 2023-09-21T00:16:44.690 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.677+0000 7f0fdb7fe700 1 -- 172.21.15.83:0/3332061376 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe400ca50 con 0x7f0ff406a780 2023-09-21T00:16:44.690 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.677+0000 7f0ff9649700 1 -- 172.21.15.83:0/3332061376 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff41606b0 con 0x7f0ff406a780 2023-09-21T00:16:44.691 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.677+0000 7f0fdb7fe700 1 -- 172.21.15.83:0/3332061376 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0fe4005a20 con 0x7f0ff406a780 2023-09-21T00:16:44.691 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.677+0000 7f0fdb7fe700 1 -- 172.21.15.83:0/3332061376 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f0fe4006700 con 0x7f0ff406a780 2023-09-21T00:16:44.691 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.678+0000 7f0ff9649700 1 -- 172.21.15.83:0/3332061376 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ff41f3190 con 0x7f0ff406a780 2023-09-21T00:16:44.691 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.680+0000 7f0fdb7fe700 1 -- 172.21.15.83:0/3332061376 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f0fe4021060 con 0x7f0ff406a780 2023-09-21T00:16:44.760 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-09-21T00:16:44.759+0000 7f546869e200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-21T00:16:44.764 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.763+0000 7f0ff9649700 1 -- 172.21.15.83:0/3332061376 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd new", "uuid": "55f2eceb-c54a-4879-a6ce-968c1c548b5d", "id": 2} v 0) v1 -- 0x7f0ff4066fd0 con 0x7f0ff406a780 2023-09-21T00:16:44.772 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.771+0000 7f0fdb7fe700 1 -- 172.21.15.83:0/3332061376 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "55f2eceb-c54a-4879-a6ce-968c1c548b5d", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0fe4017070 con 0x7f0ff406a780 2023-09-21T00:16:44.772 INFO:teuthology.orchestra.run.smithi083.stdout:2 2023-09-21T00:16:44.774 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.772+0000 7f0ff9649700 1 -- 172.21.15.83:0/3332061376 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ff406a780 msgr2=0x7f0ff4160960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:44.774 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.772+0000 7f0ff9649700 1 --2- 172.21.15.83:0/3332061376 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ff406a780 0x7f0ff4160960 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0fe400e9b0 tx=0x7f0fe400ecc0 comp rx=0 tx=0).stop 2023-09-21T00:16:44.774 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.772+0000 7f0ff9649700 1 -- 172.21.15.83:0/3332061376 shutdown_connections 2023-09-21T00:16:44.774 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.772+0000 7f0ff9649700 1 --2- 172.21.15.83:0/3332061376 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ff415d520 0x7f0ff40c8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:44.774 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.772+0000 7f0ff9649700 1 --2- 172.21.15.83:0/3332061376 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ff406a780 0x7f0ff4160960 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:44.775 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.772+0000 7f0ff9649700 1 --2- 172.21.15.83:0/3332061376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ff4071920 0x7f0ff415e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:44.775 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.772+0000 7f0ff9649700 1 -- 172.21.15.83:0/3332061376 >> 172.21.15.83:0/3332061376 conn(0x7f0ff40d0040 msgr2=0x7f0ff40d0420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:16:44.775 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.772+0000 7f0ff9649700 1 -- 172.21.15.83:0/3332061376 shutdown_connections 2023-09-21T00:16:44.775 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.772+0000 7f0ff9649700 1 -- 172.21.15.83:0/3332061376 wait complete. 2023-09-21T00:16:44.785 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new 92b89cd0-869c-49b9-a9f9-97ac8423f304 3 2023-09-21T00:16:44.790 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-09-21T00:16:44.789+0000 7f95ffd18200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-21T00:16:44.908 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.907+0000 7f2d5c70a700 1 Processor -- start 2023-09-21T00:16:44.908 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.907+0000 7f2d5c70a700 1 -- start start 2023-09-21T00:16:44.910 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.908+0000 7f2d5c70a700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2d5415a4f0 0x7f2d540cb030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:44.910 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.908+0000 7f2d5c70a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d540caba0 con 0x7f2d5415de70 2023-09-21T00:16:44.911 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.908+0000 7f2d5c70a700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d5415e8a0 con 0x7f2d54071660 2023-09-21T00:16:44.911 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.908+0000 7f2d5c70a700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d5415ee60 con 0x7f2d5415a4f0 2023-09-21T00:16:44.911 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.908+0000 7f2d59ca5700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2d5415a4f0 0x7f2d540cb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:44.911 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.908+0000 7f2d59ca5700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2d5415a4f0 0x7f2d540cb030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:36518/0 (socket says 172.21.15.83:36518) 2023-09-21T00:16:44.911 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.908+0000 7f2d59ca5700 1 -- 172.21.15.83:0/1097428722 learned_addr learned my addr 172.21.15.83:0/1097428722 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-09-21T00:16:44.912 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.908+0000 7f2d59ca5700 1 -- 172.21.15.83:0/1097428722 >> v1:172.21.15.83:6789/0 conn(0x7f2d54071660 legacy=0x7f2d54071a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:44.912 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.908+0000 7f2d59ca5700 1 -- 172.21.15.83:0/1097428722 >> v1:172.21.15.59:6789/0 conn(0x7f2d5415de70 legacy=0x7f2d5406eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:44.912 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.908+0000 7f2d59ca5700 1 -- 172.21.15.83:0/1097428722 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d5415eb80 con 0x7f2d5415a4f0 2023-09-21T00:16:44.912 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.908+0000 7f2d59ca5700 1 --2- 172.21.15.83:0/1097428722 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d5415a4f0 0x7f2d540cb030 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2d440098f0 tx=0x7f2d44009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b4b0b7aea91f243 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:16:44.913 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.908+0000 7f2d594a4700 1 -- 172.21.15.83:0/1097428722 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4400b8a0 con 0x7f2d5415a4f0 2023-09-21T00:16:44.913 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.908+0000 7f2d594a4700 1 -- 172.21.15.83:0/1097428722 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d4400ba00 con 0x7f2d5415a4f0 2023-09-21T00:16:44.913 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.908+0000 7f2d594a4700 1 -- 172.21.15.83:0/1097428722 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4400bd90 con 0x7f2d5415a4f0 2023-09-21T00:16:44.913 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.909+0000 7f2d5c70a700 1 -- 172.21.15.83:0/1097428722 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d5415a4f0 msgr2=0x7f2d540cb030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:44.913 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.909+0000 7f2d5c70a700 1 --2- 172.21.15.83:0/1097428722 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d5415a4f0 0x7f2d540cb030 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2d440098f0 tx=0x7f2d44009c00 comp rx=0 tx=0).stop 2023-09-21T00:16:44.914 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.909+0000 7f2d5c70a700 1 -- 172.21.15.83:0/1097428722 shutdown_connections 2023-09-21T00:16:44.914 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.909+0000 7f2d5c70a700 1 --2- 172.21.15.83:0/1097428722 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d5415a4f0 0x7f2d540cb030 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:44.914 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.909+0000 7f2d5c70a700 1 -- 172.21.15.83:0/1097428722 >> 172.21.15.83:0/1097428722 conn(0x7f2d540d0040 msgr2=0x7f2d540d0420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:16:44.914 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.909+0000 7f2d5c70a700 1 -- 172.21.15.83:0/1097428722 shutdown_connections 2023-09-21T00:16:44.914 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.909+0000 7f2d5c70a700 1 -- 172.21.15.83:0/1097428722 wait complete. 2023-09-21T00:16:44.917 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.910+0000 7f2d5c70a700 1 Processor -- start 2023-09-21T00:16:44.917 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.910+0000 7f2d5c70a700 1 -- start start 2023-09-21T00:16:44.918 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.911+0000 7f2d5c70a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d54071660 0x7f2d541485c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:44.918 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.911+0000 7f2d5c70a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d5415a4f0 0x7f2d54145300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:44.918 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.911+0000 7f2d5c70a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2d5415de70 0x7f2d540c3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:44.918 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.911+0000 7f2d5c70a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d54148b00 con 0x7f2d5415a4f0 2023-09-21T00:16:44.918 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.911+0000 7f2d5c70a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d54145840 con 0x7f2d54071660 2023-09-21T00:16:44.919 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.911+0000 7f2d5c70a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d54145f10 con 0x7f2d5415de70 2023-09-21T00:16:44.919 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.911+0000 7f2d5a4a6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d54071660 0x7f2d541485c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:44.919 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.911+0000 7f2d5a4a6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d54071660 0x7f2d541485c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:36522/0 (socket says 172.21.15.83:36522) 2023-09-21T00:16:44.919 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.911+0000 7f2d5a4a6700 1 -- 172.21.15.83:0/1061756814 learned_addr learned my addr 172.21.15.83:0/1061756814 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-09-21T00:16:44.919 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.911+0000 7f2d5aca7700 1 --2- 172.21.15.83:0/1061756814 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2d5415de70 0x7f2d540c3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:44.920 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.911+0000 7f2d59ca5700 1 --2- 172.21.15.83:0/1061756814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d5415a4f0 0x7f2d54145300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:44.920 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.911+0000 7f2d5a4a6700 1 -- 172.21.15.83:0/1061756814 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2d5415de70 msgr2=0x7f2d540c3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:44.920 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.911+0000 7f2d5a4a6700 1 --2- 172.21.15.83:0/1061756814 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2d5415de70 0x7f2d540c3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:44.920 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.911+0000 7f2d5a4a6700 1 -- 172.21.15.83:0/1061756814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d5415a4f0 msgr2=0x7f2d54145300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:44.920 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.911+0000 7f2d5a4a6700 1 --2- 172.21.15.83:0/1061756814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d5415a4f0 0x7f2d54145300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:44.921 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.911+0000 7f2d5a4a6700 1 -- 172.21.15.83:0/1061756814 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d44009550 con 0x7f2d54071660 2023-09-21T00:16:44.921 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.911+0000 7f2d5aca7700 1 --2- 172.21.15.83:0/1061756814 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2d5415de70 0x7f2d540c3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T00:16:44.921 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.912+0000 7f2d5a4a6700 1 --2- 172.21.15.83:0/1061756814 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d54071660 0x7f2d541485c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2d5000c450 tx=0x7f2d5000c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:16:44.921 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.912+0000 7f2d4affd700 1 -- 172.21.15.83:0/1061756814 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d500052d0 con 0x7f2d54071660 2023-09-21T00:16:44.921 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.912+0000 7f2d4affd700 1 -- 172.21.15.83:0/1061756814 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d50005430 con 0x7f2d54071660 2023-09-21T00:16:44.922 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.912+0000 7f2d5c70a700 1 -- 172.21.15.83:0/1061756814 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d541461f0 con 0x7f2d54071660 2023-09-21T00:16:44.922 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.912+0000 7f2d4affd700 1 -- 172.21.15.83:0/1061756814 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d500038c0 con 0x7f2d54071660 2023-09-21T00:16:44.922 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.912+0000 7f2d5c70a700 1 -- 172.21.15.83:0/1061756814 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d541467b0 con 0x7f2d54071660 2023-09-21T00:16:44.922 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.912+0000 7f2d4affd700 1 -- 172.21.15.83:0/1061756814 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2d50003d20 con 0x7f2d54071660 2023-09-21T00:16:44.922 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.912+0000 7f2d4affd700 1 -- 172.21.15.83:0/1061756814 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f2d50011cc0 con 0x7f2d54071660 2023-09-21T00:16:44.923 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.913+0000 7f2d5c70a700 1 -- 172.21.15.83:0/1061756814 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d54066fd0 con 0x7f2d54071660 2023-09-21T00:16:44.923 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.915+0000 7f2d4affd700 1 -- 172.21.15.83:0/1061756814 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f2d50017070 con 0x7f2d54071660 2023-09-21T00:16:44.998 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:44.997+0000 7f2d5c70a700 1 -- 172.21.15.83:0/1061756814 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd new", "uuid": "92b89cd0-869c-49b9-a9f9-97ac8423f304", "id": 3} v 0) v1 -- 0x7f2d54067e50 con 0x7f2d54071660 2023-09-21T00:16:45.006 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.005+0000 7f2d4affd700 1 -- 172.21.15.83:0/1061756814 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "92b89cd0-869c-49b9-a9f9-97ac8423f304", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2d50011590 con 0x7f2d54071660 2023-09-21T00:16:45.006 INFO:teuthology.orchestra.run.smithi083.stdout:3 2023-09-21T00:16:45.008 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.006+0000 7f2d5c70a700 1 -- 172.21.15.83:0/1061756814 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d54071660 msgr2=0x7f2d541485c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:45.008 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.006+0000 7f2d5c70a700 1 --2- 172.21.15.83:0/1061756814 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d54071660 0x7f2d541485c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2d5000c450 tx=0x7f2d5000c760 comp rx=0 tx=0).stop 2023-09-21T00:16:45.008 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.006+0000 7f2d5c70a700 1 -- 172.21.15.83:0/1061756814 shutdown_connections 2023-09-21T00:16:45.008 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.006+0000 7f2d5c70a700 1 --2- 172.21.15.83:0/1061756814 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2d5415de70 0x7f2d540c3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:45.008 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.006+0000 7f2d5c70a700 1 --2- 172.21.15.83:0/1061756814 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d54071660 0x7f2d541485c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:45.009 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.006+0000 7f2d5c70a700 1 --2- 172.21.15.83:0/1061756814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d5415a4f0 0x7f2d54145300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:45.009 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.006+0000 7f2d5c70a700 1 -- 172.21.15.83:0/1061756814 >> 172.21.15.83:0/1061756814 conn(0x7f2d540d0040 msgr2=0x7f2d5406a780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:16:45.009 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.006+0000 7f2d5c70a700 1 -- 172.21.15.83:0/1061756814 shutdown_connections 2023-09-21T00:16:45.009 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.006+0000 7f2d5c70a700 1 -- 172.21.15.83:0/1061756814 wait complete. 2023-09-21T00:16:45.019 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new 25b80e94-e0e6-403d-b69f-61542f289637 4 2023-09-21T00:16:45.148 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.147+0000 7f088aedb700 1 Processor -- start 2023-09-21T00:16:45.149 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.147+0000 7f088aedb700 1 -- start start 2023-09-21T00:16:45.151 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.148+0000 7f088aedb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f08840d0a40 0x7f08840d1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:45.152 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.148+0000 7f088aedb700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08840cda60 0x7f08840cde90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:45.152 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.148+0000 7f088aedb700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08840ce3d0 con 0x7f08840b1f90 2023-09-21T00:16:45.152 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.148+0000 7f088aedb700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f088406cee0 con 0x7f08840d0a40 2023-09-21T00:16:45.152 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.148+0000 7f088aedb700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08840b18a0 con 0x7f08840cda60 2023-09-21T00:16:45.153 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.148+0000 7f0889478700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08840cda60 0x7f08840cde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:45.153 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.148+0000 7f0889478700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08840cda60 0x7f08840cde90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.83:56314/0 (socket says 172.21.15.83:56314) 2023-09-21T00:16:45.153 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.148+0000 7f0889478700 1 -- 172.21.15.83:0/392246984 learned_addr learned my addr 172.21.15.83:0/392246984 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-09-21T00:16:45.153 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.148+0000 7f0888c77700 1 --2- 172.21.15.83:0/392246984 >> v2:172.21.15.59:3300/0 conn(0x7f08840d0a40 0x7f08840d1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:45.153 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.148+0000 7f0889478700 1 -- 172.21.15.83:0/392246984 >> v2:172.21.15.59:3300/0 conn(0x7f08840d0a40 msgr2=0x7f08840d1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:16:45.154 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.148+0000 7f0889478700 1 --2- 172.21.15.83:0/392246984 >> v2:172.21.15.59:3300/0 conn(0x7f08840d0a40 0x7f08840d1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:45.154 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.148+0000 7f0889478700 1 -- 172.21.15.83:0/392246984 >> v1:172.21.15.59:6789/0 conn(0x7f08840b1f90 legacy=0x7f088406c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:45.154 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.148+0000 7f0889478700 1 -- 172.21.15.83:0/392246984 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08840b1b80 con 0x7f08840cda60 2023-09-21T00:16:45.154 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.148+0000 7f0889478700 1 --2- 172.21.15.83:0/392246984 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08840cda60 0x7f08840cde90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f087c009e50 tx=0x7f087c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19d65cc62970c109 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:16:45.154 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.149+0000 7f08837fe700 1 -- 172.21.15.83:0/392246984 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087c00e070 con 0x7f08840cda60 2023-09-21T00:16:45.155 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.149+0000 7f08837fe700 1 -- 172.21.15.83:0/392246984 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f087c00b910 con 0x7f08840cda60 2023-09-21T00:16:45.155 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.149+0000 7f08837fe700 1 -- 172.21.15.83:0/392246984 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087c00bcc0 con 0x7f08840cda60 2023-09-21T00:16:45.155 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.149+0000 7f088aedb700 1 -- 172.21.15.83:0/392246984 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08840cda60 msgr2=0x7f08840cde90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:45.155 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.149+0000 7f088aedb700 1 --2- 172.21.15.83:0/392246984 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08840cda60 0x7f08840cde90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f087c009e50 tx=0x7f087c00b330 comp rx=0 tx=0).stop 2023-09-21T00:16:45.155 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.149+0000 7f088aedb700 1 -- 172.21.15.83:0/392246984 shutdown_connections 2023-09-21T00:16:45.156 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.149+0000 7f088aedb700 1 --2- 172.21.15.83:0/392246984 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08840cda60 0x7f08840cde90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:45.156 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.149+0000 7f088aedb700 1 --2- 172.21.15.83:0/392246984 >> v2:172.21.15.59:3300/0 conn(0x7f08840d0a40 0x7f08840d1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:45.156 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.149+0000 7f088aedb700 1 -- 172.21.15.83:0/392246984 >> 172.21.15.83:0/392246984 conn(0x7f08840d1150 msgr2=0x7f08840d1560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:16:45.156 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.149+0000 7f088aedb700 1 -- 172.21.15.83:0/392246984 shutdown_connections 2023-09-21T00:16:45.157 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.149+0000 7f088aedb700 1 -- 172.21.15.83:0/392246984 wait complete. 2023-09-21T00:16:45.157 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.150+0000 7f088aedb700 1 Processor -- start 2023-09-21T00:16:45.157 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.150+0000 7f088aedb700 1 -- start start 2023-09-21T00:16:45.159 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.151+0000 7f088aedb700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08840b1f90 0x7f088409ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:45.160 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.151+0000 7f088aedb700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08840cda60 0x7f088415bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:45.160 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.151+0000 7f088aedb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08840d0a40 0x7f08840cc520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:45.160 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.151+0000 7f088aedb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f088409ef70 con 0x7f08840d0a40 2023-09-21T00:16:45.160 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.151+0000 7f088aedb700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08840c5bc0 con 0x7f08840b1f90 2023-09-21T00:16:45.160 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.151+0000 7f088aedb700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08840c5600 con 0x7f08840cda60 2023-09-21T00:16:45.161 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.151+0000 7f0883fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08840cda60 0x7f088415bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:45.161 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.151+0000 7f0888c77700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08840b1f90 0x7f088409ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:45.161 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.151+0000 7f0883fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08840cda60 0x7f088415bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.83:56318/0 (socket says 172.21.15.83:56318) 2023-09-21T00:16:45.161 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.151+0000 7f0883fff700 1 -- 172.21.15.83:0/4085546539 learned_addr learned my addr 172.21.15.83:0/4085546539 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-09-21T00:16:45.162 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.151+0000 7f0889478700 1 --2- 172.21.15.83:0/4085546539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08840d0a40 0x7f08840cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:45.162 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.152+0000 7f0883fff700 1 -- 172.21.15.83:0/4085546539 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08840b1f90 msgr2=0x7f088409ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:45.162 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.152+0000 7f0883fff700 1 --2- 172.21.15.83:0/4085546539 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08840b1f90 0x7f088409ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:45.162 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.152+0000 7f0883fff700 1 -- 172.21.15.83:0/4085546539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08840d0a40 msgr2=0x7f08840cc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:45.162 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.152+0000 7f0883fff700 1 --2- 172.21.15.83:0/4085546539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08840d0a40 0x7f08840cc520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:45.163 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.152+0000 7f0883fff700 1 -- 172.21.15.83:0/4085546539 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f087c009b30 con 0x7f08840cda60 2023-09-21T00:16:45.163 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.152+0000 7f0888c77700 1 --2- 172.21.15.83:0/4085546539 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08840b1f90 0x7f088409ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T00:16:45.163 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.152+0000 7f0883fff700 1 --2- 172.21.15.83:0/4085546539 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08840cda60 0x7f088415bd70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f087000c480 tx=0x7f087000c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:16:45.163 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.152+0000 7f08817fa700 1 -- 172.21.15.83:0/4085546539 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08700052d0 con 0x7f08840cda60 2023-09-21T00:16:45.163 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.152+0000 7f08817fa700 1 -- 172.21.15.83:0/4085546539 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0870005430 con 0x7f08840cda60 2023-09-21T00:16:45.164 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.152+0000 7f088aedb700 1 -- 172.21.15.83:0/4085546539 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08840c58e0 con 0x7f08840cda60 2023-09-21T00:16:45.164 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.152+0000 7f08817fa700 1 -- 172.21.15.83:0/4085546539 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08700038c0 con 0x7f08840cda60 2023-09-21T00:16:45.164 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.152+0000 7f088aedb700 1 -- 172.21.15.83:0/4085546539 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08841f6e90 con 0x7f08840cda60 2023-09-21T00:16:45.164 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.152+0000 7f08817fa700 1 -- 172.21.15.83:0/4085546539 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0870003d20 con 0x7f08840cda60 2023-09-21T00:16:45.164 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.152+0000 7f08817fa700 1 -- 172.21.15.83:0/4085546539 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f0870011cc0 con 0x7f08840cda60 2023-09-21T00:16:45.165 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.153+0000 7f088aedb700 1 -- 172.21.15.83:0/4085546539 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08841f6a10 con 0x7f08840cda60 2023-09-21T00:16:45.165 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.157+0000 7f08817fa700 1 -- 172.21.15.83:0/4085546539 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f08841f6a10 con 0x7f08840cda60 2023-09-21T00:16:45.271 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.270+0000 7f088aedb700 1 -- 172.21.15.83:0/4085546539 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd new", "uuid": "25b80e94-e0e6-403d-b69f-61542f289637", "id": 4} v 0) v1 -- 0x7f0884067e50 con 0x7f08840cda60 2023-09-21T00:16:45.281 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.280+0000 7f08817fa700 1 -- 172.21.15.83:0/4085546539 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "25b80e94-e0e6-403d-b69f-61542f289637", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0870017070 con 0x7f08840cda60 2023-09-21T00:16:45.282 INFO:teuthology.orchestra.run.smithi083.stdout:4 2023-09-21T00:16:45.283 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.281+0000 7f088aedb700 1 -- 172.21.15.83:0/4085546539 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08840cda60 msgr2=0x7f088415bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:45.283 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.281+0000 7f088aedb700 1 --2- 172.21.15.83:0/4085546539 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08840cda60 0x7f088415bd70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f087000c480 tx=0x7f087000c790 comp rx=0 tx=0).stop 2023-09-21T00:16:45.283 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.282+0000 7f088aedb700 1 -- 172.21.15.83:0/4085546539 shutdown_connections 2023-09-21T00:16:45.283 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.282+0000 7f088aedb700 1 --2- 172.21.15.83:0/4085546539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08840d0a40 0x7f08840cc520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:45.284 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.282+0000 7f088aedb700 1 --2- 172.21.15.83:0/4085546539 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08840b1f90 0x7f088409ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:45.284 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.282+0000 7f088aedb700 1 --2- 172.21.15.83:0/4085546539 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f08840cda60 0x7f088415bd70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:45.284 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.282+0000 7f088aedb700 1 -- 172.21.15.83:0/4085546539 >> 172.21.15.83:0/4085546539 conn(0x7f08840d1150 msgr2=0x7f088406c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:16:45.284 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.282+0000 7f088aedb700 1 -- 172.21.15.83:0/4085546539 shutdown_connections 2023-09-21T00:16:45.285 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.282+0000 7f088aedb700 1 -- 172.21.15.83:0/4085546539 wait complete. 2023-09-21T00:16:45.294 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new 5498d9ab-1086-4796-a199-9051e6dfea91 5 2023-09-21T00:16:45.419 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.417+0000 7f5bfb022700 1 Processor -- start 2023-09-21T00:16:45.419 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.417+0000 7f5bfb022700 1 -- start start 2023-09-21T00:16:45.427 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.418+0000 7f5bfb022700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5bf415de70 0x7f5bf406eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:45.427 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.418+0000 7f5bfb022700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bf40cb740 con 0x7f5bf4071660 2023-09-21T00:16:45.427 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.418+0000 7f5bfb022700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bf40caba0 con 0x7f5bf415a4f0 2023-09-21T00:16:45.428 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.418+0000 7f5bfb022700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bf415ee60 con 0x7f5bf415de70 2023-09-21T00:16:45.428 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.418+0000 7f5bf3fff700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f5bf415a4f0 0x7f5bf40cb030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:39588/0 (socket says 172.21.15.83:39588) 2023-09-21T00:16:45.428 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.418+0000 7f5bf3fff700 1 -- 172.21.15.83:0/2465499302 learned_addr learned my addr 172.21.15.83:0/2465499302 (peer_addr_for_me v1:172.21.15.83:0/0) 2023-09-21T00:16:45.428 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.418+0000 7f5bf95bf700 1 --2- 172.21.15.83:0/2465499302 >> v2:172.21.15.59:3300/0 conn(0x7f5bf415de70 0x7f5bf406eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:45.428 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.419+0000 7f5bf37fe700 1 -- 172.21.15.83:0/2465499302 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 984209857 0 0) 0x7f5bf40caba0 con 0x7f5bf415a4f0 2023-09-21T00:16:45.429 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.419+0000 7f5bf37fe700 1 -- 172.21.15.83:0/2465499302 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5be40035b0 con 0x7f5bf415a4f0 2023-09-21T00:16:45.429 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.419+0000 7f5bf95bf700 1 -- 172.21.15.83:0/2465499302 >> v1:172.21.15.83:6789/0 conn(0x7f5bf415a4f0 legacy=0x7f5bf40cb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:45.429 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.419+0000 7f5bf95bf700 1 -- 172.21.15.83:0/2465499302 >> v1:172.21.15.59:6789/0 conn(0x7f5bf4071660 legacy=0x7f5bf4071a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:45.429 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.419+0000 7f5bf95bf700 1 -- 172.21.15.83:0/2465499302 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf415e8a0 con 0x7f5bf415de70 2023-09-21T00:16:45.429 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.419+0000 7f5bf95bf700 1 --2- 172.21.15.83:0/2465499302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bf415de70 0x7f5bf406eac0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5bec009d90 tx=0x7f5bec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=702c04d87335eb63 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:16:45.430 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.419+0000 7f5bf37fe700 1 -- 172.21.15.83:0/2465499302 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bec00e070 con 0x7f5bf415de70 2023-09-21T00:16:45.430 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.419+0000 7f5bf37fe700 1 -- 172.21.15.83:0/2465499302 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bec00bb20 con 0x7f5bf415de70 2023-09-21T00:16:45.430 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.419+0000 7f5bf37fe700 1 -- 172.21.15.83:0/2465499302 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bec00be90 con 0x7f5bf415de70 2023-09-21T00:16:45.430 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.420+0000 7f5bfb022700 1 -- 172.21.15.83:0/2465499302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bf415de70 msgr2=0x7f5bf406eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:45.431 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.420+0000 7f5bfb022700 1 --2- 172.21.15.83:0/2465499302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bf415de70 0x7f5bf406eac0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5bec009d90 tx=0x7f5bec00b330 comp rx=0 tx=0).stop 2023-09-21T00:16:45.431 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.420+0000 7f5bfb022700 1 -- 172.21.15.83:0/2465499302 shutdown_connections 2023-09-21T00:16:45.431 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.420+0000 7f5bfb022700 1 --2- 172.21.15.83:0/2465499302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bf415de70 0x7f5bf406eac0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:45.431 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.420+0000 7f5bfb022700 1 -- 172.21.15.83:0/2465499302 >> 172.21.15.83:0/2465499302 conn(0x7f5bf40d0040 msgr2=0x7f5bf40d0420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:16:45.431 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.420+0000 7f5bfb022700 1 -- 172.21.15.83:0/2465499302 shutdown_connections 2023-09-21T00:16:45.432 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.420+0000 7f5bfb022700 1 -- 172.21.15.83:0/2465499302 wait complete. 2023-09-21T00:16:45.432 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.421+0000 7f5bfb022700 1 Processor -- start 2023-09-21T00:16:45.432 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.421+0000 7f5bfb022700 1 -- start start 2023-09-21T00:16:45.432 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.422+0000 7f5bfb022700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bf4071660 0x7f5bf4153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:45.433 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.422+0000 7f5bfb022700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5bf415a4f0 0x7f5bf40c7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:45.433 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.422+0000 7f5bfb022700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5bf415de70 0x7f5bf40ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:45.433 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.422+0000 7f5bfb022700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf4153c70 con 0x7f5bf4071660 2023-09-21T00:16:45.433 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.422+0000 7f5bfb022700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf415bc60 con 0x7f5bf415de70 2023-09-21T00:16:45.433 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.422+0000 7f5bfb022700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf40c7a60 con 0x7f5bf415a4f0 2023-09-21T00:16:45.434 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.422+0000 7f5bf95bf700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5bf415de70 0x7f5bf40ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:45.434 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.422+0000 7f5bf3fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5bf415a4f0 0x7f5bf40c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:45.434 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.422+0000 7f5bf95bf700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5bf415de70 0x7f5bf40ccb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:36550/0 (socket says 172.21.15.83:36550) 2023-09-21T00:16:45.434 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.422+0000 7f5bf95bf700 1 -- 172.21.15.83:0/2036091290 learned_addr learned my addr 172.21.15.83:0/2036091290 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-09-21T00:16:45.434 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.422+0000 7f5bf8dbe700 1 --2- 172.21.15.83:0/2036091290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bf4071660 0x7f5bf4153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:45.435 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.422+0000 7f5bf8dbe700 1 -- 172.21.15.83:0/2036091290 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5bf415a4f0 msgr2=0x7f5bf40c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:45.435 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.422+0000 7f5bf8dbe700 1 --2- 172.21.15.83:0/2036091290 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5bf415a4f0 0x7f5bf40c7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:45.435 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.422+0000 7f5bf8dbe700 1 -- 172.21.15.83:0/2036091290 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5bf415de70 msgr2=0x7f5bf40ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:45.435 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.422+0000 7f5bf8dbe700 1 --2- 172.21.15.83:0/2036091290 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5bf415de70 0x7f5bf40ccb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:45.435 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.422+0000 7f5bf8dbe700 1 -- 172.21.15.83:0/2036091290 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bec009a70 con 0x7f5bf4071660 2023-09-21T00:16:45.436 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.422+0000 7f5bf95bf700 1 --2- 172.21.15.83:0/2036091290 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5bf415de70 0x7f5bf40ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T00:16:45.436 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.422+0000 7f5bf3fff700 1 --2- 172.21.15.83:0/2036091290 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5bf415a4f0 0x7f5bf40c7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T00:16:45.436 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.423+0000 7f5bf8dbe700 1 --2- 172.21.15.83:0/2036091290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bf4071660 0x7f5bf4153730 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5be800c440 tx=0x7f5be8001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:16:45.436 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.423+0000 7f5bf17fa700 1 -- 172.21.15.83:0/2036091290 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be80052d0 con 0x7f5bf4071660 2023-09-21T00:16:45.436 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.423+0000 7f5bf17fa700 1 -- 172.21.15.83:0/2036091290 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be8005430 con 0x7f5bf4071660 2023-09-21T00:16:45.436 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.423+0000 7f5bf17fa700 1 -- 172.21.15.83:0/2036091290 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be8006aa0 con 0x7f5bf4071660 2023-09-21T00:16:45.437 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.423+0000 7f5bfb022700 1 -- 172.21.15.83:0/2036091290 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bf40c7d40 con 0x7f5bf4071660 2023-09-21T00:16:45.437 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.423+0000 7f5bfb022700 1 -- 172.21.15.83:0/2036091290 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf415bec0 con 0x7f5bf4071660 2023-09-21T00:16:45.437 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.423+0000 7f5bf17fa700 1 -- 172.21.15.83:0/2036091290 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5be8003980 con 0x7f5bf4071660 2023-09-21T00:16:45.438 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.423+0000 7f5bf17fa700 1 -- 172.21.15.83:0/2036091290 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f5be8003c30 con 0x7f5bf4071660 2023-09-21T00:16:45.438 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.424+0000 7f5bfb022700 1 -- 172.21.15.83:0/2036091290 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bf4066fd0 con 0x7f5bf4071660 2023-09-21T00:16:45.439 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.429+0000 7f5bf17fa700 1 -- 172.21.15.83:0/2036091290 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f5be8020060 con 0x7f5bf4071660 2023-09-21T00:16:45.441 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-09-21T00:16:45.430+0000 7f546869e200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-21T00:16:45.470 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-09-21T00:16:45.466+0000 7f95ffd18200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-21T00:16:45.502 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-09-21T00:16:45.501+0000 7f546869e200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-21T00:16:45.514 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.513+0000 7f5bfb022700 1 -- 172.21.15.83:0/2036091290 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5498d9ab-1086-4796-a199-9051e6dfea91", "id": 5} v 0) v1 -- 0x7f5bf40c8260 con 0x7f5bf4071660 2023-09-21T00:16:45.522 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.521+0000 7f5bf17fa700 1 -- 172.21.15.83:0/2036091290 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5498d9ab-1086-4796-a199-9051e6dfea91", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5bf40c8260 con 0x7f5bf4071660 2023-09-21T00:16:45.522 INFO:teuthology.orchestra.run.smithi083.stdout:5 2023-09-21T00:16:45.523 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.522+0000 7f5bfb022700 1 -- 172.21.15.83:0/2036091290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bf4071660 msgr2=0x7f5bf4153730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:45.523 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.522+0000 7f5bfb022700 1 --2- 172.21.15.83:0/2036091290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bf4071660 0x7f5bf4153730 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5be800c440 tx=0x7f5be8001e70 comp rx=0 tx=0).stop 2023-09-21T00:16:45.523 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.522+0000 7f5bfb022700 1 -- 172.21.15.83:0/2036091290 shutdown_connections 2023-09-21T00:16:45.524 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.522+0000 7f5bfb022700 1 --2- 172.21.15.83:0/2036091290 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5bf415de70 0x7f5bf40ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:45.524 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.522+0000 7f5bfb022700 1 --2- 172.21.15.83:0/2036091290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bf4071660 0x7f5bf4153730 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:45.524 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.522+0000 7f5bfb022700 1 --2- 172.21.15.83:0/2036091290 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5bf415a4f0 0x7f5bf40c7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:45.524 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.522+0000 7f5bfb022700 1 -- 172.21.15.83:0/2036091290 >> 172.21.15.83:0/2036091290 conn(0x7f5bf40d0040 msgr2=0x7f5bf406ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:16:45.524 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.522+0000 7f5bfb022700 1 -- 172.21.15.83:0/2036091290 shutdown_connections 2023-09-21T00:16:45.525 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.522+0000 7f5bfb022700 1 -- 172.21.15.83:0/2036091290 wait complete. 2023-09-21T00:16:45.534 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new cfd810c0-5015-4d60-9a75-7efc93a32e09 6 2023-09-21T00:16:45.540 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-09-21T00:16:45.538+0000 7f95ffd18200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-21T00:16:45.655 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.654+0000 7efc4d760700 1 Processor -- start 2023-09-21T00:16:45.655 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.654+0000 7efc4d760700 1 -- start start 2023-09-21T00:16:45.657 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.656+0000 7efc4d760700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7efc480cca60 0x7efc480cce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:45.658 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.656+0000 7efc4d760700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc480cd380 con 0x7efc480c6330 2023-09-21T00:16:45.658 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.656+0000 7efc4d760700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc4806de10 con 0x7efc4815ea50 2023-09-21T00:16:45.658 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.656+0000 7efc4d760700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc4806dc20 con 0x7efc480cca60 2023-09-21T00:16:45.658 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.656+0000 7efc46ffd700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7efc480cca60 0x7efc480cce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:45.658 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.656+0000 7efc467fc700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7efc4815ea50 0x7efc4806d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:39600/0 (socket says 172.21.15.83:39600) 2023-09-21T00:16:45.659 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.656+0000 7efc46ffd700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7efc480cca60 0x7efc480cce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:36552/0 (socket says 172.21.15.83:36552) 2023-09-21T00:16:45.659 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.656+0000 7efc467fc700 1 -- 172.21.15.83:0/2141765530 learned_addr learned my addr 172.21.15.83:0/2141765530 (peer_addr_for_me v1:172.21.15.83:0/0) 2023-09-21T00:16:45.659 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.656+0000 7efc46ffd700 1 -- 172.21.15.83:0/2141765530 >> v1:172.21.15.83:6789/0 conn(0x7efc4815ea50 legacy=0x7efc4806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:45.659 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.656+0000 7efc45ffb700 1 -- 172.21.15.83:0/2141765530 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4281374892 0 0) 0x7efc4806de10 con 0x7efc4815ea50 2023-09-21T00:16:45.659 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.656+0000 7efc46ffd700 1 -- 172.21.15.83:0/2141765530 >> v1:172.21.15.59:6789/0 conn(0x7efc480c6330 legacy=0x7efc480cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:45.660 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.656+0000 7efc46ffd700 1 -- 172.21.15.83:0/2141765530 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc4806e0f0 con 0x7efc480cca60 2023-09-21T00:16:45.660 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.656+0000 7efc46ffd700 1 --2- 172.21.15.83:0/2141765530 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc480cca60 0x7efc480cce40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7efc38009840 tx=0x7efc38009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34f7bf7b969a45d4 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:16:45.660 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.656+0000 7efc45ffb700 1 -- 172.21.15.83:0/2141765530 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc38011830 con 0x7efc480cca60 2023-09-21T00:16:45.660 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.656+0000 7efc45ffb700 1 -- 172.21.15.83:0/2141765530 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc38011990 con 0x7efc480cca60 2023-09-21T00:16:45.660 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.656+0000 7efc45ffb700 1 -- 172.21.15.83:0/2141765530 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc38011d20 con 0x7efc480cca60 2023-09-21T00:16:45.663 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.657+0000 7efc4d760700 1 -- 172.21.15.83:0/2141765530 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc480cca60 msgr2=0x7efc480cce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:45.664 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.657+0000 7efc4d760700 1 --2- 172.21.15.83:0/2141765530 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc480cca60 0x7efc480cce40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7efc38009840 tx=0x7efc38009b50 comp rx=0 tx=0).stop 2023-09-21T00:16:45.664 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.657+0000 7efc4d760700 1 -- 172.21.15.83:0/2141765530 shutdown_connections 2023-09-21T00:16:45.664 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.657+0000 7efc4d760700 1 --2- 172.21.15.83:0/2141765530 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc480cca60 0x7efc480cce40 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:45.665 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.657+0000 7efc4d760700 1 -- 172.21.15.83:0/2141765530 >> 172.21.15.83:0/2141765530 conn(0x7efc480b1c80 msgr2=0x7efc480b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:16:45.665 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.657+0000 7efc4d760700 1 -- 172.21.15.83:0/2141765530 shutdown_connections 2023-09-21T00:16:45.665 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.657+0000 7efc4d760700 1 -- 172.21.15.83:0/2141765530 wait complete. 2023-09-21T00:16:45.665 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.659+0000 7efc4d760700 1 Processor -- start 2023-09-21T00:16:45.666 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.659+0000 7efc4d760700 1 -- start start 2023-09-21T00:16:45.666 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.659+0000 7efc4d760700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efc480c6330 0x7efc4813cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:45.666 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.659+0000 7efc4d760700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc480cca60 0x7efc48141ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:45.666 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.659+0000 7efc4d760700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc4815ea50 0x7efc480cad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:45.667 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.659+0000 7efc4d760700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc4814cfe0 con 0x7efc480cca60 2023-09-21T00:16:45.667 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.659+0000 7efc4d760700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc4813cff0 con 0x7efc4815ea50 2023-09-21T00:16:45.667 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.659+0000 7efc4d760700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc48142410 con 0x7efc480c6330 2023-09-21T00:16:45.667 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.659+0000 7efc46ffd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efc480c6330 0x7efc4813cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:45.667 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.659+0000 7efc477fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc4815ea50 0x7efc480cad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:45.668 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.659+0000 7efc46ffd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efc480c6330 0x7efc4813cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.83:56340/0 (socket says 172.21.15.83:56340) 2023-09-21T00:16:45.668 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.659+0000 7efc46ffd700 1 -- 172.21.15.83:0/59670571 learned_addr learned my addr 172.21.15.83:0/59670571 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-09-21T00:16:45.668 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.659+0000 7efc467fc700 1 --2- 172.21.15.83:0/59670571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc480cca60 0x7efc48141ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:45.668 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.660+0000 7efc477fe700 1 -- 172.21.15.83:0/59670571 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efc480c6330 msgr2=0x7efc4813cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:45.668 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.660+0000 7efc477fe700 1 --2- 172.21.15.83:0/59670571 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efc480c6330 0x7efc4813cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:45.669 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.660+0000 7efc477fe700 1 -- 172.21.15.83:0/59670571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc480cca60 msgr2=0x7efc48141ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:45.669 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.660+0000 7efc477fe700 1 --2- 172.21.15.83:0/59670571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc480cca60 0x7efc48141ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:45.669 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.660+0000 7efc477fe700 1 -- 172.21.15.83:0/59670571 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc380094a0 con 0x7efc4815ea50 2023-09-21T00:16:45.669 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.660+0000 7efc46ffd700 1 --2- 172.21.15.83:0/59670571 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efc480c6330 0x7efc4813cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T00:16:45.669 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.660+0000 7efc477fe700 1 --2- 172.21.15.83:0/59670571 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc4815ea50 0x7efc480cad50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efc4000cb90 tx=0x7efc4000cea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:16:45.670 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.660+0000 7efc2f7fe700 1 -- 172.21.15.83:0/59670571 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc40003c00 con 0x7efc4815ea50 2023-09-21T00:16:45.670 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.660+0000 7efc2f7fe700 1 -- 172.21.15.83:0/59670571 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc40003d60 con 0x7efc4815ea50 2023-09-21T00:16:45.670 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.660+0000 7efc2f7fe700 1 -- 172.21.15.83:0/59670571 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4000aa80 con 0x7efc4815ea50 2023-09-21T00:16:45.670 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.660+0000 7efc4d760700 1 -- 172.21.15.83:0/59670571 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc481426d0 con 0x7efc4815ea50 2023-09-21T00:16:45.670 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.660+0000 7efc4d760700 1 -- 172.21.15.83:0/59670571 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc48142c90 con 0x7efc4815ea50 2023-09-21T00:16:45.671 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.661+0000 7efc2f7fe700 1 -- 172.21.15.83:0/59670571 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7efc400050d0 con 0x7efc4815ea50 2023-09-21T00:16:45.671 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.661+0000 7efc2f7fe700 1 -- 172.21.15.83:0/59670571 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7efc40012b00 con 0x7efc4815ea50 2023-09-21T00:16:45.671 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.661+0000 7efc4d760700 1 -- 172.21.15.83:0/59670571 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc48067e50 con 0x7efc4815ea50 2023-09-21T00:16:45.671 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.663+0000 7efc2f7fe700 1 -- 172.21.15.83:0/59670571 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7efc40012d60 con 0x7efc4815ea50 2023-09-21T00:16:45.747 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.746+0000 7efc4d760700 1 -- 172.21.15.83:0/59670571 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cfd810c0-5015-4d60-9a75-7efc93a32e09", "id": 6} v 0) v1 -- 0x7efc4815db10 con 0x7efc4815ea50 2023-09-21T00:16:45.756 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.755+0000 7efc2f7fe700 1 -- 172.21.15.83:0/59670571 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cfd810c0-5015-4d60-9a75-7efc93a32e09", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7efc40005510 con 0x7efc4815ea50 2023-09-21T00:16:45.756 INFO:teuthology.orchestra.run.smithi083.stdout:6 2023-09-21T00:16:45.757 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.755+0000 7efc4d760700 1 -- 172.21.15.83:0/59670571 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc4815ea50 msgr2=0x7efc480cad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:45.757 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.755+0000 7efc4d760700 1 --2- 172.21.15.83:0/59670571 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc4815ea50 0x7efc480cad50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efc4000cb90 tx=0x7efc4000cea0 comp rx=0 tx=0).stop 2023-09-21T00:16:45.758 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.756+0000 7efc4d760700 1 -- 172.21.15.83:0/59670571 shutdown_connections 2023-09-21T00:16:45.758 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.756+0000 7efc4d760700 1 --2- 172.21.15.83:0/59670571 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc4815ea50 0x7efc480cad50 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:45.758 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.756+0000 7efc4d760700 1 --2- 172.21.15.83:0/59670571 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efc480c6330 0x7efc4813cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:45.758 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.756+0000 7efc4d760700 1 --2- 172.21.15.83:0/59670571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc480cca60 0x7efc48141ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:45.758 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.756+0000 7efc4d760700 1 -- 172.21.15.83:0/59670571 >> 172.21.15.83:0/59670571 conn(0x7efc480b1c80 msgr2=0x7efc480c4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:16:45.759 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.756+0000 7efc4d760700 1 -- 172.21.15.83:0/59670571 shutdown_connections 2023-09-21T00:16:45.759 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.756+0000 7efc4d760700 1 -- 172.21.15.83:0/59670571 wait complete. 2023-09-21T00:16:45.772 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new e992c8fa-0a3d-4b3c-85b5-2c511223dee4 7 2023-09-21T00:16:45.892 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.891+0000 7f54c6b5c700 1 Processor -- start 2023-09-21T00:16:45.893 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.891+0000 7f54c6b5c700 1 -- start start 2023-09-21T00:16:45.895 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.892+0000 7f54c6b5c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54c0071660 0x7f54c0071a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:45.895 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.892+0000 7f54c6b5c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c00cb740 con 0x7f54c015de70 2023-09-21T00:16:45.895 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.892+0000 7f54c6b5c700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c00caba0 con 0x7f54c015a4f0 2023-09-21T00:16:45.895 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.892+0000 7f54c6b5c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c015ee60 con 0x7f54c0071660 2023-09-21T00:16:45.895 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.892+0000 7f54c48f8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54c0071660 0x7f54c0071a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:45.896 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.892+0000 7f54bffff700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f54c015a4f0 0x7f54c00cb030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:39610/0 (socket says 172.21.15.83:39610) 2023-09-21T00:16:45.896 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.892+0000 7f54bffff700 1 -- 172.21.15.83:0/261310812 learned_addr learned my addr 172.21.15.83:0/261310812 (peer_addr_for_me v1:172.21.15.83:0/0) 2023-09-21T00:16:45.896 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.892+0000 7f54bf7fe700 1 -- 172.21.15.83:0/261310812 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1190759107 0 0) 0x7f54c00caba0 con 0x7f54c015a4f0 2023-09-21T00:16:45.896 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.892+0000 7f54c48f8700 1 -- 172.21.15.83:0/261310812 >> v1:172.21.15.83:6789/0 conn(0x7f54c015a4f0 legacy=0x7f54c00cb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:45.896 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.892+0000 7f54c48f8700 1 -- 172.21.15.83:0/261310812 >> v1:172.21.15.59:6789/0 conn(0x7f54c015de70 legacy=0x7f54c006eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:45.897 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.892+0000 7f54c48f8700 1 -- 172.21.15.83:0/261310812 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c0071f80 con 0x7f54c0071660 2023-09-21T00:16:45.897 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.893+0000 7f54c48f8700 1 --2- 172.21.15.83:0/261310812 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54c0071660 0x7f54c0071a40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f54b4009870 tx=0x7f54b4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a88aed3ecf9249a3 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:16:45.897 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.893+0000 7f54bf7fe700 1 -- 172.21.15.83:0/261310812 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b4011830 con 0x7f54c0071660 2023-09-21T00:16:45.897 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.893+0000 7f54bf7fe700 1 -- 172.21.15.83:0/261310812 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b4011990 con 0x7f54c0071660 2023-09-21T00:16:45.897 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.893+0000 7f54bf7fe700 1 -- 172.21.15.83:0/261310812 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b4011d20 con 0x7f54c0071660 2023-09-21T00:16:45.898 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.893+0000 7f54c6b5c700 1 -- 172.21.15.83:0/261310812 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54c0071660 msgr2=0x7f54c0071a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:45.898 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.893+0000 7f54c6b5c700 1 --2- 172.21.15.83:0/261310812 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54c0071660 0x7f54c0071a40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f54b4009870 tx=0x7f54b4009b80 comp rx=0 tx=0).stop 2023-09-21T00:16:45.898 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.893+0000 7f54c6b5c700 1 -- 172.21.15.83:0/261310812 shutdown_connections 2023-09-21T00:16:45.898 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.893+0000 7f54c6b5c700 1 --2- 172.21.15.83:0/261310812 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54c0071660 0x7f54c0071a40 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:45.898 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.893+0000 7f54c6b5c700 1 -- 172.21.15.83:0/261310812 >> 172.21.15.83:0/261310812 conn(0x7f54c00d0040 msgr2=0x7f54c00d0420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:16:45.899 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.893+0000 7f54c6b5c700 1 -- 172.21.15.83:0/261310812 shutdown_connections 2023-09-21T00:16:45.899 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.893+0000 7f54c6b5c700 1 -- 172.21.15.83:0/261310812 wait complete. 2023-09-21T00:16:45.901 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.895+0000 7f54c6b5c700 1 Processor -- start 2023-09-21T00:16:45.901 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.895+0000 7f54c6b5c700 1 -- start start 2023-09-21T00:16:45.901 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.897+0000 7f54c6b5c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54c0071660 0x7f54c01f3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:45.902 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.897+0000 7f54c6b5c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f54c015a4f0 0x7f54c00c63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:45.902 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.897+0000 7f54c6b5c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54c015de70 0x7f54c00a8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:45.902 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.897+0000 7f54c6b5c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c01f17b0 con 0x7f54c0071660 2023-09-21T00:16:45.902 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.897+0000 7f54c6b5c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c01f0940 con 0x7f54c015a4f0 2023-09-21T00:16:45.902 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.897+0000 7f54c6b5c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c01f0ba0 con 0x7f54c015de70 2023-09-21T00:16:45.903 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.897+0000 7f54bffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f54c015a4f0 0x7f54c00c63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:45.903 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.897+0000 7f54c50f9700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54c015de70 0x7f54c00a8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:45.903 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.897+0000 7f54bffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f54c015a4f0 0x7f54c00c63c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:36572/0 (socket says 172.21.15.83:36572) 2023-09-21T00:16:45.903 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.897+0000 7f54bffff700 1 -- 172.21.15.83:0/3781018243 learned_addr learned my addr 172.21.15.83:0/3781018243 (peer_addr_for_me v2:172.21.15.83:0/0) 2023-09-21T00:16:45.903 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.897+0000 7f54c48f8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54c0071660 0x7f54c01f3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:45.903 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.897+0000 7f54c50f9700 1 -- 172.21.15.83:0/3781018243 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f54c015a4f0 msgr2=0x7f54c00c63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:45.904 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.897+0000 7f54c50f9700 1 --2- 172.21.15.83:0/3781018243 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f54c015a4f0 0x7f54c00c63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:45.904 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.897+0000 7f54c50f9700 1 -- 172.21.15.83:0/3781018243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54c0071660 msgr2=0x7f54c01f3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:45.904 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.897+0000 7f54c50f9700 1 --2- 172.21.15.83:0/3781018243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54c0071660 0x7f54c01f3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:45.904 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.897+0000 7f54c50f9700 1 -- 172.21.15.83:0/3781018243 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b40094a0 con 0x7f54c015de70 2023-09-21T00:16:45.904 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.897+0000 7f54bffff700 1 --2- 172.21.15.83:0/3781018243 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f54c015a4f0 0x7f54c00c63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T00:16:45.905 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.897+0000 7f54c50f9700 1 --2- 172.21.15.83:0/3781018243 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54c015de70 0x7f54c00a8a40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f54b800cae0 tx=0x7f54b800cdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:16:45.905 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.897+0000 7f54bd7fa700 1 -- 172.21.15.83:0/3781018243 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b8003c00 con 0x7f54c015de70 2023-09-21T00:16:45.905 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.897+0000 7f54bd7fa700 1 -- 172.21.15.83:0/3781018243 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b8003d60 con 0x7f54c015de70 2023-09-21T00:16:45.905 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.897+0000 7f54bd7fa700 1 -- 172.21.15.83:0/3781018243 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b800aa20 con 0x7f54c015de70 2023-09-21T00:16:45.905 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.897+0000 7f54c6b5c700 1 -- 172.21.15.83:0/3781018243 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54c01f0e80 con 0x7f54c015de70 2023-09-21T00:16:45.906 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.898+0000 7f54c6b5c700 1 -- 172.21.15.83:0/3781018243 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c01f1440 con 0x7f54c015de70 2023-09-21T00:16:45.906 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.898+0000 7f54bd7fa700 1 -- 172.21.15.83:0/3781018243 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f54b80050d0 con 0x7f54c015de70 2023-09-21T00:16:45.906 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.898+0000 7f54bd7fa700 1 -- 172.21.15.83:0/3781018243 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f54b8012ad0 con 0x7f54c015de70 2023-09-21T00:16:45.906 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.898+0000 7f54c6b5c700 1 -- 172.21.15.83:0/3781018243 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54c0066fd0 con 0x7f54c015de70 2023-09-21T00:16:45.907 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.902+0000 7f54bd7fa700 1 -- 172.21.15.83:0/3781018243 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f54c00cb740 con 0x7f54c015de70 2023-09-21T00:16:45.986 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.985+0000 7f54c6b5c700 1 -- 172.21.15.83:0/3781018243 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e992c8fa-0a3d-4b3c-85b5-2c511223dee4", "id": 7} v 0) v1 -- 0x7f54c0067e50 con 0x7f54c015de70 2023-09-21T00:16:45.994 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.993+0000 7f54bd7fa700 1 -- 172.21.15.83:0/3781018243 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e992c8fa-0a3d-4b3c-85b5-2c511223dee4", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f54b8012e00 con 0x7f54c015de70 2023-09-21T00:16:45.994 INFO:teuthology.orchestra.run.smithi083.stdout:7 2023-09-21T00:16:45.995 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.994+0000 7f54c6b5c700 1 -- 172.21.15.83:0/3781018243 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54c015de70 msgr2=0x7f54c00a8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:45.995 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.994+0000 7f54c6b5c700 1 --2- 172.21.15.83:0/3781018243 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54c015de70 0x7f54c00a8a40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f54b800cae0 tx=0x7f54b800cdf0 comp rx=0 tx=0).stop 2023-09-21T00:16:45.996 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.994+0000 7f54c6b5c700 1 -- 172.21.15.83:0/3781018243 shutdown_connections 2023-09-21T00:16:45.996 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.994+0000 7f54c6b5c700 1 --2- 172.21.15.83:0/3781018243 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54c015de70 0x7f54c00a8a40 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:45.996 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.994+0000 7f54c6b5c700 1 --2- 172.21.15.83:0/3781018243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54c0071660 0x7f54c01f3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:45.996 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.994+0000 7f54c6b5c700 1 --2- 172.21.15.83:0/3781018243 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f54c015a4f0 0x7f54c00c63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:45.996 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.994+0000 7f54c6b5c700 1 -- 172.21.15.83:0/3781018243 >> 172.21.15.83:0/3781018243 conn(0x7f54c00d0040 msgr2=0x7f54c00afb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:16:45.997 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.994+0000 7f54c6b5c700 1 -- 172.21.15.83:0/3781018243 shutdown_connections 2023-09-21T00:16:45.997 INFO:teuthology.orchestra.run.smithi083.stderr:2023-09-21T00:16:45.994+0000 7f54c6b5c700 1 -- 172.21.15.83:0/3781018243 wait complete. 2023-09-21T00:16:46.007 INFO:tasks.ceph.osd.0:Restarting daemon 2023-09-21T00:16:46.008 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-09-21T00:16:46.010 INFO:tasks.ceph.osd.0:Started 2023-09-21T00:16:46.011 INFO:tasks.ceph.osd.1:Restarting daemon 2023-09-21T00:16:46.011 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-09-21T00:16:46.014 INFO:tasks.ceph.osd.1:Started 2023-09-21T00:16:46.015 INFO:tasks.ceph.osd.2:Restarting daemon 2023-09-21T00:16:46.015 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-09-21T00:16:46.018 INFO:tasks.ceph.osd.2:Started 2023-09-21T00:16:46.019 INFO:tasks.ceph.osd.3:Restarting daemon 2023-09-21T00:16:46.019 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-09-21T00:16:46.022 INFO:tasks.ceph.osd.3:Started 2023-09-21T00:16:46.022 INFO:tasks.ceph.osd.4:Restarting daemon 2023-09-21T00:16:46.023 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-09-21T00:16:46.025 INFO:tasks.ceph.osd.4:Started 2023-09-21T00:16:46.025 INFO:tasks.ceph.osd.5:Restarting daemon 2023-09-21T00:16:46.026 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-09-21T00:16:46.028 INFO:tasks.ceph.osd.5:Started 2023-09-21T00:16:46.028 INFO:tasks.ceph.osd.6:Restarting daemon 2023-09-21T00:16:46.029 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-09-21T00:16:46.031 INFO:tasks.ceph.osd.6:Started 2023-09-21T00:16:46.032 INFO:tasks.ceph.osd.7:Restarting daemon 2023-09-21T00:16:46.032 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-09-21T00:16:46.035 INFO:tasks.ceph.osd.7:Started 2023-09-21T00:16:46.036 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T00:16:46.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.193+0000 7f5650d2e700 1 Processor -- start 2023-09-21T00:16:46.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.193+0000 7f5650d2e700 1 -- start start 2023-09-21T00:16:46.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.193+0000 7f5650d2e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f564c15d690 0x7f564c070b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:46.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.194+0000 7f5650d2e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f564c0cedb0 0x7f564c0cf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:46.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.194+0000 7f5650d2e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f564c0cf740 con 0x7f564c143ce0 2023-09-21T00:16:46.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.194+0000 7f5650d2e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f564c161990 con 0x7f564c0cedb0 2023-09-21T00:16:46.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.194+0000 7f5650d2e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f564c162170 con 0x7f564c15d690 2023-09-21T00:16:46.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.194+0000 7f564ad9d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f564c0cedb0 0x7f564c0cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:46.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.194+0000 7f564a59c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f564c15d690 0x7f564c070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:46.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.194+0000 7f5649d9b700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f564c143ce0 0x7f564c161280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.59:46556/0 (socket says 172.21.15.59:46556) 2023-09-21T00:16:46.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.194+0000 7f5649d9b700 1 -- 172.21.15.59:0/2591471202 learned_addr learned my addr 172.21.15.59:0/2591471202 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:16:46.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.194+0000 7f564a59c700 1 -- 172.21.15.59:0/2591471202 >> v2:172.21.15.83:3300/0 conn(0x7f564c0cedb0 msgr2=0x7f564c0cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:16:46.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.194+0000 7f564a59c700 1 --2- 172.21.15.59:0/2591471202 >> v2:172.21.15.83:3300/0 conn(0x7f564c0cedb0 0x7f564c0cf200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:46.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.194+0000 7f564a59c700 1 -- 172.21.15.59:0/2591471202 >> v1:172.21.15.83:6789/0 conn(0x7f564c143ce0 legacy=0x7f564c161280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:46.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.194+0000 7f564a59c700 1 -- 172.21.15.59:0/2591471202 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f564c161bb0 con 0x7f564c15d690 2023-09-21T00:16:46.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.194+0000 7f564959a700 1 -- 172.21.15.59:0/2591471202 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 470214371 0 0) 0x7f5640001110 con 0x7f564c143ce0 2023-09-21T00:16:46.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.194+0000 7f564ad9d700 1 --2- 172.21.15.59:0/2591471202 >> v2:172.21.15.83:3300/0 conn(0x7f564c0cedb0 0x7f564c0cf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T00:16:46.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.194+0000 7f564a59c700 1 --2- 172.21.15.59:0/2591471202 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f564c15d690 0x7f564c070b10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f563c009840 tx=0x7f563c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e154a98f7563883 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:16:46.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.194+0000 7f564959a700 1 -- 172.21.15.59:0/2591471202 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563c011830 con 0x7f564c15d690 2023-09-21T00:16:46.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.195+0000 7f564959a700 1 -- 172.21.15.59:0/2591471202 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563c011990 con 0x7f564c15d690 2023-09-21T00:16:46.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.195+0000 7f564959a700 1 -- 172.21.15.59:0/2591471202 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563c011d20 con 0x7f564c15d690 2023-09-21T00:16:46.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.195+0000 7f5650d2e700 1 -- 172.21.15.59:0/2591471202 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f564c15d690 msgr2=0x7f564c070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:46.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.195+0000 7f5650d2e700 1 --2- 172.21.15.59:0/2591471202 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f564c15d690 0x7f564c070b10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f563c009840 tx=0x7f563c009b50 comp rx=0 tx=0).stop 2023-09-21T00:16:46.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.195+0000 7f5650d2e700 1 -- 172.21.15.59:0/2591471202 shutdown_connections 2023-09-21T00:16:46.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.195+0000 7f5650d2e700 1 --2- 172.21.15.59:0/2591471202 >> v2:172.21.15.83:3300/0 conn(0x7f564c0cedb0 0x7f564c0cf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:46.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.195+0000 7f5650d2e700 1 --2- 172.21.15.59:0/2591471202 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f564c15d690 0x7f564c070b10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:46.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.195+0000 7f5650d2e700 1 -- 172.21.15.59:0/2591471202 >> 172.21.15.59:0/2591471202 conn(0x7f564c0d11e0 msgr2=0x7f564c0d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:16:46.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.195+0000 7f5650d2e700 1 -- 172.21.15.59:0/2591471202 shutdown_connections 2023-09-21T00:16:46.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.195+0000 7f5650d2e700 1 -- 172.21.15.59:0/2591471202 wait complete. 2023-09-21T00:16:46.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.197+0000 7f5650d2e700 1 Processor -- start 2023-09-21T00:16:46.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.197+0000 7f5650d2e700 1 -- start start 2023-09-21T00:16:46.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.198+0000 7f5650d2e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f564c0cedb0 0x7f564c1f2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:46.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.198+0000 7f5650d2e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f564c143ce0 0x7f564c0b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:46.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.198+0000 7f5650d2e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f564c15d690 0x7f564c0b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:46.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.198+0000 7f5650d2e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564c0cacd0 con 0x7f564c15d690 2023-09-21T00:16:46.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.198+0000 7f5650d2e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564c0b3170 con 0x7f564c0cedb0 2023-09-21T00:16:46.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.198+0000 7f5650d2e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f564c0c4670 con 0x7f564c143ce0 2023-09-21T00:16:46.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.198+0000 7f564ad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f564c15d690 0x7f564c0b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:46.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.198+0000 7f564ad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f564c15d690 0x7f564c0b2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50498/0 (socket says 172.21.15.59:50498) 2023-09-21T00:16:46.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.198+0000 7f564ad9d700 1 -- 172.21.15.59:0/2603351925 learned_addr learned my addr 172.21.15.59:0/2603351925 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:16:46.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.198+0000 7f564a59c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f564c0cedb0 0x7f564c1f2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:46.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.198+0000 7f5649d9b700 1 --2- 172.21.15.59:0/2603351925 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f564c143ce0 0x7f564c0b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:46.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.198+0000 7f564a59c700 1 -- 172.21.15.59:0/2603351925 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f564c143ce0 msgr2=0x7f564c0b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:46.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.198+0000 7f564a59c700 1 --2- 172.21.15.59:0/2603351925 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f564c143ce0 0x7f564c0b26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:46.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.198+0000 7f564a59c700 1 -- 172.21.15.59:0/2603351925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f564c15d690 msgr2=0x7f564c0b2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:46.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.198+0000 7f564a59c700 1 --2- 172.21.15.59:0/2603351925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f564c15d690 0x7f564c0b2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:46.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.198+0000 7f564a59c700 1 -- 172.21.15.59:0/2603351925 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5644009a70 con 0x7f564c0cedb0 2023-09-21T00:16:46.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.198+0000 7f564ad9d700 1 --2- 172.21.15.59:0/2603351925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f564c15d690 0x7f564c0b2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T00:16:46.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.199+0000 7f564a59c700 1 --2- 172.21.15.59:0/2603351925 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f564c0cedb0 0x7f564c1f2680 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f563c016000 tx=0x7f563c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:16:46.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.199+0000 7f563affd700 1 -- 172.21.15.59:0/2603351925 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563c0036a0 con 0x7f564c0cedb0 2023-09-21T00:16:46.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.199+0000 7f563affd700 1 -- 172.21.15.59:0/2603351925 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563c01f070 con 0x7f564c0cedb0 2023-09-21T00:16:46.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.199+0000 7f5650d2e700 1 -- 172.21.15.59:0/2603351925 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f563c0094a0 con 0x7f564c0cedb0 2023-09-21T00:16:46.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.199+0000 7f563affd700 1 -- 172.21.15.59:0/2603351925 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563c003a20 con 0x7f564c0cedb0 2023-09-21T00:16:46.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.199+0000 7f5650d2e700 1 -- 172.21.15.59:0/2603351925 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f564c159ee0 con 0x7f564c0cedb0 2023-09-21T00:16:46.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.199+0000 7f563affd700 1 -- 172.21.15.59:0/2603351925 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f563c026480 con 0x7f564c0cedb0 2023-09-21T00:16:46.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.199+0000 7f563affd700 1 -- 172.21.15.59:0/2603351925 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f563c021070 con 0x7f564c0cedb0 2023-09-21T00:16:46.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.200+0000 7f5650d2e700 1 -- 172.21.15.59:0/2603351925 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f564c067e50 con 0x7f564c0cedb0 2023-09-21T00:16:46.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.202+0000 7f563affd700 1 -- 172.21.15.59:0/2603351925 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f563c015020 con 0x7f564c0cedb0 2023-09-21T00:16:46.245 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-09-21T00:16:46.244+0000 7f546869e200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-21T00:16:46.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.273+0000 7f5650d2e700 1 -- 172.21.15.59:0/2603351925 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f564c0b7160 con 0x7f564c0cedb0 2023-09-21T00:16:46.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.274+0000 7f563affd700 1 -- 172.21.15.59:0/2603351925 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f563c026730 con 0x7f564c0cedb0 2023-09-21T00:16:46.276 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:16:46.277 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":10,"fsid":"dd69925c-6e25-42fe-880b-2f60fc6f384b","created":"2023-09-21T00:16:43.074489+0000","modified":"2023-09-21T00:16:45.987089+0000","last_up_change":"0.000000","last_in_change":"2023-09-21T00:16:45.987089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d4b18344-74c0-4f75-920b-7a9247e48914","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"80940d50-a248-4e64-a282-7ffcdad790ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"55f2eceb-c54a-4879-a6ce-968c1c548b5d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"92b89cd0-869c-49b9-a9f9-97ac8423f304","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"25b80e94-e0e6-403d-b69f-61542f289637","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5498d9ab-1086-4796-a199-9051e6dfea91","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"cfd810c0-5015-4d60-9a75-7efc93a32e09","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e992c8fa-0a3d-4b3c-85b5-2c511223dee4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T00:16:46.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.275+0000 7f5650d2e700 1 -- 172.21.15.59:0/2603351925 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f564c0cedb0 msgr2=0x7f564c1f2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:46.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.275+0000 7f5650d2e700 1 --2- 172.21.15.59:0/2603351925 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f564c0cedb0 0x7f564c1f2680 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f563c016000 tx=0x7f563c004750 comp rx=0 tx=0).stop 2023-09-21T00:16:46.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.275+0000 7f5650d2e700 1 -- 172.21.15.59:0/2603351925 shutdown_connections 2023-09-21T00:16:46.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.275+0000 7f5650d2e700 1 --2- 172.21.15.59:0/2603351925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f564c15d690 0x7f564c0b2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:46.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.275+0000 7f5650d2e700 1 --2- 172.21.15.59:0/2603351925 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f564c0cedb0 0x7f564c1f2680 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:46.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.275+0000 7f5650d2e700 1 --2- 172.21.15.59:0/2603351925 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f564c143ce0 0x7f564c0b26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:46.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.275+0000 7f5650d2e700 1 -- 172.21.15.59:0/2603351925 >> 172.21.15.59:0/2603351925 conn(0x7f564c0d11e0 msgr2=0x7f564c145450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:16:46.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.275+0000 7f5650d2e700 1 -- 172.21.15.59:0/2603351925 shutdown_connections 2023-09-21T00:16:46.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:16:46.275+0000 7f5650d2e700 1 -- 172.21.15.59:0/2603351925 wait complete. 2023-09-21T00:16:46.289 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-09-21T00:16:46.290 INFO:tasks.ceph:Waiting for OSDs to come up 2023-09-21T00:16:46.303 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-09-21T00:16:46.301+0000 7f95ffd18200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-21T00:16:46.322 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-09-21T00:16:46.321+0000 7f546869e200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-21T00:16:46.381 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-09-21T00:16:46.379+0000 7fadcdc1b640 -1 Falling back to public interface 2023-09-21T00:16:46.385 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-09-21T00:16:46.383+0000 7f95ffd18200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-21T00:16:46.463 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-09-21T00:16:46.462+0000 7f546869e200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-21T00:16:46.535 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-09-21T00:16:46.533+0000 7f95ffd18200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-21T00:16:46.634 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-09-21T00:16:46.632+0000 7f795364e640 -1 Falling back to public interface 2023-09-21T00:16:46.639 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-09-21T00:16:46.637+0000 7fc5d2ffc640 -1 Falling back to public interface 2023-09-21T00:16:46.643 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-09-21T00:16:46.642+0000 7fe57abc1640 -1 Falling back to public interface 2023-09-21T00:16:46.644 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-09-21T00:16:46.642+0000 7fae899db640 -1 Falling back to public interface 2023-09-21T00:16:46.644 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-09-21T00:16:46.642+0000 7fe571f7f700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2023-09-21T00:16:46.644 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-09-21T00:16:46.642+0000 7fae80d99700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2023-09-21T00:16:46.656 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-09-21T00:16:46.655+0000 7f6a3b10b640 -1 Falling back to public interface 2023-09-21T00:16:46.660 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-09-21T00:16:46.658+0000 7f969d1ce640 -1 Falling back to public interface 2023-09-21T00:16:46.665 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-09-21T00:16:46.664+0000 7fcec2f7b640 -1 Falling back to public interface 2023-09-21T00:16:46.699 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-09-21T00:16:46.699+0000 7f546869e200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-21T00:16:46.783 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-09-21T00:16:46.782+0000 7f95ffd18200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-21T00:16:46.907 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-09-21T00:16:46.906+0000 7f546869e200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-21T00:16:47.004 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-09-21T00:16:47.002+0000 7f95ffd18200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-21T00:16:47.040 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-09-21T00:16:47.039+0000 7f546869e200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-21T00:16:47.096 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-21T00:16:47.145 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-09-21T00:16:47.143+0000 7f95ffd18200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-21T00:16:47.213 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.211+0000 7fc94cd8a700 1 Processor -- start 2023-09-21T00:16:47.213 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.211+0000 7fc94cd8a700 1 -- start start 2023-09-21T00:16:47.215 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.212+0000 7fc94cd8a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc94815b2e0 0x7fc94815e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:47.215 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.212+0000 7fc94cd8a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc94806f2d0 0x7fc948070160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:47.216 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.212+0000 7fc94cd8a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc948070b00 con 0x7fc9480706a0 2023-09-21T00:16:47.216 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.212+0000 7fc94cd8a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc94815ebc0 con 0x7fc94806f2d0 2023-09-21T00:16:47.216 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.212+0000 7fc94cd8a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94806ee40 con 0x7fc94815b2e0 2023-09-21T00:16:47.216 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.212+0000 7fc945d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc94806f2d0 0x7fc948070160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:47.216 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.212+0000 7fc946d9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc9480706a0 0x7fc94806b8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56072/0 (socket says 172.21.15.59:56072) 2023-09-21T00:16:47.217 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.212+0000 7fc946d9d700 1 -- 172.21.15.59:0/699067137 learned_addr learned my addr 172.21.15.59:0/699067137 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:16:47.217 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.212+0000 7fc94659c700 1 --2- 172.21.15.59:0/699067137 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc94815b2e0 0x7fc94815e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:47.217 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.212+0000 7fc945d9b700 1 -- 172.21.15.59:0/699067137 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc94815b2e0 msgr2=0x7fc94815e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:16:47.217 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.212+0000 7fc945d9b700 1 --2- 172.21.15.59:0/699067137 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc94815b2e0 0x7fc94815e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:47.217 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.212+0000 7fc945d9b700 1 -- 172.21.15.59:0/699067137 >> v1:172.21.15.59:6789/0 conn(0x7fc9480706a0 legacy=0x7fc94806b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:47.218 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.212+0000 7fc945d9b700 1 -- 172.21.15.59:0/699067137 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc94806eb10 con 0x7fc94806f2d0 2023-09-21T00:16:47.218 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.212+0000 7fc94559a700 1 -- 172.21.15.59:0/699067137 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1695895278 0 0) 0x7fc948070b00 con 0x7fc9480706a0 2023-09-21T00:16:47.218 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.212+0000 7fc945d9b700 1 --2- 172.21.15.59:0/699067137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc94806f2d0 0x7fc948070160 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc93c009840 tx=0x7fc93c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=992cb090a547a594 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:16:47.218 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.213+0000 7fc94559a700 1 -- 172.21.15.59:0/699067137 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c011830 con 0x7fc94806f2d0 2023-09-21T00:16:47.219 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.213+0000 7fc94559a700 1 -- 172.21.15.59:0/699067137 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc93c011990 con 0x7fc94806f2d0 2023-09-21T00:16:47.219 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.213+0000 7fc94559a700 1 -- 172.21.15.59:0/699067137 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c011d20 con 0x7fc94806f2d0 2023-09-21T00:16:47.219 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.213+0000 7fc94cd8a700 1 -- 172.21.15.59:0/699067137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc94806f2d0 msgr2=0x7fc948070160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:47.219 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.213+0000 7fc94cd8a700 1 --2- 172.21.15.59:0/699067137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc94806f2d0 0x7fc948070160 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc93c009840 tx=0x7fc93c009b50 comp rx=0 tx=0).stop 2023-09-21T00:16:47.219 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.213+0000 7fc94cd8a700 1 -- 172.21.15.59:0/699067137 shutdown_connections 2023-09-21T00:16:47.220 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.213+0000 7fc94cd8a700 1 --2- 172.21.15.59:0/699067137 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc94815b2e0 0x7fc94815e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:47.220 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.213+0000 7fc94cd8a700 1 --2- 172.21.15.59:0/699067137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc94806f2d0 0x7fc948070160 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:47.220 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.213+0000 7fc94cd8a700 1 -- 172.21.15.59:0/699067137 >> 172.21.15.59:0/699067137 conn(0x7fc9480d11f0 msgr2=0x7fc9480d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:16:47.220 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.213+0000 7fc94cd8a700 1 -- 172.21.15.59:0/699067137 shutdown_connections 2023-09-21T00:16:47.220 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.213+0000 7fc94cd8a700 1 -- 172.21.15.59:0/699067137 wait complete. 2023-09-21T00:16:47.223 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.215+0000 7fc94cd8a700 1 Processor -- start 2023-09-21T00:16:47.223 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.215+0000 7fc94cd8a700 1 -- start start 2023-09-21T00:16:47.223 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.215+0000 7fc94cd8a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc94806f2d0 0x7fc9480b3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:47.223 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.215+0000 7fc94cd8a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9480706a0 0x7fc9480ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:47.223 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.215+0000 7fc94cd8a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc94815b2e0 0x7fc9480acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:47.224 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.215+0000 7fc94cd8a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9480b59e0 con 0x7fc94806f2d0 2023-09-21T00:16:47.224 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.215+0000 7fc94cd8a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9480b4dd0 con 0x7fc94815b2e0 2023-09-21T00:16:47.224 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.215+0000 7fc94cd8a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9480b50b0 con 0x7fc9480706a0 2023-09-21T00:16:47.224 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.215+0000 7fc94659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc94806f2d0 0x7fc9480b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:47.224 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.216+0000 7fc94659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc94806f2d0 0x7fc9480b3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50506/0 (socket says 172.21.15.59:50506) 2023-09-21T00:16:47.225 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.216+0000 7fc94659c700 1 -- 172.21.15.59:0/3148157869 learned_addr learned my addr 172.21.15.59:0/3148157869 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:16:47.225 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.216+0000 7fc946d9d700 1 --2- 172.21.15.59:0/3148157869 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc94815b2e0 0x7fc9480acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:47.225 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.216+0000 7fc945d9b700 1 --2- 172.21.15.59:0/3148157869 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9480706a0 0x7fc9480ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:47.225 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.216+0000 7fc94659c700 1 -- 172.21.15.59:0/3148157869 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9480706a0 msgr2=0x7fc9480ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:47.225 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.216+0000 7fc94659c700 1 --2- 172.21.15.59:0/3148157869 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9480706a0 0x7fc9480ac890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:47.226 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.216+0000 7fc94659c700 1 -- 172.21.15.59:0/3148157869 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc94815b2e0 msgr2=0x7fc9480acdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:47.226 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.216+0000 7fc94659c700 1 --2- 172.21.15.59:0/3148157869 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc94815b2e0 0x7fc9480acdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:47.226 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.216+0000 7fc94659c700 1 -- 172.21.15.59:0/3148157869 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc93c0094a0 con 0x7fc94806f2d0 2023-09-21T00:16:47.226 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.216+0000 7fc94659c700 1 --2- 172.21.15.59:0/3148157869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc94806f2d0 0x7fc9480b3040 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc93800e9b0 tx=0x7fc93800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:16:47.226 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.216+0000 7fc936ffd700 1 -- 172.21.15.59:0/3148157869 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc938009710 con 0x7fc94806f2d0 2023-09-21T00:16:47.227 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.216+0000 7fc936ffd700 1 -- 172.21.15.59:0/3148157869 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc93800ee50 con 0x7fc94806f2d0 2023-09-21T00:16:47.227 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.216+0000 7fc936ffd700 1 -- 172.21.15.59:0/3148157869 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93800ca50 con 0x7fc94806f2d0 2023-09-21T00:16:47.227 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.216+0000 7fc94cd8a700 1 -- 172.21.15.59:0/3148157869 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9480b5390 con 0x7fc94806f2d0 2023-09-21T00:16:47.227 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.216+0000 7fc94cd8a700 1 -- 172.21.15.59:0/3148157869 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9480b3580 con 0x7fc94806f2d0 2023-09-21T00:16:47.227 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.216+0000 7fc936ffd700 1 -- 172.21.15.59:0/3148157869 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc938013470 con 0x7fc94806f2d0 2023-09-21T00:16:47.228 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.216+0000 7fc936ffd700 1 -- 172.21.15.59:0/3148157869 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fc93801cc60 con 0x7fc94806f2d0 2023-09-21T00:16:47.228 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.217+0000 7fc94cd8a700 1 -- 172.21.15.59:0/3148157869 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9480b5cc0 con 0x7fc94806f2d0 2023-09-21T00:16:47.228 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.219+0000 7fc936ffd700 1 -- 172.21.15.59:0/3148157869 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fc938021060 con 0x7fc94806f2d0 2023-09-21T00:16:47.260 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-09-21T00:16:47.259+0000 7f546869e200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-21T00:16:47.292 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.290+0000 7fc94cd8a700 1 -- 172.21.15.59:0/3148157869 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc94804f330 con 0x7fc94806f2d0 2023-09-21T00:16:47.292 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.290+0000 7fc936ffd700 1 -- 172.21.15.59:0/3148157869 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fc938017070 con 0x7fc94806f2d0 2023-09-21T00:16:47.293 INFO:teuthology.misc.health.smithi059.stdout: 2023-09-21T00:16:47.293 INFO:teuthology.misc.health.smithi059.stdout:{"epoch":10,"fsid":"dd69925c-6e25-42fe-880b-2f60fc6f384b","created":"2023-09-21T00:16:43.074489+0000","modified":"2023-09-21T00:16:45.987089+0000","last_up_change":"0.000000","last_in_change":"2023-09-21T00:16:45.987089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d4b18344-74c0-4f75-920b-7a9247e48914","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"80940d50-a248-4e64-a282-7ffcdad790ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"55f2eceb-c54a-4879-a6ce-968c1c548b5d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"92b89cd0-869c-49b9-a9f9-97ac8423f304","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"25b80e94-e0e6-403d-b69f-61542f289637","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5498d9ab-1086-4796-a199-9051e6dfea91","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"cfd810c0-5015-4d60-9a75-7efc93a32e09","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e992c8fa-0a3d-4b3c-85b5-2c511223dee4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T00:16:47.294 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.291+0000 7fc94cd8a700 1 -- 172.21.15.59:0/3148157869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc94806f2d0 msgr2=0x7fc9480b3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:47.295 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.291+0000 7fc94cd8a700 1 --2- 172.21.15.59:0/3148157869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc94806f2d0 0x7fc9480b3040 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc93800e9b0 tx=0x7fc93800ecc0 comp rx=0 tx=0).stop 2023-09-21T00:16:47.295 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.291+0000 7fc94cd8a700 1 -- 172.21.15.59:0/3148157869 shutdown_connections 2023-09-21T00:16:47.295 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.291+0000 7fc94cd8a700 1 --2- 172.21.15.59:0/3148157869 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc94815b2e0 0x7fc9480acdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:47.295 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.291+0000 7fc94cd8a700 1 --2- 172.21.15.59:0/3148157869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc94806f2d0 0x7fc9480b3040 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:47.295 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.291+0000 7fc94cd8a700 1 --2- 172.21.15.59:0/3148157869 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc9480706a0 0x7fc9480ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:47.296 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.291+0000 7fc94cd8a700 1 -- 172.21.15.59:0/3148157869 >> 172.21.15.59:0/3148157869 conn(0x7fc9480d11f0 msgr2=0x7fc94815e390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:16:47.296 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.291+0000 7fc94cd8a700 1 -- 172.21.15.59:0/3148157869 shutdown_connections 2023-09-21T00:16:47.296 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:47.291+0000 7fc94cd8a700 1 -- 172.21.15.59:0/3148157869 wait complete. 2023-09-21T00:16:47.304 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-09-21T00:16:47.378 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-09-21T00:16:47.376+0000 7f95ffd18200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-21T00:16:47.412 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-09-21T00:16:47.411+0000 7f546869e200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-21T00:16:47.528 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-09-21T00:16:47.527+0000 7f546869e200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-21T00:16:47.540 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-09-21T00:16:47.538+0000 7f95ffd18200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-21T00:16:47.661 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-09-21T00:16:47.659+0000 7f95ffd18200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-21T00:16:47.848 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-09-21T00:16:47.847+0000 7f546869e200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-21T00:16:47.946 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-09-21T00:16:47.945+0000 7f546869e200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-21T00:16:47.996 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-09-21T00:16:47.994+0000 7f95ffd18200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-21T00:16:48.100 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-09-21T00:16:48.098+0000 7f95ffd18200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-21T00:16:48.132 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-09-21T00:16:48.132+0000 7f546869e200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-21T00:16:48.296 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-09-21T00:16:48.294+0000 7f95ffd18200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-21T00:16:48.722 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-09-21T00:16:48.721+0000 7f546869e200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-21T00:16:48.922 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-09-21T00:16:48.920+0000 7f95ffd18200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-21T00:16:49.747 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-09-21T00:16:49.746+0000 7f5428657700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-09-21T00:16:49.748 INFO:tasks.ceph.mgr.x.smithi083.stderr:2023-09-21T00:16:49.747+0000 7f5428657700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-09-21T00:16:49.871 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-09-21T00:16:49.869+0000 7fadcdc1b640 -1 osd.1 0 log_to_monitors true 2023-09-21T00:16:49.933 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-09-21T00:16:49.932+0000 7f6a3b10b640 -1 osd.5 0 log_to_monitors true 2023-09-21T00:16:50.130 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-09-21T00:16:50.128+0000 7fc5d2ffc640 -1 osd.2 0 log_to_monitors true 2023-09-21T00:16:50.135 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-09-21T00:16:50.135+0000 7fe57abc1640 -1 osd.4 0 log_to_monitors true 2023-09-21T00:16:50.145 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-09-21T00:16:50.143+0000 7f795364e640 -1 osd.0 0 log_to_monitors true 2023-09-21T00:16:50.164 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-09-21T00:16:50.163+0000 7fae899db640 -1 osd.6 0 log_to_monitors true 2023-09-21T00:16:50.169 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-09-21T00:16:50.168+0000 7fcec2f7b640 -1 osd.7 0 log_to_monitors true 2023-09-21T00:16:50.200 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-09-21T00:16:50.198+0000 7f969d1ce640 -1 osd.3 0 log_to_monitors true 2023-09-21T00:16:53.734 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-09-21T00:16:53.733+0000 7fae7dd93700 -1 osd.6 0 waiting for initial osdmap 2023-09-21T00:16:53.743 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-09-21T00:16:53.743+0000 7fae7596d700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-21T00:16:53.752 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-09-21T00:16:53.750+0000 7f9691586700 -1 osd.3 0 waiting for initial osdmap 2023-09-21T00:16:53.764 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-09-21T00:16:53.762+0000 7f9689160700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-21T00:16:53.772 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-09-21T00:16:53.770+0000 7fadc1fd3700 -1 osd.1 0 waiting for initial osdmap 2023-09-21T00:16:53.785 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-09-21T00:16:53.783+0000 7f7947a06700 -1 osd.0 0 waiting for initial osdmap 2023-09-21T00:16:53.788 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-09-21T00:16:53.787+0000 7fadb9bad700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-21T00:16:53.803 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-09-21T00:16:53.802+0000 7fceb7333700 -1 osd.7 0 waiting for initial osdmap 2023-09-21T00:16:53.803 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-09-21T00:16:53.802+0000 7f793f5e0700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-21T00:16:53.804 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-09-21T00:16:53.803+0000 7f6a2f4c3700 -1 osd.5 0 waiting for initial osdmap 2023-09-21T00:16:53.812 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-09-21T00:16:53.812+0000 7fceaef0d700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-21T00:16:53.815 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-09-21T00:16:53.815+0000 7fe56ef79700 -1 osd.4 0 waiting for initial osdmap 2023-09-21T00:16:53.820 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-09-21T00:16:53.820+0000 7f6a2709d700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-21T00:16:53.830 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-09-21T00:16:53.830+0000 7fe566b53700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-21T00:16:53.991 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-09-21T00:16:53.989+0000 7fc5c73b4700 -1 osd.2 0 waiting for initial osdmap 2023-09-21T00:16:54.010 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-09-21T00:16:54.009+0000 7fc5bef8e700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-21T00:16:54.111 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-21T00:16:54.226 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.224+0000 7f1736948700 1 Processor -- start 2023-09-21T00:16:54.226 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.224+0000 7f1736948700 1 -- start start 2023-09-21T00:16:54.229 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.225+0000 7f1736948700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f17300cbc20 0x7f173015df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:54.229 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.225+0000 7f1736948700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1730070e70 0x7f1730071300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:54.229 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.225+0000 7f1736948700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f173015ee20 con 0x7f17300af5f0 2023-09-21T00:16:54.230 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.225+0000 7f1736948700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1730071840 con 0x7f1730070e70 2023-09-21T00:16:54.230 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.225+0000 7f1736948700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f173015e860 con 0x7f17300cbc20 2023-09-21T00:16:54.230 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.225+0000 7f1734ee5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1730070e70 0x7f1730071300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:54.230 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.225+0000 7f172ffff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f17300af5f0 0x7f173015b310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56134/0 (socket says 172.21.15.59:56134) 2023-09-21T00:16:54.230 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.225+0000 7f172ffff700 1 -- 172.21.15.59:0/2991510488 learned_addr learned my addr 172.21.15.59:0/2991510488 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:16:54.231 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.225+0000 7f172f7fe700 1 --2- 172.21.15.59:0/2991510488 >> v2:172.21.15.83:3300/0 conn(0x7f17300cbc20 0x7f173015df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:54.231 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.226+0000 7f1734ee5700 1 -- 172.21.15.59:0/2991510488 >> v2:172.21.15.83:3300/0 conn(0x7f17300cbc20 msgr2=0x7f173015df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:16:54.231 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.226+0000 7f1734ee5700 1 --2- 172.21.15.59:0/2991510488 >> v2:172.21.15.83:3300/0 conn(0x7f17300cbc20 0x7f173015df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:54.231 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.226+0000 7f1734ee5700 1 -- 172.21.15.59:0/2991510488 >> v1:172.21.15.59:6789/0 conn(0x7f17300af5f0 legacy=0x7f173015b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:54.231 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.226+0000 7f172effd700 1 -- 172.21.15.59:0/2991510488 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3007853541 0 0) 0x7f173015ee20 con 0x7f17300af5f0 2023-09-21T00:16:54.232 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.226+0000 7f1734ee5700 1 -- 172.21.15.59:0/2991510488 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f173015eb40 con 0x7f1730070e70 2023-09-21T00:16:54.232 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.226+0000 7f1734ee5700 1 --2- 172.21.15.59:0/2991510488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1730070e70 0x7f1730071300 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f17300cc260 tx=0x7f172800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=319e8facfb5bc534 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:16:54.232 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.226+0000 7f172effd700 1 -- 172.21.15.59:0/2991510488 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172800e070 con 0x7f1730070e70 2023-09-21T00:16:54.232 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.226+0000 7f172effd700 1 -- 172.21.15.59:0/2991510488 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f172800bbd0 con 0x7f1730070e70 2023-09-21T00:16:54.232 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.226+0000 7f172effd700 1 -- 172.21.15.59:0/2991510488 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1728012430 con 0x7f1730070e70 2023-09-21T00:16:54.233 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.226+0000 7f1736948700 1 -- 172.21.15.59:0/2991510488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1730070e70 msgr2=0x7f1730071300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:54.233 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.226+0000 7f1736948700 1 --2- 172.21.15.59:0/2991510488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1730070e70 0x7f1730071300 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f17300cc260 tx=0x7f172800b330 comp rx=0 tx=0).stop 2023-09-21T00:16:54.233 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.226+0000 7f1736948700 1 -- 172.21.15.59:0/2991510488 shutdown_connections 2023-09-21T00:16:54.233 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.226+0000 7f1736948700 1 --2- 172.21.15.59:0/2991510488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1730070e70 0x7f1730071300 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:54.233 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.226+0000 7f1736948700 1 --2- 172.21.15.59:0/2991510488 >> v2:172.21.15.83:3300/0 conn(0x7f17300cbc20 0x7f173015df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:54.234 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.226+0000 7f1736948700 1 -- 172.21.15.59:0/2991510488 >> 172.21.15.59:0/2991510488 conn(0x7f173006a7d0 msgr2=0x7f173006abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:16:54.234 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.226+0000 7f1736948700 1 -- 172.21.15.59:0/2991510488 shutdown_connections 2023-09-21T00:16:54.234 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.227+0000 7f1736948700 1 -- 172.21.15.59:0/2991510488 wait complete. 2023-09-21T00:16:54.237 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.228+0000 7f1736948700 1 Processor -- start 2023-09-21T00:16:54.237 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.228+0000 7f1736948700 1 -- start start 2023-09-21T00:16:54.238 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.229+0000 7f1736948700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1730070e70 0x7f1730153470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:54.238 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.229+0000 7f1736948700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17300af5f0 0x7f17300b4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:54.238 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.229+0000 7f1736948700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17300cbc20 0x7f17300b4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:54.238 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.229+0000 7f1736948700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17300b5b10 con 0x7f17300af5f0 2023-09-21T00:16:54.239 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.229+0000 7f1736948700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1730156ed0 con 0x7f17300cbc20 2023-09-21T00:16:54.239 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.229+0000 7f1736948700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17301562c0 con 0x7f1730070e70 2023-09-21T00:16:54.239 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.229+0000 7f172f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17300af5f0 0x7f17300b4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:54.239 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.229+0000 7f172f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17300af5f0 0x7f17300b4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50574/0 (socket says 172.21.15.59:50574) 2023-09-21T00:16:54.239 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.229+0000 7f172f7fe700 1 -- 172.21.15.59:0/1768243484 learned_addr learned my addr 172.21.15.59:0/1768243484 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:16:54.240 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.229+0000 7f172ffff700 1 --2- 172.21.15.59:0/1768243484 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1730070e70 0x7f1730153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:54.240 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.229+0000 7f1734ee5700 1 --2- 172.21.15.59:0/1768243484 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17300cbc20 0x7f17300b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:54.240 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.229+0000 7f172f7fe700 1 -- 172.21.15.59:0/1768243484 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1730070e70 msgr2=0x7f1730153470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:54.240 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.229+0000 7f172f7fe700 1 --2- 172.21.15.59:0/1768243484 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1730070e70 0x7f1730153470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:54.241 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.229+0000 7f172f7fe700 1 -- 172.21.15.59:0/1768243484 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17300cbc20 msgr2=0x7f17300b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:54.241 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.229+0000 7f172f7fe700 1 --2- 172.21.15.59:0/1768243484 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17300cbc20 0x7f17300b4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:54.241 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.229+0000 7f172f7fe700 1 -- 172.21.15.59:0/1768243484 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1728009a70 con 0x7f17300af5f0 2023-09-21T00:16:54.241 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.229+0000 7f172f7fe700 1 --2- 172.21.15.59:0/1768243484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17300af5f0 0x7f17300b4410 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f171800d800 tx=0x7f171800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:16:54.241 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.229+0000 7f172cff9700 1 -- 172.21.15.59:0/1768243484 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17180125f0 con 0x7f17300af5f0 2023-09-21T00:16:54.242 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.229+0000 7f172cff9700 1 -- 172.21.15.59:0/1768243484 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1718012750 con 0x7f17300af5f0 2023-09-21T00:16:54.242 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.229+0000 7f1736948700 1 -- 172.21.15.59:0/1768243484 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17301565a0 con 0x7f17300af5f0 2023-09-21T00:16:54.242 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.229+0000 7f172cff9700 1 -- 172.21.15.59:0/1768243484 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1718012b00 con 0x7f17300af5f0 2023-09-21T00:16:54.242 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.230+0000 7f1736948700 1 -- 172.21.15.59:0/1768243484 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1730156b60 con 0x7f17300af5f0 2023-09-21T00:16:54.242 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.230+0000 7f1736948700 1 -- 172.21.15.59:0/1768243484 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1730157080 con 0x7f17300af5f0 2023-09-21T00:16:54.243 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.231+0000 7f172cff9700 1 -- 172.21.15.59:0/1768243484 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 89251+0+0 (secure 0 0 0) 0x7f1718012c60 con 0x7f17300af5f0 2023-09-21T00:16:54.243 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.231+0000 7f172cff9700 1 --2- 172.21.15.59:0/1768243484 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f171006ad70 0x7f171006d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:16:54.243 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.231+0000 7f172cff9700 1 -- 172.21.15.59:0/1768243484 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f1718088660 con 0x7f17300af5f0 2023-09-21T00:16:54.243 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.231+0000 7f172ffff700 1 --2- 172.21.15.59:0/1768243484 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f171006ad70 0x7f171006d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:16:54.243 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.232+0000 7f172ffff700 1 --2- 172.21.15.59:0/1768243484 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f171006ad70 0x7f171006d230 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1720007fd0 tx=0x7f1720007de0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:16:54.244 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.237+0000 7f172cff9700 1 -- 172.21.15.59:0/1768243484 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f1730157080 con 0x7f17300af5f0 2023-09-21T00:16:54.438 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.436+0000 7f1736948700 1 -- 172.21.15.59:0/1768243484 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1730157040 con 0x7f17300af5f0 2023-09-21T00:16:54.439 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.437+0000 7f172cff9700 1 -- 172.21.15.59:0/1768243484 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f17180545e0 con 0x7f17300af5f0 2023-09-21T00:16:54.439 INFO:teuthology.misc.health.smithi059.stdout: 2023-09-21T00:16:54.440 INFO:teuthology.misc.health.smithi059.stdout:{"epoch":12,"fsid":"dd69925c-6e25-42fe-880b-2f60fc6f384b","created":"2023-09-21T00:16:43.074489+0000","modified":"2023-09-21T00:16:51.742621+0000","last_up_change":"0.000000","last_in_change":"2023-09-21T00:16:45.987089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d4b18344-74c0-4f75-920b-7a9247e48914","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"80940d50-a248-4e64-a282-7ffcdad790ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"55f2eceb-c54a-4879-a6ce-968c1c548b5d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"92b89cd0-869c-49b9-a9f9-97ac8423f304","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"25b80e94-e0e6-403d-b69f-61542f289637","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5498d9ab-1086-4796-a199-9051e6dfea91","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"cfd810c0-5015-4d60-9a75-7efc93a32e09","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e992c8fa-0a3d-4b3c-85b5-2c511223dee4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T00:16:54.441 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.440+0000 7f1736948700 1 -- 172.21.15.59:0/1768243484 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f171006ad70 msgr2=0x7f171006d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:54.442 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.440+0000 7f1736948700 1 --2- 172.21.15.59:0/1768243484 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f171006ad70 0x7f171006d230 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1720007fd0 tx=0x7f1720007de0 comp rx=0 tx=0).stop 2023-09-21T00:16:54.442 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.440+0000 7f1736948700 1 -- 172.21.15.59:0/1768243484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17300af5f0 msgr2=0x7f17300b4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:16:54.442 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.440+0000 7f1736948700 1 --2- 172.21.15.59:0/1768243484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17300af5f0 0x7f17300b4410 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f171800d800 tx=0x7f171800db10 comp rx=0 tx=0).stop 2023-09-21T00:16:54.442 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.440+0000 7f1736948700 1 -- 172.21.15.59:0/1768243484 shutdown_connections 2023-09-21T00:16:54.442 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.440+0000 7f1736948700 1 --2- 172.21.15.59:0/1768243484 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17300cbc20 0x7f17300b4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:54.443 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.440+0000 7f1736948700 1 --2- 172.21.15.59:0/1768243484 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f171006ad70 0x7f171006d230 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:54.443 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.440+0000 7f1736948700 1 --2- 172.21.15.59:0/1768243484 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1730070e70 0x7f1730153470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:54.443 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.440+0000 7f1736948700 1 --2- 172.21.15.59:0/1768243484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17300af5f0 0x7f17300b4410 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:16:54.443 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.440+0000 7f1736948700 1 -- 172.21.15.59:0/1768243484 >> 172.21.15.59:0/1768243484 conn(0x7f173006a7d0 msgr2=0x7f173006abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:16:54.443 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.440+0000 7f1736948700 1 -- 172.21.15.59:0/1768243484 shutdown_connections 2023-09-21T00:16:54.444 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:16:54.440+0000 7f1736948700 1 -- 172.21.15.59:0/1768243484 wait complete. 2023-09-21T00:16:54.452 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-09-21T00:17:01.260 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-21T00:17:01.387 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.386+0000 7f47faa49700 1 Processor -- start 2023-09-21T00:17:01.388 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.387+0000 7f47faa49700 1 -- start start 2023-09-21T00:17:01.391 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.387+0000 7f47faa49700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47f406f040 0x7f47f406f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:01.391 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.387+0000 7f47faa49700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f47f415c0a0 0x7f47f415c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:01.391 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.387+0000 7f47faa49700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47f415bc10 con 0x7f47f40d0980 2023-09-21T00:17:01.391 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.387+0000 7f47faa49700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47f40d10b0 con 0x7f47f415c0a0 2023-09-21T00:17:01.391 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.387+0000 7f47faa49700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f40d0e00 con 0x7f47f406f040 2023-09-21T00:17:01.392 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.388+0000 7f47f8fe6700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f47f415c0a0 0x7f47f415c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:01.392 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.388+0000 7f47f3fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47f406f040 0x7f47f406f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:01.392 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.388+0000 7f47f37fe700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f47f40d0980 0x7f47f40cedc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.59:46824/0 (socket says 172.21.15.59:46824) 2023-09-21T00:17:01.392 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.388+0000 7f47f3fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47f406f040 0x7f47f406f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.59:51372/0 (socket says 172.21.15.59:51372) 2023-09-21T00:17:01.393 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.388+0000 7f47f8fe6700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f47f415c0a0 0x7f47f415c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.59:36876/0 (socket says 172.21.15.59:36876) 2023-09-21T00:17:01.393 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.388+0000 7f47f3fff700 1 -- 172.21.15.59:0/3181078293 learned_addr learned my addr 172.21.15.59:0/3181078293 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:01.393 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.388+0000 7f47f2ffd700 1 -- 172.21.15.59:0/3181078293 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1324161298 0 0) 0x7f47f415bc10 con 0x7f47f40d0980 2023-09-21T00:17:01.393 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.388+0000 7f47f2ffd700 1 -- 172.21.15.59:0/3181078293 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47e00035b0 con 0x7f47f40d0980 2023-09-21T00:17:01.393 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.388+0000 7f47f3fff700 1 -- 172.21.15.59:0/3181078293 >> v2:172.21.15.83:3300/0 conn(0x7f47f415c0a0 msgr2=0x7f47f415c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:01.393 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.388+0000 7f47f3fff700 1 --2- 172.21.15.59:0/3181078293 >> v2:172.21.15.83:3300/0 conn(0x7f47f415c0a0 0x7f47f415c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:01.394 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.388+0000 7f47f3fff700 1 -- 172.21.15.59:0/3181078293 >> v1:172.21.15.83:6789/0 conn(0x7f47f40d0980 legacy=0x7f47f40cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:01.394 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.388+0000 7f47f3fff700 1 -- 172.21.15.59:0/3181078293 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f40cb9e0 con 0x7f47f406f040 2023-09-21T00:17:01.394 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.388+0000 7f47f3fff700 1 --2- 172.21.15.59:0/3181078293 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47f406f040 0x7f47f406f420 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f47e40098f0 tx=0x7f47e4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c02a660d3eb5e8 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:01.394 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.389+0000 7f47f2ffd700 1 -- 172.21.15.59:0/3181078293 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e4011830 con 0x7f47f406f040 2023-09-21T00:17:01.394 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.389+0000 7f47f2ffd700 1 -- 172.21.15.59:0/3181078293 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e4011990 con 0x7f47f406f040 2023-09-21T00:17:01.395 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.389+0000 7f47f2ffd700 1 -- 172.21.15.59:0/3181078293 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e4011d20 con 0x7f47f406f040 2023-09-21T00:17:01.395 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.389+0000 7f47faa49700 1 -- 172.21.15.59:0/3181078293 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47f406f040 msgr2=0x7f47f406f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:01.395 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.389+0000 7f47faa49700 1 --2- 172.21.15.59:0/3181078293 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47f406f040 0x7f47f406f420 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f47e40098f0 tx=0x7f47e4009c00 comp rx=0 tx=0).stop 2023-09-21T00:17:01.395 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.389+0000 7f47faa49700 1 -- 172.21.15.59:0/3181078293 shutdown_connections 2023-09-21T00:17:01.395 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.389+0000 7f47faa49700 1 --2- 172.21.15.59:0/3181078293 >> v2:172.21.15.83:3300/0 conn(0x7f47f415c0a0 0x7f47f415c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:01.396 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.389+0000 7f47faa49700 1 --2- 172.21.15.59:0/3181078293 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47f406f040 0x7f47f406f420 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:01.396 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.389+0000 7f47faa49700 1 -- 172.21.15.59:0/3181078293 >> 172.21.15.59:0/3181078293 conn(0x7f47f40d11f0 msgr2=0x7f47f40d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:01.396 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.389+0000 7f47faa49700 1 -- 172.21.15.59:0/3181078293 shutdown_connections 2023-09-21T00:17:01.396 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.389+0000 7f47faa49700 1 -- 172.21.15.59:0/3181078293 wait complete. 2023-09-21T00:17:01.399 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.391+0000 7f47faa49700 1 Processor -- start 2023-09-21T00:17:01.399 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.391+0000 7f47faa49700 1 -- start start 2023-09-21T00:17:01.399 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.392+0000 7f47faa49700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47f406f040 0x7f47f414e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:01.399 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.392+0000 7f47faa49700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47f40d0980 0x7f47f406c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:01.399 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.392+0000 7f47faa49700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47f415c0a0 0x7f47f40c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:01.400 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.392+0000 7f47faa49700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f406d650 con 0x7f47f415c0a0 2023-09-21T00:17:01.400 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.392+0000 7f47faa49700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f406ca40 con 0x7f47f40d0980 2023-09-21T00:17:01.400 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.392+0000 7f47faa49700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f406cd20 con 0x7f47f406f040 2023-09-21T00:17:01.400 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.392+0000 7f47f8fe6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47f415c0a0 0x7f47f40c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:01.400 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.392+0000 7f47f8fe6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47f415c0a0 0x7f47f40c82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50766/0 (socket says 172.21.15.59:50766) 2023-09-21T00:17:01.401 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.392+0000 7f47f8fe6700 1 -- 172.21.15.59:0/377552290 learned_addr learned my addr 172.21.15.59:0/377552290 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:01.401 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.392+0000 7f47f37fe700 1 --2- 172.21.15.59:0/377552290 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47f40d0980 0x7f47f406c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:01.401 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.392+0000 7f47f3fff700 1 --2- 172.21.15.59:0/377552290 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47f406f040 0x7f47f414e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:01.401 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.393+0000 7f47f8fe6700 1 -- 172.21.15.59:0/377552290 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47f406f040 msgr2=0x7f47f414e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:01.401 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.393+0000 7f47f8fe6700 1 --2- 172.21.15.59:0/377552290 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47f406f040 0x7f47f414e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:01.402 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.393+0000 7f47f8fe6700 1 -- 172.21.15.59:0/377552290 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47f40d0980 msgr2=0x7f47f406c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:01.402 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.393+0000 7f47f8fe6700 1 --2- 172.21.15.59:0/377552290 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47f40d0980 0x7f47f406c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:01.402 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.393+0000 7f47f8fe6700 1 -- 172.21.15.59:0/377552290 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e4009550 con 0x7f47f415c0a0 2023-09-21T00:17:01.402 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.393+0000 7f47f8fe6700 1 --2- 172.21.15.59:0/377552290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47f415c0a0 0x7f47f40c82c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f47ec00efc0 tx=0x7f47ec00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:01.403 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.393+0000 7f47f0ff9700 1 -- 172.21.15.59:0/377552290 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec009ea0 con 0x7f47f415c0a0 2023-09-21T00:17:01.403 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.393+0000 7f47f0ff9700 1 -- 172.21.15.59:0/377552290 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47ec00f040 con 0x7f47f415c0a0 2023-09-21T00:17:01.403 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.393+0000 7f47f0ff9700 1 -- 172.21.15.59:0/377552290 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec00ced0 con 0x7f47f415c0a0 2023-09-21T00:17:01.403 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.393+0000 7f47faa49700 1 -- 172.21.15.59:0/377552290 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47f406d000 con 0x7f47f415c0a0 2023-09-21T00:17:01.403 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.393+0000 7f47faa49700 1 -- 172.21.15.59:0/377552290 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47f414eba0 con 0x7f47f415c0a0 2023-09-21T00:17:01.403 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.394+0000 7f47faa49700 1 -- 172.21.15.59:0/377552290 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47f40cbfa0 con 0x7f47f415c0a0 2023-09-21T00:17:01.404 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.395+0000 7f47f0ff9700 1 -- 172.21.15.59:0/377552290 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f47ec014480 con 0x7f47f415c0a0 2023-09-21T00:17:01.404 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.395+0000 7f47f0ff9700 1 --2- 172.21.15.59:0/377552290 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f47d406ae00 0x7f47d406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:01.404 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.395+0000 7f47f0ff9700 1 -- 172.21.15.59:0/377552290 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f47ec0899f0 con 0x7f47f415c0a0 2023-09-21T00:17:01.404 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.395+0000 7f47f3fff700 1 --2- 172.21.15.59:0/377552290 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f47d406ae00 0x7f47d406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:01.404 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.396+0000 7f47f3fff700 1 --2- 172.21.15.59:0/377552290 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f47d406ae00 0x7f47d406d2c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f47e4009840 tx=0x7f47e4008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:01.405 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.400+0000 7f47f0ff9700 1 -- 172.21.15.59:0/377552290 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f47ec054e60 con 0x7f47f415c0a0 2023-09-21T00:17:01.600 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.599+0000 7f47faa49700 1 -- 172.21.15.59:0/377552290 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47f404f330 con 0x7f47f415c0a0 2023-09-21T00:17:01.601 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.600+0000 7f47f0ff9700 1 -- 172.21.15.59:0/377552290 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12766 (secure 0 0 0) 0x7f47ec018090 con 0x7f47f415c0a0 2023-09-21T00:17:01.601 INFO:teuthology.misc.health.smithi059.stdout: 2023-09-21T00:17:01.602 INFO:teuthology.misc.health.smithi059.stdout:{"epoch":16,"fsid":"dd69925c-6e25-42fe-880b-2f60fc6f384b","created":"2023-09-21T00:16:43.074489+0000","modified":"2023-09-21T00:16:57.751111+0000","last_up_change":"2023-09-21T00:16:54.740101+0000","last_in_change":"2023-09-21T00:16:45.987089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T00:16:54.796248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d4b18344-74c0-4f75-920b-7a9247e48914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6809","nonce":2418314235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6811","nonce":2418314235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6815","nonce":2418314235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6813","nonce":2418314235}]},"public_addr":"172.21.15.59:6809/2418314235","cluster_addr":"172.21.15.59:6811/2418314235","heartbeat_back_addr":"172.21.15.59:6815/2418314235","heartbeat_front_addr":"172.21.15.59:6813/2418314235","state":["exists","up"]},{"osd":1,"uuid":"80940d50-a248-4e64-a282-7ffcdad790ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6801","nonce":869668251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6803","nonce":869668251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6807","nonce":869668251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6805","nonce":869668251}]},"public_addr":"172.21.15.59:6801/869668251","cluster_addr":"172.21.15.59:6803/869668251","heartbeat_back_addr":"172.21.15.59:6807/869668251","heartbeat_front_addr":"172.21.15.59:6805/869668251","state":["exists","up"]},{"osd":2,"uuid":"55f2eceb-c54a-4879-a6ce-968c1c548b5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6817","nonce":372517778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6819","nonce":372517778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6823","nonce":372517778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6821","nonce":372517778}]},"public_addr":"172.21.15.59:6817/372517778","cluster_addr":"172.21.15.59:6819/372517778","heartbeat_back_addr":"172.21.15.59:6823/372517778","heartbeat_front_addr":"172.21.15.59:6821/372517778","state":["exists","up"]},{"osd":3,"uuid":"92b89cd0-869c-49b9-a9f9-97ac8423f304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6825","nonce":575188498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6827","nonce":575188498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6831","nonce":575188498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6829","nonce":575188498}]},"public_addr":"172.21.15.59:6825/575188498","cluster_addr":"172.21.15.59:6827/575188498","heartbeat_back_addr":"172.21.15.59:6831/575188498","heartbeat_front_addr":"172.21.15.59:6829/575188498","state":["exists","up"]},{"osd":4,"uuid":"25b80e94-e0e6-403d-b69f-61542f289637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6803","nonce":1741219098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6805","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6807","nonce":1741219098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6815","nonce":1741219098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6811","nonce":1741219098}]},"public_addr":"172.21.15.83:6803/1741219098","cluster_addr":"172.21.15.83:6807/1741219098","heartbeat_back_addr":"172.21.15.83:6815/1741219098","heartbeat_front_addr":"172.21.15.83:6811/1741219098","state":["exists","up"]},{"osd":5,"uuid":"5498d9ab-1086-4796-a199-9051e6dfea91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6817","nonce":156730565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6819","nonce":156730565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6823","nonce":156730565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6821","nonce":156730565}]},"public_addr":"172.21.15.83:6817/156730565","cluster_addr":"172.21.15.83:6819/156730565","heartbeat_back_addr":"172.21.15.83:6823/156730565","heartbeat_front_addr":"172.21.15.83:6821/156730565","state":["exists","up"]},{"osd":6,"uuid":"cfd810c0-5015-4d60-9a75-7efc93a32e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6801","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6800","nonce":1337723778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6806","nonce":1337723778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6814","nonce":1337723778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6810","nonce":1337723778}]},"public_addr":"172.21.15.83:6800/1337723778","cluster_addr":"172.21.15.83:6806/1337723778","heartbeat_back_addr":"172.21.15.83:6814/1337723778","heartbeat_front_addr":"172.21.15.83:6810/1337723778","state":["exists","up"]},{"osd":7,"uuid":"e992c8fa-0a3d-4b3c-85b5-2c511223dee4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6825","nonce":4204859272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6827","nonce":4204859272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6831","nonce":4204859272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6829","nonce":4204859272}]},"public_addr":"172.21.15.83:6825/4204859272","cluster_addr":"172.21.15.83:6827/4204859272","heartbeat_back_addr":"172.21.15.83:6831/4204859272","heartbeat_front_addr":"172.21.15.83:6829/4204859272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.156498+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.882707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.093978+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.158565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.173933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.888606+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.135525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.149712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T00:17:01.603 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.602+0000 7f47faa49700 1 -- 172.21.15.59:0/377552290 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f47d406ae00 msgr2=0x7f47d406d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:01.603 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.602+0000 7f47faa49700 1 --2- 172.21.15.59:0/377552290 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f47d406ae00 0x7f47d406d2c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f47e4009840 tx=0x7f47e4008030 comp rx=0 tx=0).stop 2023-09-21T00:17:01.604 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.602+0000 7f47faa49700 1 -- 172.21.15.59:0/377552290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47f415c0a0 msgr2=0x7f47f40c82c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:01.604 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.602+0000 7f47faa49700 1 --2- 172.21.15.59:0/377552290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47f415c0a0 0x7f47f40c82c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f47ec00efc0 tx=0x7f47ec00c3a0 comp rx=0 tx=0).stop 2023-09-21T00:17:01.604 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.602+0000 7f47faa49700 1 -- 172.21.15.59:0/377552290 shutdown_connections 2023-09-21T00:17:01.604 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.602+0000 7f47faa49700 1 --2- 172.21.15.59:0/377552290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47f415c0a0 0x7f47f40c82c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:01.604 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.602+0000 7f47faa49700 1 --2- 172.21.15.59:0/377552290 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f47d406ae00 0x7f47d406d2c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:01.605 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.602+0000 7f47faa49700 1 --2- 172.21.15.59:0/377552290 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47f406f040 0x7f47f414e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:01.605 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.602+0000 7f47faa49700 1 --2- 172.21.15.59:0/377552290 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47f40d0980 0x7f47f406c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:01.605 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.602+0000 7f47faa49700 1 -- 172.21.15.59:0/377552290 >> 172.21.15.59:0/377552290 conn(0x7f47f40d11f0 msgr2=0x7f47f4073200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:01.605 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.602+0000 7f47faa49700 1 -- 172.21.15.59:0/377552290 shutdown_connections 2023-09-21T00:17:01.605 INFO:teuthology.misc.health.smithi059.stderr:2023-09-21T00:17:01.602+0000 7f47faa49700 1 -- 172.21.15.59:0/377552290 wait complete. 2023-09-21T00:17:01.614 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-09-21T00:17:01.615 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-09-21T00:17:01.615 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-21T00:17:01.615 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-21T00:17:01.617 INFO:tasks.ceph.mds.a:Started 2023-09-21T00:17:01.618 INFO:tasks.ceph.mds.c:Restarting daemon 2023-09-21T00:17:01.618 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-09-21T00:17:01.620 INFO:tasks.ceph.mds.c:Started 2023-09-21T00:17:01.620 INFO:tasks.ceph.mds.b:Restarting daemon 2023-09-21T00:17:01.621 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-09-21T00:17:01.623 INFO:tasks.ceph.mds.b:Started 2023-09-21T00:17:01.623 INFO:tasks.ceph.mds.d:Restarting daemon 2023-09-21T00:17:01.624 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-09-21T00:17:01.626 INFO:tasks.ceph.mds.d:Started 2023-09-21T00:17:01.626 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-09-21T00:17:01.627 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T00:17:01.700 INFO:tasks.ceph.mds.a.smithi059.stdout:starting mds.a at 2023-09-21T00:17:01.701 INFO:tasks.ceph.mds.c.smithi059.stdout:starting mds.c at 2023-09-21T00:17:01.713 INFO:tasks.ceph.mds.d.smithi083.stdout:starting mds.d at 2023-09-21T00:17:01.713 INFO:tasks.ceph.mds.b.smithi083.stdout:starting mds.b at 2023-09-21T00:17:01.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.759+0000 7f96c46ff700 1 Processor -- start 2023-09-21T00:17:01.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.759+0000 7f96c46ff700 1 -- start start 2023-09-21T00:17:01.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.760+0000 7f96c46ff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f96bc0ca790 0x7f96bc071680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:01.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.760+0000 7f96c46ff700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96bc0cb1c0 con 0x7f96bc15a230 2023-09-21T00:17:01.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.760+0000 7f96c46ff700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96bc0cb4a0 con 0x7f96bc0cac20 2023-09-21T00:17:01.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.760+0000 7f96c46ff700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96bc0cb780 con 0x7f96bc0ca790 2023-09-21T00:17:01.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.760+0000 7f96c249b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f96bc15a230 0x7f96bc15e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56364/0 (socket says 172.21.15.59:56364) 2023-09-21T00:17:01.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.760+0000 7f96c249b700 1 -- 172.21.15.59:0/2321579450 learned_addr learned my addr 172.21.15.59:0/2321579450 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:01.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.760+0000 7f96c1c9a700 1 --2- 172.21.15.59:0/2321579450 >> v2:172.21.15.83:3300/0 conn(0x7f96bc0ca790 0x7f96bc071680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:01.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.761+0000 7f96c1499700 1 -- 172.21.15.59:0/2321579450 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2877759672 0 0) 0x7f96bc0cb1c0 con 0x7f96bc15a230 2023-09-21T00:17:01.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.761+0000 7f96c1499700 1 -- 172.21.15.59:0/2321579450 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96a40035b0 con 0x7f96bc15a230 2023-09-21T00:17:01.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.761+0000 7f96c1499700 1 -- 172.21.15.59:0/2321579450 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 302466054 0 0) 0x7f96bc0cb4a0 con 0x7f96bc0cac20 2023-09-21T00:17:01.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.761+0000 7f96c1499700 1 -- 172.21.15.59:0/2321579450 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96bc0cb1c0 con 0x7f96bc0cac20 2023-09-21T00:17:01.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.761+0000 7f96c1499700 1 -- 172.21.15.59:0/2321579450 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3961246775 0 0) 0x7f96a40035b0 con 0x7f96bc15a230 2023-09-21T00:17:01.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.761+0000 7f96c1c9a700 1 -- 172.21.15.59:0/2321579450 >> v1:172.21.15.83:6789/0 conn(0x7f96bc0cac20 legacy=0x7f96bc06eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:01.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.761+0000 7f96c1c9a700 1 -- 172.21.15.59:0/2321579450 >> v1:172.21.15.59:6789/0 conn(0x7f96bc15a230 legacy=0x7f96bc15e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:01.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.761+0000 7f96c1c9a700 1 -- 172.21.15.59:0/2321579450 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96bc15e0b0 con 0x7f96bc0ca790 2023-09-21T00:17:01.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.761+0000 7f96c1c9a700 1 --2- 172.21.15.59:0/2321579450 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96bc0ca790 0x7f96bc071680 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f96b0009840 tx=0x7f96b0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af4b8ba0d44c808a server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:01.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.761+0000 7f96c1499700 1 -- 172.21.15.59:0/2321579450 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b4001670 con 0x7f96bc0ca790 2023-09-21T00:17:01.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.761+0000 7f96c1499700 1 -- 172.21.15.59:0/2321579450 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b0004030 con 0x7f96bc0ca790 2023-09-21T00:17:01.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.761+0000 7f96c1499700 1 -- 172.21.15.59:0/2321579450 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b00043c0 con 0x7f96bc0ca790 2023-09-21T00:17:01.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.762+0000 7f96c46ff700 1 -- 172.21.15.59:0/2321579450 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96bc0ca790 msgr2=0x7f96bc071680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:01.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.762+0000 7f96c46ff700 1 --2- 172.21.15.59:0/2321579450 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96bc0ca790 0x7f96bc071680 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f96b0009840 tx=0x7f96b0009b50 comp rx=0 tx=0).stop 2023-09-21T00:17:01.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.762+0000 7f96c46ff700 1 -- 172.21.15.59:0/2321579450 shutdown_connections 2023-09-21T00:17:01.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.762+0000 7f96c46ff700 1 --2- 172.21.15.59:0/2321579450 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96bc0ca790 0x7f96bc071680 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:01.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.762+0000 7f96c46ff700 1 -- 172.21.15.59:0/2321579450 >> 172.21.15.59:0/2321579450 conn(0x7f96bc0d0140 msgr2=0x7f96bc0d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:01.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.762+0000 7f96c46ff700 1 -- 172.21.15.59:0/2321579450 shutdown_connections 2023-09-21T00:17:01.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.762+0000 7f96c46ff700 1 -- 172.21.15.59:0/2321579450 wait complete. 2023-09-21T00:17:01.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.763+0000 7f96c46ff700 1 Processor -- start 2023-09-21T00:17:01.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.763+0000 7f96c46ff700 1 -- start start 2023-09-21T00:17:01.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.764+0000 7f96c46ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96bc0ca790 0x7f96bc0b2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:01.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.764+0000 7f96c46ff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96bc0cac20 0x7f96bc15c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:01.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.764+0000 7f96c46ff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f96bc15a230 0x7f96bc0c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:01.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.764+0000 7f96c46ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96bc0b47a0 con 0x7f96bc0ca790 2023-09-21T00:17:01.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.764+0000 7f96c46ff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96bc1510c0 con 0x7f96bc0cac20 2023-09-21T00:17:01.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.764+0000 7f96c46ff700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96bc15c9b0 con 0x7f96bc15a230 2023-09-21T00:17:01.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.764+0000 7f96c249b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96bc0ca790 0x7f96bc0b2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:01.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.764+0000 7f96c249b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96bc0ca790 0x7f96bc0b2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50802/0 (socket says 172.21.15.59:50802) 2023-09-21T00:17:01.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.764+0000 7f96c249b700 1 -- 172.21.15.59:0/2162429040 learned_addr learned my addr 172.21.15.59:0/2162429040 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:01.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.764+0000 7f96c1c9a700 1 --2- 172.21.15.59:0/2162429040 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96bc0cac20 0x7f96bc15c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:01.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.764+0000 7f96c2c9c700 1 --2- 172.21.15.59:0/2162429040 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f96bc15a230 0x7f96bc0c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:01.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.764+0000 7f96c249b700 1 -- 172.21.15.59:0/2162429040 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f96bc15a230 msgr2=0x7f96bc0c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:01.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.764+0000 7f96c249b700 1 --2- 172.21.15.59:0/2162429040 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f96bc15a230 0x7f96bc0c93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:01.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.764+0000 7f96c249b700 1 -- 172.21.15.59:0/2162429040 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96bc0cac20 msgr2=0x7f96bc15c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:01.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.764+0000 7f96c249b700 1 --2- 172.21.15.59:0/2162429040 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96bc0cac20 0x7f96bc15c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:01.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.764+0000 7f96c249b700 1 -- 172.21.15.59:0/2162429040 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b00094a0 con 0x7f96bc0ca790 2023-09-21T00:17:01.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.764+0000 7f96c249b700 1 --2- 172.21.15.59:0/2162429040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96bc0ca790 0x7f96bc0b2c80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f96b400c6b0 tx=0x7f96b400ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:01.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.764+0000 7f96baffd700 1 -- 172.21.15.59:0/2162429040 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b4004c80 con 0x7f96bc0ca790 2023-09-21T00:17:01.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.764+0000 7f96baffd700 1 -- 172.21.15.59:0/2162429040 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b4004de0 con 0x7f96bc0ca790 2023-09-21T00:17:01.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.764+0000 7f96c46ff700 1 -- 172.21.15.59:0/2162429040 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96bc1517b0 con 0x7f96bc0ca790 2023-09-21T00:17:01.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.765+0000 7f96baffd700 1 -- 172.21.15.59:0/2162429040 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b4007310 con 0x7f96bc0ca790 2023-09-21T00:17:01.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.765+0000 7f96c46ff700 1 -- 172.21.15.59:0/2162429040 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96bc15d500 con 0x7f96bc0ca790 2023-09-21T00:17:01.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.765+0000 7f96c46ff700 1 -- 172.21.15.59:0/2162429040 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96bc0b4570 con 0x7f96bc0ca790 2023-09-21T00:17:01.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.766+0000 7f96baffd700 1 -- 172.21.15.59:0/2162429040 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f96b4007470 con 0x7f96bc0ca790 2023-09-21T00:17:01.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.766+0000 7f96baffd700 1 --2- 172.21.15.59:0/2162429040 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f96a806ae00 0x7f96a806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:01.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.766+0000 7f96baffd700 1 -- 172.21.15.59:0/2162429040 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f96b4088f60 con 0x7f96bc0ca790 2023-09-21T00:17:01.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.767+0000 7f96c1c9a700 1 --2- 172.21.15.59:0/2162429040 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f96a806ae00 0x7f96a806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:01.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.767+0000 7f96c1c9a700 1 --2- 172.21.15.59:0/2162429040 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f96a806ae00 0x7f96a806d2c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f96b00090b0 tx=0x7f96b0008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:01.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.771+0000 7f96baffd700 1 -- 172.21.15.59:0/2162429040 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f96bc0b4570 con 0x7f96bc0ca790 2023-09-21T00:17:01.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.971+0000 7f96c46ff700 1 -- 172.21.15.59:0/2162429040 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96bc0b4570 con 0x7f96bc0ca790 2023-09-21T00:17:01.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.972+0000 7f96baffd700 1 -- 172.21.15.59:0/2162429040 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12766 (secure 0 0 0) 0x7f96bc0b4570 con 0x7f96bc0ca790 2023-09-21T00:17:01.973 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:17:01.974 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":16,"fsid":"dd69925c-6e25-42fe-880b-2f60fc6f384b","created":"2023-09-21T00:16:43.074489+0000","modified":"2023-09-21T00:16:57.751111+0000","last_up_change":"2023-09-21T00:16:54.740101+0000","last_in_change":"2023-09-21T00:16:45.987089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T00:16:54.796248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d4b18344-74c0-4f75-920b-7a9247e48914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6809","nonce":2418314235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6811","nonce":2418314235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6815","nonce":2418314235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6813","nonce":2418314235}]},"public_addr":"172.21.15.59:6809/2418314235","cluster_addr":"172.21.15.59:6811/2418314235","heartbeat_back_addr":"172.21.15.59:6815/2418314235","heartbeat_front_addr":"172.21.15.59:6813/2418314235","state":["exists","up"]},{"osd":1,"uuid":"80940d50-a248-4e64-a282-7ffcdad790ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6801","nonce":869668251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6803","nonce":869668251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6807","nonce":869668251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6805","nonce":869668251}]},"public_addr":"172.21.15.59:6801/869668251","cluster_addr":"172.21.15.59:6803/869668251","heartbeat_back_addr":"172.21.15.59:6807/869668251","heartbeat_front_addr":"172.21.15.59:6805/869668251","state":["exists","up"]},{"osd":2,"uuid":"55f2eceb-c54a-4879-a6ce-968c1c548b5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6817","nonce":372517778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6819","nonce":372517778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6823","nonce":372517778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6821","nonce":372517778}]},"public_addr":"172.21.15.59:6817/372517778","cluster_addr":"172.21.15.59:6819/372517778","heartbeat_back_addr":"172.21.15.59:6823/372517778","heartbeat_front_addr":"172.21.15.59:6821/372517778","state":["exists","up"]},{"osd":3,"uuid":"92b89cd0-869c-49b9-a9f9-97ac8423f304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6825","nonce":575188498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6827","nonce":575188498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6831","nonce":575188498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6829","nonce":575188498}]},"public_addr":"172.21.15.59:6825/575188498","cluster_addr":"172.21.15.59:6827/575188498","heartbeat_back_addr":"172.21.15.59:6831/575188498","heartbeat_front_addr":"172.21.15.59:6829/575188498","state":["exists","up"]},{"osd":4,"uuid":"25b80e94-e0e6-403d-b69f-61542f289637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6803","nonce":1741219098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6805","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6807","nonce":1741219098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6815","nonce":1741219098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6811","nonce":1741219098}]},"public_addr":"172.21.15.83:6803/1741219098","cluster_addr":"172.21.15.83:6807/1741219098","heartbeat_back_addr":"172.21.15.83:6815/1741219098","heartbeat_front_addr":"172.21.15.83:6811/1741219098","state":["exists","up"]},{"osd":5,"uuid":"5498d9ab-1086-4796-a199-9051e6dfea91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6817","nonce":156730565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6819","nonce":156730565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6823","nonce":156730565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6821","nonce":156730565}]},"public_addr":"172.21.15.83:6817/156730565","cluster_addr":"172.21.15.83:6819/156730565","heartbeat_back_addr":"172.21.15.83:6823/156730565","heartbeat_front_addr":"172.21.15.83:6821/156730565","state":["exists","up"]},{"osd":6,"uuid":"cfd810c0-5015-4d60-9a75-7efc93a32e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6801","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6800","nonce":1337723778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6806","nonce":1337723778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6814","nonce":1337723778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6810","nonce":1337723778}]},"public_addr":"172.21.15.83:6800/1337723778","cluster_addr":"172.21.15.83:6806/1337723778","heartbeat_back_addr":"172.21.15.83:6814/1337723778","heartbeat_front_addr":"172.21.15.83:6810/1337723778","state":["exists","up"]},{"osd":7,"uuid":"e992c8fa-0a3d-4b3c-85b5-2c511223dee4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6825","nonce":4204859272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6827","nonce":4204859272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6831","nonce":4204859272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6829","nonce":4204859272}]},"public_addr":"172.21.15.83:6825/4204859272","cluster_addr":"172.21.15.83:6827/4204859272","heartbeat_back_addr":"172.21.15.83:6831/4204859272","heartbeat_front_addr":"172.21.15.83:6829/4204859272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.156498+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.882707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.093978+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.158565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.173933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.888606+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.135525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.149712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T00:17:01.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.974+0000 7f96c46ff700 1 -- 172.21.15.59:0/2162429040 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f96a806ae00 msgr2=0x7f96a806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:01.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.974+0000 7f96c46ff700 1 --2- 172.21.15.59:0/2162429040 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f96a806ae00 0x7f96a806d2c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f96b00090b0 tx=0x7f96b0008030 comp rx=0 tx=0).stop 2023-09-21T00:17:01.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.974+0000 7f96c46ff700 1 -- 172.21.15.59:0/2162429040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96bc0ca790 msgr2=0x7f96bc0b2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:01.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.974+0000 7f96c46ff700 1 --2- 172.21.15.59:0/2162429040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96bc0ca790 0x7f96bc0b2c80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f96b400c6b0 tx=0x7f96b400ca70 comp rx=0 tx=0).stop 2023-09-21T00:17:01.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.975+0000 7f96c46ff700 1 -- 172.21.15.59:0/2162429040 shutdown_connections 2023-09-21T00:17:01.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.975+0000 7f96c46ff700 1 --2- 172.21.15.59:0/2162429040 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f96a806ae00 0x7f96a806d2c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:01.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.975+0000 7f96c46ff700 1 --2- 172.21.15.59:0/2162429040 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f96bc15a230 0x7f96bc0c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:01.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.975+0000 7f96c46ff700 1 --2- 172.21.15.59:0/2162429040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96bc0ca790 0x7f96bc0b2c80 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:01.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.975+0000 7f96c46ff700 1 --2- 172.21.15.59:0/2162429040 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96bc0cac20 0x7f96bc15c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:01.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.975+0000 7f96c46ff700 1 -- 172.21.15.59:0/2162429040 >> 172.21.15.59:0/2162429040 conn(0x7f96bc0d0140 msgr2=0x7f96bc071580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:01.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.975+0000 7f96c46ff700 1 -- 172.21.15.59:0/2162429040 shutdown_connections 2023-09-21T00:17:01.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:01.975+0000 7f96c46ff700 1 -- 172.21.15.59:0/2162429040 wait complete. 2023-09-21T00:17:01.988 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-21T00:16:54.796248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-21T00:17:01.988 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-21T00:17:02.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.114+0000 7fb4fb52d700 1 Processor -- start 2023-09-21T00:17:02.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.114+0000 7fb4fb52d700 1 -- start start 2023-09-21T00:17:02.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.115+0000 7fb4fb52d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb4f415b480 0x7fb4f406f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:02.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.115+0000 7fb4fb52d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb4f40d0820 0x7fb4f40701e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:02.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.115+0000 7fb4fb52d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb4f4070720 0x7fb4f40cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:02.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.115+0000 7fb4fb52d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4f4070b70 con 0x7fb4f415b480 2023-09-21T00:17:02.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.115+0000 7fb4fb52d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4f40b4030 con 0x7fb4f40d0820 2023-09-21T00:17:02.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.115+0000 7fb4fb52d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f40cb8d0 con 0x7fb4f4070720 2023-09-21T00:17:02.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.115+0000 7fb4f92c9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb4f415b480 0x7fb4f406f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:02.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.115+0000 7fb4f92c9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb4f415b480 0x7fb4f406f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50810/0 (socket says 172.21.15.59:50810) 2023-09-21T00:17:02.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.115+0000 7fb4f92c9700 1 -- 172.21.15.59:0/3667912054 learned_addr learned my addr 172.21.15.59:0/3667912054 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:02.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.116+0000 7fb4f9aca700 1 --2- 172.21.15.59:0/3667912054 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb4f4070720 0x7fb4f40cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:02.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.116+0000 7fb4f8ac8700 1 --2- 172.21.15.59:0/3667912054 >> v2:172.21.15.83:3300/0 conn(0x7fb4f40d0820 0x7fb4f40701e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:02.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.116+0000 7fb4f92c9700 1 -- 172.21.15.59:0/3667912054 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb4f4070720 msgr2=0x7fb4f40cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:02.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.116+0000 7fb4f92c9700 1 --2- 172.21.15.59:0/3667912054 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb4f4070720 0x7fb4f40cedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:02.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.116+0000 7fb4f92c9700 1 -- 172.21.15.59:0/3667912054 >> v2:172.21.15.83:3300/0 conn(0x7fb4f40d0820 msgr2=0x7fb4f40701e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:02.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.116+0000 7fb4f92c9700 1 --2- 172.21.15.59:0/3667912054 >> v2:172.21.15.83:3300/0 conn(0x7fb4f40d0820 0x7fb4f40701e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:02.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.116+0000 7fb4f92c9700 1 -- 172.21.15.59:0/3667912054 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f40cbb40 con 0x7fb4f415b480 2023-09-21T00:17:02.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.116+0000 7fb4f92c9700 1 --2- 172.21.15.59:0/3667912054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4f415b480 0x7fb4f406f400 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb4f406e300 tx=0x7fb4e4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d39552871268598b server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:02.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.116+0000 7fb4ebfff700 1 -- 172.21.15.59:0/3667912054 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e400b870 con 0x7fb4f415b480 2023-09-21T00:17:02.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.116+0000 7fb4ebfff700 1 -- 172.21.15.59:0/3667912054 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e400b9d0 con 0x7fb4f415b480 2023-09-21T00:17:02.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.116+0000 7fb4ebfff700 1 -- 172.21.15.59:0/3667912054 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e400bd60 con 0x7fb4f415b480 2023-09-21T00:17:02.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.116+0000 7fb4fb52d700 1 -- 172.21.15.59:0/3667912054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4f415b480 msgr2=0x7fb4f406f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:02.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.116+0000 7fb4fb52d700 1 --2- 172.21.15.59:0/3667912054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4f415b480 0x7fb4f406f400 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb4f406e300 tx=0x7fb4e4009bd0 comp rx=0 tx=0).stop 2023-09-21T00:17:02.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.117+0000 7fb4fb52d700 1 -- 172.21.15.59:0/3667912054 shutdown_connections 2023-09-21T00:17:02.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.117+0000 7fb4fb52d700 1 --2- 172.21.15.59:0/3667912054 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb4f4070720 0x7fb4f40cedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:02.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.117+0000 7fb4fb52d700 1 --2- 172.21.15.59:0/3667912054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4f415b480 0x7fb4f406f400 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:02.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.117+0000 7fb4fb52d700 1 --2- 172.21.15.59:0/3667912054 >> v2:172.21.15.83:3300/0 conn(0x7fb4f40d0820 0x7fb4f40701e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:02.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.117+0000 7fb4fb52d700 1 -- 172.21.15.59:0/3667912054 >> 172.21.15.59:0/3667912054 conn(0x7fb4f40d11e0 msgr2=0x7fb4f40d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:02.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.117+0000 7fb4fb52d700 1 -- 172.21.15.59:0/3667912054 shutdown_connections 2023-09-21T00:17:02.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.117+0000 7fb4fb52d700 1 -- 172.21.15.59:0/3667912054 wait complete. 2023-09-21T00:17:02.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.118+0000 7fb4fb52d700 1 Processor -- start 2023-09-21T00:17:02.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.118+0000 7fb4fb52d700 1 -- start start 2023-09-21T00:17:02.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.119+0000 7fb4fb52d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb4f4070720 0x7fb4f414c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:02.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.119+0000 7fb4fb52d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb4f40d0820 0x7fb4f40c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:02.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.119+0000 7fb4fb52d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4f415b480 0x7fb4f40ca3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:02.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.119+0000 7fb4fb52d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f4158ae0 con 0x7fb4f415b480 2023-09-21T00:17:02.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.119+0000 7fb4fb52d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f41f0840 con 0x7fb4f4070720 2023-09-21T00:17:02.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.119+0000 7fb4fb52d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f40c8f00 con 0x7fb4f40d0820 2023-09-21T00:17:02.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.119+0000 7fb4f9aca700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4f415b480 0x7fb4f40ca3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:02.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.119+0000 7fb4f9aca700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4f415b480 0x7fb4f40ca3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50820/0 (socket says 172.21.15.59:50820) 2023-09-21T00:17:02.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.119+0000 7fb4f9aca700 1 -- 172.21.15.59:0/2316920431 learned_addr learned my addr 172.21.15.59:0/2316920431 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:02.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.119+0000 7fb4f8ac8700 1 --2- 172.21.15.59:0/2316920431 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb4f40d0820 0x7fb4f40c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:02.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.119+0000 7fb4f92c9700 1 --2- 172.21.15.59:0/2316920431 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb4f4070720 0x7fb4f414c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:02.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.119+0000 7fb4f9aca700 1 -- 172.21.15.59:0/2316920431 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb4f40d0820 msgr2=0x7fb4f40c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:02.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.119+0000 7fb4f9aca700 1 --2- 172.21.15.59:0/2316920431 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb4f40d0820 0x7fb4f40c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:02.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.119+0000 7fb4f9aca700 1 -- 172.21.15.59:0/2316920431 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb4f4070720 msgr2=0x7fb4f414c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:02.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.119+0000 7fb4f9aca700 1 --2- 172.21.15.59:0/2316920431 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb4f4070720 0x7fb4f414c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:02.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.119+0000 7fb4f9aca700 1 -- 172.21.15.59:0/2316920431 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e4009550 con 0x7fb4f415b480 2023-09-21T00:17:02.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.119+0000 7fb4f9aca700 1 --2- 172.21.15.59:0/2316920431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4f415b480 0x7fb4f40ca3c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec007e90 tx=0x7fb4ec00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:02.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.119+0000 7fb4e9ffb700 1 -- 172.21.15.59:0/2316920431 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec00eea0 con 0x7fb4f415b480 2023-09-21T00:17:02.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.119+0000 7fb4e9ffb700 1 -- 172.21.15.59:0/2316920431 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4ec014420 con 0x7fb4f415b480 2023-09-21T00:17:02.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.119+0000 7fb4fb52d700 1 -- 172.21.15.59:0/2316920431 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4f40c91e0 con 0x7fb4f415b480 2023-09-21T00:17:02.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.119+0000 7fb4e9ffb700 1 -- 172.21.15.59:0/2316920431 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec0147f0 con 0x7fb4f415b480 2023-09-21T00:17:02.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.120+0000 7fb4fb52d700 1 -- 172.21.15.59:0/2316920431 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4f40c4d90 con 0x7fb4f415b480 2023-09-21T00:17:02.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.120+0000 7fb4fb52d700 1 -- 172.21.15.59:0/2316920431 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4f4067e50 con 0x7fb4f415b480 2023-09-21T00:17:02.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.121+0000 7fb4e9ffb700 1 -- 172.21.15.59:0/2316920431 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fb4ec014950 con 0x7fb4f415b480 2023-09-21T00:17:02.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.121+0000 7fb4e9ffb700 1 --2- 172.21.15.59:0/2316920431 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fb4d806ae00 0x7fb4d806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:02.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.121+0000 7fb4e9ffb700 1 -- 172.21.15.59:0/2316920431 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb4ec089970 con 0x7fb4f415b480 2023-09-21T00:17:02.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.122+0000 7fb4f92c9700 1 --2- 172.21.15.59:0/2316920431 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fb4d806ae00 0x7fb4d806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:02.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.122+0000 7fb4f92c9700 1 --2- 172.21.15.59:0/2316920431 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fb4d806ae00 0x7fb4d806d2c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4014040 tx=0x7fb4e4008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:02.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.126+0000 7fb4e9ffb700 1 -- 172.21.15.59:0/2316920431 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fb4ec054de0 con 0x7fb4f415b480 2023-09-21T00:17:02.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.327+0000 7fb4fb52d700 1 -- 172.21.15.59:0/2316920431 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb4f40cf1a0 con 0x7fb4f415b480 2023-09-21T00:17:02.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.327+0000 7fb4e9ffb700 1 -- 172.21.15.59:0/2316920431 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb4ec058400 con 0x7fb4f415b480 2023-09-21T00:17:02.328 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-09-21T00:17:02.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.329+0000 7fb4fb52d700 1 -- 172.21.15.59:0/2316920431 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fb4d806ae00 msgr2=0x7fb4d806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:02.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.329+0000 7fb4fb52d700 1 --2- 172.21.15.59:0/2316920431 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fb4d806ae00 0x7fb4d806d2c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4014040 tx=0x7fb4e4008030 comp rx=0 tx=0).stop 2023-09-21T00:17:02.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.329+0000 7fb4fb52d700 1 -- 172.21.15.59:0/2316920431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4f415b480 msgr2=0x7fb4f40ca3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:02.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.329+0000 7fb4fb52d700 1 --2- 172.21.15.59:0/2316920431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4f415b480 0x7fb4f40ca3c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec007e90 tx=0x7fb4ec00e3c0 comp rx=0 tx=0).stop 2023-09-21T00:17:02.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.329+0000 7fb4fb52d700 1 -- 172.21.15.59:0/2316920431 shutdown_connections 2023-09-21T00:17:02.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.329+0000 7fb4fb52d700 1 --2- 172.21.15.59:0/2316920431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4f415b480 0x7fb4f40ca3c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:02.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.329+0000 7fb4fb52d700 1 --2- 172.21.15.59:0/2316920431 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb4f4070720 0x7fb4f414c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:02.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.329+0000 7fb4fb52d700 1 --2- 172.21.15.59:0/2316920431 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fb4d806ae00 0x7fb4d806d2c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:02.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.329+0000 7fb4fb52d700 1 --2- 172.21.15.59:0/2316920431 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb4f40d0820 0x7fb4f40c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:02.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.329+0000 7fb4fb52d700 1 -- 172.21.15.59:0/2316920431 >> 172.21.15.59:0/2316920431 conn(0x7fb4f40d11e0 msgr2=0x7fb4f415a600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:02.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.329+0000 7fb4fb52d700 1 -- 172.21.15.59:0/2316920431 shutdown_connections 2023-09-21T00:17:02.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.329+0000 7fb4fb52d700 1 -- 172.21.15.59:0/2316920431 wait complete. 2023-09-21T00:17:02.342 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T00:17:02.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.466+0000 7ff61e397700 1 Processor -- start 2023-09-21T00:17:02.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.466+0000 7ff61e397700 1 -- start start 2023-09-21T00:17:02.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.467+0000 7ff61e397700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff6180c9870 0x7ff61806c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:02.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.467+0000 7ff61e397700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6180cc530 0x7ff61806cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:02.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.467+0000 7ff61e397700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff61815e2f0 con 0x7ff618159a80 2023-09-21T00:17:02.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.467+0000 7ff61e397700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6180cb060 con 0x7ff6180c9870 2023-09-21T00:17:02.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.467+0000 7ff61e397700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff618070fe0 con 0x7ff6180cc530 2023-09-21T00:17:02.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.467+0000 7ff6177fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff6180c9870 0x7ff61806c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:02.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.467+0000 7ff6177fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff6180c9870 0x7ff61806c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50826/0 (socket says 172.21.15.59:50826) 2023-09-21T00:17:02.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.467+0000 7ff6177fe700 1 -- 172.21.15.59:0/1247662401 learned_addr learned my addr 172.21.15.59:0/1247662401 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:02.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.467+0000 7ff61c934700 1 --2- 172.21.15.59:0/1247662401 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6180cc530 0x7ff61806cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:02.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.467+0000 7ff6177fe700 1 -- 172.21.15.59:0/1247662401 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6180cc530 msgr2=0x7ff61806cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:02.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.467+0000 7ff6177fe700 1 --2- 172.21.15.59:0/1247662401 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6180cc530 0x7ff61806cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:02.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.467+0000 7ff6177fe700 1 -- 172.21.15.59:0/1247662401 >> v1:172.21.15.83:6789/0 conn(0x7ff618159a80 legacy=0x7ff618071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:02.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.467+0000 7ff6177fe700 1 -- 172.21.15.59:0/1247662401 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6180712c0 con 0x7ff6180c9870 2023-09-21T00:17:02.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.467+0000 7ff6177fe700 1 --2- 172.21.15.59:0/1247662401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6180c9870 0x7ff61806c650 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff60800bb90 tx=0x7ff60800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5f78a55255b3998 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:02.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.468+0000 7ff616ffd700 1 -- 172.21.15.59:0/1247662401 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60800dc20 con 0x7ff6180c9870 2023-09-21T00:17:02.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.468+0000 7ff616ffd700 1 -- 172.21.15.59:0/1247662401 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff60800dd80 con 0x7ff6180c9870 2023-09-21T00:17:02.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.468+0000 7ff616ffd700 1 -- 172.21.15.59:0/1247662401 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff608017660 con 0x7ff6180c9870 2023-09-21T00:17:02.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.468+0000 7ff61e397700 1 -- 172.21.15.59:0/1247662401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6180c9870 msgr2=0x7ff61806c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:02.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.468+0000 7ff61e397700 1 --2- 172.21.15.59:0/1247662401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6180c9870 0x7ff61806c650 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff60800bb90 tx=0x7ff60800bea0 comp rx=0 tx=0).stop 2023-09-21T00:17:02.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.468+0000 7ff61e397700 1 -- 172.21.15.59:0/1247662401 shutdown_connections 2023-09-21T00:17:02.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.468+0000 7ff61e397700 1 --2- 172.21.15.59:0/1247662401 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6180cc530 0x7ff61806cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:02.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.468+0000 7ff61e397700 1 --2- 172.21.15.59:0/1247662401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6180c9870 0x7ff61806c650 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:02.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.468+0000 7ff61e397700 1 -- 172.21.15.59:0/1247662401 >> 172.21.15.59:0/1247662401 conn(0x7ff6180b0d70 msgr2=0x7ff6180b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:02.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.468+0000 7ff61e397700 1 -- 172.21.15.59:0/1247662401 shutdown_connections 2023-09-21T00:17:02.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.468+0000 7ff61e397700 1 -- 172.21.15.59:0/1247662401 wait complete. 2023-09-21T00:17:02.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.469+0000 7ff61e397700 1 Processor -- start 2023-09-21T00:17:02.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.470+0000 7ff61e397700 1 -- start start 2023-09-21T00:17:02.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.470+0000 7ff61e397700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6180c9870 0x7ff6180b2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:02.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.470+0000 7ff61e397700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff6180cc530 0x7ff618153de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:02.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.470+0000 7ff61e397700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff618159a80 0x7ff618159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:02.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.470+0000 7ff61e397700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6180b3c40 con 0x7ff618159a80 2023-09-21T00:17:02.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.470+0000 7ff61e397700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6180b2db0 con 0x7ff6180cc530 2023-09-21T00:17:02.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.470+0000 7ff61e397700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff618154320 con 0x7ff6180c9870 2023-09-21T00:17:02.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.470+0000 7ff61c934700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff618159a80 0x7ff618159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:02.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.470+0000 7ff61c934700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff618159a80 0x7ff618159fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50834/0 (socket says 172.21.15.59:50834) 2023-09-21T00:17:02.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.470+0000 7ff61c934700 1 -- 172.21.15.59:0/3021940390 learned_addr learned my addr 172.21.15.59:0/3021940390 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:02.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.470+0000 7ff6177fe700 1 --2- 172.21.15.59:0/3021940390 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff6180cc530 0x7ff618153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:02.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.470+0000 7ff617fff700 1 --2- 172.21.15.59:0/3021940390 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6180c9870 0x7ff6180b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:02.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.471+0000 7ff61c934700 1 -- 172.21.15.59:0/3021940390 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6180c9870 msgr2=0x7ff6180b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:02.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.471+0000 7ff61c934700 1 --2- 172.21.15.59:0/3021940390 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6180c9870 0x7ff6180b2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:02.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.471+0000 7ff61c934700 1 -- 172.21.15.59:0/3021940390 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff6180cc530 msgr2=0x7ff618153de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:02.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.471+0000 7ff61c934700 1 --2- 172.21.15.59:0/3021940390 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff6180cc530 0x7ff618153de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:02.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.471+0000 7ff61c934700 1 -- 172.21.15.59:0/3021940390 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff60800b7f0 con 0x7ff618159a80 2023-09-21T00:17:02.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.471+0000 7ff61c934700 1 --2- 172.21.15.59:0/3021940390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff618159a80 0x7ff618159fe0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff610009dd0 tx=0x7ff61000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:02.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.471+0000 7ff614ff9700 1 -- 172.21.15.59:0/3021940390 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff610009c40 con 0x7ff618159a80 2023-09-21T00:17:02.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.471+0000 7ff614ff9700 1 -- 172.21.15.59:0/3021940390 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff61000f040 con 0x7ff618159a80 2023-09-21T00:17:02.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.471+0000 7ff614ff9700 1 -- 172.21.15.59:0/3021940390 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61000ceb0 con 0x7ff618159a80 2023-09-21T00:17:02.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.471+0000 7ff61e397700 1 -- 172.21.15.59:0/3021940390 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6180b3030 con 0x7ff618159a80 2023-09-21T00:17:02.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.471+0000 7ff61e397700 1 -- 172.21.15.59:0/3021940390 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6180b35f0 con 0x7ff618159a80 2023-09-21T00:17:02.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.472+0000 7ff61e397700 1 -- 172.21.15.59:0/3021940390 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6180b3df0 con 0x7ff618159a80 2023-09-21T00:17:02.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.473+0000 7ff614ff9700 1 -- 172.21.15.59:0/3021940390 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7ff610014480 con 0x7ff618159a80 2023-09-21T00:17:02.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.473+0000 7ff614ff9700 1 --2- 172.21.15.59:0/3021940390 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ff60406ae00 0x7ff60406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:02.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.473+0000 7ff614ff9700 1 -- 172.21.15.59:0/3021940390 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff6100899c0 con 0x7ff618159a80 2023-09-21T00:17:02.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.473+0000 7ff617fff700 1 --2- 172.21.15.59:0/3021940390 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ff60406ae00 0x7ff60406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:02.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.474+0000 7ff617fff700 1 --2- 172.21.15.59:0/3021940390 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ff60406ae00 0x7ff60406d2c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff60c007fd0 tx=0x7ff60c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:02.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.477+0000 7ff614ff9700 1 -- 172.21.15.59:0/3021940390 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7ff610054ec0 con 0x7ff618159a80 2023-09-21T00:17:02.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.719+0000 7ff61e397700 1 -- 172.21.15.59:0/3021940390 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff618067e50 con 0x7ff618159a80 2023-09-21T00:17:02.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.720+0000 7ff614ff9700 1 -- 172.21.15.59:0/3021940390 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3688 (secure 0 0 0) 0x7ff610018090 con 0x7ff618159a80 2023-09-21T00:17:02.722 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:17:02.722 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/461673980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":461673980},{"type":"v1","addr":"172.21.15.59:6835","nonce":461673980}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/3148728526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3148728526},{"type":"v1","addr":"172.21.15.59:6834","nonce":3148728526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/3250481509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3250481509},{"type":"v1","addr":"172.21.15.83:6836","nonce":3250481509}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4299,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/792952552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":792952552},{"type":"v1","addr":"172.21.15.83:6837","nonce":792952552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-09-21T00:17:02.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.722+0000 7ff61e397700 1 -- 172.21.15.59:0/3021940390 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ff60406ae00 msgr2=0x7ff60406d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:02.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.722+0000 7ff61e397700 1 --2- 172.21.15.59:0/3021940390 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ff60406ae00 0x7ff60406d2c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff60c007fd0 tx=0x7ff60c009040 comp rx=0 tx=0).stop 2023-09-21T00:17:02.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.722+0000 7ff61e397700 1 -- 172.21.15.59:0/3021940390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff618159a80 msgr2=0x7ff618159fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:02.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.722+0000 7ff61e397700 1 --2- 172.21.15.59:0/3021940390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff618159a80 0x7ff618159fe0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff610009dd0 tx=0x7ff61000c3a0 comp rx=0 tx=0).stop 2023-09-21T00:17:02.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.722+0000 7ff61e397700 1 -- 172.21.15.59:0/3021940390 shutdown_connections 2023-09-21T00:17:02.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.722+0000 7ff61e397700 1 --2- 172.21.15.59:0/3021940390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff618159a80 0x7ff618159fe0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:02.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.722+0000 7ff61e397700 1 --2- 172.21.15.59:0/3021940390 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ff60406ae00 0x7ff60406d2c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:02.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.722+0000 7ff61e397700 1 --2- 172.21.15.59:0/3021940390 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff6180c9870 0x7ff6180b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:02.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.722+0000 7ff61e397700 1 --2- 172.21.15.59:0/3021940390 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff6180cc530 0x7ff618153de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:02.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.722+0000 7ff61e397700 1 -- 172.21.15.59:0/3021940390 >> 172.21.15.59:0/3021940390 conn(0x7ff6180b0d70 msgr2=0x7ff6180b05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:02.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.722+0000 7ff61e397700 1 -- 172.21.15.59:0/3021940390 shutdown_connections 2023-09-21T00:17:02.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.722+0000 7ff61e397700 1 -- 172.21.15.59:0/3021940390 wait complete. 2023-09-21T00:17:02.726 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 3 2023-09-21T00:17:02.736 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T00:17:02.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.859+0000 7f5563baf700 1 Processor -- start 2023-09-21T00:17:02.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.860+0000 7f5563baf700 1 -- start start 2023-09-21T00:17:02.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.860+0000 7f5563baf700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f555c15b2b0 0x7f555c0cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:02.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.860+0000 7f5563baf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f555c06a780 0x7f555c06abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:02.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.860+0000 7f5563baf700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f555c06b110 con 0x7f555c0ce420 2023-09-21T00:17:02.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.860+0000 7f5563baf700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f555c0ce250 con 0x7f555c06a780 2023-09-21T00:17:02.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.860+0000 7f5563baf700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f555c1618a0 con 0x7f555c15b2b0 2023-09-21T00:17:02.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.861+0000 7f556214c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f555c06a780 0x7f555c06abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:02.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.861+0000 7f556114a700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f555c0ce420 0x7f555c161190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56410/0 (socket says 172.21.15.59:56410) 2023-09-21T00:17:02.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.861+0000 7f556114a700 1 -- 172.21.15.59:0/3477610966 learned_addr learned my addr 172.21.15.59:0/3477610966 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:02.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.861+0000 7f556194b700 1 --2- 172.21.15.59:0/3477610966 >> v2:172.21.15.83:3300/0 conn(0x7f555c15b2b0 0x7f555c0cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:02.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.861+0000 7f556214c700 1 -- 172.21.15.59:0/3477610966 >> v2:172.21.15.83:3300/0 conn(0x7f555c15b2b0 msgr2=0x7f555c0cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:02.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.861+0000 7f556214c700 1 --2- 172.21.15.59:0/3477610966 >> v2:172.21.15.83:3300/0 conn(0x7f555c15b2b0 0x7f555c0cdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:02.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.861+0000 7f556214c700 1 -- 172.21.15.59:0/3477610966 >> v1:172.21.15.59:6789/0 conn(0x7f555c0ce420 legacy=0x7f555c161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:02.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.861+0000 7f5560949700 1 -- 172.21.15.59:0/3477610966 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 534980328 0 0) 0x7f5550001110 con 0x7f555c0ce420 2023-09-21T00:17:02.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.861+0000 7f556214c700 1 -- 172.21.15.59:0/3477610966 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f555c0cfee0 con 0x7f555c06a780 2023-09-21T00:17:02.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.861+0000 7f556194b700 1 --2- 172.21.15.59:0/3477610966 >> v2:172.21.15.83:3300/0 conn(0x7f555c15b2b0 0x7f555c0cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:17:02.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.861+0000 7f556214c700 1 --2- 172.21.15.59:0/3477610966 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f555c06a780 0x7f555c06abd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f555c0ccb20 tx=0x7f555400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a99b4e838035cc6 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:02.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.861+0000 7f5560949700 1 -- 172.21.15.59:0/3477610966 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555400e070 con 0x7f555c06a780 2023-09-21T00:17:02.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.861+0000 7f5560949700 1 -- 172.21.15.59:0/3477610966 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f555400bbd0 con 0x7f555c06a780 2023-09-21T00:17:02.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.861+0000 7f5560949700 1 -- 172.21.15.59:0/3477610966 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5554012430 con 0x7f555c06a780 2023-09-21T00:17:02.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.862+0000 7f5563baf700 1 -- 172.21.15.59:0/3477610966 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f555c06a780 msgr2=0x7f555c06abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:02.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.862+0000 7f5563baf700 1 --2- 172.21.15.59:0/3477610966 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f555c06a780 0x7f555c06abd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f555c0ccb20 tx=0x7f555400b330 comp rx=0 tx=0).stop 2023-09-21T00:17:02.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.862+0000 7f5563baf700 1 -- 172.21.15.59:0/3477610966 shutdown_connections 2023-09-21T00:17:02.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.862+0000 7f5563baf700 1 --2- 172.21.15.59:0/3477610966 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f555c06a780 0x7f555c06abd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:02.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.862+0000 7f5563baf700 1 --2- 172.21.15.59:0/3477610966 >> v2:172.21.15.83:3300/0 conn(0x7f555c15b2b0 0x7f555c0cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:02.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.862+0000 7f5563baf700 1 -- 172.21.15.59:0/3477610966 >> 172.21.15.59:0/3477610966 conn(0x7f555c0d0140 msgr2=0x7f555c0d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:02.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.862+0000 7f5563baf700 1 -- 172.21.15.59:0/3477610966 shutdown_connections 2023-09-21T00:17:02.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.862+0000 7f5563baf700 1 -- 172.21.15.59:0/3477610966 wait complete. 2023-09-21T00:17:02.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.863+0000 7f5563baf700 1 Processor -- start 2023-09-21T00:17:02.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.863+0000 7f5563baf700 1 -- start start 2023-09-21T00:17:02.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.864+0000 7f5563baf700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f555c06a780 0x7f555c14f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:02.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.864+0000 7f5563baf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f555c0ce420 0x7f555c15ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:02.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.864+0000 7f5563baf700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f555c15b2b0 0x7f555c0c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:02.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.864+0000 7f5563baf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555c14fc10 con 0x7f555c0ce420 2023-09-21T00:17:02.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.864+0000 7f5563baf700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555c15f930 con 0x7f555c15b2b0 2023-09-21T00:17:02.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.864+0000 7f5563baf700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f555c1f6380 con 0x7f555c06a780 2023-09-21T00:17:02.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.864+0000 7f556114a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f555c0ce420 0x7f555c15ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:02.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.864+0000 7f556114a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f555c0ce420 0x7f555c15ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50848/0 (socket says 172.21.15.59:50848) 2023-09-21T00:17:02.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.864+0000 7f556114a700 1 -- 172.21.15.59:0/2885628734 learned_addr learned my addr 172.21.15.59:0/2885628734 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:02.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.864+0000 7f556194b700 1 --2- 172.21.15.59:0/2885628734 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f555c06a780 0x7f555c14f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:02.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.864+0000 7f556214c700 1 --2- 172.21.15.59:0/2885628734 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f555c15b2b0 0x7f555c0c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:02.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.864+0000 7f556114a700 1 -- 172.21.15.59:0/2885628734 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f555c06a780 msgr2=0x7f555c14f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:02.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.864+0000 7f556114a700 1 --2- 172.21.15.59:0/2885628734 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f555c06a780 0x7f555c14f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:02.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.864+0000 7f556114a700 1 -- 172.21.15.59:0/2885628734 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f555c15b2b0 msgr2=0x7f555c0c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:02.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.864+0000 7f556114a700 1 --2- 172.21.15.59:0/2885628734 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f555c15b2b0 0x7f555c0c93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:02.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.864+0000 7f556114a700 1 -- 172.21.15.59:0/2885628734 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5554009a70 con 0x7f555c0ce420 2023-09-21T00:17:02.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.864+0000 7f556214c700 1 --2- 172.21.15.59:0/2885628734 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f555c15b2b0 0x7f555c0c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:17:02.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.864+0000 7f556114a700 1 --2- 172.21.15.59:0/2885628734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f555c0ce420 0x7f555c15ec70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f555000c550 tx=0x7f555000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:02.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.864+0000 7f554e7fc700 1 -- 172.21.15.59:0/2885628734 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5550004c80 con 0x7f555c0ce420 2023-09-21T00:17:02.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.865+0000 7f554e7fc700 1 -- 172.21.15.59:0/2885628734 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5550004e00 con 0x7f555c0ce420 2023-09-21T00:17:02.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.865+0000 7f5563baf700 1 -- 172.21.15.59:0/2885628734 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f555c15f650 con 0x7f555c0ce420 2023-09-21T00:17:02.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.865+0000 7f554e7fc700 1 -- 172.21.15.59:0/2885628734 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5550007310 con 0x7f555c0ce420 2023-09-21T00:17:02.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.865+0000 7f5563baf700 1 -- 172.21.15.59:0/2885628734 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f555c1f6870 con 0x7f555c0ce420 2023-09-21T00:17:02.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.865+0000 7f5563baf700 1 -- 172.21.15.59:0/2885628734 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f555c067e50 con 0x7f555c0ce420 2023-09-21T00:17:02.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.866+0000 7f554e7fc700 1 -- 172.21.15.59:0/2885628734 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f5550007470 con 0x7f555c0ce420 2023-09-21T00:17:02.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.866+0000 7f554e7fc700 1 --2- 172.21.15.59:0/2885628734 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f554006ae00 0x7f554006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:02.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.866+0000 7f554e7fc700 1 -- 172.21.15.59:0/2885628734 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5550088d70 con 0x7f555c0ce420 2023-09-21T00:17:02.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.866+0000 7f556194b700 1 --2- 172.21.15.59:0/2885628734 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f554006ae00 0x7f554006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:02.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.867+0000 7f556194b700 1 --2- 172.21.15.59:0/2885628734 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f554006ae00 0x7f554006d2c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f555c0c4ec0 tx=0x7f5558008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:02.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:02.871+0000 7f554e7fc700 1 -- 172.21.15.59:0/2885628734 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f5550054270 con 0x7f555c0ce420 2023-09-21T00:17:03.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.071+0000 7f5563baf700 1 -- 172.21.15.59:0/2885628734 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f555c06b110 con 0x7f555c0ce420 2023-09-21T00:17:03.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.072+0000 7f554e7fc700 1 -- 172.21.15.59:0/2885628734 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12766 (secure 0 0 0) 0x7f555c06b110 con 0x7f555c0ce420 2023-09-21T00:17:03.073 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:17:03.073 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":16,"fsid":"dd69925c-6e25-42fe-880b-2f60fc6f384b","created":"2023-09-21T00:16:43.074489+0000","modified":"2023-09-21T00:16:57.751111+0000","last_up_change":"2023-09-21T00:16:54.740101+0000","last_in_change":"2023-09-21T00:16:45.987089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T00:16:54.796248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d4b18344-74c0-4f75-920b-7a9247e48914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6809","nonce":2418314235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6811","nonce":2418314235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6815","nonce":2418314235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6813","nonce":2418314235}]},"public_addr":"172.21.15.59:6809/2418314235","cluster_addr":"172.21.15.59:6811/2418314235","heartbeat_back_addr":"172.21.15.59:6815/2418314235","heartbeat_front_addr":"172.21.15.59:6813/2418314235","state":["exists","up"]},{"osd":1,"uuid":"80940d50-a248-4e64-a282-7ffcdad790ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6801","nonce":869668251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6803","nonce":869668251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6807","nonce":869668251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6805","nonce":869668251}]},"public_addr":"172.21.15.59:6801/869668251","cluster_addr":"172.21.15.59:6803/869668251","heartbeat_back_addr":"172.21.15.59:6807/869668251","heartbeat_front_addr":"172.21.15.59:6805/869668251","state":["exists","up"]},{"osd":2,"uuid":"55f2eceb-c54a-4879-a6ce-968c1c548b5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6817","nonce":372517778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6819","nonce":372517778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6823","nonce":372517778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6821","nonce":372517778}]},"public_addr":"172.21.15.59:6817/372517778","cluster_addr":"172.21.15.59:6819/372517778","heartbeat_back_addr":"172.21.15.59:6823/372517778","heartbeat_front_addr":"172.21.15.59:6821/372517778","state":["exists","up"]},{"osd":3,"uuid":"92b89cd0-869c-49b9-a9f9-97ac8423f304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6825","nonce":575188498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6827","nonce":575188498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6831","nonce":575188498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6829","nonce":575188498}]},"public_addr":"172.21.15.59:6825/575188498","cluster_addr":"172.21.15.59:6827/575188498","heartbeat_back_addr":"172.21.15.59:6831/575188498","heartbeat_front_addr":"172.21.15.59:6829/575188498","state":["exists","up"]},{"osd":4,"uuid":"25b80e94-e0e6-403d-b69f-61542f289637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6803","nonce":1741219098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6805","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6807","nonce":1741219098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6815","nonce":1741219098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6811","nonce":1741219098}]},"public_addr":"172.21.15.83:6803/1741219098","cluster_addr":"172.21.15.83:6807/1741219098","heartbeat_back_addr":"172.21.15.83:6815/1741219098","heartbeat_front_addr":"172.21.15.83:6811/1741219098","state":["exists","up"]},{"osd":5,"uuid":"5498d9ab-1086-4796-a199-9051e6dfea91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6817","nonce":156730565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6819","nonce":156730565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6823","nonce":156730565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6821","nonce":156730565}]},"public_addr":"172.21.15.83:6817/156730565","cluster_addr":"172.21.15.83:6819/156730565","heartbeat_back_addr":"172.21.15.83:6823/156730565","heartbeat_front_addr":"172.21.15.83:6821/156730565","state":["exists","up"]},{"osd":6,"uuid":"cfd810c0-5015-4d60-9a75-7efc93a32e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6801","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6800","nonce":1337723778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6806","nonce":1337723778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6814","nonce":1337723778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6810","nonce":1337723778}]},"public_addr":"172.21.15.83:6800/1337723778","cluster_addr":"172.21.15.83:6806/1337723778","heartbeat_back_addr":"172.21.15.83:6814/1337723778","heartbeat_front_addr":"172.21.15.83:6810/1337723778","state":["exists","up"]},{"osd":7,"uuid":"e992c8fa-0a3d-4b3c-85b5-2c511223dee4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6825","nonce":4204859272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6827","nonce":4204859272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6831","nonce":4204859272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6829","nonce":4204859272}]},"public_addr":"172.21.15.83:6825/4204859272","cluster_addr":"172.21.15.83:6827/4204859272","heartbeat_back_addr":"172.21.15.83:6831/4204859272","heartbeat_front_addr":"172.21.15.83:6829/4204859272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.156498+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.882707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.093978+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.158565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.173933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.888606+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.135525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.149712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T00:17:03.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.074+0000 7f5563baf700 1 -- 172.21.15.59:0/2885628734 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f554006ae00 msgr2=0x7f554006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:03.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.074+0000 7f5563baf700 1 --2- 172.21.15.59:0/2885628734 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f554006ae00 0x7f554006d2c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f555c0c4ec0 tx=0x7f5558008040 comp rx=0 tx=0).stop 2023-09-21T00:17:03.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.074+0000 7f5563baf700 1 -- 172.21.15.59:0/2885628734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f555c0ce420 msgr2=0x7f555c15ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:03.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.074+0000 7f5563baf700 1 --2- 172.21.15.59:0/2885628734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f555c0ce420 0x7f555c15ec70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f555000c550 tx=0x7f555000c910 comp rx=0 tx=0).stop 2023-09-21T00:17:03.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.074+0000 7f5563baf700 1 -- 172.21.15.59:0/2885628734 shutdown_connections 2023-09-21T00:17:03.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.074+0000 7f5563baf700 1 --2- 172.21.15.59:0/2885628734 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f555c15b2b0 0x7f555c0c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:03.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.074+0000 7f5563baf700 1 --2- 172.21.15.59:0/2885628734 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f554006ae00 0x7f554006d2c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:03.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.074+0000 7f5563baf700 1 --2- 172.21.15.59:0/2885628734 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f555c06a780 0x7f555c14f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:03.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.074+0000 7f5563baf700 1 --2- 172.21.15.59:0/2885628734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f555c0ce420 0x7f555c15ec70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:03.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.074+0000 7f5563baf700 1 -- 172.21.15.59:0/2885628734 >> 172.21.15.59:0/2885628734 conn(0x7f555c0d0140 msgr2=0x7f555c0af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:03.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.074+0000 7f5563baf700 1 -- 172.21.15.59:0/2885628734 shutdown_connections 2023-09-21T00:17:03.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.074+0000 7f5563baf700 1 -- 172.21.15.59:0/2885628734 wait complete. 2023-09-21T00:17:03.087 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-21T00:16:54.796248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-21T00:17:03.087 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-21T00:17:03.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.214+0000 7fbae4855700 1 Processor -- start 2023-09-21T00:17:03.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.214+0000 7fbae4855700 1 -- start start 2023-09-21T00:17:03.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.215+0000 7fbae4855700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbae015d5d0 0x7fbae00cc260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:03.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.215+0000 7fbae4855700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbae006d770 0x7fbae00cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:03.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.215+0000 7fbae4855700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbae006d230 0x7fbae00c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:03.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.215+0000 7fbae4855700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbae00ca2f0 con 0x7fbae006d230 2023-09-21T00:17:03.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.215+0000 7fbae4855700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbae00b2810 con 0x7fbae006d770 2023-09-21T00:17:03.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.215+0000 7fbae4855700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbae0072080 con 0x7fbae015d5d0 2023-09-21T00:17:03.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.215+0000 7fbaded9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbae006d230 0x7fbae00c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:03.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.215+0000 7fbaded9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbae006d230 0x7fbae00c8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50858/0 (socket says 172.21.15.59:50858) 2023-09-21T00:17:03.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.215+0000 7fbaded9d700 1 -- 172.21.15.59:0/2820168748 learned_addr learned my addr 172.21.15.59:0/2820168748 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:03.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.215+0000 7fbade59c700 1 --2- 172.21.15.59:0/2820168748 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbae015d5d0 0x7fbae00cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:03.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.215+0000 7fbaddd9b700 1 --2- 172.21.15.59:0/2820168748 >> v2:172.21.15.83:3300/0 conn(0x7fbae006d770 0x7fbae00cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:03.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.216+0000 7fbaded9d700 1 -- 172.21.15.59:0/2820168748 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbae015d5d0 msgr2=0x7fbae00cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:03.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.216+0000 7fbaded9d700 1 --2- 172.21.15.59:0/2820168748 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbae015d5d0 0x7fbae00cc260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:03.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.216+0000 7fbaded9d700 1 -- 172.21.15.59:0/2820168748 >> v2:172.21.15.83:3300/0 conn(0x7fbae006d770 msgr2=0x7fbae00cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:03.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.216+0000 7fbaded9d700 1 --2- 172.21.15.59:0/2820168748 >> v2:172.21.15.83:3300/0 conn(0x7fbae006d770 0x7fbae00cc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:03.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.216+0000 7fbaded9d700 1 -- 172.21.15.59:0/2820168748 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae00ca010 con 0x7fbae006d230 2023-09-21T00:17:03.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.216+0000 7fbaded9d700 1 --2- 172.21.15.59:0/2820168748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbae006d230 0x7fbae00c8b90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbae00c9c60 tx=0x7fbad800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b084d096fd47b67 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:03.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.216+0000 7fbadd59a700 1 -- 172.21.15.59:0/2820168748 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad800e070 con 0x7fbae006d230 2023-09-21T00:17:03.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.216+0000 7fbadd59a700 1 -- 172.21.15.59:0/2820168748 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad800b910 con 0x7fbae006d230 2023-09-21T00:17:03.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.216+0000 7fbadd59a700 1 -- 172.21.15.59:0/2820168748 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad800bcc0 con 0x7fbae006d230 2023-09-21T00:17:03.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.217+0000 7fbae4855700 1 -- 172.21.15.59:0/2820168748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbae006d230 msgr2=0x7fbae00c8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:03.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.217+0000 7fbae4855700 1 --2- 172.21.15.59:0/2820168748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbae006d230 0x7fbae00c8b90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbae00c9c60 tx=0x7fbad800b330 comp rx=0 tx=0).stop 2023-09-21T00:17:03.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.217+0000 7fbae4855700 1 -- 172.21.15.59:0/2820168748 shutdown_connections 2023-09-21T00:17:03.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.217+0000 7fbae4855700 1 --2- 172.21.15.59:0/2820168748 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbae015d5d0 0x7fbae00cc260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:03.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.217+0000 7fbae4855700 1 --2- 172.21.15.59:0/2820168748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbae006d230 0x7fbae00c8b90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:03.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.217+0000 7fbae4855700 1 --2- 172.21.15.59:0/2820168748 >> v2:172.21.15.83:3300/0 conn(0x7fbae006d770 0x7fbae00cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:03.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.217+0000 7fbae4855700 1 -- 172.21.15.59:0/2820168748 >> 172.21.15.59:0/2820168748 conn(0x7fbae006a780 msgr2=0x7fbae006ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:03.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.217+0000 7fbae4855700 1 -- 172.21.15.59:0/2820168748 shutdown_connections 2023-09-21T00:17:03.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.217+0000 7fbae4855700 1 -- 172.21.15.59:0/2820168748 wait complete. 2023-09-21T00:17:03.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.218+0000 7fbae4855700 1 Processor -- start 2023-09-21T00:17:03.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.218+0000 7fbae4855700 1 -- start start 2023-09-21T00:17:03.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.219+0000 7fbae4855700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbae006d230 0x7fbae01603e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:03.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.219+0000 7fbae4855700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbae006d770 0x7fbae014e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:03.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.219+0000 7fbae4855700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbae015d5d0 0x7fbae00b0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:03.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.219+0000 7fbae4855700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae00b0070 con 0x7fbae015d5d0 2023-09-21T00:17:03.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.219+0000 7fbae4855700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae00af3f0 con 0x7fbae006d770 2023-09-21T00:17:03.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.219+0000 7fbae4855700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbae00af6d0 con 0x7fbae006d230 2023-09-21T00:17:03.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.219+0000 7fbaded9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbae015d5d0 0x7fbae00b0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:03.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.219+0000 7fbaded9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbae015d5d0 0x7fbae00b0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50862/0 (socket says 172.21.15.59:50862) 2023-09-21T00:17:03.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.219+0000 7fbaded9d700 1 -- 172.21.15.59:0/4076845157 learned_addr learned my addr 172.21.15.59:0/4076845157 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:03.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.219+0000 7fbade59c700 1 --2- 172.21.15.59:0/4076845157 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbae006d230 0x7fbae01603e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:03.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.219+0000 7fbaddd9b700 1 --2- 172.21.15.59:0/4076845157 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbae006d770 0x7fbae014e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:03.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.219+0000 7fbaded9d700 1 -- 172.21.15.59:0/4076845157 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbae006d230 msgr2=0x7fbae01603e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:03.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.219+0000 7fbaded9d700 1 --2- 172.21.15.59:0/4076845157 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbae006d230 0x7fbae01603e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:03.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.219+0000 7fbaded9d700 1 -- 172.21.15.59:0/4076845157 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbae006d770 msgr2=0x7fbae014e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:03.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.219+0000 7fbaded9d700 1 --2- 172.21.15.59:0/4076845157 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbae006d770 0x7fbae014e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:03.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.219+0000 7fbaded9d700 1 -- 172.21.15.59:0/4076845157 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad8009b30 con 0x7fbae015d5d0 2023-09-21T00:17:03.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.219+0000 7fbaded9d700 1 --2- 172.21.15.59:0/4076845157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbae015d5d0 0x7fbae00b0490 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbad800b370 tx=0x7fbad8004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:03.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.220+0000 7fbaceffd700 1 -- 172.21.15.59:0/4076845157 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad8003e80 con 0x7fbae015d5d0 2023-09-21T00:17:03.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.220+0000 7fbaceffd700 1 -- 172.21.15.59:0/4076845157 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad8004250 con 0x7fbae015d5d0 2023-09-21T00:17:03.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.220+0000 7fbaceffd700 1 -- 172.21.15.59:0/4076845157 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad8004600 con 0x7fbae015d5d0 2023-09-21T00:17:03.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.220+0000 7fbae4855700 1 -- 172.21.15.59:0/4076845157 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbae00af9b0 con 0x7fbae015d5d0 2023-09-21T00:17:03.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.220+0000 7fbae4855700 1 -- 172.21.15.59:0/4076845157 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbae0160920 con 0x7fbae015d5d0 2023-09-21T00:17:03.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.221+0000 7fbae4855700 1 -- 172.21.15.59:0/4076845157 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbae0160ab0 con 0x7fbae015d5d0 2023-09-21T00:17:03.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.221+0000 7fbaceffd700 1 -- 172.21.15.59:0/4076845157 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fbad8004760 con 0x7fbae015d5d0 2023-09-21T00:17:03.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.221+0000 7fbaceffd700 1 --2- 172.21.15.59:0/4076845157 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fbac006ae00 0x7fbac006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:03.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.222+0000 7fbaceffd700 1 -- 172.21.15.59:0/4076845157 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbad808a1f0 con 0x7fbae015d5d0 2023-09-21T00:17:03.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.222+0000 7fbade59c700 1 --2- 172.21.15.59:0/4076845157 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fbac006ae00 0x7fbac006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:03.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.222+0000 7fbade59c700 1 --2- 172.21.15.59:0/4076845157 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fbac006ae00 0x7fbac006d2c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbad4009af0 tx=0x7fbad4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:03.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.226+0000 7fbaceffd700 1 -- 172.21.15.59:0/4076845157 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fbad80556f0 con 0x7fbae015d5d0 2023-09-21T00:17:03.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.425+0000 7fbae4855700 1 -- 172.21.15.59:0/4076845157 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbae00b01b0 con 0x7fbae015d5d0 2023-09-21T00:17:03.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.425+0000 7fbaceffd700 1 -- 172.21.15.59:0/4076845157 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbad801f020 con 0x7fbae015d5d0 2023-09-21T00:17:03.428 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-09-21T00:17:03.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.427+0000 7fbae4855700 1 -- 172.21.15.59:0/4076845157 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fbac006ae00 msgr2=0x7fbac006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:03.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.427+0000 7fbae4855700 1 --2- 172.21.15.59:0/4076845157 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fbac006ae00 0x7fbac006d2c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbad4009af0 tx=0x7fbad4008040 comp rx=0 tx=0).stop 2023-09-21T00:17:03.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.427+0000 7fbae4855700 1 -- 172.21.15.59:0/4076845157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbae015d5d0 msgr2=0x7fbae00b0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:03.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.427+0000 7fbae4855700 1 --2- 172.21.15.59:0/4076845157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbae015d5d0 0x7fbae00b0490 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbad800b370 tx=0x7fbad8004b20 comp rx=0 tx=0).stop 2023-09-21T00:17:03.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.427+0000 7fbae4855700 1 -- 172.21.15.59:0/4076845157 shutdown_connections 2023-09-21T00:17:03.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.427+0000 7fbae4855700 1 --2- 172.21.15.59:0/4076845157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbae015d5d0 0x7fbae00b0490 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:03.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.427+0000 7fbae4855700 1 --2- 172.21.15.59:0/4076845157 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fbac006ae00 0x7fbac006d2c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:03.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.427+0000 7fbae4855700 1 --2- 172.21.15.59:0/4076845157 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbae006d230 0x7fbae01603e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:03.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.427+0000 7fbae4855700 1 --2- 172.21.15.59:0/4076845157 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbae006d770 0x7fbae014e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:03.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.427+0000 7fbae4855700 1 -- 172.21.15.59:0/4076845157 >> 172.21.15.59:0/4076845157 conn(0x7fbae006a780 msgr2=0x7fbae00b3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:03.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.427+0000 7fbae4855700 1 -- 172.21.15.59:0/4076845157 shutdown_connections 2023-09-21T00:17:03.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.427+0000 7fbae4855700 1 -- 172.21.15.59:0/4076845157 wait complete. 2023-09-21T00:17:03.441 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-21T00:17:03.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.564+0000 7fb113e9e700 1 Processor -- start 2023-09-21T00:17:03.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.564+0000 7fb113e9e700 1 -- start start 2023-09-21T00:17:03.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.565+0000 7fb113e9e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb10c15d690 0x7fb10c070b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:03.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.565+0000 7fb113e9e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb10c162170 con 0x7fb10c0cedb0 2023-09-21T00:17:03.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.565+0000 7fb113e9e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb10c161bb0 con 0x7fb10c143ce0 2023-09-21T00:17:03.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.565+0000 7fb113e9e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb10c161990 con 0x7fb10c15d690 2023-09-21T00:17:03.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.565+0000 7fb11243b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb10c0cedb0 0x7fb10c0cf190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56438/0 (socket says 172.21.15.59:56438) 2023-09-21T00:17:03.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.565+0000 7fb11243b700 1 -- 172.21.15.59:0/4248726453 learned_addr learned my addr 172.21.15.59:0/4248726453 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:03.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.566+0000 7fb111c3a700 1 --2- 172.21.15.59:0/4248726453 >> v2:172.21.15.83:3300/0 conn(0x7fb10c15d690 0x7fb10c070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:03.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.566+0000 7fb110c38700 1 -- 172.21.15.59:0/4248726453 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1212190849 0 0) 0x7fb10c162170 con 0x7fb10c0cedb0 2023-09-21T00:17:03.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.566+0000 7fb110c38700 1 -- 172.21.15.59:0/4248726453 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0f80035b0 con 0x7fb10c0cedb0 2023-09-21T00:17:03.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.566+0000 7fb111c3a700 1 -- 172.21.15.59:0/4248726453 >> v1:172.21.15.83:6789/0 conn(0x7fb10c143ce0 legacy=0x7fb10c161280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:03.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.566+0000 7fb111c3a700 1 -- 172.21.15.59:0/4248726453 >> v1:172.21.15.59:6789/0 conn(0x7fb10c0cedb0 legacy=0x7fb10c0cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:03.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.566+0000 7fb110c38700 1 -- 172.21.15.59:0/4248726453 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3831497212 0 0) 0x7fb0f80035b0 con 0x7fb10c0cedb0 2023-09-21T00:17:03.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.566+0000 7fb111c3a700 1 -- 172.21.15.59:0/4248726453 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb10c161e90 con 0x7fb10c15d690 2023-09-21T00:17:03.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.566+0000 7fb111c3a700 1 --2- 172.21.15.59:0/4248726453 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb10c15d690 0x7fb10c070b10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc009840 tx=0x7fb0fc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e6b8d22b450ca82 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:03.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.566+0000 7fb110c38700 1 -- 172.21.15.59:0/4248726453 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1040019f0 con 0x7fb10c15d690 2023-09-21T00:17:03.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.566+0000 7fb110c38700 1 -- 172.21.15.59:0/4248726453 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0fc004030 con 0x7fb10c15d690 2023-09-21T00:17:03.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.566+0000 7fb110c38700 1 -- 172.21.15.59:0/4248726453 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc0043c0 con 0x7fb10c15d690 2023-09-21T00:17:03.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.567+0000 7fb113e9e700 1 -- 172.21.15.59:0/4248726453 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb10c15d690 msgr2=0x7fb10c070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:03.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.567+0000 7fb113e9e700 1 --2- 172.21.15.59:0/4248726453 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb10c15d690 0x7fb10c070b10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc009840 tx=0x7fb0fc009b50 comp rx=0 tx=0).stop 2023-09-21T00:17:03.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.567+0000 7fb113e9e700 1 -- 172.21.15.59:0/4248726453 shutdown_connections 2023-09-21T00:17:03.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.567+0000 7fb113e9e700 1 --2- 172.21.15.59:0/4248726453 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb10c15d690 0x7fb10c070b10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:03.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.567+0000 7fb113e9e700 1 -- 172.21.15.59:0/4248726453 >> 172.21.15.59:0/4248726453 conn(0x7fb10c0d11e0 msgr2=0x7fb10c0d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:03.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.567+0000 7fb113e9e700 1 -- 172.21.15.59:0/4248726453 shutdown_connections 2023-09-21T00:17:03.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.567+0000 7fb113e9e700 1 -- 172.21.15.59:0/4248726453 wait complete. 2023-09-21T00:17:03.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.568+0000 7fb113e9e700 1 Processor -- start 2023-09-21T00:17:03.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.568+0000 7fb113e9e700 1 -- start start 2023-09-21T00:17:03.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.569+0000 7fb113e9e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb10c0cedb0 0x7fb10c0b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:03.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.569+0000 7fb113e9e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb10c143ce0 0x7fb10c15ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:03.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.569+0000 7fb113e9e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb10c15d690 0x7fb10c160490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:03.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.569+0000 7fb113e9e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c158950 con 0x7fb10c0cedb0 2023-09-21T00:17:03.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.569+0000 7fb113e9e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c1593b0 con 0x7fb10c15d690 2023-09-21T00:17:03.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.569+0000 7fb113e9e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c0b44d0 con 0x7fb10c143ce0 2023-09-21T00:17:03.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.569+0000 7fb111c3a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb10c0cedb0 0x7fb10c0b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:03.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.569+0000 7fb111c3a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb10c0cedb0 0x7fb10c0b3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50872/0 (socket says 172.21.15.59:50872) 2023-09-21T00:17:03.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.569+0000 7fb111c3a700 1 -- 172.21.15.59:0/2514294754 learned_addr learned my addr 172.21.15.59:0/2514294754 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:03.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.569+0000 7fb11243b700 1 --2- 172.21.15.59:0/2514294754 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb10c15d690 0x7fb10c160490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:03.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.569+0000 7fb111439700 1 --2- 172.21.15.59:0/2514294754 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb10c143ce0 0x7fb10c15ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:03.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.569+0000 7fb111c3a700 1 -- 172.21.15.59:0/2514294754 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb10c143ce0 msgr2=0x7fb10c15ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:03.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.569+0000 7fb111c3a700 1 --2- 172.21.15.59:0/2514294754 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb10c143ce0 0x7fb10c15ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:03.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.569+0000 7fb111c3a700 1 -- 172.21.15.59:0/2514294754 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb10c15d690 msgr2=0x7fb10c160490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:03.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.569+0000 7fb111c3a700 1 --2- 172.21.15.59:0/2514294754 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb10c15d690 0x7fb10c160490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:03.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.569+0000 7fb111c3a700 1 -- 172.21.15.59:0/2514294754 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0fc0094a0 con 0x7fb10c0cedb0 2023-09-21T00:17:03.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.569+0000 7fb111c3a700 1 --2- 172.21.15.59:0/2514294754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb10c0cedb0 0x7fb10c0b3dd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc00a010 tx=0x7fb0fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:03.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.570+0000 7fb1027fc700 1 -- 172.21.15.59:0/2514294754 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc003e30 con 0x7fb10c0cedb0 2023-09-21T00:17:03.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.570+0000 7fb1027fc700 1 -- 172.21.15.59:0/2514294754 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0fc01f070 con 0x7fb10c0cedb0 2023-09-21T00:17:03.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.570+0000 7fb113e9e700 1 -- 172.21.15.59:0/2514294754 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb10c1e70d0 con 0x7fb10c0cedb0 2023-09-21T00:17:03.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.570+0000 7fb1027fc700 1 -- 172.21.15.59:0/2514294754 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc011850 con 0x7fb10c0cedb0 2023-09-21T00:17:03.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.570+0000 7fb113e9e700 1 -- 172.21.15.59:0/2514294754 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb10c1e7690 con 0x7fb10c0cedb0 2023-09-21T00:17:03.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.571+0000 7fb113e9e700 1 -- 172.21.15.59:0/2514294754 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb10c067e50 con 0x7fb10c0cedb0 2023-09-21T00:17:03.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.571+0000 7fb1027fc700 1 -- 172.21.15.59:0/2514294754 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fb0fc021030 con 0x7fb10c0cedb0 2023-09-21T00:17:03.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.572+0000 7fb1027fc700 1 --2- 172.21.15.59:0/2514294754 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fb0f006ae00 0x7fb0f006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:03.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.572+0000 7fb1027fc700 1 -- 172.21.15.59:0/2514294754 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb0fc08a5c0 con 0x7fb10c0cedb0 2023-09-21T00:17:03.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.572+0000 7fb111439700 1 --2- 172.21.15.59:0/2514294754 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fb0f006ae00 0x7fb0f006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:03.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.572+0000 7fb111439700 1 --2- 172.21.15.59:0/2514294754 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fb0f006ae00 0x7fb0f006d2c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb10c0b09f0 tx=0x7fb108009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:03.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.576+0000 7fb1027fc700 1 -- 172.21.15.59:0/2514294754 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fb0fc055ac0 con 0x7fb10c0cedb0 2023-09-21T00:17:03.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.777+0000 7fb113e9e700 1 -- 172.21.15.59:0/2514294754 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb10c146d60 con 0x7fb10c0cedb0 2023-09-21T00:17:03.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.778+0000 7fb1027fc700 1 -- 172.21.15.59:0/2514294754 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7fb0fc0590e0 con 0x7fb10c0cedb0 2023-09-21T00:17:03.779 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:17:03.779 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2023-09-21T00:17:03.780 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-21T00:17:03.780 INFO:teuthology.orchestra.run.smithi059.stdout: "poolnum": 1, 2023-09-21T00:17:03.780 INFO:teuthology.orchestra.run.smithi059.stdout: "poolname": ".mgr" 2023-09-21T00:17:03.780 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-21T00:17:03.780 INFO:teuthology.orchestra.run.smithi059.stdout:] 2023-09-21T00:17:03.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.780+0000 7fb113e9e700 1 -- 172.21.15.59:0/2514294754 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fb0f006ae00 msgr2=0x7fb0f006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:03.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.780+0000 7fb113e9e700 1 --2- 172.21.15.59:0/2514294754 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fb0f006ae00 0x7fb0f006d2c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb10c0b09f0 tx=0x7fb108009040 comp rx=0 tx=0).stop 2023-09-21T00:17:03.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.780+0000 7fb113e9e700 1 -- 172.21.15.59:0/2514294754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb10c0cedb0 msgr2=0x7fb10c0b3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:03.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.780+0000 7fb113e9e700 1 --2- 172.21.15.59:0/2514294754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb10c0cedb0 0x7fb10c0b3dd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc00a010 tx=0x7fb0fc004750 comp rx=0 tx=0).stop 2023-09-21T00:17:03.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.780+0000 7fb113e9e700 1 -- 172.21.15.59:0/2514294754 shutdown_connections 2023-09-21T00:17:03.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.780+0000 7fb113e9e700 1 --2- 172.21.15.59:0/2514294754 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb10c15d690 0x7fb10c160490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:03.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.780+0000 7fb113e9e700 1 --2- 172.21.15.59:0/2514294754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb10c0cedb0 0x7fb10c0b3dd0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:03.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.780+0000 7fb113e9e700 1 --2- 172.21.15.59:0/2514294754 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fb0f006ae00 0x7fb0f006d2c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:03.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.780+0000 7fb113e9e700 1 --2- 172.21.15.59:0/2514294754 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb10c143ce0 0x7fb10c15ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:03.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.780+0000 7fb113e9e700 1 -- 172.21.15.59:0/2514294754 >> 172.21.15.59:0/2514294754 conn(0x7fb10c0d11e0 msgr2=0x7fb10c0cc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:03.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.780+0000 7fb113e9e700 1 -- 172.21.15.59:0/2514294754 shutdown_connections 2023-09-21T00:17:03.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.780+0000 7fb113e9e700 1 -- 172.21.15.59:0/2514294754 wait complete. 2023-09-21T00:17:03.793 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-21T00:17:03.793 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-21T00:17:03.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.922+0000 7fa83cb1a700 1 Processor -- start 2023-09-21T00:17:03.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.922+0000 7fa83cb1a700 1 -- start start 2023-09-21T00:17:03.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.923+0000 7fa83cb1a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa838151270 0x7fa83815b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:03.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.923+0000 7fa83cb1a700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa838151650 0x7fa8380716a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:03.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.923+0000 7fa83cb1a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa838071be0 0x7fa8380ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:03.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.923+0000 7fa83cb1a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa83806ffc0 con 0x7fa838151270 2023-09-21T00:17:03.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.923+0000 7fa83cb1a700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa838072030 con 0x7fa838151650 2023-09-21T00:17:03.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.923+0000 7fa83cb1a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa83806fb30 con 0x7fa838071be0 2023-09-21T00:17:03.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.923+0000 7fa83659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa838151270 0x7fa83815b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:03.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.923+0000 7fa83659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa838151270 0x7fa83815b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50880/0 (socket says 172.21.15.59:50880) 2023-09-21T00:17:03.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.923+0000 7fa83659c700 1 -- 172.21.15.59:0/2932363124 learned_addr learned my addr 172.21.15.59:0/2932363124 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:03.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.923+0000 7fa835d9b700 1 --2- 172.21.15.59:0/2932363124 >> v2:172.21.15.83:3300/0 conn(0x7fa838151650 0x7fa8380716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:03.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.923+0000 7fa836d9d700 1 --2- 172.21.15.59:0/2932363124 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa838071be0 0x7fa8380ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:03.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.923+0000 7fa83659c700 1 -- 172.21.15.59:0/2932363124 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa838071be0 msgr2=0x7fa8380ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:03.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.923+0000 7fa83659c700 1 --2- 172.21.15.59:0/2932363124 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa838071be0 0x7fa8380ced60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:03.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.923+0000 7fa83659c700 1 -- 172.21.15.59:0/2932363124 >> v2:172.21.15.83:3300/0 conn(0x7fa838151650 msgr2=0x7fa8380716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:03.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.923+0000 7fa83659c700 1 --2- 172.21.15.59:0/2932363124 >> v2:172.21.15.83:3300/0 conn(0x7fa838151650 0x7fa8380716a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:03.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.923+0000 7fa83659c700 1 -- 172.21.15.59:0/2932363124 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83815b8e0 con 0x7fa838151270 2023-09-21T00:17:03.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.923+0000 7fa835d9b700 1 --2- 172.21.15.59:0/2932363124 >> v2:172.21.15.83:3300/0 conn(0x7fa838151650 0x7fa8380716a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:17:03.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.923+0000 7fa83659c700 1 --2- 172.21.15.59:0/2932363124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa838151270 0x7fa83815b3a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa8380b2d30 tx=0x7fa82c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a0a0bb82ae82fca server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:03.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.923+0000 7fa83559a700 1 -- 172.21.15.59:0/2932363124 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c011830 con 0x7fa838151270 2023-09-21T00:17:03.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.923+0000 7fa83559a700 1 -- 172.21.15.59:0/2932363124 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa82c011990 con 0x7fa838151270 2023-09-21T00:17:03.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.923+0000 7fa83559a700 1 -- 172.21.15.59:0/2932363124 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c011d20 con 0x7fa838151270 2023-09-21T00:17:03.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.924+0000 7fa83cb1a700 1 -- 172.21.15.59:0/2932363124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa838151270 msgr2=0x7fa83815b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:03.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.924+0000 7fa83cb1a700 1 --2- 172.21.15.59:0/2932363124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa838151270 0x7fa83815b3a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa8380b2d30 tx=0x7fa82c009bd0 comp rx=0 tx=0).stop 2023-09-21T00:17:03.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.924+0000 7fa83cb1a700 1 -- 172.21.15.59:0/2932363124 shutdown_connections 2023-09-21T00:17:03.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.924+0000 7fa83cb1a700 1 --2- 172.21.15.59:0/2932363124 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa838071be0 0x7fa8380ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:03.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.924+0000 7fa83cb1a700 1 --2- 172.21.15.59:0/2932363124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa838151270 0x7fa83815b3a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:03.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.924+0000 7fa83cb1a700 1 --2- 172.21.15.59:0/2932363124 >> v2:172.21.15.83:3300/0 conn(0x7fa838151650 0x7fa8380716a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:03.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.924+0000 7fa83cb1a700 1 -- 172.21.15.59:0/2932363124 >> 172.21.15.59:0/2932363124 conn(0x7fa8380ccc00 msgr2=0x7fa8380cd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:03.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.924+0000 7fa83cb1a700 1 -- 172.21.15.59:0/2932363124 shutdown_connections 2023-09-21T00:17:03.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.924+0000 7fa83cb1a700 1 -- 172.21.15.59:0/2932363124 wait complete. 2023-09-21T00:17:03.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.925+0000 7fa83cb1a700 1 Processor -- start 2023-09-21T00:17:03.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.925+0000 7fa83cb1a700 1 -- start start 2023-09-21T00:17:03.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.926+0000 7fa83cb1a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa838071be0 0x7fa8380b4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:03.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.926+0000 7fa83cb1a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa838151270 0x7fa8380cf820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:03.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.926+0000 7fa83cb1a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa8380b0c50 0x7fa8380c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:03.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.926+0000 7fa83cb1a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8380c8ab0 con 0x7fa838071be0 2023-09-21T00:17:03.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.926+0000 7fa83cb1a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8380b10e0 con 0x7fa838151270 2023-09-21T00:17:03.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.926+0000 7fa83cb1a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8380b4de0 con 0x7fa8380b0c50 2023-09-21T00:17:03.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.926+0000 7fa83659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa838071be0 0x7fa8380b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:03.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.926+0000 7fa83659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa838071be0 0x7fa8380b4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50886/0 (socket says 172.21.15.59:50886) 2023-09-21T00:17:03.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.926+0000 7fa83659c700 1 -- 172.21.15.59:0/3331979416 learned_addr learned my addr 172.21.15.59:0/3331979416 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:03.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.926+0000 7fa835d9b700 1 --2- 172.21.15.59:0/3331979416 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa838151270 0x7fa8380cf820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:03.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.926+0000 7fa836d9d700 1 --2- 172.21.15.59:0/3331979416 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa8380b0c50 0x7fa8380c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:03.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.926+0000 7fa83659c700 1 -- 172.21.15.59:0/3331979416 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa8380b0c50 msgr2=0x7fa8380c7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:03.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.927+0000 7fa83659c700 1 --2- 172.21.15.59:0/3331979416 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa8380b0c50 0x7fa8380c7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:03.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.927+0000 7fa83659c700 1 -- 172.21.15.59:0/3331979416 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa838151270 msgr2=0x7fa8380cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:03.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.927+0000 7fa83659c700 1 --2- 172.21.15.59:0/3331979416 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa838151270 0x7fa8380cf820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:03.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.927+0000 7fa83659c700 1 -- 172.21.15.59:0/3331979416 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa82c009550 con 0x7fa838071be0 2023-09-21T00:17:03.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.927+0000 7fa836d9d700 1 --2- 172.21.15.59:0/3331979416 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa8380b0c50 0x7fa8380c7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:17:03.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.927+0000 7fa835d9b700 1 --2- 172.21.15.59:0/3331979416 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa838151270 0x7fa8380cf820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:17:03.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.927+0000 7fa83659c700 1 --2- 172.21.15.59:0/3331979416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa838071be0 0x7fa8380b4800 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa82c000c00 tx=0x7fa82c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:03.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.927+0000 7fa826ffd700 1 -- 172.21.15.59:0/3331979416 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c004380 con 0x7fa838071be0 2023-09-21T00:17:03.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.927+0000 7fa826ffd700 1 -- 172.21.15.59:0/3331979416 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa82c01f070 con 0x7fa838071be0 2023-09-21T00:17:03.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.927+0000 7fa826ffd700 1 -- 172.21.15.59:0/3331979416 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c0036a0 con 0x7fa838071be0 2023-09-21T00:17:03.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.927+0000 7fa83cb1a700 1 -- 172.21.15.59:0/3331979416 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8380b50c0 con 0x7fa838071be0 2023-09-21T00:17:03.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.927+0000 7fa83cb1a700 1 -- 172.21.15.59:0/3331979416 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8380b5680 con 0x7fa838071be0 2023-09-21T00:17:03.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.928+0000 7fa83cb1a700 1 -- 172.21.15.59:0/3331979416 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa838067e50 con 0x7fa838071be0 2023-09-21T00:17:03.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.928+0000 7fa826ffd700 1 -- 172.21.15.59:0/3331979416 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fa82c021030 con 0x7fa838071be0 2023-09-21T00:17:03.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.929+0000 7fa826ffd700 1 --2- 172.21.15.59:0/3331979416 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa81806ae00 0x7fa81806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:03.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.929+0000 7fa826ffd700 1 -- 172.21.15.59:0/3331979416 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa82c08a600 con 0x7fa838071be0 2023-09-21T00:17:03.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.929+0000 7fa835d9b700 1 --2- 172.21.15.59:0/3331979416 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa81806ae00 0x7fa81806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:03.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.930+0000 7fa835d9b700 1 --2- 172.21.15.59:0/3331979416 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa81806ae00 0x7fa81806d2c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa8380ca560 tx=0x7fa828008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:03.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:03.933+0000 7fa826ffd700 1 -- 172.21.15.59:0/3331979416 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fa82c055b00 con 0x7fa838071be0 2023-09-21T00:17:04.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:04.136+0000 7fa83cb1a700 1 -- 172.21.15.59:0/3331979416 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa83815d8e0 con 0x7fa838071be0 2023-09-21T00:17:04.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:04.906+0000 7fa826ffd700 1 -- 172.21.15.59:0/3331979416 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa82c059120 con 0x7fa838071be0 2023-09-21T00:17:04.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:04.911+0000 7fa83cb1a700 1 -- 172.21.15.59:0/3331979416 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa81806ae00 msgr2=0x7fa81806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:04.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:04.911+0000 7fa83cb1a700 1 --2- 172.21.15.59:0/3331979416 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa81806ae00 0x7fa81806d2c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa8380ca560 tx=0x7fa828008040 comp rx=0 tx=0).stop 2023-09-21T00:17:04.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:04.911+0000 7fa83cb1a700 1 -- 172.21.15.59:0/3331979416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa838071be0 msgr2=0x7fa8380b4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:04.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:04.911+0000 7fa83cb1a700 1 --2- 172.21.15.59:0/3331979416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa838071be0 0x7fa8380b4800 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa82c000c00 tx=0x7fa82c004750 comp rx=0 tx=0).stop 2023-09-21T00:17:04.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:04.911+0000 7fa83cb1a700 1 -- 172.21.15.59:0/3331979416 shutdown_connections 2023-09-21T00:17:04.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:04.911+0000 7fa83cb1a700 1 --2- 172.21.15.59:0/3331979416 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa81806ae00 0x7fa81806d2c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:04.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:04.911+0000 7fa83cb1a700 1 --2- 172.21.15.59:0/3331979416 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa8380b0c50 0x7fa8380c7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:04.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:04.911+0000 7fa83cb1a700 1 --2- 172.21.15.59:0/3331979416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa838071be0 0x7fa8380b4800 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:04.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:04.911+0000 7fa83cb1a700 1 --2- 172.21.15.59:0/3331979416 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa838151270 0x7fa8380cf820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:04.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:04.911+0000 7fa83cb1a700 1 -- 172.21.15.59:0/3331979416 >> 172.21.15.59:0/3331979416 conn(0x7fa8380ccc00 msgr2=0x7fa83814ee90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:04.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:04.911+0000 7fa83cb1a700 1 -- 172.21.15.59:0/3331979416 shutdown_connections 2023-09-21T00:17:04.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:04.911+0000 7fa83cb1a700 1 -- 172.21.15.59:0/3331979416 wait complete. 2023-09-21T00:17:04.914 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' created 2023-09-21T00:17:04.928 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-09-21T00:17:05.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.067+0000 7f84c56a5700 1 Processor -- start 2023-09-21T00:17:05.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.067+0000 7f84c56a5700 1 -- start start 2023-09-21T00:17:05.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.068+0000 7f84c56a5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f84c006ae90 0x7f84c00cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:05.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.068+0000 7f84c56a5700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f84c00cac80 0x7f84c00b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:05.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.068+0000 7f84c56a5700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84c00b3030 con 0x7f84c015b4f0 2023-09-21T00:17:05.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.068+0000 7f84c56a5700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84c00cb180 con 0x7f84c00cac80 2023-09-21T00:17:05.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.068+0000 7f84c56a5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84c00cb460 con 0x7f84c006ae90 2023-09-21T00:17:05.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.068+0000 7f84bf7fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f84c00cac80 0x7f84c00b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:05.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.068+0000 7f84be7fc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f84c006ae90 0x7f84c00cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:05.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.068+0000 7f84bf7fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f84c00cac80 0x7f84c00b34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.59:37014/0 (socket says 172.21.15.59:37014) 2023-09-21T00:17:05.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.068+0000 7f84bf7fe700 1 -- 172.21.15.59:0/4134330860 learned_addr learned my addr 172.21.15.59:0/4134330860 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:05.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.068+0000 7f84beffd700 1 --1- 172.21.15.59:0/4134330860 >> v1:172.21.15.83:6789/0 conn(0x7f84c015b4f0 0x7f84c006a780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.59:46962/0 (socket says 172.21.15.59:46962) 2023-09-21T00:17:05.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.069+0000 7f84bf7fe700 1 -- 172.21.15.59:0/4134330860 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f84c006ae90 msgr2=0x7f84c00cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:05.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.069+0000 7f84bf7fe700 1 --2- 172.21.15.59:0/4134330860 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f84c006ae90 0x7f84c00cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:05.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.069+0000 7f84bf7fe700 1 -- 172.21.15.59:0/4134330860 >> v1:172.21.15.83:6789/0 conn(0x7f84c015b4f0 legacy=0x7f84c006a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:05.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.069+0000 7f84bf7fe700 1 -- 172.21.15.59:0/4134330860 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c00cb740 con 0x7f84c00cac80 2023-09-21T00:17:05.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.069+0000 7f84bdffb700 1 -- 172.21.15.59:0/4134330860 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 770384790 0 0) 0x7f84c00b3030 con 0x7f84c015b4f0 2023-09-21T00:17:05.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.069+0000 7f84be7fc700 1 --2- 172.21.15.59:0/4134330860 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f84c006ae90 0x7f84c00cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T00:17:05.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.069+0000 7f84bf7fe700 1 --2- 172.21.15.59:0/4134330860 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f84c00cac80 0x7f84c00b34e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f84b8009e50 tx=0x7f84b800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20a7de86d765cb2c server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:05.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.069+0000 7f84bdffb700 1 -- 172.21.15.59:0/4134330860 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b800e070 con 0x7f84c00cac80 2023-09-21T00:17:05.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.069+0000 7f84bdffb700 1 -- 172.21.15.59:0/4134330860 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b800b910 con 0x7f84c00cac80 2023-09-21T00:17:05.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.069+0000 7f84bdffb700 1 -- 172.21.15.59:0/4134330860 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b800bcc0 con 0x7f84c00cac80 2023-09-21T00:17:05.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.069+0000 7f84c56a5700 1 -- 172.21.15.59:0/4134330860 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f84c00cac80 msgr2=0x7f84c00b34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:05.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.069+0000 7f84c56a5700 1 --2- 172.21.15.59:0/4134330860 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f84c00cac80 0x7f84c00b34e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f84b8009e50 tx=0x7f84b800b330 comp rx=0 tx=0).stop 2023-09-21T00:17:05.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.069+0000 7f84c56a5700 1 -- 172.21.15.59:0/4134330860 shutdown_connections 2023-09-21T00:17:05.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.069+0000 7f84c56a5700 1 --2- 172.21.15.59:0/4134330860 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f84c00cac80 0x7f84c00b34e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:05.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.069+0000 7f84c56a5700 1 --2- 172.21.15.59:0/4134330860 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f84c006ae90 0x7f84c00cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:05.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.069+0000 7f84c56a5700 1 -- 172.21.15.59:0/4134330860 >> 172.21.15.59:0/4134330860 conn(0x7f84c00d0140 msgr2=0x7f84c00d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:05.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.069+0000 7f84c56a5700 1 -- 172.21.15.59:0/4134330860 shutdown_connections 2023-09-21T00:17:05.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.069+0000 7f84c56a5700 1 -- 172.21.15.59:0/4134330860 wait complete. 2023-09-21T00:17:05.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.071+0000 7f84c56a5700 1 Processor -- start 2023-09-21T00:17:05.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.071+0000 7f84c56a5700 1 -- start start 2023-09-21T00:17:05.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.072+0000 7f84c56a5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84c006ae90 0x7f84c014a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:05.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.072+0000 7f84c56a5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f84c00cac80 0x7f84c00b4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:05.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.072+0000 7f84c56a5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f84c015b4f0 0x7f84c00b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:05.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.072+0000 7f84c56a5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c014aaa0 con 0x7f84c006ae90 2023-09-21T00:17:05.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.072+0000 7f84c56a5700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c00ca580 con 0x7f84c015b4f0 2023-09-21T00:17:05.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.072+0000 7f84c56a5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84c00ca2a0 con 0x7f84c00cac80 2023-09-21T00:17:05.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.072+0000 7f84beffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84c006ae90 0x7f84c014a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:05.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.072+0000 7f84beffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84c006ae90 0x7f84c014a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50900/0 (socket says 172.21.15.59:50900) 2023-09-21T00:17:05.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.072+0000 7f84be7fc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f84c00cac80 0x7f84c00b4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:05.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.072+0000 7f84beffd700 1 -- 172.21.15.59:0/471394715 learned_addr learned my addr 172.21.15.59:0/471394715 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:05.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.072+0000 7f84bf7fe700 1 --2- 172.21.15.59:0/471394715 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f84c015b4f0 0x7f84c00b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:05.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.073+0000 7f84beffd700 1 -- 172.21.15.59:0/471394715 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f84c00cac80 msgr2=0x7f84c00b4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:05.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.073+0000 7f84beffd700 1 --2- 172.21.15.59:0/471394715 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f84c00cac80 0x7f84c00b4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:05.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.073+0000 7f84beffd700 1 -- 172.21.15.59:0/471394715 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f84c015b4f0 msgr2=0x7f84c00b48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:05.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.073+0000 7f84beffd700 1 --2- 172.21.15.59:0/471394715 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f84c015b4f0 0x7f84c00b48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:05.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.073+0000 7f84beffd700 1 -- 172.21.15.59:0/471394715 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b00094a0 con 0x7f84c006ae90 2023-09-21T00:17:05.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.073+0000 7f84beffd700 1 --2- 172.21.15.59:0/471394715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84c006ae90 0x7f84c014a560 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f84b400c550 tx=0x7f84b400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:05.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.073+0000 7f84a77fe700 1 -- 172.21.15.59:0/471394715 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b4004c80 con 0x7f84c006ae90 2023-09-21T00:17:05.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.073+0000 7f84a77fe700 1 -- 172.21.15.59:0/471394715 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b4004e00 con 0x7f84c006ae90 2023-09-21T00:17:05.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.073+0000 7f84c56a5700 1 -- 172.21.15.59:0/471394715 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84b8009b30 con 0x7f84c006ae90 2023-09-21T00:17:05.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.073+0000 7f84a77fe700 1 -- 172.21.15.59:0/471394715 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b4007310 con 0x7f84c006ae90 2023-09-21T00:17:05.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.073+0000 7f84c56a5700 1 -- 172.21.15.59:0/471394715 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84c00c4530 con 0x7f84c006ae90 2023-09-21T00:17:05.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.074+0000 7f84c56a5700 1 -- 172.21.15.59:0/471394715 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84c0067e50 con 0x7f84c006ae90 2023-09-21T00:17:05.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.074+0000 7f84a77fe700 1 -- 172.21.15.59:0/471394715 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f84b4007470 con 0x7f84c006ae90 2023-09-21T00:17:05.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.075+0000 7f84a77fe700 1 --2- 172.21.15.59:0/471394715 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f84ac06ae00 0x7f84ac06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:05.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.075+0000 7f84a77fe700 1 -- 172.21.15.59:0/471394715 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f84b4088f00 con 0x7f84c006ae90 2023-09-21T00:17:05.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.075+0000 7f84be7fc700 1 --2- 172.21.15.59:0/471394715 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f84ac06ae00 0x7f84ac06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:05.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.076+0000 7f84be7fc700 1 --2- 172.21.15.59:0/471394715 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f84ac06ae00 0x7f84ac06d2c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f84c00c67e0 tx=0x7f84b0009210 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:05.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.080+0000 7f84a77fe700 1 -- 172.21.15.59:0/471394715 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f84b4054200 con 0x7f84c006ae90 2023-09-21T00:17:05.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.282+0000 7f84c56a5700 1 -- 172.21.15.59:0/471394715 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f84c00b2a20 con 0x7f84c006ae90 2023-09-21T00:17:05.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.911+0000 7f84a77fe700 1 -- 172.21.15.59:0/471394715 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) v1 ==== 171+0+0 (secure 0 0 0) 0x7f84b4057820 con 0x7f84c006ae90 2023-09-21T00:17:05.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.917+0000 7f84c56a5700 1 -- 172.21.15.59:0/471394715 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f84ac06ae00 msgr2=0x7f84ac06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:05.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.917+0000 7f84c56a5700 1 --2- 172.21.15.59:0/471394715 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f84ac06ae00 0x7f84ac06d2c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f84c00c67e0 tx=0x7f84b0009210 comp rx=0 tx=0).stop 2023-09-21T00:17:05.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.917+0000 7f84c56a5700 1 -- 172.21.15.59:0/471394715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84c006ae90 msgr2=0x7f84c014a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:05.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.917+0000 7f84c56a5700 1 --2- 172.21.15.59:0/471394715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84c006ae90 0x7f84c014a560 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f84b400c550 tx=0x7f84b400c860 comp rx=0 tx=0).stop 2023-09-21T00:17:05.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.918+0000 7f84c56a5700 1 -- 172.21.15.59:0/471394715 shutdown_connections 2023-09-21T00:17:05.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.918+0000 7f84c56a5700 1 --2- 172.21.15.59:0/471394715 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f84c015b4f0 0x7f84c00b48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:05.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.918+0000 7f84c56a5700 1 --2- 172.21.15.59:0/471394715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84c006ae90 0x7f84c014a560 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:05.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.918+0000 7f84c56a5700 1 --2- 172.21.15.59:0/471394715 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f84ac06ae00 0x7f84ac06d2c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:05.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.918+0000 7f84c56a5700 1 --2- 172.21.15.59:0/471394715 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f84c00cac80 0x7f84c00b4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:05.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.918+0000 7f84c56a5700 1 -- 172.21.15.59:0/471394715 >> 172.21.15.59:0/471394715 conn(0x7f84c00d0140 msgr2=0x7f84c006dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:05.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.921+0000 7f84c56a5700 1 -- 172.21.15.59:0/471394715 shutdown_connections 2023-09-21T00:17:05.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:05.921+0000 7f84c56a5700 1 -- 172.21.15.59:0/471394715 wait complete. 2023-09-21T00:17:05.931 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' created 2023-09-21T00:17:05.946 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-21T00:17:06.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.079+0000 7fbfa8926700 1 Processor -- start 2023-09-21T00:17:06.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.079+0000 7fbfa8926700 1 -- start start 2023-09-21T00:17:06.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.080+0000 7fbfa8926700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbfa415d690 0x7fbfa4070b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:06.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.080+0000 7fbfa8926700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbfa4143ce0 0x7fbfa4161280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:06.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.080+0000 7fbfa8926700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfa4162170 con 0x7fbfa40cedb0 2023-09-21T00:17:06.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.080+0000 7fbfa8926700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfa4161bb0 con 0x7fbfa4143ce0 2023-09-21T00:17:06.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.080+0000 7fbfa8926700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfa4161e90 con 0x7fbfa415d690 2023-09-21T00:17:06.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.080+0000 7fbfa1d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbfa4143ce0 0x7fbfa4161280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:06.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.080+0000 7fbfa2d9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fbfa40cedb0 0x7fbfa40cf190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56480/0 (socket says 172.21.15.59:56480) 2023-09-21T00:17:06.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.080+0000 7fbfa2d9d700 1 -- 172.21.15.59:0/2206609310 learned_addr learned my addr 172.21.15.59:0/2206609310 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:06.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.080+0000 7fbfa1d9b700 1 --2- 172.21.15.59:0/2206609310 >> v2:172.21.15.59:3300/0 conn(0x7fbfa4143ce0 0x7fbfa4161280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50908/0 (socket says 172.21.15.59:50908) 2023-09-21T00:17:06.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.080+0000 7fbfa259c700 1 --2- 172.21.15.59:0/2206609310 >> v2:172.21.15.83:3300/0 conn(0x7fbfa415d690 0x7fbfa4070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:06.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.080+0000 7fbfa1d9b700 1 -- 172.21.15.59:0/2206609310 >> v2:172.21.15.83:3300/0 conn(0x7fbfa415d690 msgr2=0x7fbfa4070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:06.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.080+0000 7fbfa1d9b700 1 --2- 172.21.15.59:0/2206609310 >> v2:172.21.15.83:3300/0 conn(0x7fbfa415d690 0x7fbfa4070b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:06.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.080+0000 7fbfa1d9b700 1 -- 172.21.15.59:0/2206609310 >> v1:172.21.15.59:6789/0 conn(0x7fbfa40cedb0 legacy=0x7fbfa40cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:06.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.080+0000 7fbfa1d9b700 1 -- 172.21.15.59:0/2206609310 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa4070310 con 0x7fbfa4143ce0 2023-09-21T00:17:06.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.080+0000 7fbfa159a700 1 -- 172.21.15.59:0/2206609310 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2757239508 0 0) 0x7fbfa4162170 con 0x7fbfa40cedb0 2023-09-21T00:17:06.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.080+0000 7fbfa259c700 1 --2- 172.21.15.59:0/2206609310 >> v2:172.21.15.83:3300/0 conn(0x7fbfa415d690 0x7fbfa4070b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:17:06.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.081+0000 7fbfa1d9b700 1 --2- 172.21.15.59:0/2206609310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfa4143ce0 0x7fbfa4161280 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4068d30 tx=0x7fbf94009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6e603d732777da8 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:06.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.081+0000 7fbfa159a700 1 -- 172.21.15.59:0/2206609310 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf94011830 con 0x7fbfa4143ce0 2023-09-21T00:17:06.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.081+0000 7fbfa159a700 1 -- 172.21.15.59:0/2206609310 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf94011990 con 0x7fbfa4143ce0 2023-09-21T00:17:06.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.081+0000 7fbfa159a700 1 -- 172.21.15.59:0/2206609310 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf94011d20 con 0x7fbfa4143ce0 2023-09-21T00:17:06.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.081+0000 7fbfa8926700 1 -- 172.21.15.59:0/2206609310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfa4143ce0 msgr2=0x7fbfa4161280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:06.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.081+0000 7fbfa8926700 1 --2- 172.21.15.59:0/2206609310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfa4143ce0 0x7fbfa4161280 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4068d30 tx=0x7fbf94009b20 comp rx=0 tx=0).stop 2023-09-21T00:17:06.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.081+0000 7fbfa8926700 1 -- 172.21.15.59:0/2206609310 shutdown_connections 2023-09-21T00:17:06.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.081+0000 7fbfa8926700 1 --2- 172.21.15.59:0/2206609310 >> v2:172.21.15.83:3300/0 conn(0x7fbfa415d690 0x7fbfa4070b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:06.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.081+0000 7fbfa8926700 1 --2- 172.21.15.59:0/2206609310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfa4143ce0 0x7fbfa4161280 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:06.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.081+0000 7fbfa8926700 1 -- 172.21.15.59:0/2206609310 >> 172.21.15.59:0/2206609310 conn(0x7fbfa40d11e0 msgr2=0x7fbfa40d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:06.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.081+0000 7fbfa8926700 1 -- 172.21.15.59:0/2206609310 shutdown_connections 2023-09-21T00:17:06.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.081+0000 7fbfa8926700 1 -- 172.21.15.59:0/2206609310 wait complete. 2023-09-21T00:17:06.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.083+0000 7fbfa8926700 1 Processor -- start 2023-09-21T00:17:06.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.083+0000 7fbfa8926700 1 -- start start 2023-09-21T00:17:06.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.083+0000 7fbfa8926700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbfa40cedb0 0x7fbfa41f04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:06.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.083+0000 7fbfa8926700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbfa4143ce0 0x7fbfa41f3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:06.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.083+0000 7fbfa8926700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfa415d690 0x7fbfa406c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:06.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.084+0000 7fbfa8926700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa415f5c0 con 0x7fbfa415d690 2023-09-21T00:17:06.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.084+0000 7fbfa8926700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa4141f30 con 0x7fbfa40cedb0 2023-09-21T00:17:06.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.084+0000 7fbfa8926700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa41f3e50 con 0x7fbfa4143ce0 2023-09-21T00:17:06.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.084+0000 7fbfa2d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfa415d690 0x7fbfa406c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:06.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.084+0000 7fbfa2d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfa415d690 0x7fbfa406c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50918/0 (socket says 172.21.15.59:50918) 2023-09-21T00:17:06.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.084+0000 7fbfa2d9d700 1 -- 172.21.15.59:0/2806825823 learned_addr learned my addr 172.21.15.59:0/2806825823 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:06.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.084+0000 7fbfa259c700 1 --2- 172.21.15.59:0/2806825823 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbfa40cedb0 0x7fbfa41f04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:06.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.084+0000 7fbfa1d9b700 1 --2- 172.21.15.59:0/2806825823 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbfa4143ce0 0x7fbfa41f3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:06.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.084+0000 7fbfa2d9d700 1 -- 172.21.15.59:0/2806825823 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbfa4143ce0 msgr2=0x7fbfa41f3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:06.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.084+0000 7fbfa2d9d700 1 --2- 172.21.15.59:0/2806825823 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbfa4143ce0 0x7fbfa41f3910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:06.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.084+0000 7fbfa2d9d700 1 -- 172.21.15.59:0/2806825823 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbfa40cedb0 msgr2=0x7fbfa41f04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:06.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.084+0000 7fbfa2d9d700 1 --2- 172.21.15.59:0/2806825823 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbfa40cedb0 0x7fbfa41f04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:06.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.084+0000 7fbfa2d9d700 1 -- 172.21.15.59:0/2806825823 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf940094a0 con 0x7fbfa415d690 2023-09-21T00:17:06.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.084+0000 7fbfa2d9d700 1 --2- 172.21.15.59:0/2806825823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfa415d690 0x7fbfa406c8e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c00cc70 tx=0x7fbf9c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:06.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.084+0000 7fbf92ffd700 1 -- 172.21.15.59:0/2806825823 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c00ada0 con 0x7fbfa415d690 2023-09-21T00:17:06.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.084+0000 7fbf92ffd700 1 -- 172.21.15.59:0/2806825823 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9c00ce70 con 0x7fbfa415d690 2023-09-21T00:17:06.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.084+0000 7fbfa8926700 1 -- 172.21.15.59:0/2806825823 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfa415dbf0 con 0x7fbfa415d690 2023-09-21T00:17:06.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.084+0000 7fbf92ffd700 1 -- 172.21.15.59:0/2806825823 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c0072f0 con 0x7fbfa415d690 2023-09-21T00:17:06.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.084+0000 7fbfa8926700 1 -- 172.21.15.59:0/2806825823 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfa4141600 con 0x7fbfa415d690 2023-09-21T00:17:06.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.085+0000 7fbfa8926700 1 -- 172.21.15.59:0/2806825823 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfa4067e50 con 0x7fbfa415d690 2023-09-21T00:17:06.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.086+0000 7fbf92ffd700 1 -- 172.21.15.59:0/2806825823 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fbf9c007450 con 0x7fbfa415d690 2023-09-21T00:17:06.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.086+0000 7fbf92ffd700 1 --2- 172.21.15.59:0/2806825823 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fbf8406ae00 0x7fbf8406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:06.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.086+0000 7fbf92ffd700 1 -- 172.21.15.59:0/2806825823 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fbf9c0893b0 con 0x7fbfa415d690 2023-09-21T00:17:06.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.087+0000 7fbfa259c700 1 --2- 172.21.15.59:0/2806825823 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fbf8406ae00 0x7fbf8406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:06.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.087+0000 7fbfa259c700 1 --2- 172.21.15.59:0/2806825823 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fbf8406ae00 0x7fbf8406d2c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbf98006fd0 tx=0x7fbf98008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:06.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.091+0000 7fbf92ffd700 1 -- 172.21.15.59:0/2806825823 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fbf9c054530 con 0x7fbfa415d690 2023-09-21T00:17:06.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.337+0000 7fbfa8926700 1 -- 172.21.15.59:0/2806825823 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fbfa41460e0 con 0x7fbfa415d690 2023-09-21T00:17:06.589 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:17:06.591 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:17:06.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.936+0000 7fbf92ffd700 1 -- 172.21.15.59:0/2806825823 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fbf9c057b50 con 0x7fbfa415d690 2023-09-21T00:17:06.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.941+0000 7fbfa8926700 1 -- 172.21.15.59:0/2806825823 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fbf8406ae00 msgr2=0x7fbf8406d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:06.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.941+0000 7fbfa8926700 1 --2- 172.21.15.59:0/2806825823 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fbf8406ae00 0x7fbf8406d2c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbf98006fd0 tx=0x7fbf98008040 comp rx=0 tx=0).stop 2023-09-21T00:17:06.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.941+0000 7fbfa8926700 1 -- 172.21.15.59:0/2806825823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfa415d690 msgr2=0x7fbfa406c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:06.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.941+0000 7fbfa8926700 1 --2- 172.21.15.59:0/2806825823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfa415d690 0x7fbfa406c8e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c00cc70 tx=0x7fbf9c00a340 comp rx=0 tx=0).stop 2023-09-21T00:17:06.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.942+0000 7fbfa8926700 1 -- 172.21.15.59:0/2806825823 shutdown_connections 2023-09-21T00:17:06.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.942+0000 7fbfa8926700 1 --2- 172.21.15.59:0/2806825823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfa415d690 0x7fbfa406c8e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:06.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.942+0000 7fbfa8926700 1 --2- 172.21.15.59:0/2806825823 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbfa40cedb0 0x7fbfa41f04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:06.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.942+0000 7fbfa8926700 1 --2- 172.21.15.59:0/2806825823 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fbf8406ae00 0x7fbf8406d2c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:06.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.942+0000 7fbfa8926700 1 --2- 172.21.15.59:0/2806825823 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbfa4143ce0 0x7fbfa41f3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:06.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.942+0000 7fbfa8926700 1 -- 172.21.15.59:0/2806825823 >> 172.21.15.59:0/2806825823 conn(0x7fbfa40d11e0 msgr2=0x7fbfa415ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:06.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.943+0000 7fbfa8926700 1 -- 172.21.15.59:0/2806825823 shutdown_connections 2023-09-21T00:17:06.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:06.945+0000 7fbfa8926700 1 -- 172.21.15.59:0/2806825823 wait complete. 2023-09-21T00:17:06.951 INFO:teuthology.orchestra.run.smithi059.stderr:new fs with metadata pool 2 and data pool 3 2023-09-21T00:17:06.966 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-09-21T00:17:06.966 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-09-21T00:17:07.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.099+0000 7fb63702e700 1 Processor -- start 2023-09-21T00:17:07.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.099+0000 7fb63702e700 1 -- start start 2023-09-21T00:17:07.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.100+0000 7fb63702e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb630154b20 0x7fb63015aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:07.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.100+0000 7fb63702e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6300cb150 con 0x7fb6300ce770 2023-09-21T00:17:07.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.100+0000 7fb63702e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb630154f00 con 0x7fb6300cd4c0 2023-09-21T00:17:07.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.100+0000 7fb63702e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6300d06b0 con 0x7fb630154b20 2023-09-21T00:17:07.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.100+0000 7fb634dca700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb630154b20 0x7fb63015aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:07.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.100+0000 7fb6355cb700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb6300ce770 0x7fb6300cb5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56494/0 (socket says 172.21.15.59:56494) 2023-09-21T00:17:07.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.100+0000 7fb634dca700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb630154b20 0x7fb63015aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50922/0 (socket says 172.21.15.59:50922) 2023-09-21T00:17:07.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.100+0000 7fb6355cb700 1 -- 172.21.15.59:0/4166165869 learned_addr learned my addr 172.21.15.59:0/4166165869 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:07.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.100+0000 7fb634dca700 1 -- 172.21.15.59:0/4166165869 >> v1:172.21.15.83:6789/0 conn(0x7fb6300cd4c0 legacy=0x7fb63006ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:07.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.100+0000 7fb634dca700 1 -- 172.21.15.59:0/4166165869 >> v1:172.21.15.59:6789/0 conn(0x7fb6300ce770 legacy=0x7fb6300cb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:07.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.100+0000 7fb634dca700 1 -- 172.21.15.59:0/4166165869 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6300ce4d0 con 0x7fb630154b20 2023-09-21T00:17:07.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.100+0000 7fb62f7fe700 1 -- 172.21.15.59:0/4166165869 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1942262470 0 0) 0x7fb6300cb150 con 0x7fb6300ce770 2023-09-21T00:17:07.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.101+0000 7fb634dca700 1 --2- 172.21.15.59:0/4166165869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb630154b20 0x7fb63015aad0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb624009840 tx=0x7fb624009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac3e481328e54c5c server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:07.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.101+0000 7fb62f7fe700 1 -- 172.21.15.59:0/4166165869 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb624011830 con 0x7fb630154b20 2023-09-21T00:17:07.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.101+0000 7fb62f7fe700 1 -- 172.21.15.59:0/4166165869 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb624011990 con 0x7fb630154b20 2023-09-21T00:17:07.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.101+0000 7fb62f7fe700 1 -- 172.21.15.59:0/4166165869 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb624011d20 con 0x7fb630154b20 2023-09-21T00:17:07.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.101+0000 7fb63702e700 1 -- 172.21.15.59:0/4166165869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb630154b20 msgr2=0x7fb63015aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:07.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.101+0000 7fb63702e700 1 --2- 172.21.15.59:0/4166165869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb630154b20 0x7fb63015aad0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb624009840 tx=0x7fb624009b50 comp rx=0 tx=0).stop 2023-09-21T00:17:07.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.101+0000 7fb63702e700 1 -- 172.21.15.59:0/4166165869 shutdown_connections 2023-09-21T00:17:07.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.101+0000 7fb63702e700 1 --2- 172.21.15.59:0/4166165869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb630154b20 0x7fb63015aad0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:07.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.101+0000 7fb63702e700 1 -- 172.21.15.59:0/4166165869 >> 172.21.15.59:0/4166165869 conn(0x7fb6300cf8f0 msgr2=0x7fb6300cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:07.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.101+0000 7fb63702e700 1 -- 172.21.15.59:0/4166165869 shutdown_connections 2023-09-21T00:17:07.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.101+0000 7fb63702e700 1 -- 172.21.15.59:0/4166165869 wait complete. 2023-09-21T00:17:07.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.102+0000 7fb63702e700 1 Processor -- start 2023-09-21T00:17:07.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.103+0000 7fb63702e700 1 -- start start 2023-09-21T00:17:07.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.103+0000 7fb63702e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb6300cd4c0 0x7fb6300c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:07.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.103+0000 7fb63702e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6300ce770 0x7fb6301536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:07.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.103+0000 7fb63702e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb630154b20 0x7fb6301f6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:07.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.103+0000 7fb63702e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6300c96f0 con 0x7fb6300ce770 2023-09-21T00:17:07.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.103+0000 7fb63702e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6300c8ae0 con 0x7fb630154b20 2023-09-21T00:17:07.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.103+0000 7fb63702e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6300c8dc0 con 0x7fb6300cd4c0 2023-09-21T00:17:07.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.103+0000 7fb62ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6300ce770 0x7fb6301536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:07.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.104+0000 7fb62ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6300ce770 0x7fb6301536c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50930/0 (socket says 172.21.15.59:50930) 2023-09-21T00:17:07.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.104+0000 7fb62ffff700 1 -- 172.21.15.59:0/3643059397 learned_addr learned my addr 172.21.15.59:0/3643059397 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:07.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.104+0000 7fb634dca700 1 --2- 172.21.15.59:0/3643059397 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb6300cd4c0 0x7fb6300c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:07.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.104+0000 7fb6355cb700 1 --2- 172.21.15.59:0/3643059397 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb630154b20 0x7fb6301f6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:07.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.104+0000 7fb62ffff700 1 -- 172.21.15.59:0/3643059397 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb6300cd4c0 msgr2=0x7fb6300c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:07.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.104+0000 7fb62ffff700 1 --2- 172.21.15.59:0/3643059397 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb6300cd4c0 0x7fb6300c8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:07.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.104+0000 7fb62ffff700 1 -- 172.21.15.59:0/3643059397 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb630154b20 msgr2=0x7fb6301f6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:07.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.104+0000 7fb62ffff700 1 --2- 172.21.15.59:0/3643059397 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb630154b20 0x7fb6301f6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:07.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.104+0000 7fb62ffff700 1 -- 172.21.15.59:0/3643059397 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6240094a0 con 0x7fb6300ce770 2023-09-21T00:17:07.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.104+0000 7fb62ffff700 1 --2- 172.21.15.59:0/3643059397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6300ce770 0x7fb6301536c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb61c00c4e0 tx=0x7fb61c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:07.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.104+0000 7fb62d7fa700 1 -- 172.21.15.59:0/3643059397 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61c0052d0 con 0x7fb6300ce770 2023-09-21T00:17:07.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.104+0000 7fb62d7fa700 1 -- 172.21.15.59:0/3643059397 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb61c005430 con 0x7fb6300ce770 2023-09-21T00:17:07.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.104+0000 7fb62d7fa700 1 -- 172.21.15.59:0/3643059397 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61c0038c0 con 0x7fb6300ce770 2023-09-21T00:17:07.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.104+0000 7fb63702e700 1 -- 172.21.15.59:0/3643059397 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6300c90a0 con 0x7fb6300ce770 2023-09-21T00:17:07.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.104+0000 7fb63702e700 1 -- 172.21.15.59:0/3643059397 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb630153c00 con 0x7fb6300ce770 2023-09-21T00:17:07.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.105+0000 7fb63702e700 1 -- 172.21.15.59:0/3643059397 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb630067e50 con 0x7fb6300ce770 2023-09-21T00:17:07.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.106+0000 7fb62d7fa700 1 -- 172.21.15.59:0/3643059397 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fb61c003a20 con 0x7fb6300ce770 2023-09-21T00:17:07.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.106+0000 7fb62d7fa700 1 --2- 172.21.15.59:0/3643059397 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fb61406ae00 0x7fb61406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:07.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.106+0000 7fb62d7fa700 1 -- 172.21.15.59:0/3643059397 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb61c0889a0 con 0x7fb6300ce770 2023-09-21T00:17:07.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.106+0000 7fb634dca700 1 --2- 172.21.15.59:0/3643059397 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fb61406ae00 0x7fb61406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:07.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.107+0000 7fb634dca700 1 --2- 172.21.15.59:0/3643059397 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fb61406ae00 0x7fb61406d2c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb624000c00 tx=0x7fb62401c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:07.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.111+0000 7fb62d7fa700 1 -- 172.21.15.59:0/3643059397 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fb61c053b50 con 0x7fb6300ce770 2023-09-21T00:17:07.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.322+0000 7fb63702e700 1 -- 172.21.15.59:0/3643059397 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fb6300c9830 con 0x7fb6300ce770 2023-09-21T00:17:07.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.928+0000 7fb62d7fa700 1 -- 172.21.15.59:0/3643059397 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) v1 ==== 157+0+0 (secure 0 0 0) 0x7fb61c0170e0 con 0x7fb6300ce770 2023-09-21T00:17:07.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.931+0000 7fb63702e700 1 -- 172.21.15.59:0/3643059397 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fb61406ae00 msgr2=0x7fb61406d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:07.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.931+0000 7fb63702e700 1 --2- 172.21.15.59:0/3643059397 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fb61406ae00 0x7fb61406d2c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb624000c00 tx=0x7fb62401c040 comp rx=0 tx=0).stop 2023-09-21T00:17:07.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.931+0000 7fb63702e700 1 -- 172.21.15.59:0/3643059397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6300ce770 msgr2=0x7fb6301536c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:07.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.931+0000 7fb63702e700 1 --2- 172.21.15.59:0/3643059397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6300ce770 0x7fb6301536c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb61c00c4e0 tx=0x7fb61c00c8a0 comp rx=0 tx=0).stop 2023-09-21T00:17:07.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.931+0000 7fb63702e700 1 -- 172.21.15.59:0/3643059397 shutdown_connections 2023-09-21T00:17:07.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.931+0000 7fb63702e700 1 --2- 172.21.15.59:0/3643059397 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb630154b20 0x7fb6301f6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:07.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.931+0000 7fb63702e700 1 --2- 172.21.15.59:0/3643059397 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fb61406ae00 0x7fb61406d2c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:07.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.931+0000 7fb63702e700 1 --2- 172.21.15.59:0/3643059397 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb6300cd4c0 0x7fb6300c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:07.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.931+0000 7fb63702e700 1 --2- 172.21.15.59:0/3643059397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6300ce770 0x7fb6301536c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:07.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.931+0000 7fb63702e700 1 -- 172.21.15.59:0/3643059397 >> 172.21.15.59:0/3643059397 conn(0x7fb6300cf8f0 msgr2=0x7fb63006ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:07.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.931+0000 7fb63702e700 1 -- 172.21.15.59:0/3643059397 shutdown_connections 2023-09-21T00:17:07.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:07.931+0000 7fb63702e700 1 -- 172.21.15.59:0/3643059397 wait complete. 2023-09-21T00:17:07.947 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-09-21T00:17:08.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.085+0000 7eff2db08700 1 Processor -- start 2023-09-21T00:17:08.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.085+0000 7eff2db08700 1 -- start start 2023-09-21T00:17:08.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.086+0000 7eff2db08700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7eff2815ca90 0x7eff280cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:08.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.086+0000 7eff2db08700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7eff280cd5a0 0x7eff280ce090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:08.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.086+0000 7eff2db08700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff2815ec10 con 0x7eff2815e830 2023-09-21T00:17:08.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.086+0000 7eff2db08700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff280cbed0 con 0x7eff2815ca90 2023-09-21T00:17:08.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.086+0000 7eff2db08700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff28070270 con 0x7eff280cd5a0 2023-09-21T00:17:08.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.086+0000 7eff26ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7eff2815ca90 0x7eff280cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:08.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.086+0000 7eff26ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7eff2815ca90 0x7eff280cdb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50938/0 (socket says 172.21.15.59:50938) 2023-09-21T00:17:08.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.086+0000 7eff26ffd700 1 -- 172.21.15.59:0/3511878280 learned_addr learned my addr 172.21.15.59:0/3511878280 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:08.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.087+0000 7eff27fff700 1 --2- 172.21.15.59:0/3511878280 >> v2:172.21.15.83:3300/0 conn(0x7eff280cd5a0 0x7eff280ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:08.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.087+0000 7eff26ffd700 1 -- 172.21.15.59:0/3511878280 >> v2:172.21.15.83:3300/0 conn(0x7eff280cd5a0 msgr2=0x7eff280ce090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:08.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.087+0000 7eff26ffd700 1 --2- 172.21.15.59:0/3511878280 >> v2:172.21.15.83:3300/0 conn(0x7eff280cd5a0 0x7eff280ce090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:08.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.087+0000 7eff26ffd700 1 -- 172.21.15.59:0/3511878280 >> v1:172.21.15.83:6789/0 conn(0x7eff2815e830 legacy=0x7eff280cb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:08.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.087+0000 7eff26ffd700 1 -- 172.21.15.59:0/3511878280 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff28070550 con 0x7eff2815ca90 2023-09-21T00:17:08.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.087+0000 7eff26ffd700 1 --2- 172.21.15.59:0/3511878280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff2815ca90 0x7eff280cdb50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7eff280ccc90 tx=0x7eff10009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b835a4cfb2dade45 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:08.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.087+0000 7eff267fc700 1 -- 172.21.15.59:0/3511878280 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1000b870 con 0x7eff2815ca90 2023-09-21T00:17:08.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.087+0000 7eff267fc700 1 -- 172.21.15.59:0/3511878280 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1000b9d0 con 0x7eff2815ca90 2023-09-21T00:17:08.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.087+0000 7eff267fc700 1 -- 172.21.15.59:0/3511878280 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1000bd60 con 0x7eff2815ca90 2023-09-21T00:17:08.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.087+0000 7eff2db08700 1 -- 172.21.15.59:0/3511878280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff2815ca90 msgr2=0x7eff280cdb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:08.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.087+0000 7eff2db08700 1 --2- 172.21.15.59:0/3511878280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff2815ca90 0x7eff280cdb50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7eff280ccc90 tx=0x7eff10009bd0 comp rx=0 tx=0).stop 2023-09-21T00:17:08.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.088+0000 7eff2db08700 1 -- 172.21.15.59:0/3511878280 shutdown_connections 2023-09-21T00:17:08.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.088+0000 7eff2db08700 1 --2- 172.21.15.59:0/3511878280 >> v2:172.21.15.83:3300/0 conn(0x7eff280cd5a0 0x7eff280ce090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:08.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.088+0000 7eff2db08700 1 --2- 172.21.15.59:0/3511878280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff2815ca90 0x7eff280cdb50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:08.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.088+0000 7eff2db08700 1 -- 172.21.15.59:0/3511878280 >> 172.21.15.59:0/3511878280 conn(0x7eff280b2ca0 msgr2=0x7eff280b3080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:08.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.088+0000 7eff2db08700 1 -- 172.21.15.59:0/3511878280 shutdown_connections 2023-09-21T00:17:08.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.088+0000 7eff2db08700 1 -- 172.21.15.59:0/3511878280 wait complete. 2023-09-21T00:17:08.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.089+0000 7eff2db08700 1 Processor -- start 2023-09-21T00:17:08.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.089+0000 7eff2db08700 1 -- start start 2023-09-21T00:17:08.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.090+0000 7eff2db08700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff280cd5a0 0x7eff281535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:08.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.090+0000 7eff2db08700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff2815ca90 0x7eff280ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:08.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.090+0000 7eff2db08700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff2815e830 0x7eff28155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:08.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.090+0000 7eff2db08700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff280ca800 con 0x7eff2815ca90 2023-09-21T00:17:08.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.090+0000 7eff2db08700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff280c8ff0 con 0x7eff2815e830 2023-09-21T00:17:08.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.090+0000 7eff2db08700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff280c8cf0 con 0x7eff280cd5a0 2023-09-21T00:17:08.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.090+0000 7eff26ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff2815ca90 0x7eff280ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:08.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.090+0000 7eff26ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff2815ca90 0x7eff280ca2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50944/0 (socket says 172.21.15.59:50944) 2023-09-21T00:17:08.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.090+0000 7eff26ffd700 1 -- 172.21.15.59:0/1361568702 learned_addr learned my addr 172.21.15.59:0/1361568702 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:08.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.090+0000 7eff277fe700 1 --2- 172.21.15.59:0/1361568702 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff280cd5a0 0x7eff281535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:08.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.090+0000 7eff27fff700 1 --2- 172.21.15.59:0/1361568702 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff2815e830 0x7eff28155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:08.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.090+0000 7eff26ffd700 1 -- 172.21.15.59:0/1361568702 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff280cd5a0 msgr2=0x7eff281535c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:08.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.090+0000 7eff26ffd700 1 --2- 172.21.15.59:0/1361568702 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff280cd5a0 0x7eff281535c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:08.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.090+0000 7eff26ffd700 1 -- 172.21.15.59:0/1361568702 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff2815e830 msgr2=0x7eff28155f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:08.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.090+0000 7eff26ffd700 1 --2- 172.21.15.59:0/1361568702 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff2815e830 0x7eff28155f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:08.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.090+0000 7eff26ffd700 1 -- 172.21.15.59:0/1361568702 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff10009550 con 0x7eff2815ca90 2023-09-21T00:17:08.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.090+0000 7eff26ffd700 1 --2- 172.21.15.59:0/1361568702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff2815ca90 0x7eff280ca2c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7eff10013000 tx=0x7eff10004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:08.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.091+0000 7eff1ffff700 1 -- 172.21.15.59:0/1361568702 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff10004250 con 0x7eff2815ca90 2023-09-21T00:17:08.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.091+0000 7eff1ffff700 1 -- 172.21.15.59:0/1361568702 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1001f070 con 0x7eff2815ca90 2023-09-21T00:17:08.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.091+0000 7eff2db08700 1 -- 172.21.15.59:0/1361568702 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff2815aff0 con 0x7eff2815ca90 2023-09-21T00:17:08.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.091+0000 7eff1ffff700 1 -- 172.21.15.59:0/1361568702 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff100045b0 con 0x7eff2815ca90 2023-09-21T00:17:08.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.091+0000 7eff2db08700 1 -- 172.21.15.59:0/1361568702 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff2815b590 con 0x7eff2815ca90 2023-09-21T00:17:08.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.092+0000 7eff2db08700 1 -- 172.21.15.59:0/1361568702 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff2804f330 con 0x7eff2815ca90 2023-09-21T00:17:08.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.092+0000 7eff1ffff700 1 -- 172.21.15.59:0/1361568702 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7eff10021030 con 0x7eff2815ca90 2023-09-21T00:17:08.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.092+0000 7eff1ffff700 1 --2- 172.21.15.59:0/1361568702 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7eff0806ae30 0x7eff0806d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:08.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.093+0000 7eff1ffff700 1 -- 172.21.15.59:0/1361568702 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5935+0+0 (secure 0 0 0) 0x7eff1008a710 con 0x7eff2815ca90 2023-09-21T00:17:08.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.093+0000 7eff277fe700 1 --2- 172.21.15.59:0/1361568702 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7eff0806ae30 0x7eff0806d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:08.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.093+0000 7eff277fe700 1 --2- 172.21.15.59:0/1361568702 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7eff0806ae30 0x7eff0806d2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7eff18007fd0 tx=0x7eff18009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:08.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.097+0000 7eff1ffff700 1 -- 172.21.15.59:0/1361568702 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7eff100557e0 con 0x7eff2815ca90 2023-09-21T00:17:08.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:08.296+0000 7eff2db08700 1 -- 172.21.15.59:0/1361568702 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7eff280c9130 con 0x7eff2815ca90 2023-09-21T00:17:09.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:09.946+0000 7eff1ffff700 1 -- 172.21.15.59:0/1361568702 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) v1 ==== 228+0+0 (secure 0 0 0) 0x7eff10058e00 con 0x7eff2815ca90 2023-09-21T00:17:09.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:09.951+0000 7eff2db08700 1 -- 172.21.15.59:0/1361568702 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7eff0806ae30 msgr2=0x7eff0806d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:09.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:09.951+0000 7eff2db08700 1 --2- 172.21.15.59:0/1361568702 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7eff0806ae30 0x7eff0806d2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7eff18007fd0 tx=0x7eff18009040 comp rx=0 tx=0).stop 2023-09-21T00:17:09.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:09.951+0000 7eff2db08700 1 -- 172.21.15.59:0/1361568702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff2815ca90 msgr2=0x7eff280ca2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:09.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:09.951+0000 7eff2db08700 1 --2- 172.21.15.59:0/1361568702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff2815ca90 0x7eff280ca2c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7eff10013000 tx=0x7eff10004750 comp rx=0 tx=0).stop 2023-09-21T00:17:09.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:09.952+0000 7eff2db08700 1 -- 172.21.15.59:0/1361568702 shutdown_connections 2023-09-21T00:17:09.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:09.952+0000 7eff2db08700 1 --2- 172.21.15.59:0/1361568702 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff2815e830 0x7eff28155f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:09.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:09.952+0000 7eff2db08700 1 --2- 172.21.15.59:0/1361568702 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7eff0806ae30 0x7eff0806d2f0 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7eff18007fd0 tx=0x7eff18009040 comp rx=0 tx=0).stop 2023-09-21T00:17:09.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:09.952+0000 7eff2db08700 1 --2- 172.21.15.59:0/1361568702 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff280cd5a0 0x7eff281535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:09.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:09.952+0000 7eff2db08700 1 --2- 172.21.15.59:0/1361568702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff2815ca90 0x7eff280ca2c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:09.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:09.952+0000 7eff2db08700 1 -- 172.21.15.59:0/1361568702 >> 172.21.15.59:0/1361568702 conn(0x7eff280b2ca0 msgr2=0x7eff280cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:09.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:09.953+0000 7eff2db08700 1 -- 172.21.15.59:0/1361568702 shutdown_connections 2023-09-21T00:17:09.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:09.955+0000 7eff2db08700 1 -- 172.21.15.59:0/1361568702 wait complete. 2023-09-21T00:17:09.960 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data_ec' created 2023-09-21T00:17:09.974 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-09-21T00:17:10.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.108+0000 7f6f0366e700 1 Processor -- start 2023-09-21T00:17:10.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.108+0000 7f6f0366e700 1 -- start start 2023-09-21T00:17:10.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.109+0000 7f6f0366e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6efc151650 0x7f6efc0716a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:10.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.109+0000 7f6f0366e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6efc071be0 0x7f6efc0ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:10.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.109+0000 7f6f0366e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6efc06fb30 con 0x7f6efc151270 2023-09-21T00:17:10.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.109+0000 7f6f0366e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6efc06ffc0 con 0x7f6efc071be0 2023-09-21T00:17:10.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.109+0000 7f6f0366e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6efc071ff0 con 0x7f6efc151650 2023-09-21T00:17:10.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.109+0000 7f6f01c0b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6efc071be0 0x7f6efc0ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:10.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.109+0000 7f6f01c0b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6efc071be0 0x7f6efc0ced60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50954/0 (socket says 172.21.15.59:50954) 2023-09-21T00:17:10.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.109+0000 7f6f01c0b700 1 -- 172.21.15.59:0/1834324263 learned_addr learned my addr 172.21.15.59:0/1834324263 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:10.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.110+0000 7f6f00c09700 1 --2- 172.21.15.59:0/1834324263 >> v2:172.21.15.83:3300/0 conn(0x7f6efc151650 0x7f6efc0716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:10.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.110+0000 7f6f01c0b700 1 -- 172.21.15.59:0/1834324263 >> v2:172.21.15.83:3300/0 conn(0x7f6efc151650 msgr2=0x7f6efc0716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:10.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.110+0000 7f6f01c0b700 1 --2- 172.21.15.59:0/1834324263 >> v2:172.21.15.83:3300/0 conn(0x7f6efc151650 0x7f6efc0716a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:10.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.110+0000 7f6f01c0b700 1 -- 172.21.15.59:0/1834324263 >> v1:172.21.15.83:6789/0 conn(0x7f6efc151270 legacy=0x7f6efc15b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:10.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.110+0000 7f6f01c0b700 1 -- 172.21.15.59:0/1834324263 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6efc06ef20 con 0x7f6efc071be0 2023-09-21T00:17:10.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.110+0000 7f6f00c09700 1 --2- 172.21.15.59:0/1834324263 >> v2:172.21.15.83:3300/0 conn(0x7f6efc151650 0x7f6efc0716a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:17:10.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.110+0000 7f6f01c0b700 1 --2- 172.21.15.59:0/1834324263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6efc071be0 0x7f6efc0ced60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6efc0b2d30 tx=0x7f6ef400d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b921db59570aff76 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:10.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.110+0000 7f6ef3fff700 1 -- 172.21.15.59:0/1834324263 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef4010070 con 0x7f6efc071be0 2023-09-21T00:17:10.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.110+0000 7f6ef3fff700 1 -- 172.21.15.59:0/1834324263 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef400dd50 con 0x7f6efc071be0 2023-09-21T00:17:10.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.110+0000 7f6ef3fff700 1 -- 172.21.15.59:0/1834324263 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef400b310 con 0x7f6efc071be0 2023-09-21T00:17:10.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.110+0000 7f6f0366e700 1 -- 172.21.15.59:0/1834324263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6efc071be0 msgr2=0x7f6efc0ced60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:10.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.111+0000 7f6f0366e700 1 --2- 172.21.15.59:0/1834324263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6efc071be0 0x7f6efc0ced60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6efc0b2d30 tx=0x7f6ef400d430 comp rx=0 tx=0).stop 2023-09-21T00:17:10.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.111+0000 7f6f0366e700 1 -- 172.21.15.59:0/1834324263 shutdown_connections 2023-09-21T00:17:10.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.111+0000 7f6f0366e700 1 --2- 172.21.15.59:0/1834324263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6efc071be0 0x7f6efc0ced60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:10.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.111+0000 7f6f0366e700 1 --2- 172.21.15.59:0/1834324263 >> v2:172.21.15.83:3300/0 conn(0x7f6efc151650 0x7f6efc0716a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:10.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.111+0000 7f6f0366e700 1 -- 172.21.15.59:0/1834324263 >> 172.21.15.59:0/1834324263 conn(0x7f6efc0ccc00 msgr2=0x7f6efc0cd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:10.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.111+0000 7f6f0366e700 1 -- 172.21.15.59:0/1834324263 shutdown_connections 2023-09-21T00:17:10.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.111+0000 7f6f0366e700 1 -- 172.21.15.59:0/1834324263 wait complete. 2023-09-21T00:17:10.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.112+0000 7f6f0366e700 1 Processor -- start 2023-09-21T00:17:10.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.112+0000 7f6f0366e700 1 -- start start 2023-09-21T00:17:10.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.113+0000 7f6f0366e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6efc071be0 0x7f6efc0c7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:10.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.113+0000 7f6f0366e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6efc151270 0x7f6efc0c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:10.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.113+0000 7f6f0366e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6efc1f3dd0 0x7f6efc0c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:10.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.113+0000 7f6f0366e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6efc0c94e0 con 0x7f6efc1f3dd0 2023-09-21T00:17:10.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.113+0000 7f6f0366e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6efc0b2f10 con 0x7f6efc151270 2023-09-21T00:17:10.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.113+0000 7f6f0366e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6efc0c81f0 con 0x7f6efc071be0 2023-09-21T00:17:10.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.113+0000 7f6f01c0b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6efc1f3dd0 0x7f6efc0c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:10.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.113+0000 7f6f01c0b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6efc1f3dd0 0x7f6efc0c5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50960/0 (socket says 172.21.15.59:50960) 2023-09-21T00:17:10.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.113+0000 7f6f01c0b700 1 -- 172.21.15.59:0/473842126 learned_addr learned my addr 172.21.15.59:0/473842126 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:10.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.113+0000 7f6f00c09700 1 --2- 172.21.15.59:0/473842126 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6efc151270 0x7f6efc0c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:10.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.113+0000 7f6f0140a700 1 --2- 172.21.15.59:0/473842126 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6efc071be0 0x7f6efc0c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:10.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.113+0000 7f6f01c0b700 1 -- 172.21.15.59:0/473842126 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6efc071be0 msgr2=0x7f6efc0c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:10.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.113+0000 7f6f01c0b700 1 --2- 172.21.15.59:0/473842126 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6efc071be0 0x7f6efc0c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:10.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.113+0000 7f6f01c0b700 1 -- 172.21.15.59:0/473842126 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6efc151270 msgr2=0x7f6efc0c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:10.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.113+0000 7f6f01c0b700 1 --2- 172.21.15.59:0/473842126 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6efc151270 0x7f6efc0c8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:10.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.113+0000 7f6f01c0b700 1 -- 172.21.15.59:0/473842126 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef400bd40 con 0x7f6efc1f3dd0 2023-09-21T00:17:10.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.113+0000 7f6f01c0b700 1 --2- 172.21.15.59:0/473842126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6efc1f3dd0 0x7f6efc0c5e80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6efc067480 tx=0x7f6ef4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:10.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.113+0000 7f6ef1ffb700 1 -- 172.21.15.59:0/473842126 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef4009800 con 0x7f6efc1f3dd0 2023-09-21T00:17:10.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.113+0000 7f6ef1ffb700 1 -- 172.21.15.59:0/473842126 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef4009980 con 0x7f6efc1f3dd0 2023-09-21T00:17:10.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.113+0000 7f6f0366e700 1 -- 172.21.15.59:0/473842126 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6efc0c7950 con 0x7f6efc1f3dd0 2023-09-21T00:17:10.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.113+0000 7f6ef1ffb700 1 -- 172.21.15.59:0/473842126 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef4009d30 con 0x7f6efc1f3dd0 2023-09-21T00:17:10.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.114+0000 7f6f0366e700 1 -- 172.21.15.59:0/473842126 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6efc0c7f10 con 0x7f6efc1f3dd0 2023-09-21T00:17:10.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.115+0000 7f6f0366e700 1 -- 172.21.15.59:0/473842126 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6efc0b2d60 con 0x7f6efc1f3dd0 2023-09-21T00:17:10.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.115+0000 7f6ef1ffb700 1 -- 172.21.15.59:0/473842126 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f6ef401b070 con 0x7f6efc1f3dd0 2023-09-21T00:17:10.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.115+0000 7f6ef1ffb700 1 --2- 172.21.15.59:0/473842126 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f6ee006ae00 0x7f6ee006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:10.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.116+0000 7f6ef1ffb700 1 -- 172.21.15.59:0/473842126 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f6ef408ab80 con 0x7f6efc1f3dd0 2023-09-21T00:17:10.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.116+0000 7f6f0140a700 1 --2- 172.21.15.59:0/473842126 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f6ee006ae00 0x7f6ee006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:10.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.116+0000 7f6f0140a700 1 --2- 172.21.15.59:0/473842126 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f6ee006ae00 0x7f6ee006d2c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6eec007fd0 tx=0x7f6eec007ec0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:10.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.120+0000 7f6ef1ffb700 1 -- 172.21.15.59:0/473842126 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f6ef4055a60 con 0x7f6efc1f3dd0 2023-09-21T00:17:10.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.320+0000 7f6f0366e700 1 -- 172.21.15.59:0/473842126 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f6efc0c4ca0 con 0x7f6efc1f3dd0 2023-09-21T00:17:10.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.954+0000 7f6ef1ffb700 1 -- 172.21.15.59:0/473842126 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7f6ef40190c0 con 0x7f6efc1f3dd0 2023-09-21T00:17:10.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.965+0000 7f6f0366e700 1 -- 172.21.15.59:0/473842126 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f6ee006ae00 msgr2=0x7f6ee006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:10.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.965+0000 7f6f0366e700 1 --2- 172.21.15.59:0/473842126 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f6ee006ae00 0x7f6ee006d2c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6eec007fd0 tx=0x7f6eec007ec0 comp rx=0 tx=0).stop 2023-09-21T00:17:10.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.965+0000 7f6f0366e700 1 -- 172.21.15.59:0/473842126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6efc1f3dd0 msgr2=0x7f6efc0c5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:10.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.965+0000 7f6f0366e700 1 --2- 172.21.15.59:0/473842126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6efc1f3dd0 0x7f6efc0c5e80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6efc067480 tx=0x7f6ef4004ad0 comp rx=0 tx=0).stop 2023-09-21T00:17:10.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.971+0000 7f6f0366e700 1 -- 172.21.15.59:0/473842126 shutdown_connections 2023-09-21T00:17:10.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.971+0000 7f6f0366e700 1 --2- 172.21.15.59:0/473842126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6efc1f3dd0 0x7f6efc0c5e80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:10.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.971+0000 7f6f0366e700 1 --2- 172.21.15.59:0/473842126 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f6ee006ae00 0x7f6ee006d2c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:10.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.971+0000 7f6f0366e700 1 --2- 172.21.15.59:0/473842126 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6efc071be0 0x7f6efc0c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:10.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.971+0000 7f6f0366e700 1 --2- 172.21.15.59:0/473842126 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6efc151270 0x7f6efc0c8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:10.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.971+0000 7f6f0366e700 1 -- 172.21.15.59:0/473842126 >> 172.21.15.59:0/473842126 conn(0x7f6efc0ccc00 msgr2=0x7f6efc15e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:10.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.971+0000 7f6f0366e700 1 -- 172.21.15.59:0/473842126 shutdown_connections 2023-09-21T00:17:10.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:10.971+0000 7f6f0366e700 1 -- 172.21.15.59:0/473842126 wait complete. 2023-09-21T00:17:10.976 INFO:teuthology.orchestra.run.smithi059.stderr:set pool 4 allow_ec_overwrites to true 2023-09-21T00:17:10.991 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-09-21T00:17:11.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.123+0000 7f15ad59d700 1 Processor -- start 2023-09-21T00:17:11.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.123+0000 7f15ad59d700 1 -- start start 2023-09-21T00:17:11.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.124+0000 7f15ad59d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f15a815edf0 0x7f15a80cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:11.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.124+0000 7f15ad59d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15a815f1d0 con 0x7f15a80cbc30 2023-09-21T00:17:11.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.124+0000 7f15ad59d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15a80d0170 con 0x7f15a80cf590 2023-09-21T00:17:11.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.124+0000 7f15ad59d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15a80cc0e0 con 0x7f15a815edf0 2023-09-21T00:17:11.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.124+0000 7f15a6ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f15a815edf0 0x7f15a80cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:11.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.124+0000 7f15a67fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f15a80cbc30 0x7f15a80cee80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56532/0 (socket says 172.21.15.59:56532) 2023-09-21T00:17:11.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.124+0000 7f15a67fc700 1 -- 172.21.15.59:0/146733724 learned_addr learned my addr 172.21.15.59:0/146733724 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:11.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.124+0000 7f15a6ffd700 1 -- 172.21.15.59:0/146733724 >> v1:172.21.15.83:6789/0 conn(0x7f15a80cf590 legacy=0x7f15a80c5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:11.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.124+0000 7f15a6ffd700 1 -- 172.21.15.59:0/146733724 >> v1:172.21.15.59:6789/0 conn(0x7f15a80cbc30 legacy=0x7f15a80cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:11.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.124+0000 7f15a6ffd700 1 -- 172.21.15.59:0/146733724 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a80cfbb0 con 0x7f15a815edf0 2023-09-21T00:17:11.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.124+0000 7f15a5ffb700 1 -- 172.21.15.59:0/146733724 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 436660444 0 0) 0x7f159c001110 con 0x7f15a80cbc30 2023-09-21T00:17:11.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.124+0000 7f15a6ffd700 1 --2- 172.21.15.59:0/146733724 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15a815edf0 0x7f15a80cb6f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1598009840 tx=0x7f1598009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=960a29d4925a3a5f server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:11.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.124+0000 7f15a5ffb700 1 -- 172.21.15.59:0/146733724 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1598011830 con 0x7f15a815edf0 2023-09-21T00:17:11.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.124+0000 7f15a5ffb700 1 -- 172.21.15.59:0/146733724 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1598011990 con 0x7f15a815edf0 2023-09-21T00:17:11.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.124+0000 7f15a5ffb700 1 -- 172.21.15.59:0/146733724 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1598011d20 con 0x7f15a815edf0 2023-09-21T00:17:11.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.125+0000 7f15ad59d700 1 -- 172.21.15.59:0/146733724 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15a815edf0 msgr2=0x7f15a80cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:11.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.125+0000 7f15ad59d700 1 --2- 172.21.15.59:0/146733724 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15a815edf0 0x7f15a80cb6f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1598009840 tx=0x7f1598009b50 comp rx=0 tx=0).stop 2023-09-21T00:17:11.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.125+0000 7f15ad59d700 1 -- 172.21.15.59:0/146733724 shutdown_connections 2023-09-21T00:17:11.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.125+0000 7f15ad59d700 1 --2- 172.21.15.59:0/146733724 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15a815edf0 0x7f15a80cb6f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:11.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.125+0000 7f15ad59d700 1 -- 172.21.15.59:0/146733724 >> 172.21.15.59:0/146733724 conn(0x7f15a80d1130 msgr2=0x7f15a80d1510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:11.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.125+0000 7f15ad59d700 1 -- 172.21.15.59:0/146733724 shutdown_connections 2023-09-21T00:17:11.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.125+0000 7f15ad59d700 1 -- 172.21.15.59:0/146733724 wait complete. 2023-09-21T00:17:11.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.126+0000 7f15ad59d700 1 Processor -- start 2023-09-21T00:17:11.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.126+0000 7f15ad59d700 1 -- start start 2023-09-21T00:17:11.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.127+0000 7f15ad59d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15a80cbc30 0x7f15a814da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:11.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.127+0000 7f15ad59d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f15a80cf590 0x7f15a8151d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:11.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.127+0000 7f15ad59d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f15a815edf0 0x7f15a81522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:11.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.127+0000 7f15ad59d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a8150b90 con 0x7f15a80cbc30 2023-09-21T00:17:11.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.127+0000 7f15ad59d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a8150d80 con 0x7f15a80cf590 2023-09-21T00:17:11.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.127+0000 7f15ad59d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a8151060 con 0x7f15a815edf0 2023-09-21T00:17:11.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.127+0000 7f15a6ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15a80cbc30 0x7f15a814da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:11.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.127+0000 7f15a6ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15a80cbc30 0x7f15a814da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50970/0 (socket says 172.21.15.59:50970) 2023-09-21T00:17:11.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.127+0000 7f15a6ffd700 1 -- 172.21.15.59:0/2671134352 learned_addr learned my addr 172.21.15.59:0/2671134352 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:11.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.127+0000 7f15a67fc700 1 --2- 172.21.15.59:0/2671134352 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f15a80cf590 0x7f15a8151d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:11.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.127+0000 7f15a77fe700 1 --2- 172.21.15.59:0/2671134352 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f15a815edf0 0x7f15a81522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:11.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.127+0000 7f15a6ffd700 1 -- 172.21.15.59:0/2671134352 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f15a815edf0 msgr2=0x7f15a81522c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:11.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.127+0000 7f15a6ffd700 1 --2- 172.21.15.59:0/2671134352 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f15a815edf0 0x7f15a81522c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:11.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.127+0000 7f15a6ffd700 1 -- 172.21.15.59:0/2671134352 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f15a80cf590 msgr2=0x7f15a8151d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:11.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.127+0000 7f15a6ffd700 1 --2- 172.21.15.59:0/2671134352 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f15a80cf590 0x7f15a8151d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:11.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.127+0000 7f15a6ffd700 1 -- 172.21.15.59:0/2671134352 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15980094a0 con 0x7f15a80cbc30 2023-09-21T00:17:11.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.128+0000 7f15a6ffd700 1 --2- 172.21.15.59:0/2671134352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15a80cbc30 0x7f15a814da70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f15980090b0 tx=0x7f1598004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:11.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.128+0000 7f158f7fe700 1 -- 172.21.15.59:0/2671134352 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15980036a0 con 0x7f15a80cbc30 2023-09-21T00:17:11.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.128+0000 7f158f7fe700 1 -- 172.21.15.59:0/2671134352 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159801f070 con 0x7f15a80cbc30 2023-09-21T00:17:11.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.128+0000 7f15ad59d700 1 -- 172.21.15.59:0/2671134352 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15a8151340 con 0x7f15a80cbc30 2023-09-21T00:17:11.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.128+0000 7f158f7fe700 1 -- 172.21.15.59:0/2671134352 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1598003a00 con 0x7f15a80cbc30 2023-09-21T00:17:11.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.128+0000 7f15ad59d700 1 -- 172.21.15.59:0/2671134352 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15a8151900 con 0x7f15a80cbc30 2023-09-21T00:17:11.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.129+0000 7f15ad59d700 1 -- 172.21.15.59:0/2671134352 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15a80d0f30 con 0x7f15a80cbc30 2023-09-21T00:17:11.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.129+0000 7f158f7fe700 1 -- 172.21.15.59:0/2671134352 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f1598003b60 con 0x7f15a80cbc30 2023-09-21T00:17:11.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.130+0000 7f158f7fe700 1 --2- 172.21.15.59:0/2671134352 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f159406ae00 0x7f159406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:11.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.130+0000 7f158f7fe700 1 -- 172.21.15.59:0/2671134352 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f1598021070 con 0x7f15a80cbc30 2023-09-21T00:17:11.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.130+0000 7f15a67fc700 1 --2- 172.21.15.59:0/2671134352 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f159406ae00 0x7f159406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:11.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.130+0000 7f15a67fc700 1 --2- 172.21.15.59:0/2671134352 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f159406ae00 0x7f159406d2c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f159c000f60 tx=0x7f159c007db0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:11.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.134+0000 7f158f7fe700 1 -- 172.21.15.59:0/2671134352 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f1598056190 con 0x7f15a80cbc30 2023-09-21T00:17:11.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.386+0000 7f15ad59d700 1 -- 172.21.15.59:0/2671134352 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f15a8067e50 con 0x7f15a80cbc30 2023-09-21T00:17:11.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.954+0000 7f158f7fe700 1 -- 172.21.15.59:0/2671134352 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v6) v1 ==== 137+0+0 (secure 0 0 0) 0x7f15980597b0 con 0x7f15a80cbc30 2023-09-21T00:17:11.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.959+0000 7f15ad59d700 1 -- 172.21.15.59:0/2671134352 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f159406ae00 msgr2=0x7f159406d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:11.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.959+0000 7f15ad59d700 1 --2- 172.21.15.59:0/2671134352 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f159406ae00 0x7f159406d2c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f159c000f60 tx=0x7f159c007db0 comp rx=0 tx=0).stop 2023-09-21T00:17:11.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.959+0000 7f15ad59d700 1 -- 172.21.15.59:0/2671134352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15a80cbc30 msgr2=0x7f15a814da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:11.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.959+0000 7f15ad59d700 1 --2- 172.21.15.59:0/2671134352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15a80cbc30 0x7f15a814da70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f15980090b0 tx=0x7f1598004750 comp rx=0 tx=0).stop 2023-09-21T00:17:11.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.959+0000 7f15ad59d700 1 -- 172.21.15.59:0/2671134352 shutdown_connections 2023-09-21T00:17:11.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.959+0000 7f15ad59d700 1 --2- 172.21.15.59:0/2671134352 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f159406ae00 0x7f159406d2c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:11.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.959+0000 7f15ad59d700 1 --2- 172.21.15.59:0/2671134352 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f15a815edf0 0x7f15a81522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:11.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.959+0000 7f15ad59d700 1 --2- 172.21.15.59:0/2671134352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15a80cbc30 0x7f15a814da70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:11.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.959+0000 7f15ad59d700 1 --2- 172.21.15.59:0/2671134352 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f15a80cf590 0x7f15a8151d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:11.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.959+0000 7f15ad59d700 1 -- 172.21.15.59:0/2671134352 >> 172.21.15.59:0/2671134352 conn(0x7f15a80d1130 msgr2=0x7f15a815de80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:11.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.959+0000 7f15ad59d700 1 -- 172.21.15.59:0/2671134352 shutdown_connections 2023-09-21T00:17:11.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:11.959+0000 7f15ad59d700 1 -- 172.21.15.59:0/2671134352 wait complete. 2023-09-21T00:17:11.962 INFO:teuthology.orchestra.run.smithi059.stderr:added data pool 4 to fsmap 2023-09-21T00:17:11.975 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T00:17:12.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.106+0000 7fe667048700 1 Processor -- start 2023-09-21T00:17:12.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.106+0000 7fe667048700 1 -- start start 2023-09-21T00:17:12.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.107+0000 7fe667048700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe66015b2b0 0x7fe6600cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:12.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.107+0000 7fe667048700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe6600ce420 0x7fe660161190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:12.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.107+0000 7fe667048700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe66006a780 0x7fe66006abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:12.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.107+0000 7fe667048700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6600ce250 con 0x7fe6600ce420 2023-09-21T00:17:12.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.107+0000 7fe667048700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe66006b110 con 0x7fe66006a780 2023-09-21T00:17:12.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.107+0000 7fe667048700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6600cfee0 con 0x7fe66015b2b0 2023-09-21T00:17:12.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.107+0000 7fe65ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe6600ce420 0x7fe660161190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:12.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.107+0000 7fe65ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe6600ce420 0x7fe660161190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50980/0 (socket says 172.21.15.59:50980) 2023-09-21T00:17:12.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.107+0000 7fe65ffff700 1 -- 172.21.15.59:0/2862430271 learned_addr learned my addr 172.21.15.59:0/2862430271 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:12.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.107+0000 7fe664de4700 1 --2- 172.21.15.59:0/2862430271 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe66015b2b0 0x7fe6600cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:12.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.107+0000 7fe6655e5700 1 --2- 172.21.15.59:0/2862430271 >> v2:172.21.15.83:3300/0 conn(0x7fe66006a780 0x7fe66006abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:12.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.107+0000 7fe65ffff700 1 -- 172.21.15.59:0/2862430271 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe66015b2b0 msgr2=0x7fe6600cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:12.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.107+0000 7fe65ffff700 1 --2- 172.21.15.59:0/2862430271 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe66015b2b0 0x7fe6600cdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:12.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.107+0000 7fe65ffff700 1 -- 172.21.15.59:0/2862430271 >> v2:172.21.15.83:3300/0 conn(0x7fe66006a780 msgr2=0x7fe66006abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:12.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.107+0000 7fe65ffff700 1 --2- 172.21.15.59:0/2862430271 >> v2:172.21.15.83:3300/0 conn(0x7fe66006a780 0x7fe66006abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:12.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.107+0000 7fe65ffff700 1 -- 172.21.15.59:0/2862430271 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6600ce900 con 0x7fe6600ce420 2023-09-21T00:17:12.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.107+0000 7fe65ffff700 1 --2- 172.21.15.59:0/2862430271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6600ce420 0x7fe660161190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe660072bd0 tx=0x7fe64c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34717677b86c5fc8 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:12.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.107+0000 7fe65f7fe700 1 -- 172.21.15.59:0/2862430271 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64c011830 con 0x7fe6600ce420 2023-09-21T00:17:12.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.107+0000 7fe65f7fe700 1 -- 172.21.15.59:0/2862430271 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe64c011990 con 0x7fe6600ce420 2023-09-21T00:17:12.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.107+0000 7fe65f7fe700 1 -- 172.21.15.59:0/2862430271 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64c011d20 con 0x7fe6600ce420 2023-09-21T00:17:12.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.108+0000 7fe667048700 1 -- 172.21.15.59:0/2862430271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6600ce420 msgr2=0x7fe660161190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:12.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.108+0000 7fe667048700 1 --2- 172.21.15.59:0/2862430271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6600ce420 0x7fe660161190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe660072bd0 tx=0x7fe64c009bd0 comp rx=0 tx=0).stop 2023-09-21T00:17:12.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.108+0000 7fe667048700 1 -- 172.21.15.59:0/2862430271 shutdown_connections 2023-09-21T00:17:12.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.108+0000 7fe667048700 1 --2- 172.21.15.59:0/2862430271 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe66015b2b0 0x7fe6600cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:12.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.108+0000 7fe667048700 1 --2- 172.21.15.59:0/2862430271 >> v2:172.21.15.83:3300/0 conn(0x7fe66006a780 0x7fe66006abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:12.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.108+0000 7fe667048700 1 --2- 172.21.15.59:0/2862430271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6600ce420 0x7fe660161190 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:12.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.108+0000 7fe667048700 1 -- 172.21.15.59:0/2862430271 >> 172.21.15.59:0/2862430271 conn(0x7fe6600d0140 msgr2=0x7fe6600d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:12.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.108+0000 7fe667048700 1 -- 172.21.15.59:0/2862430271 shutdown_connections 2023-09-21T00:17:12.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.108+0000 7fe667048700 1 -- 172.21.15.59:0/2862430271 wait complete. 2023-09-21T00:17:12.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.109+0000 7fe667048700 1 Processor -- start 2023-09-21T00:17:12.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.109+0000 7fe667048700 1 -- start start 2023-09-21T00:17:12.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.110+0000 7fe667048700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe66006a780 0x7fe6600c9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:12.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.110+0000 7fe667048700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6600ce420 0x7fe6600c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:12.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.110+0000 7fe667048700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe66015b2b0 0x7fe660157fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:12.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.110+0000 7fe667048700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe660153ec0 con 0x7fe66015b2b0 2023-09-21T00:17:12.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.110+0000 7fe667048700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6601588e0 con 0x7fe6600ce420 2023-09-21T00:17:12.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.110+0000 7fe667048700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe66015bb10 con 0x7fe66006a780 2023-09-21T00:17:12.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.110+0000 7fe6655e5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe66015b2b0 0x7fe660157fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:12.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.110+0000 7fe6655e5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe66015b2b0 0x7fe660157fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50988/0 (socket says 172.21.15.59:50988) 2023-09-21T00:17:12.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.110+0000 7fe6655e5700 1 -- 172.21.15.59:0/2485390184 learned_addr learned my addr 172.21.15.59:0/2485390184 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:12.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.111+0000 7fe65ffff700 1 --2- 172.21.15.59:0/2485390184 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6600ce420 0x7fe6600c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:12.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.111+0000 7fe664de4700 1 --2- 172.21.15.59:0/2485390184 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe66006a780 0x7fe6600c9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:12.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.111+0000 7fe6655e5700 1 -- 172.21.15.59:0/2485390184 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe66006a780 msgr2=0x7fe6600c9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:12.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.111+0000 7fe6655e5700 1 --2- 172.21.15.59:0/2485390184 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe66006a780 0x7fe6600c9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:12.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.111+0000 7fe6655e5700 1 -- 172.21.15.59:0/2485390184 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6600ce420 msgr2=0x7fe6600c80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:12.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.111+0000 7fe6655e5700 1 --2- 172.21.15.59:0/2485390184 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6600ce420 0x7fe6600c80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:12.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.111+0000 7fe6655e5700 1 -- 172.21.15.59:0/2485390184 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe64c009550 con 0x7fe66015b2b0 2023-09-21T00:17:12.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.111+0000 7fe6655e5700 1 --2- 172.21.15.59:0/2485390184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe66015b2b0 0x7fe660157fe0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe65800eed0 tx=0x7fe65800ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:12.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.111+0000 7fe65d7fa700 1 -- 172.21.15.59:0/2485390184 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe658010040 con 0x7fe66015b2b0 2023-09-21T00:17:12.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.111+0000 7fe65d7fa700 1 -- 172.21.15.59:0/2485390184 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65800b9f0 con 0x7fe66015b2b0 2023-09-21T00:17:12.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.111+0000 7fe667048700 1 -- 172.21.15.59:0/2485390184 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe66015bdf0 con 0x7fe66015b2b0 2023-09-21T00:17:12.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.111+0000 7fe65d7fa700 1 -- 172.21.15.59:0/2485390184 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65800bda0 con 0x7fe66015b2b0 2023-09-21T00:17:12.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.111+0000 7fe667048700 1 -- 172.21.15.59:0/2485390184 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe66015c3b0 con 0x7fe66015b2b0 2023-09-21T00:17:12.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.112+0000 7fe667048700 1 -- 172.21.15.59:0/2485390184 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe660067e50 con 0x7fe66015b2b0 2023-09-21T00:17:12.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.113+0000 7fe65d7fa700 1 -- 172.21.15.59:0/2485390184 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fe658014400 con 0x7fe66015b2b0 2023-09-21T00:17:12.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.113+0000 7fe65d7fa700 1 --2- 172.21.15.59:0/2485390184 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fe64406ae00 0x7fe64406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:12.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.113+0000 7fe65d7fa700 1 -- 172.21.15.59:0/2485390184 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe658089b30 con 0x7fe66015b2b0 2023-09-21T00:17:12.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.113+0000 7fe664de4700 1 --2- 172.21.15.59:0/2485390184 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fe64406ae00 0x7fe64406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:12.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.114+0000 7fe664de4700 1 --2- 172.21.15.59:0/2485390184 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fe64406ae00 0x7fe64406d2c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe654009be0 tx=0x7fe654009210 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:12.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.118+0000 7fe65d7fa700 1 -- 172.21.15.59:0/2485390184 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fe658054960 con 0x7fe66015b2b0 2023-09-21T00:17:12.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.365+0000 7fe667048700 1 -- 172.21.15.59:0/2485390184 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe660070040 con 0x7fe66015b2b0 2023-09-21T00:17:12.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.365+0000 7fe65d7fa700 1 -- 172.21.15.59:0/2485390184 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4903 (secure 0 0 0) 0x7fe658018090 con 0x7fe66015b2b0 2023-09-21T00:17:12.367 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:17:12.367 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/461673980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":461673980},{"type":"v1","addr":"172.21.15.59:6835","nonce":461673980}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/3148728526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3148728526},{"type":"v1","addr":"172.21.15.59:6834","nonce":3148728526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/3250481509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3250481509},{"type":"v1","addr":"172.21.15.83:6836","nonce":3250481509}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-21T00:17:06.338694+0000","modified":"2023-09-21T00:17:11.387692+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6837/792952552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":792952552},{"type":"v1","addr":"172.21.15.83:6837","nonce":792952552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-09-21T00:17:12.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.367+0000 7fe667048700 1 -- 172.21.15.59:0/2485390184 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fe64406ae00 msgr2=0x7fe64406d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:12.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.367+0000 7fe667048700 1 --2- 172.21.15.59:0/2485390184 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fe64406ae00 0x7fe64406d2c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe654009be0 tx=0x7fe654009210 comp rx=0 tx=0).stop 2023-09-21T00:17:12.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.367+0000 7fe667048700 1 -- 172.21.15.59:0/2485390184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe66015b2b0 msgr2=0x7fe660157fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:12.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.367+0000 7fe667048700 1 --2- 172.21.15.59:0/2485390184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe66015b2b0 0x7fe660157fe0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe65800eed0 tx=0x7fe65800ef00 comp rx=0 tx=0).stop 2023-09-21T00:17:12.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.367+0000 7fe667048700 1 -- 172.21.15.59:0/2485390184 shutdown_connections 2023-09-21T00:17:12.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.367+0000 7fe667048700 1 --2- 172.21.15.59:0/2485390184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe66015b2b0 0x7fe660157fe0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:12.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.367+0000 7fe667048700 1 --2- 172.21.15.59:0/2485390184 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fe64406ae00 0x7fe64406d2c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:12.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.367+0000 7fe667048700 1 --2- 172.21.15.59:0/2485390184 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe66006a780 0x7fe6600c9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:12.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.367+0000 7fe667048700 1 --2- 172.21.15.59:0/2485390184 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6600ce420 0x7fe6600c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:12.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.367+0000 7fe667048700 1 -- 172.21.15.59:0/2485390184 >> 172.21.15.59:0/2485390184 conn(0x7fe6600d0140 msgr2=0x7fe66015a730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:12.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.368+0000 7fe667048700 1 -- 172.21.15.59:0/2485390184 shutdown_connections 2023-09-21T00:17:12.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.368+0000 7fe667048700 1 -- 172.21.15.59:0/2485390184 wait complete. 2023-09-21T00:17:12.372 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 6 2023-09-21T00:17:12.381 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T00:17:12.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.504+0000 7fdff7e2c700 1 Processor -- start 2023-09-21T00:17:12.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.504+0000 7fdff7e2c700 1 -- start start 2023-09-21T00:17:12.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.505+0000 7fdff7e2c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdff015a230 0x7fdff015e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:12.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.505+0000 7fdff7e2c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fdff0071d90 0x7fdff006eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:12.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.505+0000 7fdff7e2c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdff00cb1c0 con 0x7fdff00ca790 2023-09-21T00:17:12.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.505+0000 7fdff7e2c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdff00cb780 con 0x7fdff015a230 2023-09-21T00:17:12.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.505+0000 7fdff7e2c700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdff00cb4a0 con 0x7fdff0071d90 2023-09-21T00:17:12.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.505+0000 7fdff5bc8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdff015a230 0x7fdff015e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:12.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.505+0000 7fdff53c7700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fdff00ca790 0x7fdff0071680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56560/0 (socket says 172.21.15.59:56560) 2023-09-21T00:17:12.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.505+0000 7fdff53c7700 1 -- 172.21.15.59:0/335435982 learned_addr learned my addr 172.21.15.59:0/335435982 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:12.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.506+0000 7fdff63c9700 1 --2- 172.21.15.59:0/335435982 >> v2:172.21.15.83:3300/0 conn(0x7fdff0071d90 0x7fdff006eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:12.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.506+0000 7fdff5bc8700 1 -- 172.21.15.59:0/335435982 >> v2:172.21.15.83:3300/0 conn(0x7fdff0071d90 msgr2=0x7fdff006eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:12.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.506+0000 7fdff5bc8700 1 --2- 172.21.15.59:0/335435982 >> v2:172.21.15.83:3300/0 conn(0x7fdff0071d90 0x7fdff006eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:12.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.506+0000 7fdff5bc8700 1 -- 172.21.15.59:0/335435982 >> v1:172.21.15.59:6789/0 conn(0x7fdff00ca790 legacy=0x7fdff0071680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:12.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.506+0000 7fdff5bc8700 1 -- 172.21.15.59:0/335435982 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff015e0b0 con 0x7fdff015a230 2023-09-21T00:17:12.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.506+0000 7fdff5bc8700 1 --2- 172.21.15.59:0/335435982 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdff015a230 0x7fdff015e8b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdff00cf6b0 tx=0x7fdfe0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a62600657946847 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:12.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.506+0000 7fdff4bc6700 1 -- 172.21.15.59:0/335435982 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe0011830 con 0x7fdff015a230 2023-09-21T00:17:12.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.506+0000 7fdff4bc6700 1 -- 172.21.15.59:0/335435982 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe0011990 con 0x7fdff015a230 2023-09-21T00:17:12.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.506+0000 7fdff4bc6700 1 -- 172.21.15.59:0/335435982 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe0011d20 con 0x7fdff015a230 2023-09-21T00:17:12.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.507+0000 7fdff7e2c700 1 -- 172.21.15.59:0/335435982 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdff015a230 msgr2=0x7fdff015e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:12.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.507+0000 7fdff7e2c700 1 --2- 172.21.15.59:0/335435982 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdff015a230 0x7fdff015e8b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdff00cf6b0 tx=0x7fdfe0009b20 comp rx=0 tx=0).stop 2023-09-21T00:17:12.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.507+0000 7fdff7e2c700 1 -- 172.21.15.59:0/335435982 shutdown_connections 2023-09-21T00:17:12.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.507+0000 7fdff7e2c700 1 --2- 172.21.15.59:0/335435982 >> v2:172.21.15.83:3300/0 conn(0x7fdff0071d90 0x7fdff006eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:12.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.507+0000 7fdff7e2c700 1 --2- 172.21.15.59:0/335435982 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdff015a230 0x7fdff015e8b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:12.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.507+0000 7fdff7e2c700 1 -- 172.21.15.59:0/335435982 >> 172.21.15.59:0/335435982 conn(0x7fdff00d0140 msgr2=0x7fdff00d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:12.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.507+0000 7fdff7e2c700 1 -- 172.21.15.59:0/335435982 shutdown_connections 2023-09-21T00:17:12.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.507+0000 7fdff7e2c700 1 -- 172.21.15.59:0/335435982 wait complete. 2023-09-21T00:17:12.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.508+0000 7fdff7e2c700 1 Processor -- start 2023-09-21T00:17:12.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.508+0000 7fdff7e2c700 1 -- start start 2023-09-21T00:17:12.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.509+0000 7fdff7e2c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdff0071d90 0x7fdff00b1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:12.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.509+0000 7fdff7e2c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdff00ca790 0x7fdff01516f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:12.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.509+0000 7fdff7e2c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdff015a230 0x7fdff015bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:12.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.509+0000 7fdff7e2c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff015c390 con 0x7fdff015a230 2023-09-21T00:17:12.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.509+0000 7fdff7e2c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff01f2640 con 0x7fdff0071d90 2023-09-21T00:17:12.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.509+0000 7fdff7e2c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff01f1d10 con 0x7fdff00ca790 2023-09-21T00:17:12.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.509+0000 7fdff63c9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdff015a230 0x7fdff015bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:12.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.509+0000 7fdff63c9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdff015a230 0x7fdff015bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51002/0 (socket says 172.21.15.59:51002) 2023-09-21T00:17:12.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.509+0000 7fdff63c9700 1 -- 172.21.15.59:0/3696432327 learned_addr learned my addr 172.21.15.59:0/3696432327 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:12.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.509+0000 7fdff5bc8700 1 --2- 172.21.15.59:0/3696432327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdff0071d90 0x7fdff00b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:12.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.509+0000 7fdff53c7700 1 --2- 172.21.15.59:0/3696432327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdff00ca790 0x7fdff01516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:12.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.509+0000 7fdff63c9700 1 -- 172.21.15.59:0/3696432327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdff00ca790 msgr2=0x7fdff01516f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:12.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.509+0000 7fdff63c9700 1 --2- 172.21.15.59:0/3696432327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdff00ca790 0x7fdff01516f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:12.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.509+0000 7fdff63c9700 1 -- 172.21.15.59:0/3696432327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdff0071d90 msgr2=0x7fdff00b1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:12.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.509+0000 7fdff63c9700 1 --2- 172.21.15.59:0/3696432327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdff0071d90 0x7fdff00b1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:12.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.509+0000 7fdff63c9700 1 -- 172.21.15.59:0/3696432327 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe00094a0 con 0x7fdff015a230 2023-09-21T00:17:12.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.509+0000 7fdff53c7700 1 --2- 172.21.15.59:0/3696432327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdff00ca790 0x7fdff01516f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:17:12.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.509+0000 7fdff63c9700 1 --2- 172.21.15.59:0/3696432327 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdff015a230 0x7fdff015bb40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdfe8007e40 tx=0x7fdfe800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:12.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.509+0000 7fdfe67fc700 1 -- 172.21.15.59:0/3696432327 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe800ede0 con 0x7fdff015a230 2023-09-21T00:17:12.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.509+0000 7fdfe67fc700 1 -- 172.21.15.59:0/3696432327 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe8014420 con 0x7fdff015a230 2023-09-21T00:17:12.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.509+0000 7fdff7e2c700 1 -- 172.21.15.59:0/3696432327 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdff01f1ff0 con 0x7fdff015a230 2023-09-21T00:17:12.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.509+0000 7fdfe67fc700 1 -- 172.21.15.59:0/3696432327 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe80147d0 con 0x7fdff015a230 2023-09-21T00:17:12.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.509+0000 7fdff7e2c700 1 -- 172.21.15.59:0/3696432327 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdff015c080 con 0x7fdff015a230 2023-09-21T00:17:12.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.510+0000 7fdff7e2c700 1 -- 172.21.15.59:0/3696432327 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdff01f27f0 con 0x7fdff015a230 2023-09-21T00:17:12.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.511+0000 7fdfe67fc700 1 -- 172.21.15.59:0/3696432327 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fdfe8014930 con 0x7fdff015a230 2023-09-21T00:17:12.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.511+0000 7fdfe67fc700 1 --2- 172.21.15.59:0/3696432327 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fdfd406ae00 0x7fdfd406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:12.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.512+0000 7fdfe67fc700 1 -- 172.21.15.59:0/3696432327 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdfe8089f40 con 0x7fdff015a230 2023-09-21T00:17:12.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.512+0000 7fdff5bc8700 1 --2- 172.21.15.59:0/3696432327 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fdfd406ae00 0x7fdfd406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:12.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.512+0000 7fdff5bc8700 1 --2- 172.21.15.59:0/3696432327 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fdfd406ae00 0x7fdfd406d2c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdfe00090b0 tx=0x7fdfe001c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:12.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.516+0000 7fdfe67fc700 1 -- 172.21.15.59:0/3696432327 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fdff01f27f0 con 0x7fdff015a230 2023-09-21T00:17:12.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.723+0000 7fdff7e2c700 1 -- 172.21.15.59:0/3696432327 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdff01f27b0 con 0x7fdff015a230 2023-09-21T00:17:12.725 INFO:tasks.ceph.mds.b.smithi083.stderr:2023-09-21T00:17:12.724+0000 7f2b5ccfd700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-21T00:17:12.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.724+0000 7fdfe67fc700 1 -- 172.21.15.59:0/3696432327 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18262 (secure 0 0 0) 0x7fdfe8081e60 con 0x7fdff015a230 2023-09-21T00:17:12.726 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:17:12.726 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":24,"fsid":"dd69925c-6e25-42fe-880b-2f60fc6f384b","created":"2023-09-21T00:16:43.074489+0000","modified":"2023-09-21T00:17:11.387529+0000","last_up_change":"2023-09-21T00:16:54.740101+0000","last_in_change":"2023-09-21T00:16:45.987089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T00:16:54.796248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-21T00:17:04.167102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-21T00:17:05.313188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-21T00:17:08.977609+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d4b18344-74c0-4f75-920b-7a9247e48914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6809","nonce":2418314235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6811","nonce":2418314235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6815","nonce":2418314235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6813","nonce":2418314235}]},"public_addr":"172.21.15.59:6809/2418314235","cluster_addr":"172.21.15.59:6811/2418314235","heartbeat_back_addr":"172.21.15.59:6815/2418314235","heartbeat_front_addr":"172.21.15.59:6813/2418314235","state":["exists","up"]},{"osd":1,"uuid":"80940d50-a248-4e64-a282-7ffcdad790ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6801","nonce":869668251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6803","nonce":869668251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6807","nonce":869668251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6805","nonce":869668251}]},"public_addr":"172.21.15.59:6801/869668251","cluster_addr":"172.21.15.59:6803/869668251","heartbeat_back_addr":"172.21.15.59:6807/869668251","heartbeat_front_addr":"172.21.15.59:6805/869668251","state":["exists","up"]},{"osd":2,"uuid":"55f2eceb-c54a-4879-a6ce-968c1c548b5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6817","nonce":372517778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6819","nonce":372517778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6823","nonce":372517778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6821","nonce":372517778}]},"public_addr":"172.21.15.59:6817/372517778","cluster_addr":"172.21.15.59:6819/372517778","heartbeat_back_addr":"172.21.15.59:6823/372517778","heartbeat_front_addr":"172.21.15.59:6821/372517778","state":["exists","up"]},{"osd":3,"uuid":"92b89cd0-869c-49b9-a9f9-97ac8423f304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6825","nonce":575188498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6827","nonce":575188498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6831","nonce":575188498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6829","nonce":575188498}]},"public_addr":"172.21.15.59:6825/575188498","cluster_addr":"172.21.15.59:6827/575188498","heartbeat_back_addr":"172.21.15.59:6831/575188498","heartbeat_front_addr":"172.21.15.59:6829/575188498","state":["exists","up"]},{"osd":4,"uuid":"25b80e94-e0e6-403d-b69f-61542f289637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6803","nonce":1741219098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6805","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6807","nonce":1741219098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6815","nonce":1741219098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6811","nonce":1741219098}]},"public_addr":"172.21.15.83:6803/1741219098","cluster_addr":"172.21.15.83:6807/1741219098","heartbeat_back_addr":"172.21.15.83:6815/1741219098","heartbeat_front_addr":"172.21.15.83:6811/1741219098","state":["exists","up"]},{"osd":5,"uuid":"5498d9ab-1086-4796-a199-9051e6dfea91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6817","nonce":156730565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6819","nonce":156730565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6823","nonce":156730565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6821","nonce":156730565}]},"public_addr":"172.21.15.83:6817/156730565","cluster_addr":"172.21.15.83:6819/156730565","heartbeat_back_addr":"172.21.15.83:6823/156730565","heartbeat_front_addr":"172.21.15.83:6821/156730565","state":["exists","up"]},{"osd":6,"uuid":"cfd810c0-5015-4d60-9a75-7efc93a32e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6801","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6800","nonce":1337723778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6806","nonce":1337723778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6814","nonce":1337723778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6810","nonce":1337723778}]},"public_addr":"172.21.15.83:6800/1337723778","cluster_addr":"172.21.15.83:6806/1337723778","heartbeat_back_addr":"172.21.15.83:6814/1337723778","heartbeat_front_addr":"172.21.15.83:6810/1337723778","state":["exists","up"]},{"osd":7,"uuid":"e992c8fa-0a3d-4b3c-85b5-2c511223dee4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6825","nonce":4204859272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6827","nonce":4204859272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6831","nonce":4204859272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6829","nonce":4204859272}]},"public_addr":"172.21.15.83:6825/4204859272","cluster_addr":"172.21.15.83:6827/4204859272","heartbeat_back_addr":"172.21.15.83:6831/4204859272","heartbeat_front_addr":"172.21.15.83:6829/4204859272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.156498+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.882707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.093978+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.158565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.173933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.888606+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.135525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.149712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T00:17:12.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.726+0000 7fdff7e2c700 1 -- 172.21.15.59:0/3696432327 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fdfd406ae00 msgr2=0x7fdfd406d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:12.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.726+0000 7fdff7e2c700 1 --2- 172.21.15.59:0/3696432327 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fdfd406ae00 0x7fdfd406d2c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdfe00090b0 tx=0x7fdfe001c040 comp rx=0 tx=0).stop 2023-09-21T00:17:12.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.726+0000 7fdff7e2c700 1 -- 172.21.15.59:0/3696432327 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdff015a230 msgr2=0x7fdff015bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:12.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.726+0000 7fdff7e2c700 1 --2- 172.21.15.59:0/3696432327 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdff015a230 0x7fdff015bb40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdfe8007e40 tx=0x7fdfe800e3c0 comp rx=0 tx=0).stop 2023-09-21T00:17:12.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.727+0000 7fdff7e2c700 1 -- 172.21.15.59:0/3696432327 shutdown_connections 2023-09-21T00:17:12.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.727+0000 7fdff7e2c700 1 --2- 172.21.15.59:0/3696432327 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdff015a230 0x7fdff015bb40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:12.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.727+0000 7fdff7e2c700 1 --2- 172.21.15.59:0/3696432327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdff0071d90 0x7fdff00b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:12.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.727+0000 7fdff7e2c700 1 --2- 172.21.15.59:0/3696432327 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fdfd406ae00 0x7fdfd406d2c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:12.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.727+0000 7fdff7e2c700 1 --2- 172.21.15.59:0/3696432327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdff00ca790 0x7fdff01516f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:12.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.727+0000 7fdff7e2c700 1 -- 172.21.15.59:0/3696432327 >> 172.21.15.59:0/3696432327 conn(0x7fdff00d0140 msgr2=0x7fdff0071580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:12.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.727+0000 7fdff7e2c700 1 -- 172.21.15.59:0/3696432327 shutdown_connections 2023-09-21T00:17:12.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.727+0000 7fdff7e2c700 1 -- 172.21.15.59:0/3696432327 wait complete. 2023-09-21T00:17:12.740 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T00:17:12.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.863+0000 7f0eff437700 1 Processor -- start 2023-09-21T00:17:12.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.863+0000 7f0eff437700 1 -- start start 2023-09-21T00:17:12.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.864+0000 7f0eff437700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ef815e910 0x7f0ef815f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:12.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.864+0000 7f0eff437700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0ef80b54a0 0x7f0ef80cc250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:12.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.864+0000 7f0eff437700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0ef80cc790 0x7f0ef8070de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:12.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.864+0000 7f0eff437700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ef80ccc40 con 0x7f0ef80cc790 2023-09-21T00:17:12.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.864+0000 7f0eff437700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ef806d080 con 0x7f0ef80b54a0 2023-09-21T00:17:12.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.864+0000 7f0eff437700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef815ecf0 con 0x7f0ef815e910 2023-09-21T00:17:12.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.864+0000 7f0efd9d4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0ef80cc790 0x7f0ef8070de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:12.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.864+0000 7f0efd9d4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0ef80cc790 0x7f0ef8070de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51008/0 (socket says 172.21.15.59:51008) 2023-09-21T00:17:12.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.864+0000 7f0efd9d4700 1 -- 172.21.15.59:0/2493171884 learned_addr learned my addr 172.21.15.59:0/2493171884 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:12.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.864+0000 7f0efd1d3700 1 --2- 172.21.15.59:0/2493171884 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ef815e910 0x7f0ef815f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:12.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.864+0000 7f0efc9d2700 1 --2- 172.21.15.59:0/2493171884 >> v2:172.21.15.83:3300/0 conn(0x7f0ef80b54a0 0x7f0ef80cc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:12.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.864+0000 7f0efd9d4700 1 -- 172.21.15.59:0/2493171884 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ef815e910 msgr2=0x7f0ef815f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:12.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.864+0000 7f0efd9d4700 1 --2- 172.21.15.59:0/2493171884 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ef815e910 0x7f0ef815f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:12.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.864+0000 7f0efd9d4700 1 -- 172.21.15.59:0/2493171884 >> v2:172.21.15.83:3300/0 conn(0x7f0ef80b54a0 msgr2=0x7f0ef80cc250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:12.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.864+0000 7f0efd9d4700 1 --2- 172.21.15.59:0/2493171884 >> v2:172.21.15.83:3300/0 conn(0x7f0ef80b54a0 0x7f0ef80cc250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:12.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.864+0000 7f0efd9d4700 1 -- 172.21.15.59:0/2493171884 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef815fe10 con 0x7f0ef80cc790 2023-09-21T00:17:12.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.865+0000 7f0efd9d4700 1 --2- 172.21.15.59:0/2493171884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ef80cc790 0x7f0ef8070de0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0ef80cc1e0 tx=0x7f0ef000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe1db7802981a371 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:12.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.865+0000 7f0eeffff700 1 -- 172.21.15.59:0/2493171884 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef000e070 con 0x7f0ef80cc790 2023-09-21T00:17:12.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.865+0000 7f0eeffff700 1 -- 172.21.15.59:0/2493171884 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef000b9c0 con 0x7f0ef80cc790 2023-09-21T00:17:12.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.865+0000 7f0eeffff700 1 -- 172.21.15.59:0/2493171884 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef000bd70 con 0x7f0ef80cc790 2023-09-21T00:17:12.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.865+0000 7f0eff437700 1 -- 172.21.15.59:0/2493171884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ef80cc790 msgr2=0x7f0ef8070de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:12.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.865+0000 7f0eff437700 1 --2- 172.21.15.59:0/2493171884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ef80cc790 0x7f0ef8070de0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0ef80cc1e0 tx=0x7f0ef000b330 comp rx=0 tx=0).stop 2023-09-21T00:17:12.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.865+0000 7f0eff437700 1 -- 172.21.15.59:0/2493171884 shutdown_connections 2023-09-21T00:17:12.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.865+0000 7f0eff437700 1 --2- 172.21.15.59:0/2493171884 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ef815e910 0x7f0ef815f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:12.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.865+0000 7f0eff437700 1 --2- 172.21.15.59:0/2493171884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ef80cc790 0x7f0ef8070de0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:12.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.865+0000 7f0eff437700 1 --2- 172.21.15.59:0/2493171884 >> v2:172.21.15.83:3300/0 conn(0x7f0ef80b54a0 0x7f0ef80cc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:12.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.865+0000 7f0eff437700 1 -- 172.21.15.59:0/2493171884 >> 172.21.15.59:0/2493171884 conn(0x7f0ef806a780 msgr2=0x7f0ef806ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:12.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.865+0000 7f0eff437700 1 -- 172.21.15.59:0/2493171884 shutdown_connections 2023-09-21T00:17:12.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.865+0000 7f0eff437700 1 -- 172.21.15.59:0/2493171884 wait complete. 2023-09-21T00:17:12.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.867+0000 7f0eff437700 1 Processor -- start 2023-09-21T00:17:12.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.867+0000 7f0eff437700 1 -- start start 2023-09-21T00:17:12.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.867+0000 7f0eff437700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ef80b54a0 0x7f0ef81f15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:12.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.867+0000 7f0eff437700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ef80cc790 0x7f0ef80b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:12.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.867+0000 7f0eff437700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ef815e910 0x7f0ef8146260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:12.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.867+0000 7f0eff437700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef8147be0 con 0x7f0ef80cc790 2023-09-21T00:17:12.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.867+0000 7f0eff437700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef80b3fb0 con 0x7f0ef815e910 2023-09-21T00:17:12.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.867+0000 7f0eff437700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef8146fd0 con 0x7f0ef80b54a0 2023-09-21T00:17:12.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.867+0000 7f0efc9d2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ef80cc790 0x7f0ef80b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:12.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.867+0000 7f0efc9d2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ef80cc790 0x7f0ef80b3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51012/0 (socket says 172.21.15.59:51012) 2023-09-21T00:17:12.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.867+0000 7f0efc9d2700 1 -- 172.21.15.59:0/303578573 learned_addr learned my addr 172.21.15.59:0/303578573 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:12.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.868+0000 7f0efd1d3700 1 --2- 172.21.15.59:0/303578573 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ef80b54a0 0x7f0ef81f15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:12.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.868+0000 7f0efd9d4700 1 --2- 172.21.15.59:0/303578573 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ef815e910 0x7f0ef8146260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:12.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.868+0000 7f0efc9d2700 1 -- 172.21.15.59:0/303578573 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ef80b54a0 msgr2=0x7f0ef81f15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:12.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.868+0000 7f0efc9d2700 1 --2- 172.21.15.59:0/303578573 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ef80b54a0 0x7f0ef81f15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:12.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.868+0000 7f0efc9d2700 1 -- 172.21.15.59:0/303578573 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ef815e910 msgr2=0x7f0ef8146260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:12.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.868+0000 7f0efc9d2700 1 --2- 172.21.15.59:0/303578573 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ef815e910 0x7f0ef8146260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:12.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.868+0000 7f0efc9d2700 1 -- 172.21.15.59:0/303578573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef0009b30 con 0x7f0ef80cc790 2023-09-21T00:17:12.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.868+0000 7f0efc9d2700 1 --2- 172.21.15.59:0/303578573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ef80cc790 0x7f0ef80b3a70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0ef400e810 tx=0x7f0ef400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:12.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.868+0000 7f0eedffb700 1 -- 172.21.15.59:0/303578573 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef400c070 con 0x7f0ef80cc790 2023-09-21T00:17:12.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.868+0000 7f0eedffb700 1 -- 172.21.15.59:0/303578573 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef4013610 con 0x7f0ef80cc790 2023-09-21T00:17:12.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.868+0000 7f0eff437700 1 -- 172.21.15.59:0/303578573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ef81472b0 con 0x7f0ef80cc790 2023-09-21T00:17:12.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.868+0000 7f0eedffb700 1 -- 172.21.15.59:0/303578573 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef40139a0 con 0x7f0ef80cc790 2023-09-21T00:17:12.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.868+0000 7f0eff437700 1 -- 172.21.15.59:0/303578573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef8147870 con 0x7f0ef80cc790 2023-09-21T00:17:12.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.869+0000 7f0eff437700 1 -- 172.21.15.59:0/303578573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ef806b780 con 0x7f0ef80cc790 2023-09-21T00:17:12.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.870+0000 7f0eedffb700 1 -- 172.21.15.59:0/303578573 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f0ef4013b00 con 0x7f0ef80cc790 2023-09-21T00:17:12.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.870+0000 7f0eedffb700 1 --2- 172.21.15.59:0/303578573 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f0edc06ae00 0x7f0edc06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:12.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.870+0000 7f0eedffb700 1 -- 172.21.15.59:0/303578573 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0ef40891e0 con 0x7f0ef80cc790 2023-09-21T00:17:12.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.870+0000 7f0efd1d3700 1 --2- 172.21.15.59:0/303578573 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f0edc06ae00 0x7f0edc06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:12.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.871+0000 7f0efd1d3700 1 --2- 172.21.15.59:0/303578573 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f0edc06ae00 0x7f0edc06d2c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8006b20 tx=0x7f0ee8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:12.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:12.874+0000 7f0eedffb700 1 -- 172.21.15.59:0/303578573 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f0ef40540a0 con 0x7f0ef80cc790 2023-09-21T00:17:13.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.077+0000 7f0eff437700 1 -- 172.21.15.59:0/303578573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ef8067e50 con 0x7f0ef80cc790 2023-09-21T00:17:13.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.078+0000 7f0eedffb700 1 -- 172.21.15.59:0/303578573 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18262 (secure 0 0 0) 0x7f0ef4013db0 con 0x7f0ef80cc790 2023-09-21T00:17:13.080 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:17:13.080 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":24,"fsid":"dd69925c-6e25-42fe-880b-2f60fc6f384b","created":"2023-09-21T00:16:43.074489+0000","modified":"2023-09-21T00:17:11.387529+0000","last_up_change":"2023-09-21T00:16:54.740101+0000","last_in_change":"2023-09-21T00:16:45.987089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T00:16:54.796248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-21T00:17:04.167102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-21T00:17:05.313188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-21T00:17:08.977609+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d4b18344-74c0-4f75-920b-7a9247e48914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6809","nonce":2418314235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6811","nonce":2418314235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6815","nonce":2418314235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6813","nonce":2418314235}]},"public_addr":"172.21.15.59:6809/2418314235","cluster_addr":"172.21.15.59:6811/2418314235","heartbeat_back_addr":"172.21.15.59:6815/2418314235","heartbeat_front_addr":"172.21.15.59:6813/2418314235","state":["exists","up"]},{"osd":1,"uuid":"80940d50-a248-4e64-a282-7ffcdad790ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6801","nonce":869668251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6803","nonce":869668251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6807","nonce":869668251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6805","nonce":869668251}]},"public_addr":"172.21.15.59:6801/869668251","cluster_addr":"172.21.15.59:6803/869668251","heartbeat_back_addr":"172.21.15.59:6807/869668251","heartbeat_front_addr":"172.21.15.59:6805/869668251","state":["exists","up"]},{"osd":2,"uuid":"55f2eceb-c54a-4879-a6ce-968c1c548b5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6817","nonce":372517778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6819","nonce":372517778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6823","nonce":372517778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6821","nonce":372517778}]},"public_addr":"172.21.15.59:6817/372517778","cluster_addr":"172.21.15.59:6819/372517778","heartbeat_back_addr":"172.21.15.59:6823/372517778","heartbeat_front_addr":"172.21.15.59:6821/372517778","state":["exists","up"]},{"osd":3,"uuid":"92b89cd0-869c-49b9-a9f9-97ac8423f304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6825","nonce":575188498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6827","nonce":575188498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6831","nonce":575188498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6829","nonce":575188498}]},"public_addr":"172.21.15.59:6825/575188498","cluster_addr":"172.21.15.59:6827/575188498","heartbeat_back_addr":"172.21.15.59:6831/575188498","heartbeat_front_addr":"172.21.15.59:6829/575188498","state":["exists","up"]},{"osd":4,"uuid":"25b80e94-e0e6-403d-b69f-61542f289637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6803","nonce":1741219098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6805","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6807","nonce":1741219098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6815","nonce":1741219098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6811","nonce":1741219098}]},"public_addr":"172.21.15.83:6803/1741219098","cluster_addr":"172.21.15.83:6807/1741219098","heartbeat_back_addr":"172.21.15.83:6815/1741219098","heartbeat_front_addr":"172.21.15.83:6811/1741219098","state":["exists","up"]},{"osd":5,"uuid":"5498d9ab-1086-4796-a199-9051e6dfea91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6817","nonce":156730565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6819","nonce":156730565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6823","nonce":156730565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6821","nonce":156730565}]},"public_addr":"172.21.15.83:6817/156730565","cluster_addr":"172.21.15.83:6819/156730565","heartbeat_back_addr":"172.21.15.83:6823/156730565","heartbeat_front_addr":"172.21.15.83:6821/156730565","state":["exists","up"]},{"osd":6,"uuid":"cfd810c0-5015-4d60-9a75-7efc93a32e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6801","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6800","nonce":1337723778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6806","nonce":1337723778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6814","nonce":1337723778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6810","nonce":1337723778}]},"public_addr":"172.21.15.83:6800/1337723778","cluster_addr":"172.21.15.83:6806/1337723778","heartbeat_back_addr":"172.21.15.83:6814/1337723778","heartbeat_front_addr":"172.21.15.83:6810/1337723778","state":["exists","up"]},{"osd":7,"uuid":"e992c8fa-0a3d-4b3c-85b5-2c511223dee4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6825","nonce":4204859272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6827","nonce":4204859272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6831","nonce":4204859272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6829","nonce":4204859272}]},"public_addr":"172.21.15.83:6825/4204859272","cluster_addr":"172.21.15.83:6827/4204859272","heartbeat_back_addr":"172.21.15.83:6831/4204859272","heartbeat_front_addr":"172.21.15.83:6829/4204859272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.156498+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.882707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.093978+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.158565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.173933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.888606+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.135525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.149712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T00:17:13.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.080+0000 7f0eff437700 1 -- 172.21.15.59:0/303578573 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f0edc06ae00 msgr2=0x7f0edc06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:13.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.080+0000 7f0eff437700 1 --2- 172.21.15.59:0/303578573 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f0edc06ae00 0x7f0edc06d2c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8006b20 tx=0x7f0ee8008040 comp rx=0 tx=0).stop 2023-09-21T00:17:13.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.080+0000 7f0eff437700 1 -- 172.21.15.59:0/303578573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ef80cc790 msgr2=0x7f0ef80b3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:13.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.080+0000 7f0eff437700 1 --2- 172.21.15.59:0/303578573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ef80cc790 0x7f0ef80b3a70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0ef400e810 tx=0x7f0ef400eb20 comp rx=0 tx=0).stop 2023-09-21T00:17:13.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.080+0000 7f0eff437700 1 -- 172.21.15.59:0/303578573 shutdown_connections 2023-09-21T00:17:13.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.080+0000 7f0eff437700 1 --2- 172.21.15.59:0/303578573 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ef815e910 0x7f0ef8146260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:13.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.080+0000 7f0eff437700 1 --2- 172.21.15.59:0/303578573 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f0edc06ae00 0x7f0edc06d2c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:13.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.080+0000 7f0eff437700 1 --2- 172.21.15.59:0/303578573 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ef80b54a0 0x7f0ef81f15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:13.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.080+0000 7f0eff437700 1 --2- 172.21.15.59:0/303578573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ef80cc790 0x7f0ef80b3a70 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:13.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.080+0000 7f0eff437700 1 -- 172.21.15.59:0/303578573 >> 172.21.15.59:0/303578573 conn(0x7f0ef806a780 msgr2=0x7f0ef80cf840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:13.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.080+0000 7f0eff437700 1 -- 172.21.15.59:0/303578573 shutdown_connections 2023-09-21T00:17:13.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.080+0000 7f0eff437700 1 -- 172.21.15.59:0/303578573 wait complete. 2023-09-21T00:17:13.108 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T00:17:13.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.232+0000 7fbcc289c700 1 Processor -- start 2023-09-21T00:17:13.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.232+0000 7fbcc289c700 1 -- start start 2023-09-21T00:17:13.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.233+0000 7fbcc289c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbcbc0cc250 0x7fbcbc0cc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:13.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.233+0000 7fbcc289c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbcbc0714f0 0x7fbcbc0b3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:13.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.233+0000 7fbcc289c700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcbc159f70 con 0x7fbcbc15ac90 2023-09-21T00:17:13.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.233+0000 7fbcc289c700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcbc06d2c0 con 0x7fbcbc0cc250 2023-09-21T00:17:13.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.233+0000 7fbcc289c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcbc15a800 con 0x7fbcbc0714f0 2023-09-21T00:17:13.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.233+0000 7fbcbbfff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbcbc0cc250 0x7fbcbc0cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:13.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.233+0000 7fbcc0e39700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbcbc0714f0 0x7fbcbc0b3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:13.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.233+0000 7fbcbbfff700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbcbc0cc250 0x7fbcbc0cc630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.59:37134/0 (socket says 172.21.15.59:37134) 2023-09-21T00:17:13.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.233+0000 7fbcc0e39700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbcbc0714f0 0x7fbcbc0b3950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.59:51638/0 (socket says 172.21.15.59:51638) 2023-09-21T00:17:13.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.234+0000 7fbcbbfff700 1 -- 172.21.15.59:0/3300135355 learned_addr learned my addr 172.21.15.59:0/3300135355 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:13.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.234+0000 7fbcbbfff700 1 -- 172.21.15.59:0/3300135355 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbcbc0714f0 msgr2=0x7fbcbc0b3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:13.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.234+0000 7fbcbbfff700 1 --2- 172.21.15.59:0/3300135355 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbcbc0714f0 0x7fbcbc0b3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:13.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.234+0000 7fbcbbfff700 1 -- 172.21.15.59:0/3300135355 >> v1:172.21.15.83:6789/0 conn(0x7fbcbc15ac90 legacy=0x7fbcbc070de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:13.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.234+0000 7fbcbbfff700 1 -- 172.21.15.59:0/3300135355 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcbc0ccb70 con 0x7fbcbc0cc250 2023-09-21T00:17:13.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.234+0000 7fbcc0e39700 1 --2- 172.21.15.59:0/3300135355 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbcbc0714f0 0x7fbcbc0b3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T00:17:13.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.234+0000 7fbcbbfff700 1 --2- 172.21.15.59:0/3300135355 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcbc0cc250 0x7fbcbc0cc630 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbcac00aa90 tx=0x7fbcac00ada0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=701a675e6a88f80d server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:13.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.234+0000 7fbcbaffd700 1 -- 172.21.15.59:0/3300135355 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcac00cb70 con 0x7fbcbc0cc250 2023-09-21T00:17:13.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.234+0000 7fbcbaffd700 1 -- 172.21.15.59:0/3300135355 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcac00ccd0 con 0x7fbcbc0cc250 2023-09-21T00:17:13.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.234+0000 7fbcbaffd700 1 -- 172.21.15.59:0/3300135355 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcac018620 con 0x7fbcbc0cc250 2023-09-21T00:17:13.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.235+0000 7fbcc289c700 1 -- 172.21.15.59:0/3300135355 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcbc0cc250 msgr2=0x7fbcbc0cc630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:13.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.235+0000 7fbcc289c700 1 --2- 172.21.15.59:0/3300135355 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcbc0cc250 0x7fbcbc0cc630 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbcac00aa90 tx=0x7fbcac00ada0 comp rx=0 tx=0).stop 2023-09-21T00:17:13.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.235+0000 7fbcc289c700 1 -- 172.21.15.59:0/3300135355 shutdown_connections 2023-09-21T00:17:13.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.235+0000 7fbcc289c700 1 --2- 172.21.15.59:0/3300135355 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbcbc0714f0 0x7fbcbc0b3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:13.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.235+0000 7fbcc289c700 1 --2- 172.21.15.59:0/3300135355 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcbc0cc250 0x7fbcbc0cc630 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:13.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.235+0000 7fbcc289c700 1 -- 172.21.15.59:0/3300135355 >> 172.21.15.59:0/3300135355 conn(0x7fbcbc06a780 msgr2=0x7fbcbc06ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:13.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.235+0000 7fbcc289c700 1 -- 172.21.15.59:0/3300135355 shutdown_connections 2023-09-21T00:17:13.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.235+0000 7fbcc289c700 1 -- 172.21.15.59:0/3300135355 wait complete. 2023-09-21T00:17:13.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.236+0000 7fbcc289c700 1 Processor -- start 2023-09-21T00:17:13.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.236+0000 7fbcc289c700 1 -- start start 2023-09-21T00:17:13.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.237+0000 7fbcc289c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbcbc0714f0 0x7fbcbc151c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:13.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.237+0000 7fbcc289c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcbc0cc250 0x7fbcbc151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:13.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.237+0000 7fbcc289c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbcbc15ac90 0x7fbcbc0caec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:13.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.237+0000 7fbcc289c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcbc1524d0 con 0x7fbcbc0714f0 2023-09-21T00:17:13.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.237+0000 7fbcc289c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcbc1e23b0 con 0x7fbcbc0cc250 2023-09-21T00:17:13.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.237+0000 7fbcc289c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcbc1e2690 con 0x7fbcbc15ac90 2023-09-21T00:17:13.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.237+0000 7fbcbbfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbcbc0714f0 0x7fbcbc151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:13.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.237+0000 7fbcbbfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbcbc0714f0 0x7fbcbc151c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51024/0 (socket says 172.21.15.59:51024) 2023-09-21T00:17:13.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.237+0000 7fbcbbfff700 1 -- 172.21.15.59:0/4085629766 learned_addr learned my addr 172.21.15.59:0/4085629766 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:13.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.237+0000 7fbcbb7fe700 1 --2- 172.21.15.59:0/4085629766 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcbc0cc250 0x7fbcbc151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:13.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.237+0000 7fbcc0e39700 1 --2- 172.21.15.59:0/4085629766 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbcbc15ac90 0x7fbcbc0caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:13.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.237+0000 7fbcbbfff700 1 -- 172.21.15.59:0/4085629766 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbcbc15ac90 msgr2=0x7fbcbc0caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:13.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.237+0000 7fbcbbfff700 1 --2- 172.21.15.59:0/4085629766 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbcbc15ac90 0x7fbcbc0caec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:13.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.237+0000 7fbcbbfff700 1 -- 172.21.15.59:0/4085629766 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcbc0cc250 msgr2=0x7fbcbc151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:13.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.237+0000 7fbcbbfff700 1 --2- 172.21.15.59:0/4085629766 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcbc0cc250 0x7fbcbc151460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:13.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.237+0000 7fbcbbfff700 1 -- 172.21.15.59:0/4085629766 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb4009a70 con 0x7fbcbc0714f0 2023-09-21T00:17:13.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.238+0000 7fbcbbfff700 1 --2- 172.21.15.59:0/4085629766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbcbc0714f0 0x7fbcbc151c30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbcac00ade0 tx=0x7fbcac0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:13.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.238+0000 7fbcb8ff9700 1 -- 172.21.15.59:0/4085629766 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcac0038b0 con 0x7fbcbc0714f0 2023-09-21T00:17:13.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.238+0000 7fbcb8ff9700 1 -- 172.21.15.59:0/4085629766 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcac003a10 con 0x7fbcbc0714f0 2023-09-21T00:17:13.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.238+0000 7fbcc289c700 1 -- 172.21.15.59:0/4085629766 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcac00a6f0 con 0x7fbcbc0714f0 2023-09-21T00:17:13.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.238+0000 7fbcb8ff9700 1 -- 172.21.15.59:0/4085629766 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcac003dc0 con 0x7fbcbc0714f0 2023-09-21T00:17:13.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.238+0000 7fbcc289c700 1 -- 172.21.15.59:0/4085629766 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcbc1e2c50 con 0x7fbcbc0714f0 2023-09-21T00:17:13.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.239+0000 7fbcc289c700 1 -- 172.21.15.59:0/4085629766 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcbc067e50 con 0x7fbcbc0714f0 2023-09-21T00:17:13.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.239+0000 7fbcb8ff9700 1 -- 172.21.15.59:0/4085629766 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fbcac018400 con 0x7fbcbc0714f0 2023-09-21T00:17:13.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.240+0000 7fbcb8ff9700 1 --2- 172.21.15.59:0/4085629766 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fbca806ae00 0x7fbca806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:13.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.240+0000 7fbcb8ff9700 1 -- 172.21.15.59:0/4085629766 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbcac08abc0 con 0x7fbcbc0714f0 2023-09-21T00:17:13.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.240+0000 7fbcbb7fe700 1 --2- 172.21.15.59:0/4085629766 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fbca806ae00 0x7fbca806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:13.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.240+0000 7fbcbb7fe700 1 --2- 172.21.15.59:0/4085629766 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fbca806ae00 0x7fbca806d2c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0007fd0 tx=0x7fbcb0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:13.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.244+0000 7fbcb8ff9700 1 -- 172.21.15.59:0/4085629766 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fbcac055a80 con 0x7fbcbc0714f0 2023-09-21T00:17:13.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.494+0000 7fbcc289c700 1 -- 172.21.15.59:0/4085629766 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbcbc06adb0 con 0x7fbcbc0714f0 2023-09-21T00:17:13.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.494+0000 7fbcb8ff9700 1 -- 172.21.15.59:0/4085629766 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4903 (secure 0 0 0) 0x7fbcac025090 con 0x7fbcbc0714f0 2023-09-21T00:17:13.495 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:17:13.496 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/461673980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":461673980},{"type":"v1","addr":"172.21.15.59:6835","nonce":461673980}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/3148728526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3148728526},{"type":"v1","addr":"172.21.15.59:6834","nonce":3148728526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/3250481509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3250481509},{"type":"v1","addr":"172.21.15.83:6836","nonce":3250481509}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-21T00:17:06.338694+0000","modified":"2023-09-21T00:17:11.387692+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6837/792952552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":792952552},{"type":"v1","addr":"172.21.15.83:6837","nonce":792952552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-09-21T00:17:13.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.496+0000 7fbcc289c700 1 -- 172.21.15.59:0/4085629766 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fbca806ae00 msgr2=0x7fbca806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:13.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.496+0000 7fbcc289c700 1 --2- 172.21.15.59:0/4085629766 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fbca806ae00 0x7fbca806d2c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0007fd0 tx=0x7fbcb0009040 comp rx=0 tx=0).stop 2023-09-21T00:17:13.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.496+0000 7fbcc289c700 1 -- 172.21.15.59:0/4085629766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbcbc0714f0 msgr2=0x7fbcbc151c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:13.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.496+0000 7fbcc289c700 1 --2- 172.21.15.59:0/4085629766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbcbc0714f0 0x7fbcbc151c30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbcac00ade0 tx=0x7fbcac0047c0 comp rx=0 tx=0).stop 2023-09-21T00:17:13.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.496+0000 7fbcc289c700 1 -- 172.21.15.59:0/4085629766 shutdown_connections 2023-09-21T00:17:13.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.496+0000 7fbcc289c700 1 --2- 172.21.15.59:0/4085629766 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fbca806ae00 0x7fbca806d2c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:13.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.496+0000 7fbcc289c700 1 --2- 172.21.15.59:0/4085629766 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbcbc15ac90 0x7fbcbc0caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:13.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.496+0000 7fbcc289c700 1 --2- 172.21.15.59:0/4085629766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbcbc0714f0 0x7fbcbc151c30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:13.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.496+0000 7fbcc289c700 1 --2- 172.21.15.59:0/4085629766 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcbc0cc250 0x7fbcbc151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:13.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.496+0000 7fbcc289c700 1 -- 172.21.15.59:0/4085629766 >> 172.21.15.59:0/4085629766 conn(0x7fbcbc06a780 msgr2=0x7fbcbc0b3950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:13.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.496+0000 7fbcc289c700 1 -- 172.21.15.59:0/4085629766 shutdown_connections 2023-09-21T00:17:13.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.496+0000 7fbcc289c700 1 -- 172.21.15.59:0/4085629766 wait complete. 2023-09-21T00:17:13.501 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 6 2023-09-21T00:17:13.510 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T00:17:13.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.634+0000 7f3017a1f700 1 Processor -- start 2023-09-21T00:17:13.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.634+0000 7f3017a1f700 1 -- start start 2023-09-21T00:17:13.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.635+0000 7f3017a1f700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f301015d690 0x7f3010070b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:13.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.635+0000 7f3017a1f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f30100cedb0 0x7f30100cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:13.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.635+0000 7f3017a1f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3010162170 con 0x7f3010143ce0 2023-09-21T00:17:13.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.635+0000 7f3017a1f700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3010161990 con 0x7f301015d690 2023-09-21T00:17:13.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.635+0000 7f3017a1f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30100cf720 con 0x7f30100cedb0 2023-09-21T00:17:13.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.635+0000 7f3014fba700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3010143ce0 0x7f3010161280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56602/0 (socket says 172.21.15.59:56602) 2023-09-21T00:17:13.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.635+0000 7f3014fba700 1 -- 172.21.15.59:0/3027225472 learned_addr learned my addr 172.21.15.59:0/3027225472 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:13.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.635+0000 7f30157bb700 1 --2- 172.21.15.59:0/3027225472 >> v2:172.21.15.83:3300/0 conn(0x7f301015d690 0x7f3010070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:13.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.635+0000 7f3015fbc700 1 --2- 172.21.15.59:0/3027225472 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f30100cedb0 0x7f30100cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:13.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.635+0000 7f3007fff700 1 -- 172.21.15.59:0/3027225472 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1909243292 0 0) 0x7f3010162170 con 0x7f3010143ce0 2023-09-21T00:17:13.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.635+0000 7f3007fff700 1 -- 172.21.15.59:0/3027225472 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ffc0035b0 con 0x7f3010143ce0 2023-09-21T00:17:13.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.635+0000 7f3007fff700 1 -- 172.21.15.59:0/3027225472 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 776899399 0 0) 0x7f2ffc0035b0 con 0x7f3010143ce0 2023-09-21T00:17:13.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.635+0000 7f3007fff700 1 -- 172.21.15.59:0/3027225472 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f30100cedb0 msgr2=0x7f30100cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:13.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.635+0000 7f3007fff700 1 --2- 172.21.15.59:0/3027225472 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f30100cedb0 0x7f30100cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:13.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.635+0000 7f3007fff700 1 -- 172.21.15.59:0/3027225472 >> v2:172.21.15.83:3300/0 conn(0x7f301015d690 msgr2=0x7f3010070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:13.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.635+0000 7f3007fff700 1 --2- 172.21.15.59:0/3027225472 >> v2:172.21.15.83:3300/0 conn(0x7f301015d690 0x7f3010070b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:13.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.635+0000 7f3007fff700 1 -- 172.21.15.59:0/3027225472 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3010161bb0 con 0x7f3010143ce0 2023-09-21T00:17:13.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.635+0000 7f3007fff700 1 -- 172.21.15.59:0/3027225472 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 710825841 0 0) 0x7f3000001670 con 0x7f3010143ce0 2023-09-21T00:17:13.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.635+0000 7f3007fff700 1 -- 172.21.15.59:0/3027225472 >> v1:172.21.15.59:6789/0 conn(0x7f3010143ce0 legacy=0x7f3010161280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:13.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.635+0000 7f3007fff700 1 --2- 172.21.15.59:0/3027225472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ffc003a70 0x7f2ffc003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:13.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.635+0000 7f3007fff700 1 --2- 172.21.15.59:0/3027225472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ffc004850 0x7f2ffc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:13.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.635+0000 7f3007fff700 1 --2- 172.21.15.59:0/3027225472 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f30100cedb0 0x7f2ffc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:13.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.635+0000 7f3007fff700 1 -- 172.21.15.59:0/3027225472 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3010161990 con 0x7f2ffc004850 2023-09-21T00:17:13.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.635+0000 7f3007fff700 1 -- 172.21.15.59:0/3027225472 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30100cf720 con 0x7f2ffc003a70 2023-09-21T00:17:13.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.635+0000 7f3007fff700 1 -- 172.21.15.59:0/3027225472 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ffc00ba90 con 0x7f30100cedb0 2023-09-21T00:17:13.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.635+0000 7f3014fba700 1 --2- 172.21.15.59:0/3027225472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ffc004850 0x7f2ffc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:13.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.635+0000 7f30157bb700 1 --2- 172.21.15.59:0/3027225472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ffc003a70 0x7f2ffc003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:13.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.636+0000 7f3015fbc700 1 --2- 172.21.15.59:0/3027225472 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f30100cedb0 0x7f2ffc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:13.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.636+0000 7f3014fba700 1 -- 172.21.15.59:0/3027225472 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f30100cedb0 msgr2=0x7f2ffc005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:13.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.636+0000 7f3014fba700 1 --2- 172.21.15.59:0/3027225472 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f30100cedb0 0x7f2ffc005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:13.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.636+0000 7f3014fba700 1 -- 172.21.15.59:0/3027225472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ffc003a70 msgr2=0x7f2ffc003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:13.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.636+0000 7f3014fba700 1 --2- 172.21.15.59:0/3027225472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ffc003a70 0x7f2ffc003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:13.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.636+0000 7f3014fba700 1 -- 172.21.15.59:0/3027225472 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ffc0035b0 con 0x7f2ffc004850 2023-09-21T00:17:13.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.636+0000 7f3014fba700 1 --2- 172.21.15.59:0/3027225472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ffc004850 0x7f2ffc004cd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f30101440f0 tx=0x7f2ffc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52341fa8ef45fcc5 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:13.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.636+0000 7f3007fff700 1 -- 172.21.15.59:0/3027225472 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3000007c60 con 0x7f2ffc004850 2023-09-21T00:17:13.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.636+0000 7f3007fff700 1 -- 172.21.15.59:0/3027225472 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f300000ce50 con 0x7f2ffc004850 2023-09-21T00:17:13.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.636+0000 7f3007fff700 1 -- 172.21.15.59:0/3027225472 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3000005ba0 con 0x7f2ffc004850 2023-09-21T00:17:13.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.637+0000 7f3017a1f700 1 -- 172.21.15.59:0/3027225472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ffc004850 msgr2=0x7f2ffc004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:13.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.637+0000 7f3017a1f700 1 --2- 172.21.15.59:0/3027225472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ffc004850 0x7f2ffc004cd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f30101440f0 tx=0x7f2ffc005880 comp rx=0 tx=0).stop 2023-09-21T00:17:13.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.637+0000 7f3015fbc700 1 -- 172.21.15.59:0/3027225472 reap_dead start 2023-09-21T00:17:13.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.637+0000 7f3017a1f700 1 -- 172.21.15.59:0/3027225472 shutdown_connections 2023-09-21T00:17:13.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.637+0000 7f3017a1f700 1 -- 172.21.15.59:0/3027225472 >> 172.21.15.59:0/3027225472 conn(0x7f30100d11e0 msgr2=0x7f30100d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:13.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.637+0000 7f3017a1f700 1 -- 172.21.15.59:0/3027225472 shutdown_connections 2023-09-21T00:17:13.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.637+0000 7f3017a1f700 1 -- 172.21.15.59:0/3027225472 wait complete. 2023-09-21T00:17:13.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.638+0000 7f3017a1f700 1 Processor -- start 2023-09-21T00:17:13.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.638+0000 7f3017a1f700 1 -- start start 2023-09-21T00:17:13.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.639+0000 7f3017a1f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ffc004850 0x7f3010159060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:13.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.639+0000 7f3017a1f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f30101f74f0 0x7f301015c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:13.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.639+0000 7f3017a1f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30101f68e0 0x7f30101f6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:13.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.639+0000 7f3017a1f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30101f72a0 con 0x7f30101f68e0 2023-09-21T00:17:13.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.639+0000 7f3017a1f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3010159ae0 con 0x7f2ffc004850 2023-09-21T00:17:13.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.639+0000 7f3017a1f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30100c5f90 con 0x7f30101f74f0 2023-09-21T00:17:13.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.639+0000 7f3015fbc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30101f68e0 0x7f30101f6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:13.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.639+0000 7f3015fbc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30101f68e0 0x7f30101f6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51048/0 (socket says 172.21.15.59:51048) 2023-09-21T00:17:13.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.639+0000 7f3015fbc700 1 -- 172.21.15.59:0/1704010472 learned_addr learned my addr 172.21.15.59:0/1704010472 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:13.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.639+0000 7f30157bb700 1 --2- 172.21.15.59:0/1704010472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ffc004850 0x7f3010159060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:13.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.639+0000 7f3014fba700 1 --2- 172.21.15.59:0/1704010472 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f30101f74f0 0x7f301015c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:13.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.639+0000 7f3015fbc700 1 -- 172.21.15.59:0/1704010472 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f30101f74f0 msgr2=0x7f301015c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:13.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.639+0000 7f3015fbc700 1 --2- 172.21.15.59:0/1704010472 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f30101f74f0 0x7f301015c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:13.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.639+0000 7f3015fbc700 1 -- 172.21.15.59:0/1704010472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ffc004850 msgr2=0x7f3010159060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:13.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.639+0000 7f3015fbc700 1 --2- 172.21.15.59:0/1704010472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ffc004850 0x7f3010159060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:13.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.639+0000 7f3015fbc700 1 -- 172.21.15.59:0/1704010472 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f301015a2f0 con 0x7f30101f68e0 2023-09-21T00:17:13.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.639+0000 7f3015fbc700 1 --2- 172.21.15.59:0/1704010472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30101f68e0 0x7f30101f6d60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f301006e300 tx=0x7f3008011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:13.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.639+0000 7f3005ffb700 1 -- 172.21.15.59:0/1704010472 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300800e040 con 0x7f30101f68e0 2023-09-21T00:17:13.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.639+0000 7f3005ffb700 1 -- 172.21.15.59:0/1704010472 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f300800f040 con 0x7f30101f68e0 2023-09-21T00:17:13.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.639+0000 7f3017a1f700 1 -- 172.21.15.59:0/1704010472 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30101595a0 con 0x7f30101f68e0 2023-09-21T00:17:13.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.639+0000 7f3005ffb700 1 -- 172.21.15.59:0/1704010472 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300800fc40 con 0x7f30101f68e0 2023-09-21T00:17:13.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.640+0000 7f3017a1f700 1 -- 172.21.15.59:0/1704010472 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f301015a010 con 0x7f30101f68e0 2023-09-21T00:17:13.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.640+0000 7f3017a1f700 1 -- 172.21.15.59:0/1704010472 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30100c6100 con 0x7f30101f68e0 2023-09-21T00:17:13.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.641+0000 7f3005ffb700 1 -- 172.21.15.59:0/1704010472 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f3008022460 con 0x7f30101f68e0 2023-09-21T00:17:13.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.641+0000 7f3005ffb700 1 --2- 172.21.15.59:0/1704010472 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f2ff406ae00 0x7f2ff406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:13.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.641+0000 7f3005ffb700 1 -- 172.21.15.59:0/1704010472 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3008089c70 con 0x7f30101f68e0 2023-09-21T00:17:13.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.642+0000 7f30157bb700 1 --2- 172.21.15.59:0/1704010472 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f2ff406ae00 0x7f2ff406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:13.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.642+0000 7f30157bb700 1 --2- 172.21.15.59:0/1704010472 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f2ff406ae00 0x7f2ff406d2c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f300c009c60 tx=0x7f300c009210 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:13.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.646+0000 7f3005ffb700 1 -- 172.21.15.59:0/1704010472 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f3008054a00 con 0x7f30101f68e0 2023-09-21T00:17:13.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.846+0000 7f3017a1f700 1 -- 172.21.15.59:0/1704010472 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3010067e50 con 0x7f30101f68e0 2023-09-21T00:17:13.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.847+0000 7f3005ffb700 1 -- 172.21.15.59:0/1704010472 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18262 (secure 0 0 0) 0x7f3008058020 con 0x7f30101f68e0 2023-09-21T00:17:13.848 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:17:13.848 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":24,"fsid":"dd69925c-6e25-42fe-880b-2f60fc6f384b","created":"2023-09-21T00:16:43.074489+0000","modified":"2023-09-21T00:17:11.387529+0000","last_up_change":"2023-09-21T00:16:54.740101+0000","last_in_change":"2023-09-21T00:16:45.987089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T00:16:54.796248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-21T00:17:04.167102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-21T00:17:05.313188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-21T00:17:08.977609+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d4b18344-74c0-4f75-920b-7a9247e48914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6809","nonce":2418314235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6811","nonce":2418314235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6815","nonce":2418314235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6813","nonce":2418314235}]},"public_addr":"172.21.15.59:6809/2418314235","cluster_addr":"172.21.15.59:6811/2418314235","heartbeat_back_addr":"172.21.15.59:6815/2418314235","heartbeat_front_addr":"172.21.15.59:6813/2418314235","state":["exists","up"]},{"osd":1,"uuid":"80940d50-a248-4e64-a282-7ffcdad790ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6801","nonce":869668251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6803","nonce":869668251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6807","nonce":869668251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6805","nonce":869668251}]},"public_addr":"172.21.15.59:6801/869668251","cluster_addr":"172.21.15.59:6803/869668251","heartbeat_back_addr":"172.21.15.59:6807/869668251","heartbeat_front_addr":"172.21.15.59:6805/869668251","state":["exists","up"]},{"osd":2,"uuid":"55f2eceb-c54a-4879-a6ce-968c1c548b5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6817","nonce":372517778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6819","nonce":372517778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6823","nonce":372517778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6821","nonce":372517778}]},"public_addr":"172.21.15.59:6817/372517778","cluster_addr":"172.21.15.59:6819/372517778","heartbeat_back_addr":"172.21.15.59:6823/372517778","heartbeat_front_addr":"172.21.15.59:6821/372517778","state":["exists","up"]},{"osd":3,"uuid":"92b89cd0-869c-49b9-a9f9-97ac8423f304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6825","nonce":575188498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6827","nonce":575188498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6831","nonce":575188498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6829","nonce":575188498}]},"public_addr":"172.21.15.59:6825/575188498","cluster_addr":"172.21.15.59:6827/575188498","heartbeat_back_addr":"172.21.15.59:6831/575188498","heartbeat_front_addr":"172.21.15.59:6829/575188498","state":["exists","up"]},{"osd":4,"uuid":"25b80e94-e0e6-403d-b69f-61542f289637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6803","nonce":1741219098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6805","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6807","nonce":1741219098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6815","nonce":1741219098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6811","nonce":1741219098}]},"public_addr":"172.21.15.83:6803/1741219098","cluster_addr":"172.21.15.83:6807/1741219098","heartbeat_back_addr":"172.21.15.83:6815/1741219098","heartbeat_front_addr":"172.21.15.83:6811/1741219098","state":["exists","up"]},{"osd":5,"uuid":"5498d9ab-1086-4796-a199-9051e6dfea91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6817","nonce":156730565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6819","nonce":156730565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6823","nonce":156730565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6821","nonce":156730565}]},"public_addr":"172.21.15.83:6817/156730565","cluster_addr":"172.21.15.83:6819/156730565","heartbeat_back_addr":"172.21.15.83:6823/156730565","heartbeat_front_addr":"172.21.15.83:6821/156730565","state":["exists","up"]},{"osd":6,"uuid":"cfd810c0-5015-4d60-9a75-7efc93a32e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6801","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6800","nonce":1337723778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6806","nonce":1337723778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6814","nonce":1337723778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6810","nonce":1337723778}]},"public_addr":"172.21.15.83:6800/1337723778","cluster_addr":"172.21.15.83:6806/1337723778","heartbeat_back_addr":"172.21.15.83:6814/1337723778","heartbeat_front_addr":"172.21.15.83:6810/1337723778","state":["exists","up"]},{"osd":7,"uuid":"e992c8fa-0a3d-4b3c-85b5-2c511223dee4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6825","nonce":4204859272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6827","nonce":4204859272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6831","nonce":4204859272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6829","nonce":4204859272}]},"public_addr":"172.21.15.83:6825/4204859272","cluster_addr":"172.21.15.83:6827/4204859272","heartbeat_back_addr":"172.21.15.83:6831/4204859272","heartbeat_front_addr":"172.21.15.83:6829/4204859272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.156498+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.882707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.093978+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.158565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.173933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.888606+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.135525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.149712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T00:17:13.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.849+0000 7f3017a1f700 1 -- 172.21.15.59:0/1704010472 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f2ff406ae00 msgr2=0x7f2ff406d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:13.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.849+0000 7f3017a1f700 1 --2- 172.21.15.59:0/1704010472 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f2ff406ae00 0x7f2ff406d2c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f300c009c60 tx=0x7f300c009210 comp rx=0 tx=0).stop 2023-09-21T00:17:13.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.849+0000 7f3017a1f700 1 -- 172.21.15.59:0/1704010472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30101f68e0 msgr2=0x7f30101f6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:13.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.849+0000 7f3017a1f700 1 --2- 172.21.15.59:0/1704010472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30101f68e0 0x7f30101f6d60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f301006e300 tx=0x7f3008011ed0 comp rx=0 tx=0).stop 2023-09-21T00:17:13.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.849+0000 7f3017a1f700 1 -- 172.21.15.59:0/1704010472 shutdown_connections 2023-09-21T00:17:13.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.849+0000 7f3017a1f700 1 --2- 172.21.15.59:0/1704010472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30101f68e0 0x7f30101f6d60 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:13.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.849+0000 7f3017a1f700 1 --2- 172.21.15.59:0/1704010472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ffc004850 0x7f3010159060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:13.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.849+0000 7f3017a1f700 1 --2- 172.21.15.59:0/1704010472 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f2ff406ae00 0x7f2ff406d2c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:13.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.849+0000 7f3017a1f700 1 --2- 172.21.15.59:0/1704010472 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f30101f74f0 0x7f301015c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:13.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.849+0000 7f3017a1f700 1 -- 172.21.15.59:0/1704010472 >> 172.21.15.59:0/1704010472 conn(0x7f30100d11e0 msgr2=0x7f301006d290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:13.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.849+0000 7f3017a1f700 1 -- 172.21.15.59:0/1704010472 shutdown_connections 2023-09-21T00:17:13.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:13.849+0000 7f3017a1f700 1 -- 172.21.15.59:0/1704010472 wait complete. 2023-09-21T00:17:14.265 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-21T00:17:06.338694+0000', 'modified': '2023-09-21T00:17:11.387692+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4299}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4299': {'gid': 4299, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.83:6837/792952552', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.83:6835', 'nonce': 792952552}, {'type': 'v1', 'addr': '172.21.15.83:6837', 'nonce': 792952552}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-09-21T00:17:14.266 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-21T00:17:14.266 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-09-21T00:17:14.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.395+0000 7ff51386a700 1 Processor -- start 2023-09-21T00:17:14.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.395+0000 7ff51386a700 1 -- start start 2023-09-21T00:17:14.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.396+0000 7ff51386a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff50c0cd420 0x7ff50c0cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:14.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.396+0000 7ff51386a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff50c0ce290 con 0x7ff50c15a1b0 2023-09-21T00:17:14.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.396+0000 7ff51386a700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff50c0ce530 con 0x7ff50c0cb190 2023-09-21T00:17:14.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.396+0000 7ff51386a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c0cdde0 con 0x7ff50c0cd420 2023-09-21T00:17:14.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.396+0000 7ff511606700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff50c15a1b0 0x7ff50c06daf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56620/0 (socket says 172.21.15.59:56620) 2023-09-21T00:17:14.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.396+0000 7ff511606700 1 -- 172.21.15.59:0/2321040567 learned_addr learned my addr 172.21.15.59:0/2321040567 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:14.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.396+0000 7ff510e05700 1 --2- 172.21.15.59:0/2321040567 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff50c0cd420 0x7ff50c0cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:14.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.397+0000 7ff503fff700 1 -- 172.21.15.59:0/2321040567 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3885141697 0 0) 0x7ff50c0ce290 con 0x7ff50c15a1b0 2023-09-21T00:17:14.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.397+0000 7ff503fff700 1 -- 172.21.15.59:0/2321040567 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4f80035b0 con 0x7ff50c15a1b0 2023-09-21T00:17:14.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.397+0000 7ff503fff700 1 -- 172.21.15.59:0/2321040567 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1015572460 0 0) 0x7ff50c0ce530 con 0x7ff50c0cb190 2023-09-21T00:17:14.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.397+0000 7ff503fff700 1 -- 172.21.15.59:0/2321040567 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff50c0ce290 con 0x7ff50c0cb190 2023-09-21T00:17:14.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.397+0000 7ff503fff700 1 -- 172.21.15.59:0/2321040567 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3077252087 0 0) 0x7ff4f80035b0 con 0x7ff50c15a1b0 2023-09-21T00:17:14.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.397+0000 7ff503fff700 1 -- 172.21.15.59:0/2321040567 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff50c0cd420 msgr2=0x7ff50c0cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:14.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.397+0000 7ff503fff700 1 --2- 172.21.15.59:0/2321040567 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff50c0cd420 0x7ff50c0cd8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:14.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.397+0000 7ff503fff700 1 -- 172.21.15.59:0/2321040567 >> v1:172.21.15.83:6789/0 conn(0x7ff50c0cb190 legacy=0x7ff50c0cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:14.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.397+0000 7ff503fff700 1 -- 172.21.15.59:0/2321040567 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff50c0ce810 con 0x7ff50c15a1b0 2023-09-21T00:17:14.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.397+0000 7ff503fff700 1 -- 172.21.15.59:0/2321040567 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 710825841 0 0) 0x7ff4fc001670 con 0x7ff50c15a1b0 2023-09-21T00:17:14.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.397+0000 7ff503fff700 1 -- 172.21.15.59:0/2321040567 >> v1:172.21.15.59:6789/0 conn(0x7ff50c15a1b0 legacy=0x7ff50c06daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:14.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.397+0000 7ff503fff700 1 --2- 172.21.15.59:0/2321040567 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff4f8003bc0 0x7ff4f8003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:14.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.397+0000 7ff503fff700 1 --2- 172.21.15.59:0/2321040567 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff50c0cd420 0x7ff4f8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:14.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.397+0000 7ff503fff700 1 --2- 172.21.15.59:0/2321040567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4f8004d90 0x7ff4f8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:14.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.397+0000 7ff503fff700 1 -- 172.21.15.59:0/2321040567 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c0cdde0 con 0x7ff4f8004d90 2023-09-21T00:17:14.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.397+0000 7ff503fff700 1 -- 172.21.15.59:0/2321040567 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f800bac0 con 0x7ff4f8003bc0 2023-09-21T00:17:14.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.397+0000 7ff503fff700 1 -- 172.21.15.59:0/2321040567 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f800bc30 con 0x7ff50c0cd420 2023-09-21T00:17:14.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.397+0000 7ff511606700 1 --2- 172.21.15.59:0/2321040567 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff4f8003bc0 0x7ff4f8003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:14.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.397+0000 7ff511e07700 1 --2- 172.21.15.59:0/2321040567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4f8004d90 0x7ff4f8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:14.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.397+0000 7ff510e05700 1 --2- 172.21.15.59:0/2321040567 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff50c0cd420 0x7ff4f8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:14.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.397+0000 7ff511e07700 1 -- 172.21.15.59:0/2321040567 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff50c0cd420 msgr2=0x7ff4f8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:14.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.397+0000 7ff511e07700 1 --2- 172.21.15.59:0/2321040567 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff50c0cd420 0x7ff4f8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:14.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.397+0000 7ff511e07700 1 -- 172.21.15.59:0/2321040567 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff4f8003bc0 msgr2=0x7ff4f8003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:14.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.397+0000 7ff511e07700 1 --2- 172.21.15.59:0/2321040567 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff4f8003bc0 0x7ff4f8003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:14.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.397+0000 7ff511e07700 1 -- 172.21.15.59:0/2321040567 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f80035b0 con 0x7ff4f8004d90 2023-09-21T00:17:14.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.397+0000 7ff511606700 1 --2- 172.21.15.59:0/2321040567 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff4f8003bc0 0x7ff4f8003fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T00:17:14.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.397+0000 7ff511e07700 1 --2- 172.21.15.59:0/2321040567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4f8004d90 0x7ff4f8005210 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff50400c2f0 tx=0x7ff4f8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57e2c1c270b5b61 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:14.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.398+0000 7ff503fff700 1 -- 172.21.15.59:0/2321040567 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff504001f30 con 0x7ff4f8004d90 2023-09-21T00:17:14.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.398+0000 7ff503fff700 1 -- 172.21.15.59:0/2321040567 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50400ce90 con 0x7ff4f8004d90 2023-09-21T00:17:14.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.398+0000 7ff503fff700 1 -- 172.21.15.59:0/2321040567 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff504003c40 con 0x7ff4f8004d90 2023-09-21T00:17:14.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.398+0000 7ff51386a700 1 -- 172.21.15.59:0/2321040567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4f8004d90 msgr2=0x7ff4f8005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:14.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.398+0000 7ff51386a700 1 --2- 172.21.15.59:0/2321040567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4f8004d90 0x7ff4f8005210 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff50400c2f0 tx=0x7ff4f8005880 comp rx=0 tx=0).stop 2023-09-21T00:17:14.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.398+0000 7ff511e07700 1 -- 172.21.15.59:0/2321040567 reap_dead start 2023-09-21T00:17:14.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.398+0000 7ff51386a700 1 -- 172.21.15.59:0/2321040567 shutdown_connections 2023-09-21T00:17:14.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.398+0000 7ff51386a700 1 -- 172.21.15.59:0/2321040567 >> 172.21.15.59:0/2321040567 conn(0x7ff50c06a780 msgr2=0x7ff50c06ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:14.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.398+0000 7ff51386a700 1 -- 172.21.15.59:0/2321040567 shutdown_connections 2023-09-21T00:17:14.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.398+0000 7ff51386a700 1 -- 172.21.15.59:0/2321040567 wait complete. 2023-09-21T00:17:14.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.399+0000 7ff51386a700 1 Processor -- start 2023-09-21T00:17:14.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.400+0000 7ff51386a700 1 -- start start 2023-09-21T00:17:14.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.400+0000 7ff51386a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff4f8004d90 0x7ff50c0c92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:14.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.400+0000 7ff51386a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff50c0c6b90 0x7ff50c14fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:14.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.400+0000 7ff51386a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff50c0c7010 0x7ff50c1501e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:14.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.400+0000 7ff51386a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c150720 con 0x7ff50c0c6b90 2023-09-21T00:17:14.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.400+0000 7ff51386a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c15abb0 con 0x7ff4f8004d90 2023-09-21T00:17:14.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.400+0000 7ff51386a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c15ae00 con 0x7ff50c0c7010 2023-09-21T00:17:14.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.400+0000 7ff510e05700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff50c0c6b90 0x7ff50c14fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:14.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.400+0000 7ff510e05700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff50c0c6b90 0x7ff50c14fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51066/0 (socket says 172.21.15.59:51066) 2023-09-21T00:17:14.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.400+0000 7ff510e05700 1 -- 172.21.15.59:0/4031477710 learned_addr learned my addr 172.21.15.59:0/4031477710 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:14.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.401+0000 7ff511606700 1 --2- 172.21.15.59:0/4031477710 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff4f8004d90 0x7ff50c0c92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:14.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.401+0000 7ff511e07700 1 --2- 172.21.15.59:0/4031477710 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff50c0c7010 0x7ff50c1501e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:14.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.401+0000 7ff510e05700 1 -- 172.21.15.59:0/4031477710 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff50c0c7010 msgr2=0x7ff50c1501e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:14.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.401+0000 7ff510e05700 1 --2- 172.21.15.59:0/4031477710 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff50c0c7010 0x7ff50c1501e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:14.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.401+0000 7ff510e05700 1 -- 172.21.15.59:0/4031477710 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff4f8004d90 msgr2=0x7ff50c0c92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:14.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.401+0000 7ff510e05700 1 --2- 172.21.15.59:0/4031477710 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff4f8004d90 0x7ff50c0c92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:14.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.401+0000 7ff510e05700 1 -- 172.21.15.59:0/4031477710 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff50c15b0e0 con 0x7ff50c0c6b90 2023-09-21T00:17:14.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.401+0000 7ff511606700 1 --2- 172.21.15.59:0/4031477710 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff4f8004d90 0x7ff50c0c92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:17:14.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.401+0000 7ff510e05700 1 --2- 172.21.15.59:0/4031477710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff50c0c6b90 0x7ff50c14fca0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff508011aa0 tx=0x7ff508011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:14.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.401+0000 7ff501ffb700 1 -- 172.21.15.59:0/4031477710 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50800f980 con 0x7ff50c0c6b90 2023-09-21T00:17:14.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.401+0000 7ff501ffb700 1 -- 172.21.15.59:0/4031477710 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50800fae0 con 0x7ff50c0c6b90 2023-09-21T00:17:14.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.401+0000 7ff51386a700 1 -- 172.21.15.59:0/4031477710 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff50c15b3c0 con 0x7ff50c0c6b90 2023-09-21T00:17:14.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.401+0000 7ff501ffb700 1 -- 172.21.15.59:0/4031477710 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50800fe90 con 0x7ff50c0c6b90 2023-09-21T00:17:14.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.401+0000 7ff51386a700 1 -- 172.21.15.59:0/4031477710 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff50c15b980 con 0x7ff50c0c6b90 2023-09-21T00:17:14.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.403+0000 7ff501ffb700 1 -- 172.21.15.59:0/4031477710 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7ff50801d400 con 0x7ff50c0c6b90 2023-09-21T00:17:14.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.403+0000 7ff501ffb700 1 --2- 172.21.15.59:0/4031477710 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ff4f006ae00 0x7ff4f006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:14.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.403+0000 7ff501ffb700 1 -- 172.21.15.59:0/4031477710 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff50808a040 con 0x7ff50c0c6b90 2023-09-21T00:17:14.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.404+0000 7ff511606700 1 --2- 172.21.15.59:0/4031477710 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ff4f006ae00 0x7ff4f006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:14.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.404+0000 7ff511606700 1 --2- 172.21.15.59:0/4031477710 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ff4f006ae00 0x7ff4f006d2c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc001eb0 tx=0x7ff4fc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:14.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.405+0000 7ff51fa2eb80 1 Processor -- start 2023-09-21T00:17:14.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.406+0000 7ff51fa2eb80 1 -- start start 2023-09-21T00:17:14.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.406+0000 7ff51fa2eb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc21c54620 0x55cc21c26e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:14.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.406+0000 7ff51fa2eb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc21c66040 0x55cc21c54a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:14.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.406+0000 7ff51fa2eb80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55cc21c507f0 0x55cc21c29fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:14.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.406+0000 7ff51fa2eb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc21b9ec50 con 0x55cc21c66040 2023-09-21T00:17:14.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.406+0000 7ff51fa2eb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc21b82c20 con 0x55cc21c54620 2023-09-21T00:17:14.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.406+0000 7ff51fa2eb80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cc21b80540 con 0x55cc21c507f0 2023-09-21T00:17:14.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.407+0000 7ff510e05700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc21c66040 0x55cc21c54a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:14.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.407+0000 7ff510e05700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc21c66040 0x55cc21c54a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51074/0 (socket says 172.21.15.59:51074) 2023-09-21T00:17:14.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.407+0000 7ff510e05700 1 -- 172.21.15.59:0/1732467613 learned_addr learned my addr 172.21.15.59:0/1732467613 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:14.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.407+0000 7ff511606700 1 --2- 172.21.15.59:0/1732467613 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc21c54620 0x55cc21c26e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:14.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.407+0000 7ff511e07700 1 --2- 172.21.15.59:0/1732467613 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55cc21c507f0 0x55cc21c29fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:14.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.407+0000 7ff510e05700 1 -- 172.21.15.59:0/1732467613 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55cc21c507f0 msgr2=0x55cc21c29fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:14.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.407+0000 7ff510e05700 1 --2- 172.21.15.59:0/1732467613 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55cc21c507f0 0x55cc21c29fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:14.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.407+0000 7ff510e05700 1 -- 172.21.15.59:0/1732467613 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc21c54620 msgr2=0x55cc21c26e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:14.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.407+0000 7ff510e05700 1 --2- 172.21.15.59:0/1732467613 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc21c54620 0x55cc21c26e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:14.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.407+0000 7ff510e05700 1 -- 172.21.15.59:0/1732467613 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc219fa5e0 con 0x55cc21c66040 2023-09-21T00:17:14.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.407+0000 7ff510e05700 1 --2- 172.21.15.59:0/1732467613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc21c66040 0x55cc21c54a00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff508060680 tx=0x7ff508025480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1557a83a866ce7f4 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:14.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.407+0000 7ff4f6ffd700 1 -- 172.21.15.59:0/1732467613 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50805ca00 con 0x55cc21c66040 2023-09-21T00:17:14.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.407+0000 7ff4f6ffd700 1 -- 172.21.15.59:0/1732467613 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff508060bb0 con 0x55cc21c66040 2023-09-21T00:17:14.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.407+0000 7ff4f6ffd700 1 -- 172.21.15.59:0/1732467613 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff508059be0 con 0x55cc21c66040 2023-09-21T00:17:14.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.408+0000 7ff51fa2eb80 1 -- 172.21.15.59:0/1732467613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc21c66040 msgr2=0x55cc21c54a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:14.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.408+0000 7ff51fa2eb80 1 --2- 172.21.15.59:0/1732467613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc21c66040 0x55cc21c54a00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff508060680 tx=0x7ff508025480 comp rx=0 tx=0).stop 2023-09-21T00:17:14.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.408+0000 7ff51fa2eb80 1 -- 172.21.15.59:0/1732467613 shutdown_connections 2023-09-21T00:17:14.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.408+0000 7ff51fa2eb80 1 --2- 172.21.15.59:0/1732467613 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55cc21c507f0 0x55cc21c29fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:14.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.408+0000 7ff51fa2eb80 1 --2- 172.21.15.59:0/1732467613 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc21c54620 0x55cc21c26e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:14.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.408+0000 7ff51fa2eb80 1 --2- 172.21.15.59:0/1732467613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc21c66040 0x55cc21c54a00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:14.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.408+0000 7ff51fa2eb80 1 -- 172.21.15.59:0/1732467613 >> 172.21.15.59:0/1732467613 conn(0x55cc21b56fb0 msgr2=0x55cc21c6f430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:14.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.408+0000 7ff51fa2eb80 1 -- 172.21.15.59:0/1732467613 shutdown_connections 2023-09-21T00:17:14.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.408+0000 7ff51fa2eb80 1 -- 172.21.15.59:0/1732467613 wait complete. 2023-09-21T00:17:14.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.408+0000 7ff51fa2eb80 1 -- start start 2023-09-21T00:17:14.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.409+0000 7ff51fa2eb80 1 Processor -- start 2023-09-21T00:17:14.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.410+0000 7ff51fa2eb80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55cc21c507f0 0x55cc21c4b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:14.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.410+0000 7ff51fa2eb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc21c54620 0x55cc21c72f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:14.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.410+0000 7ff51fa2eb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc21c66040 0x55cc21c235b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:14.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.410+0000 7ff51fa2eb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc21b7be30 con 0x55cc21c54620 2023-09-21T00:17:14.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.410+0000 7ff51fa2eb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc21b186f0 con 0x55cc21c66040 2023-09-21T00:17:14.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.410+0000 7ff51fa2eb80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cc21b18390 con 0x55cc21c507f0 2023-09-21T00:17:14.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.410+0000 7ff51fa2eb80 10 client.0 _ll_register_callbacks cb 0x55cc21a62a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T00:17:14.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.410+0000 7ff510e05700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc21c54620 0x55cc21c72f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:14.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.410+0000 7ff510e05700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc21c54620 0x55cc21c72f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51080/0 (socket says 172.21.15.59:51080) 2023-09-21T00:17:14.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.410+0000 7ff510e05700 1 -- 172.21.15.59:0/719086242 learned_addr learned my addr 172.21.15.59:0/719086242 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:14.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.410+0000 7ff511e07700 1 --2- 172.21.15.59:0/719086242 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc21c66040 0x55cc21c235b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:14.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.410+0000 7ff511606700 1 --2- 172.21.15.59:0/719086242 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55cc21c507f0 0x55cc21c4b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:14.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.410+0000 7ff510e05700 1 -- 172.21.15.59:0/719086242 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55cc21c507f0 msgr2=0x55cc21c4b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:14.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.410+0000 7ff510e05700 1 --2- 172.21.15.59:0/719086242 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55cc21c507f0 0x55cc21c4b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:14.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.410+0000 7ff510e05700 1 -- 172.21.15.59:0/719086242 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc21c66040 msgr2=0x55cc21c235b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:14.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.410+0000 7ff510e05700 1 --2- 172.21.15.59:0/719086242 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc21c66040 0x55cc21c235b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:14.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.410+0000 7ff510e05700 1 -- 172.21.15.59:0/719086242 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff50c15b980 con 0x55cc21c54620 2023-09-21T00:17:14.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.410+0000 7ff510e05700 1 --2- 172.21.15.59:0/719086242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc21c54620 0x55cc21c72f70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff5080882b0 tx=0x7ff508016070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbcbfd73abad73f3 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:14.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.410+0000 7ff4ebfff700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-09-21T00:17:14.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.411+0000 7ff4ebfff700 1 -- 172.21.15.59:0/719086242 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50805ca00 con 0x55cc21c54620 2023-09-21T00:17:14.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.411+0000 7ff4ebfff700 1 -- 172.21.15.59:0/719086242 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff508058e30 con 0x55cc21c54620 2023-09-21T00:17:14.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.411+0000 7ff51fa2eb80 1 -- 172.21.15.59:0/719086242 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cc21b3bb40 con 0x55cc21c54620 2023-09-21T00:17:14.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.411+0000 7ff4ebfff700 1 -- 172.21.15.59:0/719086242 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff508058ff0 con 0x55cc21c54620 2023-09-21T00:17:14.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.411+0000 7ff51fa2eb80 10 client.4428 fetch_fsmap learned FSMap version 6 2023-09-21T00:17:14.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.411+0000 7ff51fa2eb80 1 -- 172.21.15.59:0/719086242 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x55cc219a6d90 con 0x55cc21c54620 2023-09-21T00:17:14.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.411+0000 7ff4ebfff700 1 -- 172.21.15.59:0/719086242 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cc21b3bb40 con 0x55cc21c54620 2023-09-21T00:17:14.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.411+0000 7ff4ebfff700 1 -- 172.21.15.59:0/719086242 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 6) v1 ==== 3302+0+0 (secure 0 0 0) 0x7ff5080580c0 con 0x55cc21c54620 2023-09-21T00:17:14.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.411+0000 7ff51fa2eb80 10 client.4428 fetch_fsmap finished waiting for FSMap version 6 2023-09-21T00:17:14.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.411+0000 7ff51fa2eb80 10 client.4428 resolve_mds: resolved name 'b' to daemon mds.b 2023-09-21T00:17:14.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.411+0000 7ff51fa2eb80 20 client.4428 populate_metadata read hostname 'smithi059' 2023-09-21T00:17:14.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.411+0000 7ff51fa2eb80 1 --2- 172.21.15.59:0/719086242 >> [v2:172.21.15.83:6835/792952552,v1:172.21.15.83:6837/792952552] conn(0x55cc21c7ebe0 0x55cc21c7efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:14.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.411+0000 7ff51fa2eb80 4 client.4428 mds_command: new command op to 4299 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T00:17:14.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.411+0000 7ff51fa2eb80 1 -- 172.21.15.59:0/719086242 --> [v2:172.21.15.83:6835/792952552,v1:172.21.15.83:6837/792952552] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cc21bf9060 con 0x55cc21c7ebe0 2023-09-21T00:17:14.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.411+0000 7ff511606700 1 --2- 172.21.15.59:0/719086242 >> [v2:172.21.15.83:6835/792952552,v1:172.21.15.83:6837/792952552] conn(0x55cc21c7ebe0 0x55cc21c7efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:14.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.412+0000 7ff4ebfff700 10 client.4428 ms_handle_connect on v2:172.21.15.83:6835/792952552 2023-09-21T00:17:14.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.412+0000 7ff511606700 1 --2- 172.21.15.59:0/719086242 >> [v2:172.21.15.83:6835/792952552,v1:172.21.15.83:6837/792952552] conn(0x55cc21c7ebe0 0x55cc21c7efc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c9880a7cdeb878c server_cookie=dceead58ffb619d6 in_seq=0 out_seq=0 2023-09-21T00:17:14.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.412+0000 7ff4ebfff700 1 -- 172.21.15.59:0/719086242 <== mds.0 v2:172.21.15.83:6835/792952552 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55cc21bf9060 con 0x55cc21c7ebe0 2023-09-21T00:17:14.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.412+0000 7ff4ebfff700 10 client.4428 handle_command_reply: tid=0 2023-09-21T00:17:14.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.412+0000 7ff51fa2eb80 1 client.4428 shutdown 2023-09-21T00:17:14.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.412+0000 7ff51fa2eb80 1 -- 172.21.15.59:0/719086242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc21c54620 msgr2=0x55cc21c72f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:14.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.412+0000 7ff51fa2eb80 1 --2- 172.21.15.59:0/719086242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc21c54620 0x55cc21c72f70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff5080882b0 tx=0x7ff508016070 comp rx=0 tx=0).stop 2023-09-21T00:17:14.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.413+0000 7ff51fa2eb80 1 -- 172.21.15.59:0/719086242 shutdown_connections 2023-09-21T00:17:14.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.413+0000 7ff51fa2eb80 1 --2- 172.21.15.59:0/719086242 >> [v2:172.21.15.83:6835/792952552,v1:172.21.15.83:6837/792952552] conn(0x55cc21c7ebe0 0x55cc21c7efc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:14.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.413+0000 7ff51fa2eb80 1 --2- 172.21.15.59:0/719086242 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc21c66040 0x55cc21c235b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:14.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.413+0000 7ff51fa2eb80 1 --2- 172.21.15.59:0/719086242 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55cc21c507f0 0x55cc21c4b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:14.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.413+0000 7ff4ebfff700 0 client.4428 ms_handle_reset on v2:172.21.15.83:6835/792952552 2023-09-21T00:17:14.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.413+0000 7ff51fa2eb80 1 --2- 172.21.15.59:0/719086242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc21c54620 0x55cc21c72f70 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:14.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.413+0000 7ff51fa2eb80 1 -- 172.21.15.59:0/719086242 >> 172.21.15.59:0/719086242 conn(0x55cc21b56fb0 msgr2=0x55cc21c24d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:14.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.413+0000 7ff51fa2eb80 1 -- 172.21.15.59:0/719086242 shutdown_connections 2023-09-21T00:17:14.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.413+0000 7ff51fa2eb80 1 -- 172.21.15.59:0/719086242 wait complete. 2023-09-21T00:17:14.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.413+0000 7ff51fa2eb80 20 client.4428 trim_cache size 0 max 16384 2023-09-21T00:17:14.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.431+0000 7ff51fa2eb80 1 Processor -- start 2023-09-21T00:17:14.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.431+0000 7ff51fa2eb80 1 -- start start 2023-09-21T00:17:14.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.431+0000 7ff51fa2eb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc21c507f0 0x55cc21c7efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:14.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.431+0000 7ff51fa2eb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc21c54620 0x55cc21c7f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:14.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.431+0000 7ff51fa2eb80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55cc21c66040 0x55cc21c50bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:14.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.431+0000 7ff51fa2eb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc219fc8d0 con 0x55cc21c507f0 2023-09-21T00:17:14.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.431+0000 7ff51fa2eb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc21c257d0 con 0x55cc21c54620 2023-09-21T00:17:14.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.431+0000 7ff51fa2eb80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cc21c24b50 con 0x55cc21c66040 2023-09-21T00:17:14.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.431+0000 7ff511606700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc21c507f0 0x55cc21c7efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:14.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.431+0000 7ff511606700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc21c507f0 0x55cc21c7efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51086/0 (socket says 172.21.15.59:51086) 2023-09-21T00:17:14.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.431+0000 7ff511606700 1 -- 172.21.15.59:0/3901591921 learned_addr learned my addr 172.21.15.59:0/3901591921 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:14.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.432+0000 7ff510e05700 1 --2- 172.21.15.59:0/3901591921 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc21c54620 0x55cc21c7f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:14.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.432+0000 7ff511e07700 1 --2- 172.21.15.59:0/3901591921 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55cc21c66040 0x55cc21c50bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:14.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.432+0000 7ff511606700 1 -- 172.21.15.59:0/3901591921 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55cc21c66040 msgr2=0x55cc21c50bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:14.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.432+0000 7ff511606700 1 --2- 172.21.15.59:0/3901591921 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55cc21c66040 0x55cc21c50bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:14.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.432+0000 7ff511606700 1 -- 172.21.15.59:0/3901591921 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc21c54620 msgr2=0x55cc21c7f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:14.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.432+0000 7ff511606700 1 --2- 172.21.15.59:0/3901591921 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc21c54620 0x55cc21c7f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:14.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.432+0000 7ff511606700 1 -- 172.21.15.59:0/3901591921 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc2198fc10 con 0x55cc21c507f0 2023-09-21T00:17:14.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.432+0000 7ff511606700 1 --2- 172.21.15.59:0/3901591921 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc21c507f0 0x55cc21c7efc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x55cc21c4b700 tx=0x7ff4fc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0f9b52b8fe6f782 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:14.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.432+0000 7ff4f77fe700 1 -- 172.21.15.59:0/3901591921 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc028ae0 con 0x55cc21c507f0 2023-09-21T00:17:14.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.432+0000 7ff4f77fe700 1 -- 172.21.15.59:0/3901591921 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4fc028c40 con 0x55cc21c507f0 2023-09-21T00:17:14.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.432+0000 7ff4f77fe700 1 -- 172.21.15.59:0/3901591921 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc0280b0 con 0x55cc21c507f0 2023-09-21T00:17:14.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.433+0000 7ff51fa2eb80 1 -- 172.21.15.59:0/3901591921 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc21c507f0 msgr2=0x55cc21c7efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:14.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.433+0000 7ff51fa2eb80 1 --2- 172.21.15.59:0/3901591921 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc21c507f0 0x55cc21c7efc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x55cc21c4b700 tx=0x7ff4fc013000 comp rx=0 tx=0).stop 2023-09-21T00:17:14.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.433+0000 7ff51fa2eb80 1 -- 172.21.15.59:0/3901591921 shutdown_connections 2023-09-21T00:17:14.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.433+0000 7ff51fa2eb80 1 --2- 172.21.15.59:0/3901591921 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55cc21c66040 0x55cc21c50bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:14.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.433+0000 7ff51fa2eb80 1 --2- 172.21.15.59:0/3901591921 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc21c507f0 0x55cc21c7efc0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:14.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.433+0000 7ff51fa2eb80 1 --2- 172.21.15.59:0/3901591921 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc21c54620 0x55cc21c7f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:14.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.433+0000 7ff51fa2eb80 1 -- 172.21.15.59:0/3901591921 >> 172.21.15.59:0/3901591921 conn(0x55cc21b56fb0 msgr2=0x55cc21c6ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:14.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.433+0000 7ff51fa2eb80 1 -- 172.21.15.59:0/3901591921 shutdown_connections 2023-09-21T00:17:14.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.433+0000 7ff51fa2eb80 1 -- 172.21.15.59:0/3901591921 wait complete. 2023-09-21T00:17:14.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.433+0000 7ff51fa2eb80 1 -- start start 2023-09-21T00:17:14.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.433+0000 7ff51fa2eb80 1 Processor -- start 2023-09-21T00:17:14.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.434+0000 7ff51fa2eb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc21c507f0 0x55cc21c71e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:14.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.434+0000 7ff51fa2eb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc21c54620 0x55cc21cd5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:14.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.434+0000 7ff51fa2eb80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55cc21c66040 0x55cc21c50bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:14.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.434+0000 7ff51fa2eb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc21c6ff70 con 0x55cc21c54620 2023-09-21T00:17:14.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.434+0000 7ff51fa2eb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc21c57ba0 con 0x55cc21c507f0 2023-09-21T00:17:14.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.434+0000 7ff51fa2eb80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cc21cd5c70 con 0x55cc21c66040 2023-09-21T00:17:14.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.434+0000 7ff51fa2eb80 10 client.0 _ll_register_callbacks cb 0x55cc21a62a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T00:17:14.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.434+0000 7ff510e05700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc21c54620 0x55cc21cd5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:14.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.434+0000 7ff510e05700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc21c54620 0x55cc21cd5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51094/0 (socket says 172.21.15.59:51094) 2023-09-21T00:17:14.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.434+0000 7ff510e05700 1 -- 172.21.15.59:0/491956468 learned_addr learned my addr 172.21.15.59:0/491956468 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:14.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.434+0000 7ff511606700 1 --2- 172.21.15.59:0/491956468 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc21c507f0 0x55cc21c71e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:14.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.434+0000 7ff511e07700 1 --2- 172.21.15.59:0/491956468 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55cc21c66040 0x55cc21c50bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:14.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.435+0000 7ff510e05700 1 -- 172.21.15.59:0/491956468 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55cc21c66040 msgr2=0x55cc21c50bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:14.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.435+0000 7ff510e05700 1 --2- 172.21.15.59:0/491956468 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55cc21c66040 0x55cc21c50bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:14.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.435+0000 7ff510e05700 1 -- 172.21.15.59:0/491956468 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc21c507f0 msgr2=0x55cc21c71e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:14.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.435+0000 7ff510e05700 1 --2- 172.21.15.59:0/491956468 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc21c507f0 0x55cc21c71e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:14.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.435+0000 7ff510e05700 1 -- 172.21.15.59:0/491956468 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4fc01a040 con 0x55cc21c54620 2023-09-21T00:17:14.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.435+0000 7ff511e07700 1 --2- 172.21.15.59:0/491956468 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55cc21c66040 0x55cc21c50bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:17:14.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.435+0000 7ff510e05700 1 --2- 172.21.15.59:0/491956468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc21c54620 0x55cc21cd5730 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff5080585e0 tx=0x7ff508058a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0ae0e50c3bc78 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:14.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.435+0000 7ff4ebfff700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-09-21T00:17:14.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.435+0000 7ff4ebfff700 1 -- 172.21.15.59:0/491956468 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50805ca00 con 0x55cc21c54620 2023-09-21T00:17:14.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.435+0000 7ff4ebfff700 1 -- 172.21.15.59:0/491956468 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff508058e30 con 0x55cc21c54620 2023-09-21T00:17:14.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.435+0000 7ff51fa2eb80 1 -- 172.21.15.59:0/491956468 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff508060bb0 con 0x55cc21c54620 2023-09-21T00:17:14.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.435+0000 7ff4ebfff700 1 -- 172.21.15.59:0/491956468 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff508054f10 con 0x55cc21c54620 2023-09-21T00:17:14.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.435+0000 7ff51fa2eb80 10 client.4434 fetch_fsmap learned FSMap version 6 2023-09-21T00:17:14.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.435+0000 7ff51fa2eb80 1 -- 172.21.15.59:0/491956468 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x55cc219cd200 con 0x55cc21c54620 2023-09-21T00:17:14.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.435+0000 7ff4ebfff700 1 -- 172.21.15.59:0/491956468 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff508060bb0 con 0x55cc21c54620 2023-09-21T00:17:14.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.435+0000 7ff4ebfff700 1 -- 172.21.15.59:0/491956468 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 6) v1 ==== 3302+0+0 (secure 0 0 0) 0x7ff508067070 con 0x55cc21c54620 2023-09-21T00:17:14.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.435+0000 7ff51fa2eb80 10 client.4434 fetch_fsmap finished waiting for FSMap version 6 2023-09-21T00:17:14.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.435+0000 7ff51fa2eb80 10 client.4434 resolve_mds: resolved name 'b' to daemon mds.b 2023-09-21T00:17:14.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.435+0000 7ff51fa2eb80 20 client.4434 populate_metadata read hostname 'smithi059' 2023-09-21T00:17:14.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.435+0000 7ff51fa2eb80 1 --2- 172.21.15.59:0/491956468 >> [v2:172.21.15.83:6835/792952552,v1:172.21.15.83:6837/792952552] conn(0x55cc21c29110 0x55cc21c294f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:14.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.435+0000 7ff51fa2eb80 4 client.4434 mds_command: new command op to 4299 tid=0[{"prefix": "status"}] 2023-09-21T00:17:14.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.435+0000 7ff51fa2eb80 1 -- 172.21.15.59:0/491956468 --> [v2:172.21.15.83:6835/792952552,v1:172.21.15.83:6837/792952552] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55cc21b74e10 con 0x55cc21c29110 2023-09-21T00:17:14.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.436+0000 7ff511606700 1 --2- 172.21.15.59:0/491956468 >> [v2:172.21.15.83:6835/792952552,v1:172.21.15.83:6837/792952552] conn(0x55cc21c29110 0x55cc21c294f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:14.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.436+0000 7ff4ebfff700 10 client.4434 ms_handle_connect on v2:172.21.15.83:6835/792952552 2023-09-21T00:17:14.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.436+0000 7ff511606700 1 --2- 172.21.15.59:0/491956468 >> [v2:172.21.15.83:6835/792952552,v1:172.21.15.83:6837/792952552] conn(0x55cc21c29110 0x55cc21c294f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21840e2a436c3bd1 server_cookie=aec7334b74d736cb in_seq=0 out_seq=0 2023-09-21T00:17:14.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.436+0000 7ff4ebfff700 1 -- 172.21.15.59:0/491956468 <== mds.0 v2:172.21.15.83:6835/792952552 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55cc21b74e10 con 0x55cc21c29110 2023-09-21T00:17:14.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.436+0000 7ff4ebfff700 10 client.4434 handle_command_reply: tid=0 2023-09-21T00:17:14.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.436+0000 7ff51fa2eb80 1 client.4434 shutdown 2023-09-21T00:17:14.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.436+0000 7ff51fa2eb80 1 -- 172.21.15.59:0/491956468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc21c54620 msgr2=0x55cc21cd5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:14.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.436+0000 7ff51fa2eb80 1 --2- 172.21.15.59:0/491956468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc21c54620 0x55cc21cd5730 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff5080585e0 tx=0x7ff508058a50 comp rx=0 tx=0).stop 2023-09-21T00:17:14.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.436+0000 7ff51fa2eb80 1 -- 172.21.15.59:0/491956468 shutdown_connections 2023-09-21T00:17:14.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.436+0000 7ff51fa2eb80 1 --2- 172.21.15.59:0/491956468 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55cc21c66040 0x55cc21c50bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:14.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.436+0000 7ff51fa2eb80 1 --2- 172.21.15.59:0/491956468 >> [v2:172.21.15.83:6835/792952552,v1:172.21.15.83:6837/792952552] conn(0x55cc21c29110 0x55cc21c294f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:14.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.436+0000 7ff51fa2eb80 1 --2- 172.21.15.59:0/491956468 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc21c507f0 0x55cc21c71e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:14.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.436+0000 7ff4ebfff700 0 client.4434 ms_handle_reset on v2:172.21.15.83:6835/792952552 2023-09-21T00:17:14.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.436+0000 7ff51fa2eb80 1 --2- 172.21.15.59:0/491956468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc21c54620 0x55cc21cd5730 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:14.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.436+0000 7ff51fa2eb80 1 -- 172.21.15.59:0/491956468 >> 172.21.15.59:0/491956468 conn(0x55cc21b56fb0 msgr2=0x55cc21c2a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:14.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.436+0000 7ff51fa2eb80 1 -- 172.21.15.59:0/491956468 shutdown_connections 2023-09-21T00:17:14.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.436+0000 7ff51fa2eb80 1 -- 172.21.15.59:0/491956468 wait complete. 2023-09-21T00:17:14.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.437+0000 7ff51fa2eb80 20 client.4434 trim_cache size 0 max 16384 2023-09-21T00:17:14.462 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-09-21T00:17:14.462 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "dd69925c-6e25-42fe-880b-2f60fc6f384b", 2023-09-21T00:17:14.462 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 0, 2023-09-21T00:17:14.462 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 4299, 2023-09-21T00:17:14.462 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2023-09-21T00:17:14.463 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2023-09-21T00:17:14.463 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2023-09-21T00:17:14.463 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 7.5041285459999996, 2023-09-21T00:17:14.463 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 6, 2023-09-21T00:17:14.463 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 24, 2023-09-21T00:17:14.464 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 23, 2023-09-21T00:17:14.464 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 12.722150963000001 2023-09-21T00:17:14.464 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-09-21T00:17:14.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.437+0000 7ff51386a700 1 -- 172.21.15.59:0/4031477710 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ff4f006ae00 msgr2=0x7ff4f006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:14.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.437+0000 7ff51386a700 1 --2- 172.21.15.59:0/4031477710 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ff4f006ae00 0x7ff4f006d2c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc001eb0 tx=0x7ff4fc009040 comp rx=0 tx=0).stop 2023-09-21T00:17:14.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.437+0000 7ff51386a700 1 -- 172.21.15.59:0/4031477710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff50c0c6b90 msgr2=0x7ff50c14fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:14.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.437+0000 7ff51386a700 1 --2- 172.21.15.59:0/4031477710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff50c0c6b90 0x7ff50c14fca0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff508011aa0 tx=0x7ff508011e60 comp rx=0 tx=0).stop 2023-09-21T00:17:14.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.437+0000 7ff51386a700 1 -- 172.21.15.59:0/4031477710 shutdown_connections 2023-09-21T00:17:14.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.437+0000 7ff51386a700 1 --2- 172.21.15.59:0/4031477710 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ff4f006ae00 0x7ff4f006d2c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:14.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.437+0000 7ff51386a700 1 --2- 172.21.15.59:0/4031477710 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff50c0c7010 0x7ff50c1501e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:14.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.437+0000 7ff51386a700 1 --2- 172.21.15.59:0/4031477710 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff4f8004d90 0x7ff50c0c92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:14.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.437+0000 7ff51386a700 1 --2- 172.21.15.59:0/4031477710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff50c0c6b90 0x7ff50c14fca0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:14.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.437+0000 7ff51386a700 1 -- 172.21.15.59:0/4031477710 >> 172.21.15.59:0/4031477710 conn(0x7ff50c06a780 msgr2=0x7ff50c156950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:14.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.437+0000 7ff51386a700 1 -- 172.21.15.59:0/4031477710 shutdown_connections 2023-09-21T00:17:14.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.437+0000 7ff51386a700 1 -- 172.21.15.59:0/4031477710 wait complete. 2023-09-21T00:17:14.468 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-09-21T00:17:14.469 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-09-21T00:17:14.469 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-21T00:17:14.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.593+0000 7fd732aba700 1 Processor -- start 2023-09-21T00:17:14.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.593+0000 7fd732aba700 1 -- start start 2023-09-21T00:17:14.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.594+0000 7fd732aba700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd72c15b480 0x7fd72c06f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:14.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.594+0000 7fd732aba700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd72c0d0820 0x7fd72c0701e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:14.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.594+0000 7fd732aba700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd72c070720 0x7fd72c0cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:14.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.594+0000 7fd732aba700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd72c070b70 con 0x7fd72c15b480 2023-09-21T00:17:14.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.594+0000 7fd732aba700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd72c0b4030 con 0x7fd72c0d0820 2023-09-21T00:17:14.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.594+0000 7fd732aba700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd72c0cb8d0 con 0x7fd72c070720 2023-09-21T00:17:14.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.594+0000 7fd730856700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd72c15b480 0x7fd72c06f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:14.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.594+0000 7fd730856700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd72c15b480 0x7fd72c06f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51100/0 (socket says 172.21.15.59:51100) 2023-09-21T00:17:14.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.594+0000 7fd730856700 1 -- 172.21.15.59:0/264173638 learned_addr learned my addr 172.21.15.59:0/264173638 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:14.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.595+0000 7fd72bfff700 1 --2- 172.21.15.59:0/264173638 >> v2:172.21.15.83:3300/0 conn(0x7fd72c0d0820 0x7fd72c0701e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:14.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.595+0000 7fd731057700 1 --2- 172.21.15.59:0/264173638 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd72c070720 0x7fd72c0cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:14.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.595+0000 7fd730856700 1 -- 172.21.15.59:0/264173638 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd72c070720 msgr2=0x7fd72c0cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:14.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.595+0000 7fd730856700 1 --2- 172.21.15.59:0/264173638 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd72c070720 0x7fd72c0cedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:14.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.595+0000 7fd730856700 1 -- 172.21.15.59:0/264173638 >> v2:172.21.15.83:3300/0 conn(0x7fd72c0d0820 msgr2=0x7fd72c0701e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:14.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.595+0000 7fd730856700 1 --2- 172.21.15.59:0/264173638 >> v2:172.21.15.83:3300/0 conn(0x7fd72c0d0820 0x7fd72c0701e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:14.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.595+0000 7fd730856700 1 -- 172.21.15.59:0/264173638 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd72c0cbb40 con 0x7fd72c15b480 2023-09-21T00:17:14.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.595+0000 7fd731057700 1 --2- 172.21.15.59:0/264173638 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd72c070720 0x7fd72c0cedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:17:14.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.595+0000 7fd730856700 1 --2- 172.21.15.59:0/264173638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd72c15b480 0x7fd72c06f400 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd72c06e300 tx=0x7fd720009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a174a3c75b88df53 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:14.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.595+0000 7fd72b7fe700 1 -- 172.21.15.59:0/264173638 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72000b870 con 0x7fd72c15b480 2023-09-21T00:17:14.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.595+0000 7fd72b7fe700 1 -- 172.21.15.59:0/264173638 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd72000b9d0 con 0x7fd72c15b480 2023-09-21T00:17:14.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.595+0000 7fd72b7fe700 1 -- 172.21.15.59:0/264173638 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72000bd60 con 0x7fd72c15b480 2023-09-21T00:17:14.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.596+0000 7fd732aba700 1 -- 172.21.15.59:0/264173638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd72c15b480 msgr2=0x7fd72c06f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:14.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.596+0000 7fd732aba700 1 --2- 172.21.15.59:0/264173638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd72c15b480 0x7fd72c06f400 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd72c06e300 tx=0x7fd720009bd0 comp rx=0 tx=0).stop 2023-09-21T00:17:14.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.596+0000 7fd732aba700 1 -- 172.21.15.59:0/264173638 shutdown_connections 2023-09-21T00:17:14.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.596+0000 7fd732aba700 1 --2- 172.21.15.59:0/264173638 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd72c070720 0x7fd72c0cedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:14.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.596+0000 7fd732aba700 1 --2- 172.21.15.59:0/264173638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd72c15b480 0x7fd72c06f400 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:14.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.596+0000 7fd732aba700 1 --2- 172.21.15.59:0/264173638 >> v2:172.21.15.83:3300/0 conn(0x7fd72c0d0820 0x7fd72c0701e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:14.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.596+0000 7fd732aba700 1 -- 172.21.15.59:0/264173638 >> 172.21.15.59:0/264173638 conn(0x7fd72c0d11e0 msgr2=0x7fd72c0d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:14.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.596+0000 7fd732aba700 1 -- 172.21.15.59:0/264173638 shutdown_connections 2023-09-21T00:17:14.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.596+0000 7fd732aba700 1 -- 172.21.15.59:0/264173638 wait complete. 2023-09-21T00:17:14.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.597+0000 7fd732aba700 1 Processor -- start 2023-09-21T00:17:14.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.597+0000 7fd732aba700 1 -- start start 2023-09-21T00:17:14.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.598+0000 7fd732aba700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd72c070720 0x7fd72c14d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:14.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.598+0000 7fd732aba700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd72c0d0820 0x7fd72c14e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:14.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.598+0000 7fd732aba700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd72c15b480 0x7fd72c06cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:14.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.598+0000 7fd732aba700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd72c0c8aa0 con 0x7fd72c070720 2023-09-21T00:17:14.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.598+0000 7fd732aba700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd72c150ee0 con 0x7fd72c0d0820 2023-09-21T00:17:14.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.598+0000 7fd732aba700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd72c06d6c0 con 0x7fd72c15b480 2023-09-21T00:17:14.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.598+0000 7fd730856700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd72c070720 0x7fd72c14d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:14.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.598+0000 7fd730856700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd72c070720 0x7fd72c14d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51106/0 (socket says 172.21.15.59:51106) 2023-09-21T00:17:14.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.598+0000 7fd730856700 1 -- 172.21.15.59:0/2744375802 learned_addr learned my addr 172.21.15.59:0/2744375802 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:14.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.598+0000 7fd72bfff700 1 --2- 172.21.15.59:0/2744375802 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd72c0d0820 0x7fd72c14e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:14.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.598+0000 7fd731057700 1 --2- 172.21.15.59:0/2744375802 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd72c15b480 0x7fd72c06cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:14.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.598+0000 7fd730856700 1 -- 172.21.15.59:0/2744375802 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd72c15b480 msgr2=0x7fd72c06cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:14.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.598+0000 7fd730856700 1 --2- 172.21.15.59:0/2744375802 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd72c15b480 0x7fd72c06cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:14.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.598+0000 7fd730856700 1 -- 172.21.15.59:0/2744375802 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd72c0d0820 msgr2=0x7fd72c14e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:14.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.598+0000 7fd730856700 1 --2- 172.21.15.59:0/2744375802 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd72c0d0820 0x7fd72c14e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:14.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.598+0000 7fd730856700 1 -- 172.21.15.59:0/2744375802 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd720009550 con 0x7fd72c070720 2023-09-21T00:17:14.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.598+0000 7fd731057700 1 --2- 172.21.15.59:0/2744375802 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd72c15b480 0x7fd72c06cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:17:14.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.598+0000 7fd730856700 1 --2- 172.21.15.59:0/2744375802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd72c070720 0x7fd72c14d510 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd720000c00 tx=0x7fd720004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:14.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.598+0000 7fd7297fa700 1 -- 172.21.15.59:0/2744375802 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd720004520 con 0x7fd72c070720 2023-09-21T00:17:14.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.599+0000 7fd7297fa700 1 -- 172.21.15.59:0/2744375802 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd72001e070 con 0x7fd72c070720 2023-09-21T00:17:14.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.599+0000 7fd732aba700 1 -- 172.21.15.59:0/2744375802 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd72c0c8450 con 0x7fd72c070720 2023-09-21T00:17:14.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.599+0000 7fd7297fa700 1 -- 172.21.15.59:0/2744375802 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7200038c0 con 0x7fd72c070720 2023-09-21T00:17:14.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.599+0000 7fd732aba700 1 -- 172.21.15.59:0/2744375802 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd72c14da50 con 0x7fd72c070720 2023-09-21T00:17:14.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.600+0000 7fd732aba700 1 -- 172.21.15.59:0/2744375802 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd72c0c8290 con 0x7fd72c070720 2023-09-21T00:17:14.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.600+0000 7fd7297fa700 1 -- 172.21.15.59:0/2744375802 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fd720003a20 con 0x7fd72c070720 2023-09-21T00:17:14.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.601+0000 7fd7297fa700 1 --2- 172.21.15.59:0/2744375802 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd71006ae00 0x7fd71006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:14.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.601+0000 7fd7297fa700 1 -- 172.21.15.59:0/2744375802 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd720020070 con 0x7fd72c070720 2023-09-21T00:17:14.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.601+0000 7fd72bfff700 1 --2- 172.21.15.59:0/2744375802 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd71006ae00 0x7fd71006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:14.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.601+0000 7fd72bfff700 1 --2- 172.21.15.59:0/2744375802 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd71006ae00 0x7fd71006d2c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd72c1f5bf0 tx=0x7fd718008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:14.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.605+0000 7fd7297fa700 1 -- 172.21.15.59:0/2744375802 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fd720055bf0 con 0x7fd72c070720 2023-09-21T00:17:14.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.848+0000 7fd732aba700 1 -- 172.21.15.59:0/2744375802 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd72c067e50 con 0x7fd72c070720 2023-09-21T00:17:14.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.848+0000 7fd7297fa700 1 -- 172.21.15.59:0/2744375802 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+88 (secure 0 0 0) 0x7fd720015020 con 0x7fd72c070720 2023-09-21T00:17:14.850 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-09-21T00:17:14.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.851+0000 7fd732aba700 1 -- 172.21.15.59:0/2744375802 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd71006ae00 msgr2=0x7fd71006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:14.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.851+0000 7fd732aba700 1 --2- 172.21.15.59:0/2744375802 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd71006ae00 0x7fd71006d2c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd72c1f5bf0 tx=0x7fd718008040 comp rx=0 tx=0).stop 2023-09-21T00:17:14.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.851+0000 7fd732aba700 1 -- 172.21.15.59:0/2744375802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd72c070720 msgr2=0x7fd72c14d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:14.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.851+0000 7fd732aba700 1 --2- 172.21.15.59:0/2744375802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd72c070720 0x7fd72c14d510 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd720000c00 tx=0x7fd720004750 comp rx=0 tx=0).stop 2023-09-21T00:17:14.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.851+0000 7fd732aba700 1 -- 172.21.15.59:0/2744375802 shutdown_connections 2023-09-21T00:17:14.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.851+0000 7fd732aba700 1 --2- 172.21.15.59:0/2744375802 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd71006ae00 0x7fd71006d2c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:14.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.851+0000 7fd732aba700 1 --2- 172.21.15.59:0/2744375802 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd72c15b480 0x7fd72c06cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:14.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.851+0000 7fd732aba700 1 --2- 172.21.15.59:0/2744375802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd72c070720 0x7fd72c14d510 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:14.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.851+0000 7fd732aba700 1 --2- 172.21.15.59:0/2744375802 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd72c0d0820 0x7fd72c14e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:14.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.851+0000 7fd732aba700 1 -- 172.21.15.59:0/2744375802 >> 172.21.15.59:0/2744375802 conn(0x7fd72c0d11e0 msgr2=0x7fd72c0cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:14.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.851+0000 7fd732aba700 1 -- 172.21.15.59:0/2744375802 shutdown_connections 2023-09-21T00:17:14.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:14.851+0000 7fd732aba700 1 -- 172.21.15.59:0/2744375802 wait complete. 2023-09-21T00:17:14.864 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-21T00:17:14.864 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-21T00:17:14.864 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2023-09-21T00:17:14.865 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-09-21T00:17:14.865 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-09-21T00:17:14.865 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-21T00:17:14.866 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-21T00:17:14.866 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-21T00:17:14.866 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-09-21T00:17:14.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:14.867 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2023-09-21T00:17:14.884 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-21T00:17:14.884 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-21T00:17:14.884 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2023-09-21T00:17:14.885 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-09-21T00:17:14.885 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2023-09-21T00:17:14.885 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-09-21T00:17:14.885 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-21T00:17:14.885 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2023-09-21T00:17:14.885 INFO:teuthology.orchestra.run.smithi059.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-21T00:17:14.886 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2023-09-21T00:17:14.886 INFO:teuthology.orchestra.run.smithi059.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-21T00:17:14.886 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2023-09-21T00:17:14.886 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-09-21T00:17:14.886 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 42405sec preferred_lft 42405sec 2023-09-21T00:17:14.887 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2023-09-21T00:17:14.887 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-09-21T00:17:14.887 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-21T00:17:14.887 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2023-09-21T00:17:14.888 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-09-21T00:17:14.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:14.889 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-09-21T00:17:14.889 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-09-21T00:17:14.889 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link add name ceph-brx type bridge 2023-09-21T00:17:14.889 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip addr flush dev ceph-brx 2023-09-21T00:17:14.890 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set ceph-brx up 2023-09-21T00:17:14.890 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-09-21T00:17:14.890 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-09-21T00:17:15.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:15.083 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-21T00:17:15.112 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-09-21T00:17:15.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:15.114 DEBUG:teuthology.orchestra.run.smithi059:> route 2023-09-21T00:17:15.185 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2023-09-21T00:17:15.185 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-21T00:17:15.186 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-09-21T00:17:15.186 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-09-21T00:17:15.186 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-21T00:17:15.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:15.188 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-09-21T00:17:15.189 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-09-21T00:17:15.189 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-09-21T00:17:15.189 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-09-21T00:17:15.190 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-09-21T00:17:15.190 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-09-21T00:17:15.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:15.471 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2023-09-21T00:17:15.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:15.489 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list-id 2023-09-21T00:17:15.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:15.546 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-09-21T00:17:15.547 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-09-21T00:17:15.547 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-09-21T00:17:15.548 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-09-21T00:17:15.548 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-09-21T00:17:15.642 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-09-21T00:17:15.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:15.643 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-09-21T00:17:15.643 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-09-21T00:17:15.643 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-09-21T00:17:15.644 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-09-21T00:17:15.644 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-09-21T00:17:15.644 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-09-21T00:17:15.645 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-09-21T00:17:15.645 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-09-21T00:17:15.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:15.882 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-09-21T00:17:15.883 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-09-21T00:17:15.883 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2023-09-21T00:17:15.883 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set dev brx.0 master ceph-brx 2023-09-21T00:17:15.884 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-09-21T00:17:15.986 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-09-21T00:17:15.987 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-21T00:17:15.987 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-09-21T00:17:16.010 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-09-21T00:17:16.010 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-21T00:17:16.011 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-09-21T00:17:16.066 DEBUG:teuthology.orchestra.run.smithi059:> sudo modprobe fuse 2023-09-21T00:17:16.134 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-09-21T00:17:16.135 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-09-21T00:17:16.201 INFO:teuthology.orchestra.run.smithi059.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-09-21T00:17:16.202 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-09-21T00:17:16.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:16.203 DEBUG:teuthology.orchestra.run.smithi059:> ls /sys/fs/fuse/connections 2023-09-21T00:17:16.259 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-09-21T00:17:16.260 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-09-21T00:17:16.302 DEBUG:teuthology.orchestra.run.smithi059:> sudo modprobe fuse 2023-09-21T00:17:16.329 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-09-21T00:17:16.330 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-09-21T00:17:16.396 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi059.stderr:2023-09-21T00:17:16.395+0000 7f5b332855c0 -1 init, newargv = 0x55a682e05be0 newargc=15 2023-09-21T00:17:16.397 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi059.stderr:ceph-fuse[110770]: starting ceph client 2023-09-21T00:17:16.397 INFO:teuthology.orchestra.run.smithi059.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-09-21T00:17:16.398 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-09-21T00:17:16.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:16.399 DEBUG:teuthology.orchestra.run.smithi059:> ls /sys/fs/fuse/connections 2023-09-21T00:17:16.403 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi059.stderr:ceph-fuse[110770]: starting fuse 2023-09-21T00:17:16.419 INFO:teuthology.orchestra.run.smithi059.stdout:47 2023-09-21T00:17:16.420 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-09-21T00:17:16.420 DEBUG:teuthology.orchestra.run.smithi059:> sudo stdin-killer -- python3 -c ' 2023-09-21T00:17:16.421 DEBUG:teuthology.orchestra.run.smithi059:> import glob 2023-09-21T00:17:16.421 DEBUG:teuthology.orchestra.run.smithi059:> import re 2023-09-21T00:17:16.421 DEBUG:teuthology.orchestra.run.smithi059:> import os 2023-09-21T00:17:16.422 DEBUG:teuthology.orchestra.run.smithi059:> import subprocess 2023-09-21T00:17:16.422 DEBUG:teuthology.orchestra.run.smithi059:> 2023-09-21T00:17:16.422 DEBUG:teuthology.orchestra.run.smithi059:> def _find_admin_socket(client_name): 2023-09-21T00:17:16.423 DEBUG:teuthology.orchestra.run.smithi059:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-09-21T00:17:16.423 DEBUG:teuthology.orchestra.run.smithi059:> files = glob.glob(asok_path) 2023-09-21T00:17:16.423 DEBUG:teuthology.orchestra.run.smithi059:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-09-21T00:17:16.424 DEBUG:teuthology.orchestra.run.smithi059:> 2023-09-21T00:17:16.424 DEBUG:teuthology.orchestra.run.smithi059:> # Given a non-glob path, it better be there 2023-09-21T00:17:16.424 DEBUG:teuthology.orchestra.run.smithi059:> if "*" not in asok_path: 2023-09-21T00:17:16.425 DEBUG:teuthology.orchestra.run.smithi059:> assert(len(files) == 1) 2023-09-21T00:17:16.425 DEBUG:teuthology.orchestra.run.smithi059:> return files[0] 2023-09-21T00:17:16.426 DEBUG:teuthology.orchestra.run.smithi059:> 2023-09-21T00:17:16.426 DEBUG:teuthology.orchestra.run.smithi059:> for f in files: 2023-09-21T00:17:16.426 DEBUG:teuthology.orchestra.run.smithi059:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-09-21T00:17:16.427 DEBUG:teuthology.orchestra.run.smithi059:> if os.path.exists("/proc/{0}".format(pid)): 2023-09-21T00:17:16.427 DEBUG:teuthology.orchestra.run.smithi059:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-09-21T00:17:16.427 DEBUG:teuthology.orchestra.run.smithi059:> contents = proc_f.read() 2023-09-21T00:17:16.428 DEBUG:teuthology.orchestra.run.smithi059:> if mountpoint in contents: 2023-09-21T00:17:16.428 DEBUG:teuthology.orchestra.run.smithi059:> return f 2023-09-21T00:17:16.429 DEBUG:teuthology.orchestra.run.smithi059:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-09-21T00:17:16.429 DEBUG:teuthology.orchestra.run.smithi059:> 2023-09-21T00:17:16.429 DEBUG:teuthology.orchestra.run.smithi059:> print(_find_admin_socket("client.admin")) 2023-09-21T00:17:16.430 DEBUG:teuthology.orchestra.run.smithi059:> ' 2023-09-21T00:17:16.545 INFO:teuthology.orchestra.run.smithi059.stdout:/var/run/ceph/ceph-client.admin.110770.asok 2023-09-21T00:17:16.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-21T00:17:16.555 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.110770.asok 2023-09-21T00:17:16.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:16.556 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.110770.asok status 2023-09-21T00:17:16.715 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-09-21T00:17:16.716 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": { 2023-09-21T00:17:16.716 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_sha1": "bf8a061ff16ac1d393cf108f740d92dfa49f2e54", 2023-09-21T00:17:16.716 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_version": "ceph version 18.0.0-6213-gbf8a061f (bf8a061ff16ac1d393cf108f740d92dfa49f2e54) reef (dev)", 2023-09-21T00:17:16.716 INFO:teuthology.orchestra.run.smithi059.stdout: "entity_id": "admin", 2023-09-21T00:17:16.717 INFO:teuthology.orchestra.run.smithi059.stdout: "hostname": "smithi059", 2023-09-21T00:17:16.717 INFO:teuthology.orchestra.run.smithi059.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-09-21T00:17:16.717 INFO:teuthology.orchestra.run.smithi059.stdout: "pid": "110770", 2023-09-21T00:17:16.717 INFO:teuthology.orchestra.run.smithi059.stdout: "root": "/" 2023-09-21T00:17:16.717 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-21T00:17:16.717 INFO:teuthology.orchestra.run.smithi059.stdout: "dentry_count": 0, 2023-09-21T00:17:16.718 INFO:teuthology.orchestra.run.smithi059.stdout: "dentry_pinned_count": 0, 2023-09-21T00:17:16.718 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 4446, 2023-09-21T00:17:16.718 INFO:teuthology.orchestra.run.smithi059.stdout: "inst": { 2023-09-21T00:17:16.718 INFO:teuthology.orchestra.run.smithi059.stdout: "name": { 2023-09-21T00:17:16.718 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "client", 2023-09-21T00:17:16.719 INFO:teuthology.orchestra.run.smithi059.stdout: "num": 4446 2023-09-21T00:17:16.719 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-21T00:17:16.719 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": { 2023-09-21T00:17:16.719 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2023-09-21T00:17:16.719 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "192.168.0.1:0", 2023-09-21T00:17:16.720 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1761303976 2023-09-21T00:17:16.720 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-21T00:17:16.720 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-21T00:17:16.720 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": { 2023-09-21T00:17:16.721 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2023-09-21T00:17:16.721 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "192.168.0.1:0", 2023-09-21T00:17:16.721 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1761303976 2023-09-21T00:17:16.721 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-21T00:17:16.721 INFO:teuthology.orchestra.run.smithi059.stdout: "inst_str": "client.4446 192.168.0.1:0/1761303976", 2023-09-21T00:17:16.722 INFO:teuthology.orchestra.run.smithi059.stdout: "addr_str": "192.168.0.1:0/1761303976", 2023-09-21T00:17:16.722 INFO:teuthology.orchestra.run.smithi059.stdout: "inode_count": 1, 2023-09-21T00:17:16.722 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_epoch": 6, 2023-09-21T00:17:16.722 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_epoch": 24, 2023-09-21T00:17:16.722 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_epoch_barrier": 0, 2023-09-21T00:17:16.723 INFO:teuthology.orchestra.run.smithi059.stdout: "blocklisted": false, 2023-09-21T00:17:16.723 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs" 2023-09-21T00:17:16.723 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-09-21T00:17:16.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:16.726 DEBUG:teuthology.orchestra.run.smithi059:> stat --file-system '--printf=%T 2023-09-21T00:17:16.726 DEBUG:teuthology.orchestra.run.smithi059:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-09-21T00:17:16.744 INFO:teuthology.orchestra.run.smithi059.stdout:fuseblk 2023-09-21T00:17:16.744 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-09-21T00:17:16.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:16.745 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-09-21T00:17:16.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:16.812 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-09-21T00:17:16.988 INFO:teuthology.orchestra.run.smithi059.stdout:# file: . 2023-09-21T00:17:16.988 INFO:teuthology.orchestra.run.smithi059.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-09-21T00:17:16.989 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:17:16.989 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-21T00:17:16.989 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-21T00:17:17.007 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T00:17:17.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.171+0000 7f12c19c5700 1 Processor -- start 2023-09-21T00:17:17.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.172+0000 7f12c19c5700 1 -- start start 2023-09-21T00:17:17.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.172+0000 7f12c19c5700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f12bc0c9870 0x7f12bc06c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:17.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.172+0000 7f12c19c5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f12bc0cc530 0x7f12bc06cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:17.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.172+0000 7f12c19c5700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12bc15e2f0 con 0x7f12bc159a80 2023-09-21T00:17:17.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.172+0000 7f12c19c5700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12bc0cb060 con 0x7f12bc0c9870 2023-09-21T00:17:17.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.172+0000 7f12c19c5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc070fe0 con 0x7f12bc0cc530 2023-09-21T00:17:17.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.173+0000 7f12bb7fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f12bc0cc530 0x7f12bc06cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:17.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.173+0000 7f12ba7fc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f12bc0c9870 0x7f12bc06c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:17.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.173+0000 7f12ba7fc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f12bc0c9870 0x7f12bc06c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.59:37246/0 (socket says 172.21.15.59:37246) 2023-09-21T00:17:17.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.173+0000 7f12ba7fc700 1 -- 172.21.15.59:0/256002397 learned_addr learned my addr 172.21.15.59:0/256002397 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:17.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.173+0000 7f12bb7fe700 1 -- 172.21.15.59:0/256002397 >> v2:172.21.15.83:3300/0 conn(0x7f12bc0c9870 msgr2=0x7f12bc06c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:17.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.173+0000 7f12bb7fe700 1 --2- 172.21.15.59:0/256002397 >> v2:172.21.15.83:3300/0 conn(0x7f12bc0c9870 0x7f12bc06c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:17.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.173+0000 7f12bb7fe700 1 -- 172.21.15.59:0/256002397 >> v1:172.21.15.83:6789/0 conn(0x7f12bc159a80 legacy=0x7f12bc071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:17.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.173+0000 7f12bb7fe700 1 -- 172.21.15.59:0/256002397 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12bc0712c0 con 0x7f12bc0cc530 2023-09-21T00:17:17.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.173+0000 7f12ba7fc700 1 --2- 172.21.15.59:0/256002397 >> v2:172.21.15.83:3300/0 conn(0x7f12bc0c9870 0x7f12bc06c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T00:17:17.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.173+0000 7f12b9ffb700 1 -- 172.21.15.59:0/256002397 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3258824863 0 0) 0x7f12bc15e2f0 con 0x7f12bc159a80 2023-09-21T00:17:17.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.173+0000 7f12bb7fe700 1 --2- 172.21.15.59:0/256002397 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f12bc0cc530 0x7f12bc06cb90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f12b4009d90 tx=0x7f12b400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f1d347d304e28d1 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:17.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.173+0000 7f12b9ffb700 1 -- 172.21.15.59:0/256002397 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b400e070 con 0x7f12bc0cc530 2023-09-21T00:17:17.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.173+0000 7f12b9ffb700 1 -- 172.21.15.59:0/256002397 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b400bb20 con 0x7f12bc0cc530 2023-09-21T00:17:17.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.173+0000 7f12b9ffb700 1 -- 172.21.15.59:0/256002397 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b4012430 con 0x7f12bc0cc530 2023-09-21T00:17:17.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.174+0000 7f12c19c5700 1 -- 172.21.15.59:0/256002397 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f12bc0cc530 msgr2=0x7f12bc06cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:17.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.174+0000 7f12c19c5700 1 --2- 172.21.15.59:0/256002397 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f12bc0cc530 0x7f12bc06cb90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f12b4009d90 tx=0x7f12b400b330 comp rx=0 tx=0).stop 2023-09-21T00:17:17.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.174+0000 7f12c19c5700 1 -- 172.21.15.59:0/256002397 shutdown_connections 2023-09-21T00:17:17.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.174+0000 7f12c19c5700 1 --2- 172.21.15.59:0/256002397 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f12bc0cc530 0x7f12bc06cb90 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:17.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.174+0000 7f12c19c5700 1 --2- 172.21.15.59:0/256002397 >> v2:172.21.15.83:3300/0 conn(0x7f12bc0c9870 0x7f12bc06c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:17.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.174+0000 7f12c19c5700 1 -- 172.21.15.59:0/256002397 >> 172.21.15.59:0/256002397 conn(0x7f12bc0b0d70 msgr2=0x7f12bc0b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:17.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.174+0000 7f12c19c5700 1 -- 172.21.15.59:0/256002397 shutdown_connections 2023-09-21T00:17:17.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.174+0000 7f12c19c5700 1 -- 172.21.15.59:0/256002397 wait complete. 2023-09-21T00:17:17.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.175+0000 7f12c19c5700 1 Processor -- start 2023-09-21T00:17:17.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.175+0000 7f12c19c5700 1 -- start start 2023-09-21T00:17:17.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.176+0000 7f12c19c5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f12bc0c9870 0x7f12bc0adf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:17.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.176+0000 7f12c19c5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f12bc0cc530 0x7f12bc1585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:17.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.176+0000 7f12c19c5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12bc159a80 0x7f12bc158ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:17.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.176+0000 7f12c19c5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc0c91d0 con 0x7f12bc159a80 2023-09-21T00:17:17.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.176+0000 7f12c19c5700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc0c85c0 con 0x7f12bc0c9870 2023-09-21T00:17:17.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.176+0000 7f12c19c5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc0c88a0 con 0x7f12bc0cc530 2023-09-21T00:17:17.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.176+0000 7f12bb7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12bc159a80 0x7f12bc158ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:17.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.176+0000 7f12bb7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12bc159a80 0x7f12bc158ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51138/0 (socket says 172.21.15.59:51138) 2023-09-21T00:17:17.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.176+0000 7f12bb7fe700 1 -- 172.21.15.59:0/2339492960 learned_addr learned my addr 172.21.15.59:0/2339492960 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:17.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.176+0000 7f12ba7fc700 1 --2- 172.21.15.59:0/2339492960 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f12bc0cc530 0x7f12bc1585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:17.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.176+0000 7f12baffd700 1 --2- 172.21.15.59:0/2339492960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f12bc0c9870 0x7f12bc0adf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:17.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.177+0000 7f12bb7fe700 1 -- 172.21.15.59:0/2339492960 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f12bc0cc530 msgr2=0x7f12bc1585a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:17.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.177+0000 7f12bb7fe700 1 --2- 172.21.15.59:0/2339492960 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f12bc0cc530 0x7f12bc1585a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:17.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.177+0000 7f12bb7fe700 1 -- 172.21.15.59:0/2339492960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f12bc0c9870 msgr2=0x7f12bc0adf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:17.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.177+0000 7f12bb7fe700 1 --2- 172.21.15.59:0/2339492960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f12bc0c9870 0x7f12bc0adf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:17.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.177+0000 7f12bb7fe700 1 -- 172.21.15.59:0/2339492960 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ac00a6f0 con 0x7f12bc159a80 2023-09-21T00:17:17.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.177+0000 7f12bb7fe700 1 --2- 172.21.15.59:0/2339492960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12bc159a80 0x7f12bc158ae0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f12bc06e070 tx=0x7f12b4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:17.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.177+0000 7f12a3fff700 1 -- 172.21.15.59:0/2339492960 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b4012430 con 0x7f12bc159a80 2023-09-21T00:17:17.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.177+0000 7f12a3fff700 1 -- 172.21.15.59:0/2339492960 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b4020070 con 0x7f12bc159a80 2023-09-21T00:17:17.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.177+0000 7f12c19c5700 1 -- 172.21.15.59:0/2339492960 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12b4009a70 con 0x7f12bc159a80 2023-09-21T00:17:17.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.177+0000 7f12a3fff700 1 -- 172.21.15.59:0/2339492960 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b4004280 con 0x7f12bc159a80 2023-09-21T00:17:17.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.177+0000 7f12c19c5700 1 -- 172.21.15.59:0/2339492960 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12bc0c8e60 con 0x7f12bc159a80 2023-09-21T00:17:17.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.178+0000 7f12c19c5700 1 -- 172.21.15.59:0/2339492960 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12bc0c9020 con 0x7f12bc159a80 2023-09-21T00:17:17.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.179+0000 7f12a3fff700 1 -- 172.21.15.59:0/2339492960 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f12b40043e0 con 0x7f12bc159a80 2023-09-21T00:17:17.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.179+0000 7f12a3fff700 1 --2- 172.21.15.59:0/2339492960 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f12a806ae00 0x7f12a806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:17.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.179+0000 7f12a3fff700 1 -- 172.21.15.59:0/2339492960 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f12b4022070 con 0x7f12bc159a80 2023-09-21T00:17:17.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.179+0000 7f12baffd700 1 --2- 172.21.15.59:0/2339492960 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f12a806ae00 0x7f12a806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:17.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.180+0000 7f12baffd700 1 --2- 172.21.15.59:0/2339492960 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f12a806ae00 0x7f12a806d2c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f12b0000f60 tx=0x7f12b0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:17.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.183+0000 7f12a3fff700 1 -- 172.21.15.59:0/2339492960 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f12b4056850 con 0x7f12bc159a80 2023-09-21T00:17:17.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.385+0000 7f12c19c5700 1 -- 172.21.15.59:0/2339492960 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f12bc15b030 con 0x7f12bc159a80 2023-09-21T00:17:17.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.387+0000 7f12a3fff700 1 -- 172.21.15.59:0/2339492960 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18262 (secure 0 0 0) 0x7f12bc15b030 con 0x7f12bc159a80 2023-09-21T00:17:17.388 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:17:17.388 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":24,"fsid":"dd69925c-6e25-42fe-880b-2f60fc6f384b","created":"2023-09-21T00:16:43.074489+0000","modified":"2023-09-21T00:17:11.387529+0000","last_up_change":"2023-09-21T00:16:54.740101+0000","last_in_change":"2023-09-21T00:16:45.987089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T00:16:54.796248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-21T00:17:04.167102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-21T00:17:05.313188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-21T00:17:08.977609+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d4b18344-74c0-4f75-920b-7a9247e48914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6809","nonce":2418314235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6811","nonce":2418314235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6815","nonce":2418314235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6813","nonce":2418314235}]},"public_addr":"172.21.15.59:6809/2418314235","cluster_addr":"172.21.15.59:6811/2418314235","heartbeat_back_addr":"172.21.15.59:6815/2418314235","heartbeat_front_addr":"172.21.15.59:6813/2418314235","state":["exists","up"]},{"osd":1,"uuid":"80940d50-a248-4e64-a282-7ffcdad790ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6801","nonce":869668251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6803","nonce":869668251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6807","nonce":869668251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6805","nonce":869668251}]},"public_addr":"172.21.15.59:6801/869668251","cluster_addr":"172.21.15.59:6803/869668251","heartbeat_back_addr":"172.21.15.59:6807/869668251","heartbeat_front_addr":"172.21.15.59:6805/869668251","state":["exists","up"]},{"osd":2,"uuid":"55f2eceb-c54a-4879-a6ce-968c1c548b5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6817","nonce":372517778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6819","nonce":372517778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6823","nonce":372517778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6821","nonce":372517778}]},"public_addr":"172.21.15.59:6817/372517778","cluster_addr":"172.21.15.59:6819/372517778","heartbeat_back_addr":"172.21.15.59:6823/372517778","heartbeat_front_addr":"172.21.15.59:6821/372517778","state":["exists","up"]},{"osd":3,"uuid":"92b89cd0-869c-49b9-a9f9-97ac8423f304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6825","nonce":575188498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6827","nonce":575188498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6831","nonce":575188498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6829","nonce":575188498}]},"public_addr":"172.21.15.59:6825/575188498","cluster_addr":"172.21.15.59:6827/575188498","heartbeat_back_addr":"172.21.15.59:6831/575188498","heartbeat_front_addr":"172.21.15.59:6829/575188498","state":["exists","up"]},{"osd":4,"uuid":"25b80e94-e0e6-403d-b69f-61542f289637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6803","nonce":1741219098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6805","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6807","nonce":1741219098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6815","nonce":1741219098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6811","nonce":1741219098}]},"public_addr":"172.21.15.83:6803/1741219098","cluster_addr":"172.21.15.83:6807/1741219098","heartbeat_back_addr":"172.21.15.83:6815/1741219098","heartbeat_front_addr":"172.21.15.83:6811/1741219098","state":["exists","up"]},{"osd":5,"uuid":"5498d9ab-1086-4796-a199-9051e6dfea91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6817","nonce":156730565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6819","nonce":156730565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6823","nonce":156730565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6821","nonce":156730565}]},"public_addr":"172.21.15.83:6817/156730565","cluster_addr":"172.21.15.83:6819/156730565","heartbeat_back_addr":"172.21.15.83:6823/156730565","heartbeat_front_addr":"172.21.15.83:6821/156730565","state":["exists","up"]},{"osd":6,"uuid":"cfd810c0-5015-4d60-9a75-7efc93a32e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6801","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6800","nonce":1337723778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6806","nonce":1337723778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6814","nonce":1337723778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6810","nonce":1337723778}]},"public_addr":"172.21.15.83:6800/1337723778","cluster_addr":"172.21.15.83:6806/1337723778","heartbeat_back_addr":"172.21.15.83:6814/1337723778","heartbeat_front_addr":"172.21.15.83:6810/1337723778","state":["exists","up"]},{"osd":7,"uuid":"e992c8fa-0a3d-4b3c-85b5-2c511223dee4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6825","nonce":4204859272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6827","nonce":4204859272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6831","nonce":4204859272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6829","nonce":4204859272}]},"public_addr":"172.21.15.83:6825/4204859272","cluster_addr":"172.21.15.83:6827/4204859272","heartbeat_back_addr":"172.21.15.83:6831/4204859272","heartbeat_front_addr":"172.21.15.83:6829/4204859272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.156498+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.882707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.093978+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.158565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.173933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.888606+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.135525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.149712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T00:17:17.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.389+0000 7f12c19c5700 1 -- 172.21.15.59:0/2339492960 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f12a806ae00 msgr2=0x7f12a806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:17.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.389+0000 7f12c19c5700 1 --2- 172.21.15.59:0/2339492960 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f12a806ae00 0x7f12a806d2c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f12b0000f60 tx=0x7f12b0009040 comp rx=0 tx=0).stop 2023-09-21T00:17:17.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.389+0000 7f12c19c5700 1 -- 172.21.15.59:0/2339492960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12bc159a80 msgr2=0x7f12bc158ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:17.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.389+0000 7f12c19c5700 1 --2- 172.21.15.59:0/2339492960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12bc159a80 0x7f12bc158ae0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f12bc06e070 tx=0x7f12b4004ad0 comp rx=0 tx=0).stop 2023-09-21T00:17:17.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.389+0000 7f12c19c5700 1 -- 172.21.15.59:0/2339492960 shutdown_connections 2023-09-21T00:17:17.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.389+0000 7f12c19c5700 1 --2- 172.21.15.59:0/2339492960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12bc159a80 0x7f12bc158ae0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:17.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.389+0000 7f12c19c5700 1 --2- 172.21.15.59:0/2339492960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f12bc0c9870 0x7f12bc0adf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:17.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.389+0000 7f12c19c5700 1 --2- 172.21.15.59:0/2339492960 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f12a806ae00 0x7f12a806d2c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:17.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.389+0000 7f12c19c5700 1 --2- 172.21.15.59:0/2339492960 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f12bc0cc530 0x7f12bc1585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:17.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.389+0000 7f12c19c5700 1 -- 172.21.15.59:0/2339492960 >> 172.21.15.59:0/2339492960 conn(0x7f12bc0b0d70 msgr2=0x7f12bc0ccdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:17.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.389+0000 7f12c19c5700 1 -- 172.21.15.59:0/2339492960 shutdown_connections 2023-09-21T00:17:17.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.389+0000 7f12c19c5700 1 -- 172.21.15.59:0/2339492960 wait complete. 2023-09-21T00:17:17.402 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-21T00:16:54.796248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-21T00:17:04.167102+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-21T00:17:05.313188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-21T00:17:08.977609+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-21T00:17:17.403 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-21T00:17:17.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.531+0000 7f61194fa700 1 Processor -- start 2023-09-21T00:17:17.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.531+0000 7f61194fa700 1 -- start start 2023-09-21T00:17:17.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.532+0000 7f61194fa700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f611415b4b0 0x7f61140d0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:17.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.532+0000 7f61194fa700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f61140ce7a0 0x7f61140b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:17.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.532+0000 7f61194fa700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f61140b31f0 0x7f611406ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:17.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.532+0000 7f61194fa700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61140b3680 con 0x7f61140b31f0 2023-09-21T00:17:17.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.532+0000 7f61194fa700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61140cda80 con 0x7f611415b4b0 2023-09-21T00:17:17.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.532+0000 7f61194fa700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61140cefa0 con 0x7f61140ce7a0 2023-09-21T00:17:17.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.532+0000 7f61137fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f61140b31f0 0x7f611406ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:17.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.532+0000 7f61137fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f61140b31f0 0x7f611406ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51144/0 (socket says 172.21.15.59:51144) 2023-09-21T00:17:17.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.532+0000 7f61137fe700 1 -- 172.21.15.59:0/4118461067 learned_addr learned my addr 172.21.15.59:0/4118461067 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:17.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.532+0000 7f6112ffd700 1 --2- 172.21.15.59:0/4118461067 >> v2:172.21.15.83:3300/0 conn(0x7f611415b4b0 0x7f61140d0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:17.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.532+0000 7f61127fc700 1 --2- 172.21.15.59:0/4118461067 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f61140ce7a0 0x7f61140b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:17.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.532+0000 7f61137fe700 1 -- 172.21.15.59:0/4118461067 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f61140ce7a0 msgr2=0x7f61140b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:17.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.532+0000 7f61137fe700 1 --2- 172.21.15.59:0/4118461067 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f61140ce7a0 0x7f61140b2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:17.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.532+0000 7f61137fe700 1 -- 172.21.15.59:0/4118461067 >> v2:172.21.15.83:3300/0 conn(0x7f611415b4b0 msgr2=0x7f61140d0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:17.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.532+0000 7f61137fe700 1 --2- 172.21.15.59:0/4118461067 >> v2:172.21.15.83:3300/0 conn(0x7f611415b4b0 0x7f61140d0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:17.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.532+0000 7f61137fe700 1 -- 172.21.15.59:0/4118461067 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61140cf280 con 0x7f61140b31f0 2023-09-21T00:17:17.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.533+0000 7f61137fe700 1 --2- 172.21.15.59:0/4118461067 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61140b31f0 0x7f611406ea60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f611406b750 tx=0x7f610c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a39ca018f1358598 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:17.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.533+0000 7f6111ffb700 1 -- 172.21.15.59:0/4118461067 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610c00e070 con 0x7f61140b31f0 2023-09-21T00:17:17.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.533+0000 7f6111ffb700 1 -- 172.21.15.59:0/4118461067 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f610c00b910 con 0x7f61140b31f0 2023-09-21T00:17:17.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.533+0000 7f6111ffb700 1 -- 172.21.15.59:0/4118461067 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610c00bcc0 con 0x7f61140b31f0 2023-09-21T00:17:17.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.533+0000 7f61194fa700 1 -- 172.21.15.59:0/4118461067 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61140b31f0 msgr2=0x7f611406ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:17.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.533+0000 7f61194fa700 1 --2- 172.21.15.59:0/4118461067 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61140b31f0 0x7f611406ea60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f611406b750 tx=0x7f610c00b330 comp rx=0 tx=0).stop 2023-09-21T00:17:17.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.533+0000 7f61194fa700 1 -- 172.21.15.59:0/4118461067 shutdown_connections 2023-09-21T00:17:17.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.533+0000 7f61194fa700 1 --2- 172.21.15.59:0/4118461067 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61140b31f0 0x7f611406ea60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:17.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.533+0000 7f61194fa700 1 --2- 172.21.15.59:0/4118461067 >> v2:172.21.15.83:3300/0 conn(0x7f611415b4b0 0x7f61140d0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:17.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.533+0000 7f61194fa700 1 --2- 172.21.15.59:0/4118461067 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f61140ce7a0 0x7f61140b2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:17.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.533+0000 7f61194fa700 1 -- 172.21.15.59:0/4118461067 >> 172.21.15.59:0/4118461067 conn(0x7f61140cdcb0 msgr2=0x7f61140ce090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:17.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.533+0000 7f61194fa700 1 -- 172.21.15.59:0/4118461067 shutdown_connections 2023-09-21T00:17:17.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.533+0000 7f61194fa700 1 -- 172.21.15.59:0/4118461067 wait complete. 2023-09-21T00:17:17.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.535+0000 7f61194fa700 1 Processor -- start 2023-09-21T00:17:17.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.535+0000 7f61194fa700 1 -- start start 2023-09-21T00:17:17.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.536+0000 7f61194fa700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61140b31f0 0x7f611414ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:17.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.536+0000 7f61194fa700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61140ce7a0 0x7f611414e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:17.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.536+0000 7f61194fa700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f611415b4b0 0x7f611414ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:17.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.536+0000 7f61194fa700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6114151680 con 0x7f61140ce7a0 2023-09-21T00:17:17.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.536+0000 7f61194fa700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611414f330 con 0x7f61140b31f0 2023-09-21T00:17:17.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.536+0000 7f61194fa700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f611414f610 con 0x7f611415b4b0 2023-09-21T00:17:17.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.536+0000 7f61127fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61140ce7a0 0x7f611414e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:17.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.536+0000 7f61127fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61140ce7a0 0x7f611414e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51148/0 (socket says 172.21.15.59:51148) 2023-09-21T00:17:17.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.536+0000 7f61127fc700 1 -- 172.21.15.59:0/1984480662 learned_addr learned my addr 172.21.15.59:0/1984480662 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:17.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.536+0000 7f6112ffd700 1 --2- 172.21.15.59:0/1984480662 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61140b31f0 0x7f611414ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:17.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.536+0000 7f61137fe700 1 --2- 172.21.15.59:0/1984480662 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f611415b4b0 0x7f611414ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:17.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.536+0000 7f61127fc700 1 -- 172.21.15.59:0/1984480662 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f611415b4b0 msgr2=0x7f611414ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:17.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.536+0000 7f61127fc700 1 --2- 172.21.15.59:0/1984480662 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f611415b4b0 0x7f611414ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:17.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.536+0000 7f61127fc700 1 -- 172.21.15.59:0/1984480662 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61140b31f0 msgr2=0x7f611414ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:17.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.536+0000 7f61127fc700 1 --2- 172.21.15.59:0/1984480662 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61140b31f0 0x7f611414ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:17.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.536+0000 7f61127fc700 1 -- 172.21.15.59:0/1984480662 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f610c009b30 con 0x7f61140ce7a0 2023-09-21T00:17:17.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.536+0000 7f61127fc700 1 --2- 172.21.15.59:0/1984480662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61140ce7a0 0x7f611414e750 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f610400e9b0 tx=0x7f610400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:17.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.536+0000 7f60fb7fe700 1 -- 172.21.15.59:0/1984480662 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6104009710 con 0x7f61140ce7a0 2023-09-21T00:17:17.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.537+0000 7f60fb7fe700 1 -- 172.21.15.59:0/1984480662 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f610400ee50 con 0x7f61140ce7a0 2023-09-21T00:17:17.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.537+0000 7f61194fa700 1 -- 172.21.15.59:0/1984480662 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f611414f8f0 con 0x7f61140ce7a0 2023-09-21T00:17:17.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.537+0000 7f60fb7fe700 1 -- 172.21.15.59:0/1984480662 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610400ca50 con 0x7f61140ce7a0 2023-09-21T00:17:17.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.537+0000 7f61194fa700 1 -- 172.21.15.59:0/1984480662 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f611414feb0 con 0x7f61140ce7a0 2023-09-21T00:17:17.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.538+0000 7f61194fa700 1 -- 172.21.15.59:0/1984480662 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6114150070 con 0x7f61140ce7a0 2023-09-21T00:17:17.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.538+0000 7f60fb7fe700 1 -- 172.21.15.59:0/1984480662 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f610400cbb0 con 0x7f61140ce7a0 2023-09-21T00:17:17.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.538+0000 7f60fb7fe700 1 --2- 172.21.15.59:0/1984480662 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f610006ae00 0x7f610006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:17.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.539+0000 7f60fb7fe700 1 -- 172.21.15.59:0/1984480662 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6104089800 con 0x7f61140ce7a0 2023-09-21T00:17:17.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.539+0000 7f6112ffd700 1 --2- 172.21.15.59:0/1984480662 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f610006ae00 0x7f610006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:17.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.539+0000 7f6112ffd700 1 --2- 172.21.15.59:0/1984480662 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f610006ae00 0x7f610006d2c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6108009ac0 tx=0x7f6108009210 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:17.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.543+0000 7f60fb7fe700 1 -- 172.21.15.59:0/1984480662 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f6104054630 con 0x7f61140ce7a0 2023-09-21T00:17:17.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.740+0000 7f61194fa700 1 -- 172.21.15.59:0/1984480662 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6114150220 con 0x7f61140ce7a0 2023-09-21T00:17:17.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.740+0000 7f60fb7fe700 1 -- 172.21.15.59:0/1984480662 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6104087e60 con 0x7f61140ce7a0 2023-09-21T00:17:17.742 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-09-21T00:17:17.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.742+0000 7f61194fa700 1 -- 172.21.15.59:0/1984480662 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f610006ae00 msgr2=0x7f610006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:17.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.742+0000 7f61194fa700 1 --2- 172.21.15.59:0/1984480662 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f610006ae00 0x7f610006d2c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6108009ac0 tx=0x7f6108009210 comp rx=0 tx=0).stop 2023-09-21T00:17:17.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.742+0000 7f61194fa700 1 -- 172.21.15.59:0/1984480662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61140ce7a0 msgr2=0x7f611414e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:17.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.742+0000 7f61194fa700 1 --2- 172.21.15.59:0/1984480662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61140ce7a0 0x7f611414e750 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f610400e9b0 tx=0x7f610400ecc0 comp rx=0 tx=0).stop 2023-09-21T00:17:17.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.742+0000 7f61194fa700 1 -- 172.21.15.59:0/1984480662 shutdown_connections 2023-09-21T00:17:17.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.742+0000 7f61194fa700 1 --2- 172.21.15.59:0/1984480662 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f610006ae00 0x7f610006d2c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:17.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.742+0000 7f61194fa700 1 --2- 172.21.15.59:0/1984480662 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f611415b4b0 0x7f611414ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:17.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.742+0000 7f61194fa700 1 --2- 172.21.15.59:0/1984480662 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61140b31f0 0x7f611414ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:17.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.742+0000 7f61194fa700 1 --2- 172.21.15.59:0/1984480662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61140ce7a0 0x7f611414e750 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:17.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.742+0000 7f61194fa700 1 -- 172.21.15.59:0/1984480662 >> 172.21.15.59:0/1984480662 conn(0x7f61140cdcb0 msgr2=0x7f61140ce090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:17.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.743+0000 7f61194fa700 1 -- 172.21.15.59:0/1984480662 shutdown_connections 2023-09-21T00:17:17.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.743+0000 7f61194fa700 1 -- 172.21.15.59:0/1984480662 wait complete. 2023-09-21T00:17:17.755 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-21T00:17:17.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.882+0000 7f0e3d5d2700 1 Processor -- start 2023-09-21T00:17:17.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.882+0000 7f0e3d5d2700 1 -- start start 2023-09-21T00:17:17.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.883+0000 7f0e3d5d2700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0e3815b480 0x7f0e3806f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:17.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.883+0000 7f0e3d5d2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e380d0820 0x7f0e380701e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:17.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.883+0000 7f0e3d5d2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0e38070720 0x7f0e380cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:17.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.883+0000 7f0e3d5d2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e38070b90 con 0x7f0e38070720 2023-09-21T00:17:17.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.883+0000 7f0e3d5d2700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e380b4030 con 0x7f0e3815b480 2023-09-21T00:17:17.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.883+0000 7f0e3d5d2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e380cb8d0 con 0x7f0e380d0820 2023-09-21T00:17:17.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.883+0000 7f0e377fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0e38070720 0x7f0e380cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:17.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.883+0000 7f0e377fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0e38070720 0x7f0e380cedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51156/0 (socket says 172.21.15.59:51156) 2023-09-21T00:17:17.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.883+0000 7f0e377fe700 1 -- 172.21.15.59:0/1858603750 learned_addr learned my addr 172.21.15.59:0/1858603750 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:17.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.883+0000 7f0e36ffd700 1 --2- 172.21.15.59:0/1858603750 >> v2:172.21.15.83:3300/0 conn(0x7f0e3815b480 0x7f0e3806f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:17.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.883+0000 7f0e367fc700 1 --2- 172.21.15.59:0/1858603750 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e380d0820 0x7f0e380701e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:17.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.884+0000 7f0e377fe700 1 -- 172.21.15.59:0/1858603750 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e380d0820 msgr2=0x7f0e380701e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:17.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.884+0000 7f0e377fe700 1 --2- 172.21.15.59:0/1858603750 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e380d0820 0x7f0e380701e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:17.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.884+0000 7f0e377fe700 1 -- 172.21.15.59:0/1858603750 >> v2:172.21.15.83:3300/0 conn(0x7f0e3815b480 msgr2=0x7f0e3806f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:17.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.884+0000 7f0e377fe700 1 --2- 172.21.15.59:0/1858603750 >> v2:172.21.15.83:3300/0 conn(0x7f0e3815b480 0x7f0e3806f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:17.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.884+0000 7f0e377fe700 1 -- 172.21.15.59:0/1858603750 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e380cbb40 con 0x7f0e38070720 2023-09-21T00:17:17.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.884+0000 7f0e367fc700 1 --2- 172.21.15.59:0/1858603750 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e380d0820 0x7f0e380701e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:17:17.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.884+0000 7f0e377fe700 1 --2- 172.21.15.59:0/1858603750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e38070720 0x7f0e380cedb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0e380cdbc0 tx=0x7f0e3000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=805fc49b1d4c7507 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:17.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.884+0000 7f0e35ffb700 1 -- 172.21.15.59:0/1858603750 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3000e070 con 0x7f0e38070720 2023-09-21T00:17:17.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.884+0000 7f0e35ffb700 1 -- 172.21.15.59:0/1858603750 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3000b9c0 con 0x7f0e38070720 2023-09-21T00:17:17.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.884+0000 7f0e35ffb700 1 -- 172.21.15.59:0/1858603750 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3000bd70 con 0x7f0e38070720 2023-09-21T00:17:17.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.884+0000 7f0e3d5d2700 1 -- 172.21.15.59:0/1858603750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e38070720 msgr2=0x7f0e380cedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:17.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.884+0000 7f0e3d5d2700 1 --2- 172.21.15.59:0/1858603750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e38070720 0x7f0e380cedb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0e380cdbc0 tx=0x7f0e3000b330 comp rx=0 tx=0).stop 2023-09-21T00:17:17.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.884+0000 7f0e3d5d2700 1 -- 172.21.15.59:0/1858603750 shutdown_connections 2023-09-21T00:17:17.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.884+0000 7f0e3d5d2700 1 --2- 172.21.15.59:0/1858603750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e38070720 0x7f0e380cedb0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:17.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.884+0000 7f0e3d5d2700 1 --2- 172.21.15.59:0/1858603750 >> v2:172.21.15.83:3300/0 conn(0x7f0e3815b480 0x7f0e3806f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:17.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.884+0000 7f0e3d5d2700 1 --2- 172.21.15.59:0/1858603750 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e380d0820 0x7f0e380701e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:17.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.884+0000 7f0e3d5d2700 1 -- 172.21.15.59:0/1858603750 >> 172.21.15.59:0/1858603750 conn(0x7f0e380d11e0 msgr2=0x7f0e380d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:17.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.885+0000 7f0e3d5d2700 1 -- 172.21.15.59:0/1858603750 shutdown_connections 2023-09-21T00:17:17.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.885+0000 7f0e3d5d2700 1 -- 172.21.15.59:0/1858603750 wait complete. 2023-09-21T00:17:17.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.886+0000 7f0e3d5d2700 1 Processor -- start 2023-09-21T00:17:17.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.886+0000 7f0e3d5d2700 1 -- start start 2023-09-21T00:17:17.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.887+0000 7f0e3d5d2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e38070720 0x7f0e3806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:17.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.887+0000 7f0e3d5d2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e380d0820 0x7f0e380cad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:17.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.887+0000 7f0e3d5d2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e3815b480 0x7f0e38158680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:17.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.887+0000 7f0e3d5d2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e380c8600 con 0x7f0e3815b480 2023-09-21T00:17:17.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.887+0000 7f0e3d5d2700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e380cb250 con 0x7f0e380d0820 2023-09-21T00:17:17.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.887+0000 7f0e3d5d2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e380b02f0 con 0x7f0e38070720 2023-09-21T00:17:17.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.887+0000 7f0e377fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e3815b480 0x7f0e38158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:17.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.887+0000 7f0e36ffd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e38070720 0x7f0e3806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:17.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.887+0000 7f0e377fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e3815b480 0x7f0e38158680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51162/0 (socket says 172.21.15.59:51162) 2023-09-21T00:17:17.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.887+0000 7f0e377fe700 1 -- 172.21.15.59:0/3904157611 learned_addr learned my addr 172.21.15.59:0/3904157611 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:17.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.887+0000 7f0e367fc700 1 --2- 172.21.15.59:0/3904157611 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e380d0820 0x7f0e380cad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:17.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.887+0000 7f0e377fe700 1 -- 172.21.15.59:0/3904157611 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e38070720 msgr2=0x7f0e3806d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:17.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.887+0000 7f0e377fe700 1 --2- 172.21.15.59:0/3904157611 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e38070720 0x7f0e3806d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:17.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.887+0000 7f0e377fe700 1 -- 172.21.15.59:0/3904157611 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e380d0820 msgr2=0x7f0e380cad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:17.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.887+0000 7f0e377fe700 1 --2- 172.21.15.59:0/3904157611 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e380d0820 0x7f0e380cad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:17.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.887+0000 7f0e377fe700 1 -- 172.21.15.59:0/3904157611 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e30009b30 con 0x7f0e3815b480 2023-09-21T00:17:17.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.887+0000 7f0e377fe700 1 --2- 172.21.15.59:0/3904157611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e3815b480 0x7f0e38158680 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0e38068e00 tx=0x7f0e30004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:17.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.887+0000 7f0e2f7fe700 1 -- 172.21.15.59:0/3904157611 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e30004880 con 0x7f0e3815b480 2023-09-21T00:17:17.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.887+0000 7f0e2f7fe700 1 -- 172.21.15.59:0/3904157611 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e300099b0 con 0x7f0e3815b480 2023-09-21T00:17:17.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.887+0000 7f0e3d5d2700 1 -- 172.21.15.59:0/3904157611 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e3815df30 con 0x7f0e3815b480 2023-09-21T00:17:17.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.887+0000 7f0e2f7fe700 1 -- 172.21.15.59:0/3904157611 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3001c680 con 0x7f0e3815b480 2023-09-21T00:17:17.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.888+0000 7f0e3d5d2700 1 -- 172.21.15.59:0/3904157611 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e3815e4f0 con 0x7f0e3815b480 2023-09-21T00:17:17.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.888+0000 7f0e3d5d2700 1 -- 172.21.15.59:0/3904157611 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e38067e50 con 0x7f0e3815b480 2023-09-21T00:17:17.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.889+0000 7f0e2f7fe700 1 -- 172.21.15.59:0/3904157611 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f0e3001c7e0 con 0x7f0e3815b480 2023-09-21T00:17:17.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.889+0000 7f0e2f7fe700 1 --2- 172.21.15.59:0/3904157611 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f0e1806ae00 0x7f0e1806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:17.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.889+0000 7f0e2f7fe700 1 -- 172.21.15.59:0/3904157611 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0e3008b390 con 0x7f0e3815b480 2023-09-21T00:17:17.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.890+0000 7f0e36ffd700 1 --2- 172.21.15.59:0/3904157611 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f0e1806ae00 0x7f0e1806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:17.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.890+0000 7f0e36ffd700 1 --2- 172.21.15.59:0/3904157611 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f0e1806ae00 0x7f0e1806d2c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0e380cf3c0 tx=0x7f0e28008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:17.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:17.894+0000 7f0e2f7fe700 1 -- 172.21.15.59:0/3904157611 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f0e30056250 con 0x7f0e3815b480 2023-09-21T00:17:18.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.092+0000 7f0e3d5d2700 1 -- 172.21.15.59:0/3904157611 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0e380b0710 con 0x7f0e3815b480 2023-09-21T00:17:18.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.092+0000 7f0e2f7fe700 1 -- 172.21.15.59:0/3904157611 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0e30059870 con 0x7f0e3815b480 2023-09-21T00:17:18.094 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-09-21T00:17:18.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.094+0000 7f0e3d5d2700 1 -- 172.21.15.59:0/3904157611 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f0e1806ae00 msgr2=0x7f0e1806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:18.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.094+0000 7f0e3d5d2700 1 --2- 172.21.15.59:0/3904157611 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f0e1806ae00 0x7f0e1806d2c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0e380cf3c0 tx=0x7f0e28008040 comp rx=0 tx=0).stop 2023-09-21T00:17:18.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.094+0000 7f0e3d5d2700 1 -- 172.21.15.59:0/3904157611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e3815b480 msgr2=0x7f0e38158680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:18.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.094+0000 7f0e3d5d2700 1 --2- 172.21.15.59:0/3904157611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e3815b480 0x7f0e38158680 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0e38068e00 tx=0x7f0e30004ad0 comp rx=0 tx=0).stop 2023-09-21T00:17:18.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.094+0000 7f0e3d5d2700 1 -- 172.21.15.59:0/3904157611 shutdown_connections 2023-09-21T00:17:18.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.094+0000 7f0e3d5d2700 1 --2- 172.21.15.59:0/3904157611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e3815b480 0x7f0e38158680 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:18.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.094+0000 7f0e3d5d2700 1 --2- 172.21.15.59:0/3904157611 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f0e1806ae00 0x7f0e1806d2c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:18.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.094+0000 7f0e3d5d2700 1 --2- 172.21.15.59:0/3904157611 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e38070720 0x7f0e3806d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:18.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.094+0000 7f0e3d5d2700 1 --2- 172.21.15.59:0/3904157611 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e380d0820 0x7f0e380cad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:18.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.094+0000 7f0e3d5d2700 1 -- 172.21.15.59:0/3904157611 >> 172.21.15.59:0/3904157611 conn(0x7f0e380d11e0 msgr2=0x7f0e3815a590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:18.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.095+0000 7f0e3d5d2700 1 -- 172.21.15.59:0/3904157611 shutdown_connections 2023-09-21T00:17:18.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.095+0000 7f0e3d5d2700 1 -- 172.21.15.59:0/3904157611 wait complete. 2023-09-21T00:17:18.107 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-21T00:17:18.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.234+0000 7fda9d411700 1 Processor -- start 2023-09-21T00:17:18.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.234+0000 7fda9d411700 1 -- start start 2023-09-21T00:17:18.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.235+0000 7fda9d411700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fda980701e0 0x7fda98070670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:18.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.235+0000 7fda9d411700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fda980b43f0 0x7fda980b4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:18.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.235+0000 7fda9d411700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda9815b9b0 con 0x7fda9815b5d0 2023-09-21T00:17:18.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.235+0000 7fda9d411700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda9806f8c0 con 0x7fda980b43f0 2023-09-21T00:17:18.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.235+0000 7fda9d411700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda98070bb0 con 0x7fda980701e0 2023-09-21T00:17:18.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.235+0000 7fda96ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fda9815b5d0 0x7fda980cb810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56734/0 (socket says 172.21.15.59:56734) 2023-09-21T00:17:18.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.235+0000 7fda96ffd700 1 -- 172.21.15.59:0/51821384 learned_addr learned my addr 172.21.15.59:0/51821384 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:18.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.235+0000 7fda977fe700 1 --2- 172.21.15.59:0/51821384 >> v2:172.21.15.59:3300/0 conn(0x7fda980b43f0 0x7fda980b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:18.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.235+0000 7fda967fc700 1 --2- 172.21.15.59:0/51821384 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fda980701e0 0x7fda98070670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:18.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.235+0000 7fda95ffb700 1 -- 172.21.15.59:0/51821384 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3399801124 0 0) 0x7fda8c001110 con 0x7fda9815b5d0 2023-09-21T00:17:18.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.235+0000 7fda95ffb700 1 -- 172.21.15.59:0/51821384 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda800035b0 con 0x7fda9815b5d0 2023-09-21T00:17:18.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.235+0000 7fda977fe700 1 -- 172.21.15.59:0/51821384 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fda980701e0 msgr2=0x7fda98070670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:18.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.235+0000 7fda977fe700 1 --2- 172.21.15.59:0/51821384 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fda980701e0 0x7fda98070670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:18.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.235+0000 7fda977fe700 1 -- 172.21.15.59:0/51821384 >> v1:172.21.15.59:6789/0 conn(0x7fda9815b5d0 legacy=0x7fda980cb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:18.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.235+0000 7fda977fe700 1 -- 172.21.15.59:0/51821384 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9806ed40 con 0x7fda980b43f0 2023-09-21T00:17:18.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.236+0000 7fda977fe700 1 --2- 172.21.15.59:0/51821384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda980b43f0 0x7fda980b4880 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fda90009d90 tx=0x7fda9000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de270d17b300854d server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:18.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.236+0000 7fda95ffb700 1 -- 172.21.15.59:0/51821384 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9000e070 con 0x7fda980b43f0 2023-09-21T00:17:18.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.236+0000 7fda95ffb700 1 -- 172.21.15.59:0/51821384 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda9000bb20 con 0x7fda980b43f0 2023-09-21T00:17:18.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.236+0000 7fda95ffb700 1 -- 172.21.15.59:0/51821384 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda90012430 con 0x7fda980b43f0 2023-09-21T00:17:18.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.236+0000 7fda9d411700 1 -- 172.21.15.59:0/51821384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda980b43f0 msgr2=0x7fda980b4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:18.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.236+0000 7fda9d411700 1 --2- 172.21.15.59:0/51821384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda980b43f0 0x7fda980b4880 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fda90009d90 tx=0x7fda9000b330 comp rx=0 tx=0).stop 2023-09-21T00:17:18.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.236+0000 7fda9d411700 1 -- 172.21.15.59:0/51821384 shutdown_connections 2023-09-21T00:17:18.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.236+0000 7fda9d411700 1 --2- 172.21.15.59:0/51821384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda980b43f0 0x7fda980b4880 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:18.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.236+0000 7fda9d411700 1 --2- 172.21.15.59:0/51821384 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fda980701e0 0x7fda98070670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:18.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.236+0000 7fda9d411700 1 -- 172.21.15.59:0/51821384 >> 172.21.15.59:0/51821384 conn(0x7fda980d11c0 msgr2=0x7fda980d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:18.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.236+0000 7fda9d411700 1 -- 172.21.15.59:0/51821384 shutdown_connections 2023-09-21T00:17:18.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.236+0000 7fda9d411700 1 -- 172.21.15.59:0/51821384 wait complete. 2023-09-21T00:17:18.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.238+0000 7fda9d411700 1 Processor -- start 2023-09-21T00:17:18.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.238+0000 7fda9d411700 1 -- start start 2023-09-21T00:17:18.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.239+0000 7fda9d411700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fda980701e0 0x7fda980ab220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:18.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.239+0000 7fda9d411700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda980b43f0 0x7fda980aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:18.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.239+0000 7fda9d411700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda9815b5d0 0x7fda981f0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:18.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.239+0000 7fda9d411700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda980ab760 con 0x7fda980b43f0 2023-09-21T00:17:18.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.239+0000 7fda9d411700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda980ad470 con 0x7fda9815b5d0 2023-09-21T00:17:18.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.239+0000 7fda9d411700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda980af020 con 0x7fda980701e0 2023-09-21T00:17:18.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.239+0000 7fda967fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda980b43f0 0x7fda980aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:18.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.239+0000 7fda967fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda980b43f0 0x7fda980aeae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51174/0 (socket says 172.21.15.59:51174) 2023-09-21T00:17:18.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.239+0000 7fda967fc700 1 -- 172.21.15.59:0/4242220870 learned_addr learned my addr 172.21.15.59:0/4242220870 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:18.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.239+0000 7fda96ffd700 1 --2- 172.21.15.59:0/4242220870 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fda980701e0 0x7fda980ab220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:18.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.239+0000 7fda977fe700 1 --2- 172.21.15.59:0/4242220870 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda9815b5d0 0x7fda981f0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:18.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.239+0000 7fda967fc700 1 -- 172.21.15.59:0/4242220870 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fda980701e0 msgr2=0x7fda980ab220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:18.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.239+0000 7fda967fc700 1 --2- 172.21.15.59:0/4242220870 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fda980701e0 0x7fda980ab220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:18.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.239+0000 7fda967fc700 1 -- 172.21.15.59:0/4242220870 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda9815b5d0 msgr2=0x7fda981f0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:18.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.239+0000 7fda967fc700 1 --2- 172.21.15.59:0/4242220870 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda9815b5d0 0x7fda981f0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:18.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.239+0000 7fda967fc700 1 -- 172.21.15.59:0/4242220870 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda90009a70 con 0x7fda980b43f0 2023-09-21T00:17:18.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.239+0000 7fda967fc700 1 --2- 172.21.15.59:0/4242220870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda980b43f0 0x7fda980aeae0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fda8800e870 tx=0x7fda8800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:18.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.239+0000 7fda7f7fe700 1 -- 172.21.15.59:0/4242220870 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda88009590 con 0x7fda980b43f0 2023-09-21T00:17:18.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.239+0000 7fda7f7fe700 1 -- 172.21.15.59:0/4242220870 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda88013680 con 0x7fda980b43f0 2023-09-21T00:17:18.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.239+0000 7fda9d411700 1 -- 172.21.15.59:0/4242220870 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda980ad900 con 0x7fda980b43f0 2023-09-21T00:17:18.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.240+0000 7fda7f7fe700 1 -- 172.21.15.59:0/4242220870 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda880139f0 con 0x7fda980b43f0 2023-09-21T00:17:18.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.240+0000 7fda9d411700 1 -- 172.21.15.59:0/4242220870 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda980acb40 con 0x7fda980b43f0 2023-09-21T00:17:18.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.241+0000 7fda9d411700 1 -- 172.21.15.59:0/4242220870 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda98067e50 con 0x7fda980b43f0 2023-09-21T00:17:18.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.241+0000 7fda7f7fe700 1 -- 172.21.15.59:0/4242220870 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fda88013b50 con 0x7fda980b43f0 2023-09-21T00:17:18.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.241+0000 7fda7f7fe700 1 --2- 172.21.15.59:0/4242220870 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fda8406ae00 0x7fda8406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:18.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.241+0000 7fda7f7fe700 1 -- 172.21.15.59:0/4242220870 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fda88089660 con 0x7fda980b43f0 2023-09-21T00:17:18.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.242+0000 7fda96ffd700 1 --2- 172.21.15.59:0/4242220870 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fda8406ae00 0x7fda8406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:18.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.242+0000 7fda96ffd700 1 --2- 172.21.15.59:0/4242220870 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fda8406ae00 0x7fda8406d2c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fda8c007fd0 tx=0x7fda8c007c40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:18.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.246+0000 7fda7f7fe700 1 -- 172.21.15.59:0/4242220870 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fda88054490 con 0x7fda980b43f0 2023-09-21T00:17:18.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.445+0000 7fda9d411700 1 -- 172.21.15.59:0/4242220870 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fda9815c040 con 0x7fda980b43f0 2023-09-21T00:17:18.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.445+0000 7fda7f7fe700 1 -- 172.21.15.59:0/4242220870 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fda88057ab0 con 0x7fda980b43f0 2023-09-21T00:17:18.447 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-09-21T00:17:18.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.447+0000 7fda9d411700 1 -- 172.21.15.59:0/4242220870 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fda8406ae00 msgr2=0x7fda8406d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:18.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.447+0000 7fda9d411700 1 --2- 172.21.15.59:0/4242220870 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fda8406ae00 0x7fda8406d2c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fda8c007fd0 tx=0x7fda8c007c40 comp rx=0 tx=0).stop 2023-09-21T00:17:18.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.447+0000 7fda9d411700 1 -- 172.21.15.59:0/4242220870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda980b43f0 msgr2=0x7fda980aeae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:18.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.447+0000 7fda9d411700 1 --2- 172.21.15.59:0/4242220870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda980b43f0 0x7fda980aeae0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fda8800e870 tx=0x7fda8800eb80 comp rx=0 tx=0).stop 2023-09-21T00:17:18.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.447+0000 7fda9d411700 1 -- 172.21.15.59:0/4242220870 shutdown_connections 2023-09-21T00:17:18.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.447+0000 7fda9d411700 1 --2- 172.21.15.59:0/4242220870 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda9815b5d0 0x7fda981f0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:18.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.447+0000 7fda9d411700 1 --2- 172.21.15.59:0/4242220870 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fda8406ae00 0x7fda8406d2c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:18.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.447+0000 7fda9d411700 1 --2- 172.21.15.59:0/4242220870 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fda980701e0 0x7fda980ab220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:18.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.447+0000 7fda9d411700 1 --2- 172.21.15.59:0/4242220870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda980b43f0 0x7fda980aeae0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:18.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.447+0000 7fda9d411700 1 -- 172.21.15.59:0/4242220870 >> 172.21.15.59:0/4242220870 conn(0x7fda980d11c0 msgr2=0x7fda9815d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:18.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.447+0000 7fda9d411700 1 -- 172.21.15.59:0/4242220870 shutdown_connections 2023-09-21T00:17:18.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.447+0000 7fda9d411700 1 -- 172.21.15.59:0/4242220870 wait complete. 2023-09-21T00:17:18.460 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-21T00:17:18.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.587+0000 7f15bc5b3700 1 Processor -- start 2023-09-21T00:17:18.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.587+0000 7f15bc5b3700 1 -- start start 2023-09-21T00:17:18.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.588+0000 7f15bc5b3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f15b415b480 0x7f15b406f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:18.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.588+0000 7f15bc5b3700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f15b40708f0 0x7f15b40b44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:18.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.588+0000 7f15bc5b3700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15b40b4030 con 0x7f15b40d0820 2023-09-21T00:17:18.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.588+0000 7f15bc5b3700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15b40cb8d0 con 0x7f15b40708f0 2023-09-21T00:17:18.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.588+0000 7f15bc5b3700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b40cbb40 con 0x7f15b415b480 2023-09-21T00:17:18.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.588+0000 7f15ba34f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f15b415b480 0x7f15b406f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:18.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.588+0000 7f15ba34f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f15b415b480 0x7f15b406f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.59:51796/0 (socket says 172.21.15.59:51796) 2023-09-21T00:17:18.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.588+0000 7f15bab50700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f15b40708f0 0x7f15b40b44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:18.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.588+0000 7f15ba34f700 1 -- 172.21.15.59:0/3908161943 learned_addr learned my addr 172.21.15.59:0/3908161943 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:18.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.588+0000 7f15b9b4e700 1 --1- 172.21.15.59:0/3908161943 >> v1:172.21.15.83:6789/0 conn(0x7f15b40d0820 0x7f15b40701e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.59:47250/0 (socket says 172.21.15.59:47250) 2023-09-21T00:17:18.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.588+0000 7f15ba34f700 1 -- 172.21.15.59:0/3908161943 >> v2:172.21.15.83:3300/0 conn(0x7f15b40708f0 msgr2=0x7f15b40b44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:18.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.588+0000 7f15ba34f700 1 --2- 172.21.15.59:0/3908161943 >> v2:172.21.15.83:3300/0 conn(0x7f15b40708f0 0x7f15b40b44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:18.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.588+0000 7f15ba34f700 1 -- 172.21.15.59:0/3908161943 >> v1:172.21.15.83:6789/0 conn(0x7f15b40d0820 legacy=0x7f15b40701e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:18.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.588+0000 7f15ba34f700 1 -- 172.21.15.59:0/3908161943 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b40cbe20 con 0x7f15b415b480 2023-09-21T00:17:18.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.589+0000 7f15ba34f700 1 --2- 172.21.15.59:0/3908161943 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f15b415b480 0x7f15b406f400 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f15b00098f0 tx=0x7f15b0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e256f1fdeafdfd3 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:18.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.589+0000 7f15b934d700 1 -- 172.21.15.59:0/3908161943 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b0011830 con 0x7f15b415b480 2023-09-21T00:17:18.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.589+0000 7f15b934d700 1 -- 172.21.15.59:0/3908161943 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b0011990 con 0x7f15b415b480 2023-09-21T00:17:18.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.589+0000 7f15b934d700 1 -- 172.21.15.59:0/3908161943 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b0011d20 con 0x7f15b415b480 2023-09-21T00:17:18.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.589+0000 7f15bc5b3700 1 -- 172.21.15.59:0/3908161943 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f15b415b480 msgr2=0x7f15b406f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:18.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.589+0000 7f15bc5b3700 1 --2- 172.21.15.59:0/3908161943 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f15b415b480 0x7f15b406f400 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f15b00098f0 tx=0x7f15b0009c00 comp rx=0 tx=0).stop 2023-09-21T00:17:18.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.589+0000 7f15bc5b3700 1 -- 172.21.15.59:0/3908161943 shutdown_connections 2023-09-21T00:17:18.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.589+0000 7f15bc5b3700 1 --2- 172.21.15.59:0/3908161943 >> v2:172.21.15.83:3300/0 conn(0x7f15b40708f0 0x7f15b40b44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:18.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.589+0000 7f15bc5b3700 1 --2- 172.21.15.59:0/3908161943 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f15b415b480 0x7f15b406f400 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:18.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.589+0000 7f15bc5b3700 1 -- 172.21.15.59:0/3908161943 >> 172.21.15.59:0/3908161943 conn(0x7f15b40d11e0 msgr2=0x7f15b40d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:18.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.589+0000 7f15bc5b3700 1 -- 172.21.15.59:0/3908161943 shutdown_connections 2023-09-21T00:17:18.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.590+0000 7f15bc5b3700 1 -- 172.21.15.59:0/3908161943 wait complete. 2023-09-21T00:17:18.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.591+0000 7f15bc5b3700 1 Processor -- start 2023-09-21T00:17:18.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.591+0000 7f15bc5b3700 1 -- start start 2023-09-21T00:17:18.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.591+0000 7f15bc5b3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f15b40708f0 0x7f15b4157970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:18.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.591+0000 7f15bc5b3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f15b40d0820 0x7f15b40b0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:18.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.591+0000 7f15bc5b3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15b415b480 0x7f15b40a8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:18.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.591+0000 7f15bc5b3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b40aa710 con 0x7f15b415b480 2023-09-21T00:17:18.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.591+0000 7f15bc5b3700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b4157eb0 con 0x7f15b40d0820 2023-09-21T00:17:18.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.591+0000 7f15bc5b3700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b40ca950 con 0x7f15b40708f0 2023-09-21T00:17:18.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.592+0000 7f15bab50700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15b415b480 0x7f15b40a8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:18.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.592+0000 7f15bab50700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15b415b480 0x7f15b40a8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51190/0 (socket says 172.21.15.59:51190) 2023-09-21T00:17:18.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.592+0000 7f15bab50700 1 -- 172.21.15.59:0/2284102735 learned_addr learned my addr 172.21.15.59:0/2284102735 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:18.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.592+0000 7f15ba34f700 1 --2- 172.21.15.59:0/2284102735 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f15b40708f0 0x7f15b4157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:18.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.592+0000 7f15bab50700 1 -- 172.21.15.59:0/2284102735 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f15b40708f0 msgr2=0x7f15b4157970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:18.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.592+0000 7f15bab50700 1 --2- 172.21.15.59:0/2284102735 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f15b40708f0 0x7f15b4157970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:18.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.592+0000 7f15bab50700 1 -- 172.21.15.59:0/2284102735 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f15b40d0820 msgr2=0x7f15b40b0b00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-21T00:17:18.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.592+0000 7f15bab50700 1 --2- 172.21.15.59:0/2284102735 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f15b40d0820 0x7f15b40b0b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:18.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.592+0000 7f15bab50700 1 -- 172.21.15.59:0/2284102735 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b0009550 con 0x7f15b415b480 2023-09-21T00:17:18.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.592+0000 7f15bab50700 1 --2- 172.21.15.59:0/2284102735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15b415b480 0x7f15b40a8480 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f15ac00ef90 tx=0x7f15ac00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:18.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.592+0000 7f15aaffd700 1 -- 172.21.15.59:0/2284102735 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ac00cd40 con 0x7f15b415b480 2023-09-21T00:17:18.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.592+0000 7f15aaffd700 1 -- 172.21.15.59:0/2284102735 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15ac00f040 con 0x7f15b415b480 2023-09-21T00:17:18.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.592+0000 7f15bc5b3700 1 -- 172.21.15.59:0/2284102735 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15b415b9e0 con 0x7f15b415b480 2023-09-21T00:17:18.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.592+0000 7f15aaffd700 1 -- 172.21.15.59:0/2284102735 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ac00cea0 con 0x7f15b415b480 2023-09-21T00:17:18.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.592+0000 7f15bc5b3700 1 -- 172.21.15.59:0/2284102735 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15b40ca390 con 0x7f15b415b480 2023-09-21T00:17:18.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.593+0000 7f15bc5b3700 1 -- 172.21.15.59:0/2284102735 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15b40aa880 con 0x7f15b415b480 2023-09-21T00:17:18.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.594+0000 7f15aaffd700 1 -- 172.21.15.59:0/2284102735 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f15ac0146c0 con 0x7f15b415b480 2023-09-21T00:17:18.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.594+0000 7f15aaffd700 1 --2- 172.21.15.59:0/2284102735 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f159806ae30 0x7f159806d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:18.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.594+0000 7f15aaffd700 1 -- 172.21.15.59:0/2284102735 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f15ac08a3e0 con 0x7f15b415b480 2023-09-21T00:17:18.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.594+0000 7f15ba34f700 1 --2- 172.21.15.59:0/2284102735 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f159806ae30 0x7f159806d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:18.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.595+0000 7f15ba34f700 1 --2- 172.21.15.59:0/2284102735 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f159806ae30 0x7f159806d2f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f15b0014040 tx=0x7f15b0008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:18.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.599+0000 7f15aaffd700 1 -- 172.21.15.59:0/2284102735 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f15b40aa880 con 0x7f15b415b480 2023-09-21T00:17:18.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.795+0000 7f15bc5b3700 1 -- 172.21.15.59:0/2284102735 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f15b40aa850 con 0x7f15b415b480 2023-09-21T00:17:18.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.796+0000 7f15aaffd700 1 -- 172.21.15.59:0/2284102735 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f15ac055210 con 0x7f15b415b480 2023-09-21T00:17:18.797 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-09-21T00:17:18.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.798+0000 7f15bc5b3700 1 -- 172.21.15.59:0/2284102735 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f159806ae30 msgr2=0x7f159806d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:18.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.798+0000 7f15bc5b3700 1 --2- 172.21.15.59:0/2284102735 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f159806ae30 0x7f159806d2f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f15b0014040 tx=0x7f15b0008030 comp rx=0 tx=0).stop 2023-09-21T00:17:18.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.798+0000 7f15bc5b3700 1 -- 172.21.15.59:0/2284102735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15b415b480 msgr2=0x7f15b40a8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:18.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.798+0000 7f15bc5b3700 1 --2- 172.21.15.59:0/2284102735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15b415b480 0x7f15b40a8480 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f15ac00ef90 tx=0x7f15ac00c3a0 comp rx=0 tx=0).stop 2023-09-21T00:17:18.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.798+0000 7f15bc5b3700 1 -- 172.21.15.59:0/2284102735 shutdown_connections 2023-09-21T00:17:18.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.798+0000 7f15bc5b3700 1 --2- 172.21.15.59:0/2284102735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15b415b480 0x7f15b40a8480 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:18.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.798+0000 7f15bc5b3700 1 --2- 172.21.15.59:0/2284102735 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f159806ae30 0x7f159806d2f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:18.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.798+0000 7f15bc5b3700 1 --2- 172.21.15.59:0/2284102735 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f15b40708f0 0x7f15b4157970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:18.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.798+0000 7f15bc5b3700 1 --2- 172.21.15.59:0/2284102735 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f15b40d0820 0x7f15b40b0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:18.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.798+0000 7f15bc5b3700 1 -- 172.21.15.59:0/2284102735 >> 172.21.15.59:0/2284102735 conn(0x7f15b40d11e0 msgr2=0x7f15b40cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:18.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.798+0000 7f15bc5b3700 1 -- 172.21.15.59:0/2284102735 shutdown_connections 2023-09-21T00:17:18.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.798+0000 7f15bc5b3700 1 -- 172.21.15.59:0/2284102735 wait complete. 2023-09-21T00:17:18.811 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-21T00:17:18.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.936+0000 7f2034ebc700 1 Processor -- start 2023-09-21T00:17:18.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.936+0000 7f2034ebc700 1 -- start start 2023-09-21T00:17:18.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.937+0000 7f2034ebc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f203015b600 0x7f203006fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:18.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.937+0000 7f2034ebc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2030072870 0x7f203006a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:18.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.937+0000 7f2034ebc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f203006acc0 0x7f20300caba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:18.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.937+0000 7f2034ebc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f203006b170 con 0x7f203006acc0 2023-09-21T00:17:18.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.937+0000 7f2034ebc700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f203015b9e0 con 0x7f2030072870 2023-09-21T00:17:18.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.937+0000 7f2034ebc700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20300725c0 con 0x7f203015b600 2023-09-21T00:17:18.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.937+0000 7f202ed9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f203006acc0 0x7f20300caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:18.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.937+0000 7f202ed9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f203006acc0 0x7f20300caba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51198/0 (socket says 172.21.15.59:51198) 2023-09-21T00:17:18.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.937+0000 7f202ed9d700 1 -- 172.21.15.59:0/2401860073 learned_addr learned my addr 172.21.15.59:0/2401860073 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:18.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.937+0000 7f202e59c700 1 --2- 172.21.15.59:0/2401860073 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f203015b600 0x7f203006fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:18.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.937+0000 7f202dd9b700 1 --2- 172.21.15.59:0/2401860073 >> v2:172.21.15.83:3300/0 conn(0x7f2030072870 0x7f203006a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:18.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.937+0000 7f202ed9d700 1 -- 172.21.15.59:0/2401860073 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f203015b600 msgr2=0x7f203006fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:18.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.937+0000 7f202ed9d700 1 --2- 172.21.15.59:0/2401860073 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f203015b600 0x7f203006fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:18.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.938+0000 7f202ed9d700 1 -- 172.21.15.59:0/2401860073 >> v2:172.21.15.83:3300/0 conn(0x7f2030072870 msgr2=0x7f203006a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:18.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.938+0000 7f202ed9d700 1 --2- 172.21.15.59:0/2401860073 >> v2:172.21.15.83:3300/0 conn(0x7f2030072870 0x7f203006a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:18.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.938+0000 7f202ed9d700 1 -- 172.21.15.59:0/2401860073 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2030071a40 con 0x7f203006acc0 2023-09-21T00:17:18.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.938+0000 7f202dd9b700 1 --2- 172.21.15.59:0/2401860073 >> v2:172.21.15.83:3300/0 conn(0x7f2030072870 0x7f203006a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:17:18.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.938+0000 7f202ed9d700 1 --2- 172.21.15.59:0/2401860073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f203006acc0 0x7f20300caba0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f203006b860 tx=0x7f202800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6681ae92fdd360e2 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:18.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.938+0000 7f202d59a700 1 -- 172.21.15.59:0/2401860073 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202800e070 con 0x7f203006acc0 2023-09-21T00:17:18.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.938+0000 7f202d59a700 1 -- 172.21.15.59:0/2401860073 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f202800b9c0 con 0x7f203006acc0 2023-09-21T00:17:18.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.938+0000 7f202d59a700 1 -- 172.21.15.59:0/2401860073 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202800bd70 con 0x7f203006acc0 2023-09-21T00:17:18.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.938+0000 7f2034ebc700 1 -- 172.21.15.59:0/2401860073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f203006acc0 msgr2=0x7f20300caba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:18.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.938+0000 7f2034ebc700 1 --2- 172.21.15.59:0/2401860073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f203006acc0 0x7f20300caba0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f203006b860 tx=0x7f202800b330 comp rx=0 tx=0).stop 2023-09-21T00:17:18.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.938+0000 7f2034ebc700 1 -- 172.21.15.59:0/2401860073 shutdown_connections 2023-09-21T00:17:18.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.938+0000 7f2034ebc700 1 --2- 172.21.15.59:0/2401860073 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f203015b600 0x7f203006fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:18.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.938+0000 7f2034ebc700 1 --2- 172.21.15.59:0/2401860073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f203006acc0 0x7f20300caba0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:18.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.938+0000 7f2034ebc700 1 --2- 172.21.15.59:0/2401860073 >> v2:172.21.15.83:3300/0 conn(0x7f2030072870 0x7f203006a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:18.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.939+0000 7f2034ebc700 1 -- 172.21.15.59:0/2401860073 >> 172.21.15.59:0/2401860073 conn(0x7f20300d0040 msgr2=0x7f20300d0420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:18.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.939+0000 7f2034ebc700 1 -- 172.21.15.59:0/2401860073 shutdown_connections 2023-09-21T00:17:18.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.939+0000 7f2034ebc700 1 -- 172.21.15.59:0/2401860073 wait complete. 2023-09-21T00:17:18.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.940+0000 7f2034ebc700 1 Processor -- start 2023-09-21T00:17:18.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.940+0000 7f2034ebc700 1 -- start start 2023-09-21T00:17:18.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.941+0000 7f2034ebc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f203006acc0 0x7f2030149570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:18.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.941+0000 7f2034ebc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2030072870 0x7f203015e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:18.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.941+0000 7f2034ebc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f203015b600 0x7f20300c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:18.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.941+0000 7f2034ebc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20300c8850 con 0x7f2030072870 2023-09-21T00:17:18.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.941+0000 7f2034ebc700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20300c7fb0 con 0x7f203015b600 2023-09-21T00:17:18.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.941+0000 7f2034ebc700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20300c8290 con 0x7f203006acc0 2023-09-21T00:17:18.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.941+0000 7f202dd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2030072870 0x7f203015e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:18.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.941+0000 7f202dd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2030072870 0x7f203015e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51202/0 (socket says 172.21.15.59:51202) 2023-09-21T00:17:18.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.941+0000 7f202dd9b700 1 -- 172.21.15.59:0/1750930141 learned_addr learned my addr 172.21.15.59:0/1750930141 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:18.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.941+0000 7f202e59c700 1 --2- 172.21.15.59:0/1750930141 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f203006acc0 0x7f2030149570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:18.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.941+0000 7f202ed9d700 1 --2- 172.21.15.59:0/1750930141 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f203015b600 0x7f20300c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:18.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.941+0000 7f202dd9b700 1 -- 172.21.15.59:0/1750930141 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f203006acc0 msgr2=0x7f2030149570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:18.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.941+0000 7f202dd9b700 1 --2- 172.21.15.59:0/1750930141 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f203006acc0 0x7f2030149570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:18.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.941+0000 7f202dd9b700 1 -- 172.21.15.59:0/1750930141 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f203015b600 msgr2=0x7f20300c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:18.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.941+0000 7f202dd9b700 1 --2- 172.21.15.59:0/1750930141 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f203015b600 0x7f20300c8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:18.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.941+0000 7f202dd9b700 1 -- 172.21.15.59:0/1750930141 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2028009b30 con 0x7f2030072870 2023-09-21T00:17:18.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.941+0000 7f202dd9b700 1 --2- 172.21.15.59:0/1750930141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2030072870 0x7f203015e330 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f202000d7d0 tx=0x7f202000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:18.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.942+0000 7f201effd700 1 -- 172.21.15.59:0/1750930141 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2020004030 con 0x7f2030072870 2023-09-21T00:17:18.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.942+0000 7f201effd700 1 -- 172.21.15.59:0/1750930141 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2020004190 con 0x7f2030072870 2023-09-21T00:17:18.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.942+0000 7f2034ebc700 1 -- 172.21.15.59:0/1750930141 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20300c8570 con 0x7f2030072870 2023-09-21T00:17:18.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.942+0000 7f201effd700 1 -- 172.21.15.59:0/1750930141 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2020004500 con 0x7f2030072870 2023-09-21T00:17:18.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.942+0000 7f2034ebc700 1 -- 172.21.15.59:0/1750930141 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20300c7b20 con 0x7f2030072870 2023-09-21T00:17:18.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.943+0000 7f2034ebc700 1 -- 172.21.15.59:0/1750930141 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2030066fd0 con 0x7f2030072870 2023-09-21T00:17:18.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.943+0000 7f201effd700 1 -- 172.21.15.59:0/1750930141 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f20200036a0 con 0x7f2030072870 2023-09-21T00:17:18.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.944+0000 7f201effd700 1 --2- 172.21.15.59:0/1750930141 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f201006ae00 0x7f201006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:18.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.944+0000 7f201effd700 1 -- 172.21.15.59:0/1750930141 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f20200897e0 con 0x7f2030072870 2023-09-21T00:17:18.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.944+0000 7f202e59c700 1 --2- 172.21.15.59:0/1750930141 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f201006ae00 0x7f201006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:18.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.944+0000 7f202e59c700 1 --2- 172.21.15.59:0/1750930141 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f201006ae00 0x7f201006d2c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2024006b20 tx=0x7f2024008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:18.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:18.948+0000 7f201effd700 1 -- 172.21.15.59:0/1750930141 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f2020054570 con 0x7f2030072870 2023-09-21T00:17:19.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.169+0000 7f2034ebc700 1 -- 172.21.15.59:0/1750930141 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f203015bb20 con 0x7f2030072870 2023-09-21T00:17:19.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.170+0000 7f201effd700 1 -- 172.21.15.59:0/1750930141 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f203015bb20 con 0x7f2030072870 2023-09-21T00:17:19.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.171+0000 7f2034ebc700 1 -- 172.21.15.59:0/1750930141 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f201006ae00 msgr2=0x7f201006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:19.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.171+0000 7f2034ebc700 1 --2- 172.21.15.59:0/1750930141 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f201006ae00 0x7f201006d2c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2024006b20 tx=0x7f2024008040 comp rx=0 tx=0).stop 2023-09-21T00:17:19.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.171+0000 7f2034ebc700 1 -- 172.21.15.59:0/1750930141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2030072870 msgr2=0x7f203015e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:19.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.171+0000 7f2034ebc700 1 --2- 172.21.15.59:0/1750930141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2030072870 0x7f203015e330 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f202000d7d0 tx=0x7f202000dae0 comp rx=0 tx=0).stop 2023-09-21T00:17:19.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.172+0000 7f2034ebc700 1 -- 172.21.15.59:0/1750930141 shutdown_connections 2023-09-21T00:17:19.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.172+0000 7f2034ebc700 1 --2- 172.21.15.59:0/1750930141 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f203015b600 0x7f20300c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:19.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.172+0000 7f2034ebc700 1 --2- 172.21.15.59:0/1750930141 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f201006ae00 0x7f201006d2c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:19.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.172+0000 7f2034ebc700 1 --2- 172.21.15.59:0/1750930141 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f203006acc0 0x7f2030149570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:19.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.172+0000 7f2034ebc700 1 --2- 172.21.15.59:0/1750930141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2030072870 0x7f203015e330 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:19.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.172+0000 7f2034ebc700 1 -- 172.21.15.59:0/1750930141 >> 172.21.15.59:0/1750930141 conn(0x7f20300d0040 msgr2=0x7f203015a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:19.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.172+0000 7f2034ebc700 1 -- 172.21.15.59:0/1750930141 shutdown_connections 2023-09-21T00:17:19.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.172+0000 7f2034ebc700 1 -- 172.21.15.59:0/1750930141 wait complete. 2023-09-21T00:17:19.176 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2023-09-21T00:17:19.184 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-21T00:17:19.185 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-21T00:17:19.203 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T00:17:19.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.366+0000 7fd9da8f8700 1 Processor -- start 2023-09-21T00:17:19.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.366+0000 7fd9da8f8700 1 -- start start 2023-09-21T00:17:19.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.366+0000 7fd9da8f8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd9d415b480 0x7fd9d406f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:19.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.366+0000 7fd9da8f8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9d40708f0 0x7fd9d40b44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:19.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.366+0000 7fd9da8f8700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9d40b4030 con 0x7fd9d40d0820 2023-09-21T00:17:19.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.366+0000 7fd9da8f8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9d40cb8d0 con 0x7fd9d415b480 2023-09-21T00:17:19.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.366+0000 7fd9da8f8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d40cbb40 con 0x7fd9d40708f0 2023-09-21T00:17:19.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.367+0000 7fd9d3fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd9d415b480 0x7fd9d406f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:19.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.367+0000 7fd9d3fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd9d415b480 0x7fd9d406f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51212/0 (socket says 172.21.15.59:51212) 2023-09-21T00:17:19.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.367+0000 7fd9d3fff700 1 -- 172.21.15.59:0/937367412 learned_addr learned my addr 172.21.15.59:0/937367412 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:19.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.367+0000 7fd9d8e95700 1 --2- 172.21.15.59:0/937367412 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9d40708f0 0x7fd9d40b44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:19.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.367+0000 7fd9d3fff700 1 -- 172.21.15.59:0/937367412 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9d40708f0 msgr2=0x7fd9d40b44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:19.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.367+0000 7fd9d3fff700 1 --2- 172.21.15.59:0/937367412 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9d40708f0 0x7fd9d40b44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:19.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.367+0000 7fd9d3fff700 1 -- 172.21.15.59:0/937367412 >> v1:172.21.15.83:6789/0 conn(0x7fd9d40d0820 legacy=0x7fd9d40701e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:19.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.367+0000 7fd9d3fff700 1 -- 172.21.15.59:0/937367412 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d40cbe20 con 0x7fd9d415b480 2023-09-21T00:17:19.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.367+0000 7fd9d8e95700 1 --2- 172.21.15.59:0/937367412 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9d40708f0 0x7fd9d40b44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:17:19.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.367+0000 7fd9d3fff700 1 --2- 172.21.15.59:0/937367412 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9d415b480 0x7fd9d406f400 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd9c40098f0 tx=0x7fd9c4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5dcf62b83db28fe server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:19.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.367+0000 7fd9d2ffd700 1 -- 172.21.15.59:0/937367412 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c400b8a0 con 0x7fd9d415b480 2023-09-21T00:17:19.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.367+0000 7fd9d2ffd700 1 -- 172.21.15.59:0/937367412 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c400ba00 con 0x7fd9d415b480 2023-09-21T00:17:19.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.367+0000 7fd9d2ffd700 1 -- 172.21.15.59:0/937367412 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c400bd90 con 0x7fd9d415b480 2023-09-21T00:17:19.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.368+0000 7fd9da8f8700 1 -- 172.21.15.59:0/937367412 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9d415b480 msgr2=0x7fd9d406f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:19.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.368+0000 7fd9da8f8700 1 --2- 172.21.15.59:0/937367412 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9d415b480 0x7fd9d406f400 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd9c40098f0 tx=0x7fd9c4009c00 comp rx=0 tx=0).stop 2023-09-21T00:17:19.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.368+0000 7fd9da8f8700 1 -- 172.21.15.59:0/937367412 shutdown_connections 2023-09-21T00:17:19.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.368+0000 7fd9da8f8700 1 --2- 172.21.15.59:0/937367412 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9d40708f0 0x7fd9d40b44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:19.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.368+0000 7fd9da8f8700 1 --2- 172.21.15.59:0/937367412 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9d415b480 0x7fd9d406f400 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:19.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.368+0000 7fd9da8f8700 1 -- 172.21.15.59:0/937367412 >> 172.21.15.59:0/937367412 conn(0x7fd9d40d11e0 msgr2=0x7fd9d40d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:19.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.368+0000 7fd9da8f8700 1 -- 172.21.15.59:0/937367412 shutdown_connections 2023-09-21T00:17:19.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.368+0000 7fd9da8f8700 1 -- 172.21.15.59:0/937367412 wait complete. 2023-09-21T00:17:19.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.369+0000 7fd9da8f8700 1 Processor -- start 2023-09-21T00:17:19.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.369+0000 7fd9da8f8700 1 -- start start 2023-09-21T00:17:19.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.370+0000 7fd9da8f8700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9d40708f0 0x7fd9d40b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:19.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.370+0000 7fd9da8f8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9d40d0820 0x7fd9d406c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:19.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.370+0000 7fd9da8f8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9d415b480 0x7fd9d40afaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:19.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.370+0000 7fd9da8f8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d41f7400 con 0x7fd9d40d0820 2023-09-21T00:17:19.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.370+0000 7fd9da8f8700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d40c7010 con 0x7fd9d40708f0 2023-09-21T00:17:19.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.370+0000 7fd9da8f8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d41f6880 con 0x7fd9d415b480 2023-09-21T00:17:19.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.370+0000 7fd9d37fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9d40d0820 0x7fd9d406c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:19.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.370+0000 7fd9d37fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9d40d0820 0x7fd9d406c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51220/0 (socket says 172.21.15.59:51220) 2023-09-21T00:17:19.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.370+0000 7fd9d37fe700 1 -- 172.21.15.59:0/150639974 learned_addr learned my addr 172.21.15.59:0/150639974 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:19.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.370+0000 7fd9d3fff700 1 --2- 172.21.15.59:0/150639974 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9d40708f0 0x7fd9d40b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:19.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.370+0000 7fd9d8e95700 1 --2- 172.21.15.59:0/150639974 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9d415b480 0x7fd9d40afaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:19.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.370+0000 7fd9d37fe700 1 -- 172.21.15.59:0/150639974 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9d415b480 msgr2=0x7fd9d40afaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:19.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.370+0000 7fd9d37fe700 1 --2- 172.21.15.59:0/150639974 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9d415b480 0x7fd9d40afaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:19.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.370+0000 7fd9d37fe700 1 -- 172.21.15.59:0/150639974 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9d40708f0 msgr2=0x7fd9d40b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:19.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.370+0000 7fd9d37fe700 1 --2- 172.21.15.59:0/150639974 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9d40708f0 0x7fd9d40b1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:19.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.370+0000 7fd9d37fe700 1 -- 172.21.15.59:0/150639974 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c4009550 con 0x7fd9d40d0820 2023-09-21T00:17:19.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.370+0000 7fd9d8e95700 1 --2- 172.21.15.59:0/150639974 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9d415b480 0x7fd9d40afaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:17:19.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.371+0000 7fd9d37fe700 1 --2- 172.21.15.59:0/150639974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9d40d0820 0x7fd9d406c870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd9c800c4e0 tx=0x7fd9c800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:19.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.371+0000 7fd9d0ff9700 1 -- 172.21.15.59:0/150639974 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c80052d0 con 0x7fd9d40d0820 2023-09-21T00:17:19.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.371+0000 7fd9d0ff9700 1 -- 172.21.15.59:0/150639974 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c8005430 con 0x7fd9d40d0820 2023-09-21T00:17:19.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.371+0000 7fd9da8f8700 1 -- 172.21.15.59:0/150639974 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9d415b9e0 con 0x7fd9d40d0820 2023-09-21T00:17:19.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.371+0000 7fd9d0ff9700 1 -- 172.21.15.59:0/150639974 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c80038c0 con 0x7fd9d40d0820 2023-09-21T00:17:19.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.371+0000 7fd9da8f8700 1 -- 172.21.15.59:0/150639974 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9d41f6e40 con 0x7fd9d40d0820 2023-09-21T00:17:19.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.372+0000 7fd9da8f8700 1 -- 172.21.15.59:0/150639974 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9d41f3020 con 0x7fd9d40d0820 2023-09-21T00:17:19.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.372+0000 7fd9d0ff9700 1 -- 172.21.15.59:0/150639974 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fd9c8003a20 con 0x7fd9d40d0820 2023-09-21T00:17:19.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.373+0000 7fd9d0ff9700 1 --2- 172.21.15.59:0/150639974 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd9c006ae00 0x7fd9c006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:19.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.373+0000 7fd9d0ff9700 1 -- 172.21.15.59:0/150639974 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd9c8088c80 con 0x7fd9d40d0820 2023-09-21T00:17:19.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.373+0000 7fd9d3fff700 1 --2- 172.21.15.59:0/150639974 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd9c006ae00 0x7fd9c006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:19.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.373+0000 7fd9d3fff700 1 --2- 172.21.15.59:0/150639974 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd9c006ae00 0x7fd9c006d2c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4014040 tx=0x7fd9c4008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:19.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.377+0000 7fd9d0ff9700 1 -- 172.21.15.59:0/150639974 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fd9d41f3020 con 0x7fd9d40d0820 2023-09-21T00:17:19.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.580+0000 7fd9da8f8700 1 -- 172.21.15.59:0/150639974 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9d41f3020 con 0x7fd9d40d0820 2023-09-21T00:17:19.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.581+0000 7fd9d0ff9700 1 -- 172.21.15.59:0/150639974 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18262 (secure 0 0 0) 0x7fd9d41f3020 con 0x7fd9d40d0820 2023-09-21T00:17:19.582 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:17:19.583 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":24,"fsid":"dd69925c-6e25-42fe-880b-2f60fc6f384b","created":"2023-09-21T00:16:43.074489+0000","modified":"2023-09-21T00:17:11.387529+0000","last_up_change":"2023-09-21T00:16:54.740101+0000","last_in_change":"2023-09-21T00:16:45.987089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T00:16:54.796248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-21T00:17:04.167102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-21T00:17:05.313188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-21T00:17:08.977609+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d4b18344-74c0-4f75-920b-7a9247e48914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6809","nonce":2418314235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6811","nonce":2418314235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6815","nonce":2418314235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6813","nonce":2418314235}]},"public_addr":"172.21.15.59:6809/2418314235","cluster_addr":"172.21.15.59:6811/2418314235","heartbeat_back_addr":"172.21.15.59:6815/2418314235","heartbeat_front_addr":"172.21.15.59:6813/2418314235","state":["exists","up"]},{"osd":1,"uuid":"80940d50-a248-4e64-a282-7ffcdad790ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6801","nonce":869668251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6803","nonce":869668251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6807","nonce":869668251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6805","nonce":869668251}]},"public_addr":"172.21.15.59:6801/869668251","cluster_addr":"172.21.15.59:6803/869668251","heartbeat_back_addr":"172.21.15.59:6807/869668251","heartbeat_front_addr":"172.21.15.59:6805/869668251","state":["exists","up"]},{"osd":2,"uuid":"55f2eceb-c54a-4879-a6ce-968c1c548b5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6817","nonce":372517778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6819","nonce":372517778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6823","nonce":372517778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6821","nonce":372517778}]},"public_addr":"172.21.15.59:6817/372517778","cluster_addr":"172.21.15.59:6819/372517778","heartbeat_back_addr":"172.21.15.59:6823/372517778","heartbeat_front_addr":"172.21.15.59:6821/372517778","state":["exists","up"]},{"osd":3,"uuid":"92b89cd0-869c-49b9-a9f9-97ac8423f304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6825","nonce":575188498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6827","nonce":575188498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6831","nonce":575188498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6829","nonce":575188498}]},"public_addr":"172.21.15.59:6825/575188498","cluster_addr":"172.21.15.59:6827/575188498","heartbeat_back_addr":"172.21.15.59:6831/575188498","heartbeat_front_addr":"172.21.15.59:6829/575188498","state":["exists","up"]},{"osd":4,"uuid":"25b80e94-e0e6-403d-b69f-61542f289637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6803","nonce":1741219098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6805","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6807","nonce":1741219098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6815","nonce":1741219098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6811","nonce":1741219098}]},"public_addr":"172.21.15.83:6803/1741219098","cluster_addr":"172.21.15.83:6807/1741219098","heartbeat_back_addr":"172.21.15.83:6815/1741219098","heartbeat_front_addr":"172.21.15.83:6811/1741219098","state":["exists","up"]},{"osd":5,"uuid":"5498d9ab-1086-4796-a199-9051e6dfea91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6817","nonce":156730565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6819","nonce":156730565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6823","nonce":156730565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6821","nonce":156730565}]},"public_addr":"172.21.15.83:6817/156730565","cluster_addr":"172.21.15.83:6819/156730565","heartbeat_back_addr":"172.21.15.83:6823/156730565","heartbeat_front_addr":"172.21.15.83:6821/156730565","state":["exists","up"]},{"osd":6,"uuid":"cfd810c0-5015-4d60-9a75-7efc93a32e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6801","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6800","nonce":1337723778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6806","nonce":1337723778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6814","nonce":1337723778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6810","nonce":1337723778}]},"public_addr":"172.21.15.83:6800/1337723778","cluster_addr":"172.21.15.83:6806/1337723778","heartbeat_back_addr":"172.21.15.83:6814/1337723778","heartbeat_front_addr":"172.21.15.83:6810/1337723778","state":["exists","up"]},{"osd":7,"uuid":"e992c8fa-0a3d-4b3c-85b5-2c511223dee4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6825","nonce":4204859272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6827","nonce":4204859272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6831","nonce":4204859272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6829","nonce":4204859272}]},"public_addr":"172.21.15.83:6825/4204859272","cluster_addr":"172.21.15.83:6827/4204859272","heartbeat_back_addr":"172.21.15.83:6831/4204859272","heartbeat_front_addr":"172.21.15.83:6829/4204859272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.156498+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.882707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.093978+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.158565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.173933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.888606+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.135525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.149712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T00:17:19.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.583+0000 7fd9da8f8700 1 -- 172.21.15.59:0/150639974 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd9c006ae00 msgr2=0x7fd9c006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:19.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.583+0000 7fd9da8f8700 1 --2- 172.21.15.59:0/150639974 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd9c006ae00 0x7fd9c006d2c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4014040 tx=0x7fd9c4008030 comp rx=0 tx=0).stop 2023-09-21T00:17:19.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.583+0000 7fd9da8f8700 1 -- 172.21.15.59:0/150639974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9d40d0820 msgr2=0x7fd9d406c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:19.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.583+0000 7fd9da8f8700 1 --2- 172.21.15.59:0/150639974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9d40d0820 0x7fd9d406c870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd9c800c4e0 tx=0x7fd9c800c7f0 comp rx=0 tx=0).stop 2023-09-21T00:17:19.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.583+0000 7fd9da8f8700 1 -- 172.21.15.59:0/150639974 shutdown_connections 2023-09-21T00:17:19.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.583+0000 7fd9da8f8700 1 --2- 172.21.15.59:0/150639974 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd9c006ae00 0x7fd9c006d2c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:19.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.583+0000 7fd9da8f8700 1 --2- 172.21.15.59:0/150639974 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9d415b480 0x7fd9d40afaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:19.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.583+0000 7fd9da8f8700 1 --2- 172.21.15.59:0/150639974 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9d40708f0 0x7fd9d40b1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:19.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.583+0000 7fd9da8f8700 1 --2- 172.21.15.59:0/150639974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9d40d0820 0x7fd9d406c870 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:19.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.583+0000 7fd9da8f8700 1 -- 172.21.15.59:0/150639974 >> 172.21.15.59:0/150639974 conn(0x7fd9d40d11e0 msgr2=0x7fd9d4159210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:19.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.583+0000 7fd9da8f8700 1 -- 172.21.15.59:0/150639974 shutdown_connections 2023-09-21T00:17:19.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.583+0000 7fd9da8f8700 1 -- 172.21.15.59:0/150639974 wait complete. 2023-09-21T00:17:19.596 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-21T00:16:54.796248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-21T00:17:04.167102+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-21T00:17:05.313188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-21T00:17:08.977609+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-21T00:17:19.597 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-21T00:17:19.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.725+0000 7f75eebcd700 1 Processor -- start 2023-09-21T00:17:19.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.725+0000 7f75eebcd700 1 -- start start 2023-09-21T00:17:19.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.725+0000 7f75eebcd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f75e815b2b0 0x7f75e80cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:19.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.725+0000 7f75eebcd700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f75e80ce420 0x7f75e8161190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:19.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.725+0000 7f75eebcd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f75e806a780 0x7f75e806abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:19.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.725+0000 7f75eebcd700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75e80ce250 con 0x7f75e815b2b0 2023-09-21T00:17:19.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.725+0000 7f75eebcd700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75e806b110 con 0x7f75e80ce420 2023-09-21T00:17:19.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.725+0000 7f75eebcd700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e80cfee0 con 0x7f75e806a780 2023-09-21T00:17:19.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.726+0000 7f75ec969700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f75e815b2b0 0x7f75e80cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:19.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.726+0000 7f75ec969700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f75e815b2b0 0x7f75e80cdd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51226/0 (socket says 172.21.15.59:51226) 2023-09-21T00:17:19.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.726+0000 7f75ec969700 1 -- 172.21.15.59:0/1030840074 learned_addr learned my addr 172.21.15.59:0/1030840074 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:19.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.726+0000 7f75e7fff700 1 --2- 172.21.15.59:0/1030840074 >> v2:172.21.15.83:3300/0 conn(0x7f75e80ce420 0x7f75e8161190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:19.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.726+0000 7f75ed16a700 1 --2- 172.21.15.59:0/1030840074 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f75e806a780 0x7f75e806abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:19.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.726+0000 7f75ec969700 1 -- 172.21.15.59:0/1030840074 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f75e806a780 msgr2=0x7f75e806abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:19.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.726+0000 7f75ec969700 1 --2- 172.21.15.59:0/1030840074 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f75e806a780 0x7f75e806abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:19.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.726+0000 7f75ec969700 1 -- 172.21.15.59:0/1030840074 >> v2:172.21.15.83:3300/0 conn(0x7f75e80ce420 msgr2=0x7f75e8161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:19.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.726+0000 7f75ec969700 1 --2- 172.21.15.59:0/1030840074 >> v2:172.21.15.83:3300/0 conn(0x7f75e80ce420 0x7f75e8161190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:19.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.726+0000 7f75ec969700 1 -- 172.21.15.59:0/1030840074 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e80ce900 con 0x7f75e815b2b0 2023-09-21T00:17:19.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.726+0000 7f75ed16a700 1 --2- 172.21.15.59:0/1030840074 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f75e806a780 0x7f75e806abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:17:19.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.726+0000 7f75ec969700 1 --2- 172.21.15.59:0/1030840074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75e815b2b0 0x7f75e80cdd10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f75e8072750 tx=0x7f75dc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bbfa30755d3bdd9 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:19.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.726+0000 7f75e77fe700 1 -- 172.21.15.59:0/1030840074 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75dc00b870 con 0x7f75e815b2b0 2023-09-21T00:17:19.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.726+0000 7f75e77fe700 1 -- 172.21.15.59:0/1030840074 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75dc00b9d0 con 0x7f75e815b2b0 2023-09-21T00:17:19.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.726+0000 7f75e77fe700 1 -- 172.21.15.59:0/1030840074 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75dc00bd60 con 0x7f75e815b2b0 2023-09-21T00:17:19.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.727+0000 7f75eebcd700 1 -- 172.21.15.59:0/1030840074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75e815b2b0 msgr2=0x7f75e80cdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:19.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.727+0000 7f75eebcd700 1 --2- 172.21.15.59:0/1030840074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75e815b2b0 0x7f75e80cdd10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f75e8072750 tx=0x7f75dc009bd0 comp rx=0 tx=0).stop 2023-09-21T00:17:19.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.727+0000 7f75eebcd700 1 -- 172.21.15.59:0/1030840074 shutdown_connections 2023-09-21T00:17:19.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.727+0000 7f75eebcd700 1 --2- 172.21.15.59:0/1030840074 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f75e806a780 0x7f75e806abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:19.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.727+0000 7f75eebcd700 1 --2- 172.21.15.59:0/1030840074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75e815b2b0 0x7f75e80cdd10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:19.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.727+0000 7f75eebcd700 1 --2- 172.21.15.59:0/1030840074 >> v2:172.21.15.83:3300/0 conn(0x7f75e80ce420 0x7f75e8161190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:19.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.727+0000 7f75eebcd700 1 -- 172.21.15.59:0/1030840074 >> 172.21.15.59:0/1030840074 conn(0x7f75e80d0140 msgr2=0x7f75e80d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:19.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.727+0000 7f75eebcd700 1 -- 172.21.15.59:0/1030840074 shutdown_connections 2023-09-21T00:17:19.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.727+0000 7f75eebcd700 1 -- 172.21.15.59:0/1030840074 wait complete. 2023-09-21T00:17:19.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.728+0000 7f75eebcd700 1 Processor -- start 2023-09-21T00:17:19.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.728+0000 7f75eebcd700 1 -- start start 2023-09-21T00:17:19.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.729+0000 7f75eebcd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75e806a780 0x7f75e81e5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:19.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.729+0000 7f75eebcd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f75e80ce420 0x7f75e81573b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:19.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.729+0000 7f75eebcd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75e815b2b0 0x7f75e80ae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:19.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.729+0000 7f75eebcd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e81e7930 con 0x7f75e815b2b0 2023-09-21T00:17:19.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.729+0000 7f75eebcd700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e81578f0 con 0x7f75e806a780 2023-09-21T00:17:19.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.729+0000 7f75eebcd700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e81e6d20 con 0x7f75e80ce420 2023-09-21T00:17:19.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.729+0000 7f75ed16a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75e815b2b0 0x7f75e80ae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:19.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.729+0000 7f75ed16a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75e815b2b0 0x7f75e80ae2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51236/0 (socket says 172.21.15.59:51236) 2023-09-21T00:17:19.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.729+0000 7f75ed16a700 1 -- 172.21.15.59:0/3153140126 learned_addr learned my addr 172.21.15.59:0/3153140126 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:19.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.729+0000 7f75e7fff700 1 --2- 172.21.15.59:0/3153140126 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f75e80ce420 0x7f75e81573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:19.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.729+0000 7f75ec969700 1 --2- 172.21.15.59:0/3153140126 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75e806a780 0x7f75e81e5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:19.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.730+0000 7f75ed16a700 1 -- 172.21.15.59:0/3153140126 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f75e80ce420 msgr2=0x7f75e81573b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:19.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.730+0000 7f75ed16a700 1 --2- 172.21.15.59:0/3153140126 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f75e80ce420 0x7f75e81573b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:19.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.730+0000 7f75ed16a700 1 -- 172.21.15.59:0/3153140126 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75e806a780 msgr2=0x7f75e81e5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:19.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.730+0000 7f75ed16a700 1 --2- 172.21.15.59:0/3153140126 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75e806a780 0x7f75e81e5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:19.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.730+0000 7f75ed16a700 1 -- 172.21.15.59:0/3153140126 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75dc009550 con 0x7f75e815b2b0 2023-09-21T00:17:19.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.730+0000 7f75ec969700 1 --2- 172.21.15.59:0/3153140126 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75e806a780 0x7f75e81e5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:17:19.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.730+0000 7f75ed16a700 1 --2- 172.21.15.59:0/3153140126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75e815b2b0 0x7f75e80ae2e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f75e000cef0 tx=0x7f75e000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:19.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.730+0000 7f75e57fa700 1 -- 172.21.15.59:0/3153140126 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e000add0 con 0x7f75e815b2b0 2023-09-21T00:17:19.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.730+0000 7f75e57fa700 1 -- 172.21.15.59:0/3153140126 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e0015440 con 0x7f75e815b2b0 2023-09-21T00:17:19.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.730+0000 7f75eebcd700 1 -- 172.21.15.59:0/3153140126 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75e81e7000 con 0x7f75e815b2b0 2023-09-21T00:17:19.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.730+0000 7f75e57fa700 1 -- 172.21.15.59:0/3153140126 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e00157f0 con 0x7f75e815b2b0 2023-09-21T00:17:19.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.730+0000 7f75eebcd700 1 -- 172.21.15.59:0/3153140126 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75e81e75c0 con 0x7f75e815b2b0 2023-09-21T00:17:19.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.731+0000 7f75eebcd700 1 -- 172.21.15.59:0/3153140126 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75e81e7ae0 con 0x7f75e815b2b0 2023-09-21T00:17:19.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.731+0000 7f75e57fa700 1 -- 172.21.15.59:0/3153140126 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f75e000d430 con 0x7f75e815b2b0 2023-09-21T00:17:19.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.732+0000 7f75e57fa700 1 --2- 172.21.15.59:0/3153140126 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f75cc06ae00 0x7f75cc06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:19.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.732+0000 7f75e57fa700 1 -- 172.21.15.59:0/3153140126 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f75e0089e40 con 0x7f75e815b2b0 2023-09-21T00:17:19.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.732+0000 7f75ec969700 1 --2- 172.21.15.59:0/3153140126 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f75cc06ae00 0x7f75cc06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:19.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.732+0000 7f75ec969700 1 --2- 172.21.15.59:0/3153140126 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f75cc06ae00 0x7f75cc06d2c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f75dc009130 tx=0x7f75dc008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:19.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.736+0000 7f75e57fa700 1 -- 172.21.15.59:0/3153140126 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f75e81e7ae0 con 0x7f75e815b2b0 2023-09-21T00:17:19.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.935+0000 7f75eebcd700 1 -- 172.21.15.59:0/3153140126 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f75e8067e50 con 0x7f75e815b2b0 2023-09-21T00:17:19.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.936+0000 7f75e57fa700 1 -- 172.21.15.59:0/3153140126 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f75e001a020 con 0x7f75e815b2b0 2023-09-21T00:17:19.937 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-09-21T00:17:19.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.938+0000 7f75eebcd700 1 -- 172.21.15.59:0/3153140126 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f75cc06ae00 msgr2=0x7f75cc06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:19.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.938+0000 7f75eebcd700 1 --2- 172.21.15.59:0/3153140126 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f75cc06ae00 0x7f75cc06d2c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f75dc009130 tx=0x7f75dc008030 comp rx=0 tx=0).stop 2023-09-21T00:17:19.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.938+0000 7f75eebcd700 1 -- 172.21.15.59:0/3153140126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75e815b2b0 msgr2=0x7f75e80ae2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:19.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.938+0000 7f75eebcd700 1 --2- 172.21.15.59:0/3153140126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75e815b2b0 0x7f75e80ae2e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f75e000cef0 tx=0x7f75e000a340 comp rx=0 tx=0).stop 2023-09-21T00:17:19.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.938+0000 7f75eebcd700 1 -- 172.21.15.59:0/3153140126 shutdown_connections 2023-09-21T00:17:19.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.938+0000 7f75eebcd700 1 --2- 172.21.15.59:0/3153140126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75e815b2b0 0x7f75e80ae2e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:19.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.938+0000 7f75eebcd700 1 --2- 172.21.15.59:0/3153140126 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75e806a780 0x7f75e81e5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:19.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.938+0000 7f75eebcd700 1 --2- 172.21.15.59:0/3153140126 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f75cc06ae00 0x7f75cc06d2c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:19.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.938+0000 7f75eebcd700 1 --2- 172.21.15.59:0/3153140126 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f75e80ce420 0x7f75e81573b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:19.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.938+0000 7f75eebcd700 1 -- 172.21.15.59:0/3153140126 >> 172.21.15.59:0/3153140126 conn(0x7f75e80d0140 msgr2=0x7f75e80ac890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:19.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.938+0000 7f75eebcd700 1 -- 172.21.15.59:0/3153140126 shutdown_connections 2023-09-21T00:17:19.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:19.938+0000 7f75eebcd700 1 -- 172.21.15.59:0/3153140126 wait complete. 2023-09-21T00:17:19.951 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-21T00:17:20.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.078+0000 7fb90027a700 1 Processor -- start 2023-09-21T00:17:20.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.078+0000 7fb90027a700 1 -- start start 2023-09-21T00:17:20.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.079+0000 7fb90027a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb8f80ce420 0x7fb8f80cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:20.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.079+0000 7fb90027a700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb8f806a780 0x7fb8f806abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:20.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.079+0000 7fb90027a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8f806b110 con 0x7fb8f815b2b0 2023-09-21T00:17:20.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.079+0000 7fb90027a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8f80ce250 con 0x7fb8f80ce420 2023-09-21T00:17:20.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.079+0000 7fb90027a700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8f81618a0 con 0x7fb8f806a780 2023-09-21T00:17:20.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.079+0000 7fb8fd815700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb8f80ce420 0x7fb8f80cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:20.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.079+0000 7fb8fe016700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb8f815b2b0 0x7fb8f8161190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56808/0 (socket says 172.21.15.59:56808) 2023-09-21T00:17:20.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.079+0000 7fb8fe016700 1 -- 172.21.15.59:0/1411196803 learned_addr learned my addr 172.21.15.59:0/1411196803 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:20.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.079+0000 7fb8fe817700 1 --2- 172.21.15.59:0/1411196803 >> v2:172.21.15.83:3300/0 conn(0x7fb8f806a780 0x7fb8f806abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:20.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.079+0000 7fb8fd014700 1 -- 172.21.15.59:0/1411196803 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1869137754 0 0) 0x7fb8e8001110 con 0x7fb8f815b2b0 2023-09-21T00:17:20.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.079+0000 7fb8fd014700 1 -- 172.21.15.59:0/1411196803 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8e40035b0 con 0x7fb8f815b2b0 2023-09-21T00:17:20.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.080+0000 7fb8fd815700 1 -- 172.21.15.59:0/1411196803 >> v2:172.21.15.83:3300/0 conn(0x7fb8f806a780 msgr2=0x7fb8f806abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:20.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.080+0000 7fb8fd815700 1 --2- 172.21.15.59:0/1411196803 >> v2:172.21.15.83:3300/0 conn(0x7fb8f806a780 0x7fb8f806abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:20.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.080+0000 7fb8fd815700 1 -- 172.21.15.59:0/1411196803 >> v1:172.21.15.59:6789/0 conn(0x7fb8f815b2b0 legacy=0x7fb8f8161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:20.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.080+0000 7fb8fd815700 1 -- 172.21.15.59:0/1411196803 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f80cfee0 con 0x7fb8f80ce420 2023-09-21T00:17:20.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.080+0000 7fb8fd815700 1 --2- 172.21.15.59:0/1411196803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8f80ce420 0x7fb8f80cdd10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb8f80cbf10 tx=0x7fb8f4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce68ae013b503380 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:20.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.080+0000 7fb8fd014700 1 -- 172.21.15.59:0/1411196803 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f4011830 con 0x7fb8f80ce420 2023-09-21T00:17:20.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.080+0000 7fb8fd014700 1 -- 172.21.15.59:0/1411196803 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f4011990 con 0x7fb8f80ce420 2023-09-21T00:17:20.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.080+0000 7fb8fd014700 1 -- 172.21.15.59:0/1411196803 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f4011d20 con 0x7fb8f80ce420 2023-09-21T00:17:20.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.080+0000 7fb90027a700 1 -- 172.21.15.59:0/1411196803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8f80ce420 msgr2=0x7fb8f80cdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:20.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.080+0000 7fb90027a700 1 --2- 172.21.15.59:0/1411196803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8f80ce420 0x7fb8f80cdd10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb8f80cbf10 tx=0x7fb8f4009b20 comp rx=0 tx=0).stop 2023-09-21T00:17:20.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.081+0000 7fb90027a700 1 -- 172.21.15.59:0/1411196803 shutdown_connections 2023-09-21T00:17:20.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.081+0000 7fb90027a700 1 --2- 172.21.15.59:0/1411196803 >> v2:172.21.15.83:3300/0 conn(0x7fb8f806a780 0x7fb8f806abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:20.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.081+0000 7fb90027a700 1 --2- 172.21.15.59:0/1411196803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8f80ce420 0x7fb8f80cdd10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:20.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.081+0000 7fb90027a700 1 -- 172.21.15.59:0/1411196803 >> 172.21.15.59:0/1411196803 conn(0x7fb8f80d0140 msgr2=0x7fb8f80d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:20.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.081+0000 7fb90027a700 1 -- 172.21.15.59:0/1411196803 shutdown_connections 2023-09-21T00:17:20.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.081+0000 7fb90027a700 1 -- 172.21.15.59:0/1411196803 wait complete. 2023-09-21T00:17:20.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.082+0000 7fb90027a700 1 Processor -- start 2023-09-21T00:17:20.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.082+0000 7fb90027a700 1 -- start start 2023-09-21T00:17:20.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.083+0000 7fb90027a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8f806a780 0x7fb8f80c2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:20.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.083+0000 7fb90027a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8f80ce420 0x7fb8f80ae050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:20.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.083+0000 7fb90027a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8f815b2b0 0x7fb8f80ae590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:20.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.083+0000 7fb90027a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f80c3240 con 0x7fb8f80ce420 2023-09-21T00:17:20.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.083+0000 7fb90027a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f80c3c70 con 0x7fb8f815b2b0 2023-09-21T00:17:20.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.083+0000 7fb90027a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f80c3ec0 con 0x7fb8f806a780 2023-09-21T00:17:20.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.083+0000 7fb8fd815700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8f80ce420 0x7fb8f80ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:20.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.083+0000 7fb8fd815700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8f80ce420 0x7fb8f80ae050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51248/0 (socket says 172.21.15.59:51248) 2023-09-21T00:17:20.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.083+0000 7fb8fd815700 1 -- 172.21.15.59:0/3698350335 learned_addr learned my addr 172.21.15.59:0/3698350335 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:20.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.083+0000 7fb8fe817700 1 --2- 172.21.15.59:0/3698350335 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8f815b2b0 0x7fb8f80ae590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:20.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.083+0000 7fb8fd815700 1 -- 172.21.15.59:0/3698350335 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8f806a780 msgr2=0x7fb8f80c2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:20.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.083+0000 7fb8fd815700 1 --2- 172.21.15.59:0/3698350335 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8f806a780 0x7fb8f80c2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:20.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.083+0000 7fb8fd815700 1 -- 172.21.15.59:0/3698350335 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8f815b2b0 msgr2=0x7fb8f80ae590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:20.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.083+0000 7fb8fd815700 1 --2- 172.21.15.59:0/3698350335 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8f815b2b0 0x7fb8f80ae590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:20.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.083+0000 7fb8fd815700 1 -- 172.21.15.59:0/3698350335 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f40094a0 con 0x7fb8f80ce420 2023-09-21T00:17:20.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.083+0000 7fb8fe817700 1 --2- 172.21.15.59:0/3698350335 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8f815b2b0 0x7fb8f80ae590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:17:20.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.083+0000 7fb8fd815700 1 --2- 172.21.15.59:0/3698350335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8f80ce420 0x7fb8f80ae050 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4009b60 tx=0x7fb8f4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:20.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.083+0000 7fb8eeffd700 1 -- 172.21.15.59:0/3698350335 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f40038a0 con 0x7fb8f80ce420 2023-09-21T00:17:20.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.083+0000 7fb8eeffd700 1 -- 172.21.15.59:0/3698350335 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f401f070 con 0x7fb8f80ce420 2023-09-21T00:17:20.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.083+0000 7fb90027a700 1 -- 172.21.15.59:0/3698350335 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f80c41a0 con 0x7fb8f80ce420 2023-09-21T00:17:20.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.083+0000 7fb8eeffd700 1 -- 172.21.15.59:0/3698350335 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f4003c40 con 0x7fb8f80ce420 2023-09-21T00:17:20.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.083+0000 7fb90027a700 1 -- 172.21.15.59:0/3698350335 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f80c4760 con 0x7fb8f80ce420 2023-09-21T00:17:20.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.084+0000 7fb90027a700 1 -- 172.21.15.59:0/3698350335 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f8067e50 con 0x7fb8f80ce420 2023-09-21T00:17:20.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.085+0000 7fb8eeffd700 1 -- 172.21.15.59:0/3698350335 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fb8f4026480 con 0x7fb8f80ce420 2023-09-21T00:17:20.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.085+0000 7fb8eeffd700 1 --2- 172.21.15.59:0/3698350335 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fb8dc06ae00 0x7fb8dc06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:20.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.085+0000 7fb8eeffd700 1 -- 172.21.15.59:0/3698350335 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb8f4021070 con 0x7fb8f80ce420 2023-09-21T00:17:20.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.086+0000 7fb8fe016700 1 --2- 172.21.15.59:0/3698350335 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fb8dc06ae00 0x7fb8dc06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:20.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.086+0000 7fb8fe016700 1 --2- 172.21.15.59:0/3698350335 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fb8dc06ae00 0x7fb8dc06d2c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8005910 tx=0x7fb8e8001150 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:20.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.090+0000 7fb8eeffd700 1 -- 172.21.15.59:0/3698350335 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fb8f4055e90 con 0x7fb8f80ce420 2023-09-21T00:17:20.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.289+0000 7fb90027a700 1 -- 172.21.15.59:0/3698350335 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb8f80af470 con 0x7fb8f80ce420 2023-09-21T00:17:20.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.289+0000 7fb8eeffd700 1 -- 172.21.15.59:0/3698350335 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb8f402b020 con 0x7fb8f80ce420 2023-09-21T00:17:20.291 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-09-21T00:17:20.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.291+0000 7fb90027a700 1 -- 172.21.15.59:0/3698350335 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fb8dc06ae00 msgr2=0x7fb8dc06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:20.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.291+0000 7fb90027a700 1 --2- 172.21.15.59:0/3698350335 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fb8dc06ae00 0x7fb8dc06d2c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8005910 tx=0x7fb8e8001150 comp rx=0 tx=0).stop 2023-09-21T00:17:20.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.291+0000 7fb90027a700 1 -- 172.21.15.59:0/3698350335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8f80ce420 msgr2=0x7fb8f80ae050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:20.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.291+0000 7fb90027a700 1 --2- 172.21.15.59:0/3698350335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8f80ce420 0x7fb8f80ae050 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4009b60 tx=0x7fb8f4004750 comp rx=0 tx=0).stop 2023-09-21T00:17:20.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.291+0000 7fb90027a700 1 -- 172.21.15.59:0/3698350335 shutdown_connections 2023-09-21T00:17:20.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.291+0000 7fb90027a700 1 --2- 172.21.15.59:0/3698350335 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8f815b2b0 0x7fb8f80ae590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:20.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.291+0000 7fb90027a700 1 --2- 172.21.15.59:0/3698350335 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fb8dc06ae00 0x7fb8dc06d2c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:20.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.291+0000 7fb90027a700 1 --2- 172.21.15.59:0/3698350335 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8f806a780 0x7fb8f80c2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:20.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.291+0000 7fb90027a700 1 --2- 172.21.15.59:0/3698350335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8f80ce420 0x7fb8f80ae050 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:20.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.291+0000 7fb90027a700 1 -- 172.21.15.59:0/3698350335 >> 172.21.15.59:0/3698350335 conn(0x7fb8f80d0140 msgr2=0x7fb8f806f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:20.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.292+0000 7fb90027a700 1 -- 172.21.15.59:0/3698350335 shutdown_connections 2023-09-21T00:17:20.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.292+0000 7fb90027a700 1 -- 172.21.15.59:0/3698350335 wait complete. 2023-09-21T00:17:20.304 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-21T00:17:20.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.431+0000 7f40f4646700 1 Processor -- start 2023-09-21T00:17:20.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.431+0000 7f40f4646700 1 -- start start 2023-09-21T00:17:20.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.432+0000 7f40f4646700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f40ec0ca790 0x7f40ec071680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:20.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.432+0000 7f40f4646700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40ec0cb1c0 con 0x7f40ec15a230 2023-09-21T00:17:20.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.432+0000 7f40f4646700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40ec0cb4a0 con 0x7f40ec0cac20 2023-09-21T00:17:20.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.432+0000 7f40f4646700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40ec0cb780 con 0x7f40ec0ca790 2023-09-21T00:17:20.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.432+0000 7f40f1be1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f40ec0ca790 0x7f40ec071680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:20.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.432+0000 7f40f1be1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f40ec0ca790 0x7f40ec071680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51258/0 (socket says 172.21.15.59:51258) 2023-09-21T00:17:20.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.432+0000 7f40f1be1700 1 -- 172.21.15.59:0/689918664 learned_addr learned my addr 172.21.15.59:0/689918664 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:20.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.433+0000 7f40f1be1700 1 -- 172.21.15.59:0/689918664 >> v1:172.21.15.83:6789/0 conn(0x7f40ec0cac20 legacy=0x7f40ec06eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:20.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.433+0000 7f40f1be1700 1 -- 172.21.15.59:0/689918664 >> v1:172.21.15.59:6789/0 conn(0x7f40ec15a230 legacy=0x7f40ec15e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:20.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.433+0000 7f40f1be1700 1 -- 172.21.15.59:0/689918664 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ec15e0b0 con 0x7f40ec0ca790 2023-09-21T00:17:20.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.433+0000 7f40f1be1700 1 --2- 172.21.15.59:0/689918664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40ec0ca790 0x7f40ec071680 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f40e800bb90 tx=0x7f40e800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34c059edad9f8235 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:20.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.433+0000 7f40f13e0700 1 -- 172.21.15.59:0/689918664 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e800dd50 con 0x7f40ec0ca790 2023-09-21T00:17:20.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.433+0000 7f40f13e0700 1 -- 172.21.15.59:0/689918664 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e8010470 con 0x7f40ec0ca790 2023-09-21T00:17:20.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.433+0000 7f40f13e0700 1 -- 172.21.15.59:0/689918664 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e8010800 con 0x7f40ec0ca790 2023-09-21T00:17:20.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.434+0000 7f40f4646700 1 -- 172.21.15.59:0/689918664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40ec0ca790 msgr2=0x7f40ec071680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:20.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.434+0000 7f40f4646700 1 --2- 172.21.15.59:0/689918664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40ec0ca790 0x7f40ec071680 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f40e800bb90 tx=0x7f40e800bea0 comp rx=0 tx=0).stop 2023-09-21T00:17:20.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.434+0000 7f40f4646700 1 -- 172.21.15.59:0/689918664 shutdown_connections 2023-09-21T00:17:20.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.434+0000 7f40f4646700 1 --2- 172.21.15.59:0/689918664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40ec0ca790 0x7f40ec071680 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:20.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.434+0000 7f40f4646700 1 -- 172.21.15.59:0/689918664 >> 172.21.15.59:0/689918664 conn(0x7f40ec0d0140 msgr2=0x7f40ec0d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:20.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.434+0000 7f40f4646700 1 -- 172.21.15.59:0/689918664 shutdown_connections 2023-09-21T00:17:20.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.434+0000 7f40f4646700 1 -- 172.21.15.59:0/689918664 wait complete. 2023-09-21T00:17:20.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.435+0000 7f40f4646700 1 Processor -- start 2023-09-21T00:17:20.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.435+0000 7f40f4646700 1 -- start start 2023-09-21T00:17:20.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.436+0000 7f40f4646700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f40ec0ca790 0x7f40ec155500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:20.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.436+0000 7f40f4646700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40ec0cac20 0x7f40ec0b0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:20.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.436+0000 7f40f4646700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f40ec15a230 0x7f40ec0b1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:20.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.436+0000 7f40f4646700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec0ae1b0 con 0x7f40ec0cac20 2023-09-21T00:17:20.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.436+0000 7f40f4646700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec0ae490 con 0x7f40ec15a230 2023-09-21T00:17:20.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.436+0000 7f40f4646700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec0ae770 con 0x7f40ec0ca790 2023-09-21T00:17:20.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.436+0000 7f40f1be1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40ec0cac20 0x7f40ec0b0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:20.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.436+0000 7f40f1be1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40ec0cac20 0x7f40ec0b0de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51262/0 (socket says 172.21.15.59:51262) 2023-09-21T00:17:20.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.436+0000 7f40f1be1700 1 -- 172.21.15.59:0/3387049193 learned_addr learned my addr 172.21.15.59:0/3387049193 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:20.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.436+0000 7f40f2be3700 1 --2- 172.21.15.59:0/3387049193 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f40ec15a230 0x7f40ec0b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:20.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.436+0000 7f40f23e2700 1 --2- 172.21.15.59:0/3387049193 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f40ec0ca790 0x7f40ec155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:20.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.436+0000 7f40f1be1700 1 -- 172.21.15.59:0/3387049193 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f40ec0ca790 msgr2=0x7f40ec155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:20.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.436+0000 7f40f1be1700 1 --2- 172.21.15.59:0/3387049193 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f40ec0ca790 0x7f40ec155500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:20.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.436+0000 7f40f1be1700 1 -- 172.21.15.59:0/3387049193 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f40ec15a230 msgr2=0x7f40ec0b1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:20.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.436+0000 7f40f1be1700 1 --2- 172.21.15.59:0/3387049193 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f40ec15a230 0x7f40ec0b1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:20.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.437+0000 7f40f1be1700 1 -- 172.21.15.59:0/3387049193 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e800b7f0 con 0x7f40ec0cac20 2023-09-21T00:17:20.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.437+0000 7f40f2be3700 1 --2- 172.21.15.59:0/3387049193 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f40ec15a230 0x7f40ec0b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:17:20.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.437+0000 7f40f1be1700 1 --2- 172.21.15.59:0/3387049193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40ec0cac20 0x7f40ec0b0de0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f40e800bee0 tx=0x7f40e8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:20.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.437+0000 7f40e2ffd700 1 -- 172.21.15.59:0/3387049193 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e8003c30 con 0x7f40ec0cac20 2023-09-21T00:17:20.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.437+0000 7f40e2ffd700 1 -- 172.21.15.59:0/3387049193 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e8003d90 con 0x7f40ec0cac20 2023-09-21T00:17:20.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.437+0000 7f40f4646700 1 -- 172.21.15.59:0/3387049193 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40ec0aea50 con 0x7f40ec0cac20 2023-09-21T00:17:20.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.437+0000 7f40e2ffd700 1 -- 172.21.15.59:0/3387049193 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e8010820 con 0x7f40ec0cac20 2023-09-21T00:17:20.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.437+0000 7f40f4646700 1 -- 172.21.15.59:0/3387049193 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40ec155a40 con 0x7f40ec0cac20 2023-09-21T00:17:20.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.438+0000 7f40f4646700 1 -- 172.21.15.59:0/3387049193 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40ec0aef70 con 0x7f40ec0cac20 2023-09-21T00:17:20.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.438+0000 7f40e2ffd700 1 -- 172.21.15.59:0/3387049193 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f40e8019400 con 0x7f40ec0cac20 2023-09-21T00:17:20.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.439+0000 7f40e2ffd700 1 --2- 172.21.15.59:0/3387049193 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f40d006ae00 0x7f40d006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:20.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.439+0000 7f40e2ffd700 1 -- 172.21.15.59:0/3387049193 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f40e808ae20 con 0x7f40ec0cac20 2023-09-21T00:17:20.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.439+0000 7f40f23e2700 1 --2- 172.21.15.59:0/3387049193 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f40d006ae00 0x7f40d006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:20.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.439+0000 7f40f23e2700 1 --2- 172.21.15.59:0/3387049193 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f40d006ae00 0x7f40d006d2c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f40dc000f60 tx=0x7f40dc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:20.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.443+0000 7f40e2ffd700 1 -- 172.21.15.59:0/3387049193 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f40ec0aef70 con 0x7f40ec0cac20 2023-09-21T00:17:20.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.643+0000 7f40f4646700 1 -- 172.21.15.59:0/3387049193 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f40ec0aef70 con 0x7f40ec0cac20 2023-09-21T00:17:20.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.644+0000 7f40e2ffd700 1 -- 172.21.15.59:0/3387049193 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f40ec0aef70 con 0x7f40ec0cac20 2023-09-21T00:17:20.645 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-09-21T00:17:20.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.645+0000 7f40f4646700 1 -- 172.21.15.59:0/3387049193 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f40d006ae00 msgr2=0x7f40d006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:20.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.645+0000 7f40f4646700 1 --2- 172.21.15.59:0/3387049193 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f40d006ae00 0x7f40d006d2c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f40dc000f60 tx=0x7f40dc009040 comp rx=0 tx=0).stop 2023-09-21T00:17:20.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.645+0000 7f40f4646700 1 -- 172.21.15.59:0/3387049193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40ec0cac20 msgr2=0x7f40ec0b0de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:20.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.645+0000 7f40f4646700 1 --2- 172.21.15.59:0/3387049193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40ec0cac20 0x7f40ec0b0de0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f40e800bee0 tx=0x7f40e8004750 comp rx=0 tx=0).stop 2023-09-21T00:17:20.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.646+0000 7f40f4646700 1 -- 172.21.15.59:0/3387049193 shutdown_connections 2023-09-21T00:17:20.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.646+0000 7f40f4646700 1 --2- 172.21.15.59:0/3387049193 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f40ec15a230 0x7f40ec0b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:20.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.646+0000 7f40f4646700 1 --2- 172.21.15.59:0/3387049193 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f40d006ae00 0x7f40d006d2c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:20.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.646+0000 7f40f4646700 1 --2- 172.21.15.59:0/3387049193 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f40ec0ca790 0x7f40ec155500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:20.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.646+0000 7f40f4646700 1 --2- 172.21.15.59:0/3387049193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40ec0cac20 0x7f40ec0b0de0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:20.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.646+0000 7f40f4646700 1 -- 172.21.15.59:0/3387049193 >> 172.21.15.59:0/3387049193 conn(0x7f40ec0d0140 msgr2=0x7f40ec0cdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:20.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.646+0000 7f40f4646700 1 -- 172.21.15.59:0/3387049193 shutdown_connections 2023-09-21T00:17:20.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.646+0000 7f40f4646700 1 -- 172.21.15.59:0/3387049193 wait complete. 2023-09-21T00:17:20.658 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-21T00:17:20.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.785+0000 7fbbeb9fb700 1 Processor -- start 2023-09-21T00:17:20.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.786+0000 7fbbeb9fb700 1 -- start start 2023-09-21T00:17:20.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.786+0000 7fbbeb9fb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbbe406ae90 0x7fbbe40cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:20.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.786+0000 7fbbeb9fb700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbe41618a0 con 0x7fbbe415b2b0 2023-09-21T00:17:20.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.786+0000 7fbbeb9fb700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbe40cfee0 con 0x7fbbe40ce420 2023-09-21T00:17:20.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.786+0000 7fbbeb9fb700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbe40ce250 con 0x7fbbe406ae90 2023-09-21T00:17:20.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.786+0000 7fbbe9f98700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbbe406ae90 0x7fbbe40cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:20.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.786+0000 7fbbe9797700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fbbe415b2b0 0x7fbbe4161190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56836/0 (socket says 172.21.15.59:56836) 2023-09-21T00:17:20.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.786+0000 7fbbe9797700 1 -- 172.21.15.59:0/1935941619 learned_addr learned my addr 172.21.15.59:0/1935941619 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:20.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.787+0000 7fbbe9f98700 1 -- 172.21.15.59:0/1935941619 >> v1:172.21.15.83:6789/0 conn(0x7fbbe40ce420 legacy=0x7fbbe406a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:20.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.787+0000 7fbbe9f98700 1 -- 172.21.15.59:0/1935941619 >> v1:172.21.15.59:6789/0 conn(0x7fbbe415b2b0 legacy=0x7fbbe4161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:20.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.787+0000 7fbbe9f98700 1 -- 172.21.15.59:0/1935941619 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe40ce900 con 0x7fbbe406ae90 2023-09-21T00:17:20.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.787+0000 7fbbdbfff700 1 -- 172.21.15.59:0/1935941619 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 554085655 0 0) 0x7fbbe41618a0 con 0x7fbbe415b2b0 2023-09-21T00:17:20.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.787+0000 7fbbe9f98700 1 --2- 172.21.15.59:0/1935941619 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbe406ae90 0x7fbbe40cdd10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc009dc0 tx=0x7fbbdc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25af629ea42a4745 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:20.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.787+0000 7fbbdbfff700 1 -- 172.21.15.59:0/1935941619 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc00e070 con 0x7fbbe406ae90 2023-09-21T00:17:20.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.787+0000 7fbbdbfff700 1 -- 172.21.15.59:0/1935941619 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbdc00bb50 con 0x7fbbe406ae90 2023-09-21T00:17:20.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.787+0000 7fbbdbfff700 1 -- 172.21.15.59:0/1935941619 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc003a20 con 0x7fbbe406ae90 2023-09-21T00:17:20.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.788+0000 7fbbeb9fb700 1 -- 172.21.15.59:0/1935941619 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbe406ae90 msgr2=0x7fbbe40cdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:20.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.788+0000 7fbbeb9fb700 1 --2- 172.21.15.59:0/1935941619 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbe406ae90 0x7fbbe40cdd10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc009dc0 tx=0x7fbbdc00b330 comp rx=0 tx=0).stop 2023-09-21T00:17:20.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.788+0000 7fbbeb9fb700 1 -- 172.21.15.59:0/1935941619 shutdown_connections 2023-09-21T00:17:20.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.788+0000 7fbbeb9fb700 1 --2- 172.21.15.59:0/1935941619 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbe406ae90 0x7fbbe40cdd10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:20.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.788+0000 7fbbeb9fb700 1 -- 172.21.15.59:0/1935941619 >> 172.21.15.59:0/1935941619 conn(0x7fbbe40d0140 msgr2=0x7fbbe40d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:20.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.788+0000 7fbbeb9fb700 1 -- 172.21.15.59:0/1935941619 shutdown_connections 2023-09-21T00:17:20.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.788+0000 7fbbeb9fb700 1 -- 172.21.15.59:0/1935941619 wait complete. 2023-09-21T00:17:20.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.789+0000 7fbbeb9fb700 1 Processor -- start 2023-09-21T00:17:20.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.789+0000 7fbbeb9fb700 1 -- start start 2023-09-21T00:17:20.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.790+0000 7fbbeb9fb700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbbe406ae90 0x7fbbe414f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:20.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.790+0000 7fbbeb9fb700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbe40ce420 0x7fbbe415c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:20.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.790+0000 7fbbeb9fb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbe415b2b0 0x7fbbe415cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:20.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.790+0000 7fbbeb9fb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe40c7210 con 0x7fbbe415b2b0 2023-09-21T00:17:20.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.790+0000 7fbbeb9fb700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe40c74f0 con 0x7fbbe40ce420 2023-09-21T00:17:20.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.790+0000 7fbbeb9fb700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe40c77d0 con 0x7fbbe406ae90 2023-09-21T00:17:20.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.790+0000 7fbbe9f98700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbe415b2b0 0x7fbbe415cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:20.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.790+0000 7fbbe9797700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbbe406ae90 0x7fbbe414f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:20.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.790+0000 7fbbe9f98700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbe415b2b0 0x7fbbe415cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51278/0 (socket says 172.21.15.59:51278) 2023-09-21T00:17:20.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.790+0000 7fbbe9f98700 1 -- 172.21.15.59:0/3094930740 learned_addr learned my addr 172.21.15.59:0/3094930740 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:20.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.790+0000 7fbbe8f96700 1 --2- 172.21.15.59:0/3094930740 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbe40ce420 0x7fbbe415c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:20.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.790+0000 7fbbe9f98700 1 -- 172.21.15.59:0/3094930740 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbbe406ae90 msgr2=0x7fbbe414f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:20.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.790+0000 7fbbe9f98700 1 --2- 172.21.15.59:0/3094930740 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbbe406ae90 0x7fbbe414f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:20.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.790+0000 7fbbe9f98700 1 -- 172.21.15.59:0/3094930740 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbe40ce420 msgr2=0x7fbbe415c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:20.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.790+0000 7fbbe9f98700 1 --2- 172.21.15.59:0/3094930740 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbe40ce420 0x7fbbe415c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:20.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.790+0000 7fbbe9f98700 1 -- 172.21.15.59:0/3094930740 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbdc009a70 con 0x7fbbe415b2b0 2023-09-21T00:17:20.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.790+0000 7fbbe9f98700 1 --2- 172.21.15.59:0/3094930740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbe415b2b0 0x7fbbe415cc20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40728c0 tx=0x7fbbdc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:20.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.791+0000 7fbbd9ffb700 1 -- 172.21.15.59:0/3094930740 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc012630 con 0x7fbbe415b2b0 2023-09-21T00:17:20.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.791+0000 7fbbd9ffb700 1 -- 172.21.15.59:0/3094930740 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbdc0127b0 con 0x7fbbe415b2b0 2023-09-21T00:17:20.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.791+0000 7fbbeb9fb700 1 -- 172.21.15.59:0/3094930740 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe40c7ab0 con 0x7fbbe415b2b0 2023-09-21T00:17:20.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.791+0000 7fbbd9ffb700 1 -- 172.21.15.59:0/3094930740 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc012b60 con 0x7fbbe415b2b0 2023-09-21T00:17:20.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.791+0000 7fbbeb9fb700 1 -- 172.21.15.59:0/3094930740 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe40c82b0 con 0x7fbbe415b2b0 2023-09-21T00:17:20.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.792+0000 7fbbeb9fb700 1 -- 172.21.15.59:0/3094930740 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbe40c7fd0 con 0x7fbbe415b2b0 2023-09-21T00:17:20.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.792+0000 7fbbd9ffb700 1 -- 172.21.15.59:0/3094930740 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fbbdc012cc0 con 0x7fbbe415b2b0 2023-09-21T00:17:20.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.793+0000 7fbbd9ffb700 1 --2- 172.21.15.59:0/3094930740 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fbbc806ae00 0x7fbbc806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:20.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.793+0000 7fbbd9ffb700 1 -- 172.21.15.59:0/3094930740 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbbdc08b9a0 con 0x7fbbe415b2b0 2023-09-21T00:17:20.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.793+0000 7fbbe9797700 1 --2- 172.21.15.59:0/3094930740 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fbbc806ae00 0x7fbbc806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:20.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.793+0000 7fbbe9797700 1 --2- 172.21.15.59:0/3094930740 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fbbc806ae00 0x7fbbc806d2c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4000f60 tx=0x7fbbd4007e70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:20.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.797+0000 7fbbd9ffb700 1 -- 172.21.15.59:0/3094930740 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fbbe40c7fd0 con 0x7fbbe415b2b0 2023-09-21T00:17:20.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.998+0000 7fbbeb9fb700 1 -- 172.21.15.59:0/3094930740 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fbbe40c7fd0 con 0x7fbbe415b2b0 2023-09-21T00:17:21.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:20.998+0000 7fbbd9ffb700 1 -- 172.21.15.59:0/3094930740 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbbe40c7fd0 con 0x7fbbe415b2b0 2023-09-21T00:17:21.000 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-09-21T00:17:21.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.000+0000 7fbbeb9fb700 1 -- 172.21.15.59:0/3094930740 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fbbc806ae00 msgr2=0x7fbbc806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:21.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.000+0000 7fbbeb9fb700 1 --2- 172.21.15.59:0/3094930740 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fbbc806ae00 0x7fbbc806d2c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4000f60 tx=0x7fbbd4007e70 comp rx=0 tx=0).stop 2023-09-21T00:17:21.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.000+0000 7fbbeb9fb700 1 -- 172.21.15.59:0/3094930740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbe415b2b0 msgr2=0x7fbbe415cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:21.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.000+0000 7fbbeb9fb700 1 --2- 172.21.15.59:0/3094930740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbe415b2b0 0x7fbbe415cc20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40728c0 tx=0x7fbbdc004ad0 comp rx=0 tx=0).stop 2023-09-21T00:17:21.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.001+0000 7fbbeb9fb700 1 -- 172.21.15.59:0/3094930740 shutdown_connections 2023-09-21T00:17:21.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.001+0000 7fbbeb9fb700 1 --2- 172.21.15.59:0/3094930740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbe415b2b0 0x7fbbe415cc20 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:21.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.001+0000 7fbbeb9fb700 1 --2- 172.21.15.59:0/3094930740 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fbbc806ae00 0x7fbbc806d2c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:21.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.001+0000 7fbbeb9fb700 1 --2- 172.21.15.59:0/3094930740 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbbe406ae90 0x7fbbe414f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:21.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.001+0000 7fbbeb9fb700 1 --2- 172.21.15.59:0/3094930740 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbe40ce420 0x7fbbe415c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:21.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.001+0000 7fbbeb9fb700 1 -- 172.21.15.59:0/3094930740 >> 172.21.15.59:0/3094930740 conn(0x7fbbe40d0140 msgr2=0x7fbbe415a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:21.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.001+0000 7fbbeb9fb700 1 -- 172.21.15.59:0/3094930740 shutdown_connections 2023-09-21T00:17:21.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.001+0000 7fbbeb9fb700 1 -- 172.21.15.59:0/3094930740 wait complete. 2023-09-21T00:17:21.014 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-21T00:17:21.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.140+0000 7f72a4636700 1 Processor -- start 2023-09-21T00:17:21.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.140+0000 7f72a4636700 1 -- start start 2023-09-21T00:17:21.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.141+0000 7f72a4636700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f729c15b4e0 0x7f729c0cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:21.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.141+0000 7f72a4636700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f729c0cbcf0 0x7f729c0701e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:21.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.141+0000 7f72a4636700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f729c15b8c0 con 0x7f729c070720 2023-09-21T00:17:21.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.141+0000 7f72a4636700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f729c070bd0 con 0x7f729c15b4e0 2023-09-21T00:17:21.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.141+0000 7f72a4636700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f729c06ed60 con 0x7f729c0cbcf0 2023-09-21T00:17:21.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.141+0000 7f72a1bd1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f729c0cbcf0 0x7f729c0701e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:21.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.141+0000 7f72a23d2700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f729c15b4e0 0x7f729c0cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:21.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.141+0000 7f72a1bd1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f729c0cbcf0 0x7f729c0701e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.59:51898/0 (socket says 172.21.15.59:51898) 2023-09-21T00:17:21.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.141+0000 7f72a1bd1700 1 -- 172.21.15.59:0/3086944784 learned_addr learned my addr 172.21.15.59:0/3086944784 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:21.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.141+0000 7f72a2bd3700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f729c070720 0x7f729c0ced30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.59:47354/0 (socket says 172.21.15.59:47354) 2023-09-21T00:17:21.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.141+0000 7f72a1bd1700 1 -- 172.21.15.59:0/3086944784 >> v2:172.21.15.83:3300/0 conn(0x7f729c15b4e0 msgr2=0x7f729c0cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:21.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.141+0000 7f72a1bd1700 1 --2- 172.21.15.59:0/3086944784 >> v2:172.21.15.83:3300/0 conn(0x7f729c15b4e0 0x7f729c0cb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:21.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.141+0000 7f72a1bd1700 1 -- 172.21.15.59:0/3086944784 >> v1:172.21.15.83:6789/0 conn(0x7f729c070720 legacy=0x7f729c0ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:21.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.141+0000 7f72a1bd1700 1 -- 172.21.15.59:0/3086944784 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f729c06f040 con 0x7f729c0cbcf0 2023-09-21T00:17:21.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.141+0000 7f72a13d0700 1 -- 172.21.15.59:0/3086944784 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 634989450 0 0) 0x7f729c15b8c0 con 0x7f729c070720 2023-09-21T00:17:21.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.141+0000 7f72a23d2700 1 --2- 172.21.15.59:0/3086944784 >> v2:172.21.15.83:3300/0 conn(0x7f729c15b4e0 0x7f729c0cb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T00:17:21.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.142+0000 7f72a1bd1700 1 --2- 172.21.15.59:0/3086944784 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f729c0cbcf0 0x7f729c0701e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f72980098f0 tx=0x7f7298009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37186f60ee0f90da server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:21.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.142+0000 7f72a13d0700 1 -- 172.21.15.59:0/3086944784 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7298011830 con 0x7f729c0cbcf0 2023-09-21T00:17:21.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.142+0000 7f72a13d0700 1 -- 172.21.15.59:0/3086944784 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7298011990 con 0x7f729c0cbcf0 2023-09-21T00:17:21.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.142+0000 7f72a13d0700 1 -- 172.21.15.59:0/3086944784 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7298011d20 con 0x7f729c0cbcf0 2023-09-21T00:17:21.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.142+0000 7f72a4636700 1 -- 172.21.15.59:0/3086944784 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f729c0cbcf0 msgr2=0x7f729c0701e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:21.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.142+0000 7f72a4636700 1 --2- 172.21.15.59:0/3086944784 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f729c0cbcf0 0x7f729c0701e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f72980098f0 tx=0x7f7298009c00 comp rx=0 tx=0).stop 2023-09-21T00:17:21.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.142+0000 7f72a4636700 1 -- 172.21.15.59:0/3086944784 shutdown_connections 2023-09-21T00:17:21.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.142+0000 7f72a4636700 1 --2- 172.21.15.59:0/3086944784 >> v2:172.21.15.83:3300/0 conn(0x7f729c15b4e0 0x7f729c0cb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:21.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.142+0000 7f72a4636700 1 --2- 172.21.15.59:0/3086944784 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f729c0cbcf0 0x7f729c0701e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:21.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.142+0000 7f72a4636700 1 -- 172.21.15.59:0/3086944784 >> 172.21.15.59:0/3086944784 conn(0x7f729c0d1160 msgr2=0x7f729c0d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:21.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.142+0000 7f72a4636700 1 -- 172.21.15.59:0/3086944784 shutdown_connections 2023-09-21T00:17:21.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.142+0000 7f72a4636700 1 -- 172.21.15.59:0/3086944784 wait complete. 2023-09-21T00:17:21.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.144+0000 7f72a4636700 1 Processor -- start 2023-09-21T00:17:21.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.144+0000 7f72a4636700 1 -- start start 2023-09-21T00:17:21.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.144+0000 7f72a4636700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f729c070720 0x7f729c15baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:21.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.144+0000 7f72a4636700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f729c0cbcf0 0x7f729c0c9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:21.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.144+0000 7f72a4636700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f729c15b4e0 0x7f729c0ca230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:21.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.144+0000 7f72a4636700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f729c0c9860 con 0x7f729c070720 2023-09-21T00:17:21.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.144+0000 7f72a4636700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f729c0caea0 con 0x7f729c15b4e0 2023-09-21T00:17:21.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.144+0000 7f72a4636700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f729c0c8c50 con 0x7f729c0cbcf0 2023-09-21T00:17:21.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.144+0000 7f72a23d2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f729c070720 0x7f729c15baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:21.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.144+0000 7f72a23d2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f729c070720 0x7f729c15baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51288/0 (socket says 172.21.15.59:51288) 2023-09-21T00:17:21.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.144+0000 7f72a23d2700 1 -- 172.21.15.59:0/3819337080 learned_addr learned my addr 172.21.15.59:0/3819337080 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:21.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.145+0000 7f72a1bd1700 1 --2- 172.21.15.59:0/3819337080 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f729c0cbcf0 0x7f729c0c9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:21.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.145+0000 7f72a2bd3700 1 --2- 172.21.15.59:0/3819337080 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f729c15b4e0 0x7f729c0ca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:21.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.145+0000 7f72a23d2700 1 -- 172.21.15.59:0/3819337080 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f729c0cbcf0 msgr2=0x7f729c0c9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:21.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.145+0000 7f72a23d2700 1 --2- 172.21.15.59:0/3819337080 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f729c0cbcf0 0x7f729c0c9cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:21.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.145+0000 7f72a23d2700 1 -- 172.21.15.59:0/3819337080 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f729c15b4e0 msgr2=0x7f729c0ca230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:21.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.145+0000 7f72a23d2700 1 --2- 172.21.15.59:0/3819337080 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f729c15b4e0 0x7f729c0ca230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:21.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.145+0000 7f72a23d2700 1 -- 172.21.15.59:0/3819337080 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f728c0094a0 con 0x7f729c070720 2023-09-21T00:17:21.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.145+0000 7f72a2bd3700 1 --2- 172.21.15.59:0/3819337080 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f729c15b4e0 0x7f729c0ca230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:17:21.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.145+0000 7f72a23d2700 1 --2- 172.21.15.59:0/3819337080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f729c070720 0x7f729c15baf0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f728c00ebe0 tx=0x7f728c009e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:21.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.145+0000 7f7292ffd700 1 -- 172.21.15.59:0/3819337080 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728c00c8b0 con 0x7f729c070720 2023-09-21T00:17:21.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.145+0000 7f7292ffd700 1 -- 172.21.15.59:0/3819337080 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f728c00ca10 con 0x7f729c070720 2023-09-21T00:17:21.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.145+0000 7f72a4636700 1 -- 172.21.15.59:0/3819337080 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7298009550 con 0x7f729c070720 2023-09-21T00:17:21.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.145+0000 7f7292ffd700 1 -- 172.21.15.59:0/3819337080 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728c00cda0 con 0x7f729c070720 2023-09-21T00:17:21.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.145+0000 7f72a4636700 1 -- 172.21.15.59:0/3819337080 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f729c0c9210 con 0x7f729c070720 2023-09-21T00:17:21.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.146+0000 7f72a4636700 1 -- 172.21.15.59:0/3819337080 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f729c0c9b40 con 0x7f729c070720 2023-09-21T00:17:21.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.146+0000 7f7292ffd700 1 -- 172.21.15.59:0/3819337080 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f728c013470 con 0x7f729c070720 2023-09-21T00:17:21.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.147+0000 7f7292ffd700 1 --2- 172.21.15.59:0/3819337080 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f728006ae00 0x7f728006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:21.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.147+0000 7f7292ffd700 1 -- 172.21.15.59:0/3819337080 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f728c089930 con 0x7f729c070720 2023-09-21T00:17:21.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.147+0000 7f72a1bd1700 1 --2- 172.21.15.59:0/3819337080 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f728006ae00 0x7f728006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:21.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.148+0000 7f72a1bd1700 1 --2- 172.21.15.59:0/3819337080 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f728006ae00 0x7f728006d2c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f72980098f0 tx=0x7f7298008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:21.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.151+0000 7f7292ffd700 1 -- 172.21.15.59:0/3819337080 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f728c0547f0 con 0x7f729c070720 2023-09-21T00:17:21.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.367+0000 7f72a4636700 1 -- 172.21.15.59:0/3819337080 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f729c067e50 con 0x7f729c070720 2023-09-21T00:17:21.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.367+0000 7f7292ffd700 1 -- 172.21.15.59:0/3819337080 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f728c057e10 con 0x7f729c070720 2023-09-21T00:17:21.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.369+0000 7f72a4636700 1 -- 172.21.15.59:0/3819337080 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f728006ae00 msgr2=0x7f728006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:21.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.369+0000 7f72a4636700 1 --2- 172.21.15.59:0/3819337080 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f728006ae00 0x7f728006d2c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f72980098f0 tx=0x7f7298008030 comp rx=0 tx=0).stop 2023-09-21T00:17:21.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.369+0000 7f72a4636700 1 -- 172.21.15.59:0/3819337080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f729c070720 msgr2=0x7f729c15baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:21.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.369+0000 7f72a4636700 1 --2- 172.21.15.59:0/3819337080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f729c070720 0x7f729c15baf0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f728c00ebe0 tx=0x7f728c009e20 comp rx=0 tx=0).stop 2023-09-21T00:17:21.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.369+0000 7f72a4636700 1 -- 172.21.15.59:0/3819337080 shutdown_connections 2023-09-21T00:17:21.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.369+0000 7f72a4636700 1 --2- 172.21.15.59:0/3819337080 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f729c15b4e0 0x7f729c0ca230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:21.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.369+0000 7f72a4636700 1 --2- 172.21.15.59:0/3819337080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f729c070720 0x7f729c15baf0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:21.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.369+0000 7f72a4636700 1 --2- 172.21.15.59:0/3819337080 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f728006ae00 0x7f728006d2c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:21.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.369+0000 7f72a4636700 1 --2- 172.21.15.59:0/3819337080 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f729c0cbcf0 0x7f729c0c9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:21.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.369+0000 7f72a4636700 1 -- 172.21.15.59:0/3819337080 >> 172.21.15.59:0/3819337080 conn(0x7f729c0d1160 msgr2=0x7f729c0b2350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:21.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.369+0000 7f72a4636700 1 -- 172.21.15.59:0/3819337080 shutdown_connections 2023-09-21T00:17:21.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:21.369+0000 7f72a4636700 1 -- 172.21.15.59:0/3819337080 wait complete. 2023-09-21T00:17:21.373 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2023-09-21T00:17:21.382 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi059.front.sepia.ceph.com... 2023-09-21T00:17:21.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:21.383 DEBUG:teuthology.orchestra.run.smithi059:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-09-21T00:17:21.429 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi059.stderr:ceph-fuse[110770]: fuse finished with error 0 and tester_r 0 2023-09-21T00:17:21.430 INFO:teuthology.orchestra.run:waiting for 300 2023-09-21T00:17:27.532 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2023-09-21T00:17:27.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:27.533 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-09-21T00:17:27.570 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T00:17:27.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.747+0000 7f6fccb47700 1 Processor -- start 2023-09-21T00:17:27.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.747+0000 7f6fccb47700 1 -- start start 2023-09-21T00:17:27.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.748+0000 7f6fccb47700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6fc815b2b0 0x7f6fc80cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:27.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.748+0000 7f6fccb47700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6fc806a780 0x7f6fc806abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:27.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.748+0000 7f6fccb47700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fc806b110 con 0x7f6fc80ce420 2023-09-21T00:17:27.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.748+0000 7f6fccb47700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fc80ce250 con 0x7f6fc815b2b0 2023-09-21T00:17:27.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.748+0000 7f6fccb47700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc81618a0 con 0x7f6fc806a780 2023-09-21T00:17:27.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.748+0000 7f6fc659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6fc815b2b0 0x7f6fc80cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:27.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.748+0000 7f6fc5d9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6fc80ce420 0x7f6fc8161190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56864/0 (socket says 172.21.15.59:56864) 2023-09-21T00:17:27.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.748+0000 7f6fc5d9b700 1 -- 172.21.15.59:0/913388780 learned_addr learned my addr 172.21.15.59:0/913388780 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:27.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.748+0000 7f6fc6d9d700 1 --2- 172.21.15.59:0/913388780 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6fc806a780 0x7f6fc806abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:27.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.748+0000 7f6fc659c700 1 -- 172.21.15.59:0/913388780 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6fc806a780 msgr2=0x7f6fc806abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:27.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.748+0000 7f6fc659c700 1 --2- 172.21.15.59:0/913388780 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6fc806a780 0x7f6fc806abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:27.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.748+0000 7f6fc659c700 1 -- 172.21.15.59:0/913388780 >> v1:172.21.15.59:6789/0 conn(0x7f6fc80ce420 legacy=0x7f6fc8161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:27.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.748+0000 7f6fc659c700 1 -- 172.21.15.59:0/913388780 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc80cfee0 con 0x7f6fc815b2b0 2023-09-21T00:17:27.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.748+0000 7f6fc559a700 1 -- 172.21.15.59:0/913388780 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2673634291 0 0) 0x7f6fbc001110 con 0x7f6fc80ce420 2023-09-21T00:17:27.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.748+0000 7f6fc6d9d700 1 --2- 172.21.15.59:0/913388780 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6fc806a780 0x7f6fc806abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:17:27.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.748+0000 7f6fc659c700 1 --2- 172.21.15.59:0/913388780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fc815b2b0 0x7f6fc80cdd10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6fb8009840 tx=0x7f6fb8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ae8e976f6cbbea7 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:27.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.749+0000 7f6fc559a700 1 -- 172.21.15.59:0/913388780 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb8011830 con 0x7f6fc815b2b0 2023-09-21T00:17:27.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.749+0000 7f6fc559a700 1 -- 172.21.15.59:0/913388780 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb8011990 con 0x7f6fc815b2b0 2023-09-21T00:17:27.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.749+0000 7f6fc559a700 1 -- 172.21.15.59:0/913388780 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb8011d20 con 0x7f6fc815b2b0 2023-09-21T00:17:27.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.749+0000 7f6fccb47700 1 -- 172.21.15.59:0/913388780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fc815b2b0 msgr2=0x7f6fc80cdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:27.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.749+0000 7f6fccb47700 1 --2- 172.21.15.59:0/913388780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fc815b2b0 0x7f6fc80cdd10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6fb8009840 tx=0x7f6fb8009b50 comp rx=0 tx=0).stop 2023-09-21T00:17:27.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.749+0000 7f6fccb47700 1 -- 172.21.15.59:0/913388780 shutdown_connections 2023-09-21T00:17:27.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.749+0000 7f6fccb47700 1 --2- 172.21.15.59:0/913388780 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6fc806a780 0x7f6fc806abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:27.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.749+0000 7f6fccb47700 1 --2- 172.21.15.59:0/913388780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fc815b2b0 0x7f6fc80cdd10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:27.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.749+0000 7f6fccb47700 1 -- 172.21.15.59:0/913388780 >> 172.21.15.59:0/913388780 conn(0x7f6fc80d0140 msgr2=0x7f6fc80d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:27.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.749+0000 7f6fccb47700 1 -- 172.21.15.59:0/913388780 shutdown_connections 2023-09-21T00:17:27.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.749+0000 7f6fccb47700 1 -- 172.21.15.59:0/913388780 wait complete. 2023-09-21T00:17:27.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.751+0000 7f6fccb47700 1 Processor -- start 2023-09-21T00:17:27.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.751+0000 7f6fccb47700 1 -- start start 2023-09-21T00:17:27.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.752+0000 7f6fccb47700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6fc806a780 0x7f6fc8160ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:27.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.752+0000 7f6fccb47700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fc80ce420 0x7f6fc814c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:27.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.752+0000 7f6fccb47700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6fc815b2b0 0x7f6fc80c9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:27.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.752+0000 7f6fccb47700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc81606a0 con 0x7f6fc80ce420 2023-09-21T00:17:27.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.752+0000 7f6fccb47700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc814cae0 con 0x7f6fc806a780 2023-09-21T00:17:27.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.752+0000 7f6fccb47700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc815fa20 con 0x7f6fc815b2b0 2023-09-21T00:17:27.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.752+0000 7f6fc5d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fc80ce420 0x7f6fc814c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:27.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.752+0000 7f6fc5d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fc80ce420 0x7f6fc814c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51304/0 (socket says 172.21.15.59:51304) 2023-09-21T00:17:27.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.752+0000 7f6fc5d9b700 1 -- 172.21.15.59:0/3389500430 learned_addr learned my addr 172.21.15.59:0/3389500430 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:27.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.752+0000 7f6fc6d9d700 1 --2- 172.21.15.59:0/3389500430 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6fc815b2b0 0x7f6fc80c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:27.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.752+0000 7f6fc659c700 1 --2- 172.21.15.59:0/3389500430 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6fc806a780 0x7f6fc8160ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:27.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.752+0000 7f6fc5d9b700 1 -- 172.21.15.59:0/3389500430 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6fc815b2b0 msgr2=0x7f6fc80c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:27.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.752+0000 7f6fc5d9b700 1 --2- 172.21.15.59:0/3389500430 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6fc815b2b0 0x7f6fc80c9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:27.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.752+0000 7f6fc5d9b700 1 -- 172.21.15.59:0/3389500430 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6fc806a780 msgr2=0x7f6fc8160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:27.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.752+0000 7f6fc5d9b700 1 --2- 172.21.15.59:0/3389500430 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6fc806a780 0x7f6fc8160ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:27.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.752+0000 7f6fc5d9b700 1 -- 172.21.15.59:0/3389500430 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb80094a0 con 0x7f6fc80ce420 2023-09-21T00:17:27.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.752+0000 7f6fc5d9b700 1 --2- 172.21.15.59:0/3389500430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fc80ce420 0x7f6fc814c5a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc00c550 tx=0x7f6fbc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:27.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.752+0000 7f6fb6ffd700 1 -- 172.21.15.59:0/3389500430 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc004c80 con 0x7f6fc80ce420 2023-09-21T00:17:27.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.752+0000 7f6fb6ffd700 1 -- 172.21.15.59:0/3389500430 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fbc004e00 con 0x7f6fc80ce420 2023-09-21T00:17:27.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.752+0000 7f6fccb47700 1 -- 172.21.15.59:0/3389500430 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fc815fd00 con 0x7f6fc80ce420 2023-09-21T00:17:27.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.752+0000 7f6fb6ffd700 1 -- 172.21.15.59:0/3389500430 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc007310 con 0x7f6fc80ce420 2023-09-21T00:17:27.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.752+0000 7f6fccb47700 1 -- 172.21.15.59:0/3389500430 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fc81602c0 con 0x7f6fc80ce420 2023-09-21T00:17:27.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.753+0000 7f6fccb47700 1 -- 172.21.15.59:0/3389500430 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fc81607e0 con 0x7f6fc80ce420 2023-09-21T00:17:27.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.754+0000 7f6fb6ffd700 1 -- 172.21.15.59:0/3389500430 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f6fbc007470 con 0x7f6fc80ce420 2023-09-21T00:17:27.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.754+0000 7f6fb6ffd700 1 --2- 172.21.15.59:0/3389500430 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f6fa806ae00 0x7f6fa806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:27.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.754+0000 7f6fb6ffd700 1 -- 172.21.15.59:0/3389500430 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6fbc089360 con 0x7f6fc80ce420 2023-09-21T00:17:27.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.754+0000 7f6fc659c700 1 --2- 172.21.15.59:0/3389500430 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f6fa806ae00 0x7f6fa806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:27.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.755+0000 7f6fc659c700 1 --2- 172.21.15.59:0/3389500430 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f6fa806ae00 0x7f6fa806d2c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6fb80090b0 tx=0x7f6fb801c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:27.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.759+0000 7f6fb6ffd700 1 -- 172.21.15.59:0/3389500430 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f6fc81607e0 con 0x7f6fc80ce420 2023-09-21T00:17:27.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.961+0000 7f6fccb47700 1 -- 172.21.15.59:0/3389500430 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6fc806b110 con 0x7f6fc80ce420 2023-09-21T00:17:27.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.962+0000 7f6fb6ffd700 1 -- 172.21.15.59:0/3389500430 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18262 (secure 0 0 0) 0x7f6fc806b110 con 0x7f6fc80ce420 2023-09-21T00:17:27.963 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:17:27.963 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":24,"fsid":"dd69925c-6e25-42fe-880b-2f60fc6f384b","created":"2023-09-21T00:16:43.074489+0000","modified":"2023-09-21T00:17:11.387529+0000","last_up_change":"2023-09-21T00:16:54.740101+0000","last_in_change":"2023-09-21T00:16:45.987089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T00:16:54.796248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-21T00:17:04.167102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-21T00:17:05.313188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-21T00:17:08.977609+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d4b18344-74c0-4f75-920b-7a9247e48914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6809","nonce":2418314235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6811","nonce":2418314235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6815","nonce":2418314235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6813","nonce":2418314235}]},"public_addr":"172.21.15.59:6809/2418314235","cluster_addr":"172.21.15.59:6811/2418314235","heartbeat_back_addr":"172.21.15.59:6815/2418314235","heartbeat_front_addr":"172.21.15.59:6813/2418314235","state":["exists","up"]},{"osd":1,"uuid":"80940d50-a248-4e64-a282-7ffcdad790ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6801","nonce":869668251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6803","nonce":869668251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6807","nonce":869668251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6805","nonce":869668251}]},"public_addr":"172.21.15.59:6801/869668251","cluster_addr":"172.21.15.59:6803/869668251","heartbeat_back_addr":"172.21.15.59:6807/869668251","heartbeat_front_addr":"172.21.15.59:6805/869668251","state":["exists","up"]},{"osd":2,"uuid":"55f2eceb-c54a-4879-a6ce-968c1c548b5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6817","nonce":372517778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6819","nonce":372517778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6823","nonce":372517778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6821","nonce":372517778}]},"public_addr":"172.21.15.59:6817/372517778","cluster_addr":"172.21.15.59:6819/372517778","heartbeat_back_addr":"172.21.15.59:6823/372517778","heartbeat_front_addr":"172.21.15.59:6821/372517778","state":["exists","up"]},{"osd":3,"uuid":"92b89cd0-869c-49b9-a9f9-97ac8423f304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6825","nonce":575188498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6827","nonce":575188498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6831","nonce":575188498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6829","nonce":575188498}]},"public_addr":"172.21.15.59:6825/575188498","cluster_addr":"172.21.15.59:6827/575188498","heartbeat_back_addr":"172.21.15.59:6831/575188498","heartbeat_front_addr":"172.21.15.59:6829/575188498","state":["exists","up"]},{"osd":4,"uuid":"25b80e94-e0e6-403d-b69f-61542f289637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6803","nonce":1741219098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6805","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6807","nonce":1741219098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6815","nonce":1741219098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6811","nonce":1741219098}]},"public_addr":"172.21.15.83:6803/1741219098","cluster_addr":"172.21.15.83:6807/1741219098","heartbeat_back_addr":"172.21.15.83:6815/1741219098","heartbeat_front_addr":"172.21.15.83:6811/1741219098","state":["exists","up"]},{"osd":5,"uuid":"5498d9ab-1086-4796-a199-9051e6dfea91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6817","nonce":156730565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6819","nonce":156730565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6823","nonce":156730565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6821","nonce":156730565}]},"public_addr":"172.21.15.83:6817/156730565","cluster_addr":"172.21.15.83:6819/156730565","heartbeat_back_addr":"172.21.15.83:6823/156730565","heartbeat_front_addr":"172.21.15.83:6821/156730565","state":["exists","up"]},{"osd":6,"uuid":"cfd810c0-5015-4d60-9a75-7efc93a32e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6801","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6800","nonce":1337723778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6806","nonce":1337723778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6814","nonce":1337723778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6810","nonce":1337723778}]},"public_addr":"172.21.15.83:6800/1337723778","cluster_addr":"172.21.15.83:6806/1337723778","heartbeat_back_addr":"172.21.15.83:6814/1337723778","heartbeat_front_addr":"172.21.15.83:6810/1337723778","state":["exists","up"]},{"osd":7,"uuid":"e992c8fa-0a3d-4b3c-85b5-2c511223dee4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6825","nonce":4204859272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6827","nonce":4204859272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6831","nonce":4204859272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6829","nonce":4204859272}]},"public_addr":"172.21.15.83:6825/4204859272","cluster_addr":"172.21.15.83:6827/4204859272","heartbeat_back_addr":"172.21.15.83:6831/4204859272","heartbeat_front_addr":"172.21.15.83:6829/4204859272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.156498+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.882707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.093978+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.158565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.173933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.888606+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.135525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.149712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T00:17:27.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.964+0000 7f6fccb47700 1 -- 172.21.15.59:0/3389500430 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f6fa806ae00 msgr2=0x7f6fa806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:27.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.964+0000 7f6fccb47700 1 --2- 172.21.15.59:0/3389500430 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f6fa806ae00 0x7f6fa806d2c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6fb80090b0 tx=0x7f6fb801c040 comp rx=0 tx=0).stop 2023-09-21T00:17:27.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.964+0000 7f6fccb47700 1 -- 172.21.15.59:0/3389500430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fc80ce420 msgr2=0x7f6fc814c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:27.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.964+0000 7f6fccb47700 1 --2- 172.21.15.59:0/3389500430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fc80ce420 0x7f6fc814c5a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc00c550 tx=0x7f6fbc00c910 comp rx=0 tx=0).stop 2023-09-21T00:17:27.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.964+0000 7f6fccb47700 1 -- 172.21.15.59:0/3389500430 shutdown_connections 2023-09-21T00:17:27.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.964+0000 7f6fccb47700 1 --2- 172.21.15.59:0/3389500430 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f6fa806ae00 0x7f6fa806d2c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:27.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.964+0000 7f6fccb47700 1 --2- 172.21.15.59:0/3389500430 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6fc815b2b0 0x7f6fc80c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:27.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.964+0000 7f6fccb47700 1 --2- 172.21.15.59:0/3389500430 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6fc806a780 0x7f6fc8160ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:27.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.964+0000 7f6fccb47700 1 --2- 172.21.15.59:0/3389500430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fc80ce420 0x7f6fc814c5a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:27.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.964+0000 7f6fccb47700 1 -- 172.21.15.59:0/3389500430 >> 172.21.15.59:0/3389500430 conn(0x7f6fc80d0140 msgr2=0x7f6fc80af0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:27.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.964+0000 7f6fccb47700 1 -- 172.21.15.59:0/3389500430 shutdown_connections 2023-09-21T00:17:27.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:27.964+0000 7f6fccb47700 1 -- 172.21.15.59:0/3389500430 wait complete. 2023-09-21T00:17:27.977 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T00:17:28.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.102+0000 7f694b3f8700 1 Processor -- start 2023-09-21T00:17:28.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.102+0000 7f694b3f8700 1 -- start start 2023-09-21T00:17:28.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.103+0000 7f694b3f8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f694415d690 0x7f6944070b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:28.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.103+0000 7f694b3f8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f69440cedb0 0x7f69440cf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:28.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.103+0000 7f694b3f8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69440cf740 con 0x7f6944143ce0 2023-09-21T00:17:28.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.103+0000 7f694b3f8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6944161990 con 0x7f69440cedb0 2023-09-21T00:17:28.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.103+0000 7f694b3f8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6944162170 con 0x7f694415d690 2023-09-21T00:17:28.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.103+0000 7f6949995700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f69440cedb0 0x7f69440cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:28.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.103+0000 7f6948993700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6944143ce0 0x7f6944161280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56878/0 (socket says 172.21.15.59:56878) 2023-09-21T00:17:28.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.103+0000 7f6949995700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f69440cedb0 0x7f69440cf200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51314/0 (socket says 172.21.15.59:51314) 2023-09-21T00:17:28.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.103+0000 7f6948993700 1 -- 172.21.15.59:0/184588829 learned_addr learned my addr 172.21.15.59:0/184588829 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:28.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.104+0000 7f6949194700 1 --2- 172.21.15.59:0/184588829 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f694415d690 0x7f6944070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:28.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.104+0000 7f6949995700 1 -- 172.21.15.59:0/184588829 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f694415d690 msgr2=0x7f6944070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:28.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.104+0000 7f6949995700 1 --2- 172.21.15.59:0/184588829 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f694415d690 0x7f6944070b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:28.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.104+0000 7f6949995700 1 -- 172.21.15.59:0/184588829 >> v1:172.21.15.59:6789/0 conn(0x7f6944143ce0 legacy=0x7f6944161280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:28.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.104+0000 7f6949995700 1 -- 172.21.15.59:0/184588829 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6944161bb0 con 0x7f69440cedb0 2023-09-21T00:17:28.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.104+0000 7f6937fff700 1 -- 172.21.15.59:0/184588829 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3363369997 0 0) 0x7f6938001110 con 0x7f6944143ce0 2023-09-21T00:17:28.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.104+0000 7f6949194700 1 --2- 172.21.15.59:0/184588829 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f694415d690 0x7f6944070b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:17:28.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.104+0000 7f6949995700 1 --2- 172.21.15.59:0/184588829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69440cedb0 0x7f69440cf200 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f693c009d90 tx=0x7f693c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da29454b2e671a98 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:28.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.104+0000 7f6937fff700 1 -- 172.21.15.59:0/184588829 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693c00e070 con 0x7f69440cedb0 2023-09-21T00:17:28.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.104+0000 7f6937fff700 1 -- 172.21.15.59:0/184588829 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f693c00bbd0 con 0x7f69440cedb0 2023-09-21T00:17:28.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.104+0000 7f6937fff700 1 -- 172.21.15.59:0/184588829 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693c012430 con 0x7f69440cedb0 2023-09-21T00:17:28.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.104+0000 7f694b3f8700 1 -- 172.21.15.59:0/184588829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69440cedb0 msgr2=0x7f69440cf200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:28.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.104+0000 7f694b3f8700 1 --2- 172.21.15.59:0/184588829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69440cedb0 0x7f69440cf200 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f693c009d90 tx=0x7f693c00b330 comp rx=0 tx=0).stop 2023-09-21T00:17:28.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.105+0000 7f694b3f8700 1 -- 172.21.15.59:0/184588829 shutdown_connections 2023-09-21T00:17:28.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.105+0000 7f694b3f8700 1 --2- 172.21.15.59:0/184588829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69440cedb0 0x7f69440cf200 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:28.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.105+0000 7f694b3f8700 1 --2- 172.21.15.59:0/184588829 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f694415d690 0x7f6944070b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:28.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.105+0000 7f694b3f8700 1 -- 172.21.15.59:0/184588829 >> 172.21.15.59:0/184588829 conn(0x7f69440d11e0 msgr2=0x7f69440d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:28.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.105+0000 7f694b3f8700 1 -- 172.21.15.59:0/184588829 shutdown_connections 2023-09-21T00:17:28.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.105+0000 7f694b3f8700 1 -- 172.21.15.59:0/184588829 wait complete. 2023-09-21T00:17:28.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.106+0000 7f694b3f8700 1 Processor -- start 2023-09-21T00:17:28.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.106+0000 7f694b3f8700 1 -- start start 2023-09-21T00:17:28.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.107+0000 7f694b3f8700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69440cedb0 0x7f69441f3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:28.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.107+0000 7f694b3f8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6944143ce0 0x7f69440c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:28.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.107+0000 7f694b3f8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f694415d690 0x7f69440c71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:28.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.107+0000 7f694b3f8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6944140ea0 con 0x7f6944143ce0 2023-09-21T00:17:28.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.107+0000 7f694b3f8700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6944143420 con 0x7f69440cedb0 2023-09-21T00:17:28.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.107+0000 7f694b3f8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69440c6310 con 0x7f694415d690 2023-09-21T00:17:28.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.107+0000 7f6948993700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6944143ce0 0x7f69440c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:28.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.107+0000 7f6948993700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6944143ce0 0x7f69440c6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51318/0 (socket says 172.21.15.59:51318) 2023-09-21T00:17:28.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.107+0000 7f6948993700 1 -- 172.21.15.59:0/737301858 learned_addr learned my addr 172.21.15.59:0/737301858 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:28.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.107+0000 7f6949194700 1 --2- 172.21.15.59:0/737301858 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69440cedb0 0x7f69441f3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:28.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.107+0000 7f6949995700 1 --2- 172.21.15.59:0/737301858 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f694415d690 0x7f69440c71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:28.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.107+0000 7f6948993700 1 -- 172.21.15.59:0/737301858 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f694415d690 msgr2=0x7f69440c71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:28.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.107+0000 7f6948993700 1 --2- 172.21.15.59:0/737301858 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f694415d690 0x7f69440c71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:28.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.107+0000 7f6948993700 1 -- 172.21.15.59:0/737301858 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69440cedb0 msgr2=0x7f69441f3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:28.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.107+0000 7f6948993700 1 --2- 172.21.15.59:0/737301858 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69440cedb0 0x7f69441f3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:28.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.107+0000 7f6948993700 1 -- 172.21.15.59:0/737301858 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f693c009a70 con 0x7f6944143ce0 2023-09-21T00:17:28.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.107+0000 7f6948993700 1 --2- 172.21.15.59:0/737301858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6944143ce0 0x7f69440c6c80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f693800c550 tx=0x7f693800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:28.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.107+0000 7f6935ffb700 1 -- 172.21.15.59:0/737301858 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6938004c80 con 0x7f6944143ce0 2023-09-21T00:17:28.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.107+0000 7f6935ffb700 1 -- 172.21.15.59:0/737301858 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6938004e00 con 0x7f6944143ce0 2023-09-21T00:17:28.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.107+0000 7f6935ffb700 1 -- 172.21.15.59:0/737301858 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6938007310 con 0x7f6944143ce0 2023-09-21T00:17:28.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.107+0000 7f694b3f8700 1 -- 172.21.15.59:0/737301858 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69440c65f0 con 0x7f6944143ce0 2023-09-21T00:17:28.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.108+0000 7f694b3f8700 1 -- 172.21.15.59:0/737301858 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69441410b0 con 0x7f6944143ce0 2023-09-21T00:17:28.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.109+0000 7f694b3f8700 1 -- 172.21.15.59:0/737301858 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6944067e50 con 0x7f6944143ce0 2023-09-21T00:17:28.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.109+0000 7f6935ffb700 1 -- 172.21.15.59:0/737301858 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f6938007470 con 0x7f6944143ce0 2023-09-21T00:17:28.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.109+0000 7f6935ffb700 1 --2- 172.21.15.59:0/737301858 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f692806ae00 0x7f692806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:28.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.110+0000 7f6935ffb700 1 -- 172.21.15.59:0/737301858 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6938089290 con 0x7f6944143ce0 2023-09-21T00:17:28.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.110+0000 7f6949194700 1 --2- 172.21.15.59:0/737301858 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f692806ae00 0x7f692806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:28.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.110+0000 7f6949194700 1 --2- 172.21.15.59:0/737301858 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f692806ae00 0x7f692806d2c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6940006fd0 tx=0x7f6940008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:28.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.114+0000 7f6935ffb700 1 -- 172.21.15.59:0/737301858 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f69380540c0 con 0x7f6944143ce0 2023-09-21T00:17:28.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.320+0000 7f694b3f8700 1 -- 172.21.15.59:0/737301858 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f69440cf740 con 0x7f6944143ce0 2023-09-21T00:17:28.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.321+0000 7f6935ffb700 1 -- 172.21.15.59:0/737301858 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18262 (secure 0 0 0) 0x7f69440cf740 con 0x7f6944143ce0 2023-09-21T00:17:28.322 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:17:28.323 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":24,"fsid":"dd69925c-6e25-42fe-880b-2f60fc6f384b","created":"2023-09-21T00:16:43.074489+0000","modified":"2023-09-21T00:17:11.387529+0000","last_up_change":"2023-09-21T00:16:54.740101+0000","last_in_change":"2023-09-21T00:16:45.987089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T00:16:54.796248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-21T00:17:04.167102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-21T00:17:05.313188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-21T00:17:08.977609+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d4b18344-74c0-4f75-920b-7a9247e48914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6809","nonce":2418314235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6811","nonce":2418314235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6815","nonce":2418314235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6813","nonce":2418314235}]},"public_addr":"172.21.15.59:6809/2418314235","cluster_addr":"172.21.15.59:6811/2418314235","heartbeat_back_addr":"172.21.15.59:6815/2418314235","heartbeat_front_addr":"172.21.15.59:6813/2418314235","state":["exists","up"]},{"osd":1,"uuid":"80940d50-a248-4e64-a282-7ffcdad790ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6801","nonce":869668251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6803","nonce":869668251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6807","nonce":869668251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6805","nonce":869668251}]},"public_addr":"172.21.15.59:6801/869668251","cluster_addr":"172.21.15.59:6803/869668251","heartbeat_back_addr":"172.21.15.59:6807/869668251","heartbeat_front_addr":"172.21.15.59:6805/869668251","state":["exists","up"]},{"osd":2,"uuid":"55f2eceb-c54a-4879-a6ce-968c1c548b5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6817","nonce":372517778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6819","nonce":372517778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6823","nonce":372517778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6821","nonce":372517778}]},"public_addr":"172.21.15.59:6817/372517778","cluster_addr":"172.21.15.59:6819/372517778","heartbeat_back_addr":"172.21.15.59:6823/372517778","heartbeat_front_addr":"172.21.15.59:6821/372517778","state":["exists","up"]},{"osd":3,"uuid":"92b89cd0-869c-49b9-a9f9-97ac8423f304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6825","nonce":575188498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6827","nonce":575188498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6831","nonce":575188498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6829","nonce":575188498}]},"public_addr":"172.21.15.59:6825/575188498","cluster_addr":"172.21.15.59:6827/575188498","heartbeat_back_addr":"172.21.15.59:6831/575188498","heartbeat_front_addr":"172.21.15.59:6829/575188498","state":["exists","up"]},{"osd":4,"uuid":"25b80e94-e0e6-403d-b69f-61542f289637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6803","nonce":1741219098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6805","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6807","nonce":1741219098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6815","nonce":1741219098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6811","nonce":1741219098}]},"public_addr":"172.21.15.83:6803/1741219098","cluster_addr":"172.21.15.83:6807/1741219098","heartbeat_back_addr":"172.21.15.83:6815/1741219098","heartbeat_front_addr":"172.21.15.83:6811/1741219098","state":["exists","up"]},{"osd":5,"uuid":"5498d9ab-1086-4796-a199-9051e6dfea91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6817","nonce":156730565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6819","nonce":156730565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6823","nonce":156730565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6821","nonce":156730565}]},"public_addr":"172.21.15.83:6817/156730565","cluster_addr":"172.21.15.83:6819/156730565","heartbeat_back_addr":"172.21.15.83:6823/156730565","heartbeat_front_addr":"172.21.15.83:6821/156730565","state":["exists","up"]},{"osd":6,"uuid":"cfd810c0-5015-4d60-9a75-7efc93a32e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6801","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6800","nonce":1337723778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6806","nonce":1337723778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6814","nonce":1337723778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6810","nonce":1337723778}]},"public_addr":"172.21.15.83:6800/1337723778","cluster_addr":"172.21.15.83:6806/1337723778","heartbeat_back_addr":"172.21.15.83:6814/1337723778","heartbeat_front_addr":"172.21.15.83:6810/1337723778","state":["exists","up"]},{"osd":7,"uuid":"e992c8fa-0a3d-4b3c-85b5-2c511223dee4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6825","nonce":4204859272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6827","nonce":4204859272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6831","nonce":4204859272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6829","nonce":4204859272}]},"public_addr":"172.21.15.83:6825/4204859272","cluster_addr":"172.21.15.83:6827/4204859272","heartbeat_back_addr":"172.21.15.83:6831/4204859272","heartbeat_front_addr":"172.21.15.83:6829/4204859272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.156498+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.882707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.093978+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.158565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.173933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.888606+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.135525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.149712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T00:17:28.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.323+0000 7f694b3f8700 1 -- 172.21.15.59:0/737301858 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f692806ae00 msgr2=0x7f692806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:28.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.323+0000 7f694b3f8700 1 --2- 172.21.15.59:0/737301858 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f692806ae00 0x7f692806d2c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6940006fd0 tx=0x7f6940008040 comp rx=0 tx=0).stop 2023-09-21T00:17:28.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.323+0000 7f694b3f8700 1 -- 172.21.15.59:0/737301858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6944143ce0 msgr2=0x7f69440c6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:28.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.323+0000 7f694b3f8700 1 --2- 172.21.15.59:0/737301858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6944143ce0 0x7f69440c6c80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f693800c550 tx=0x7f693800c860 comp rx=0 tx=0).stop 2023-09-21T00:17:28.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.324+0000 7f694b3f8700 1 -- 172.21.15.59:0/737301858 shutdown_connections 2023-09-21T00:17:28.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.324+0000 7f694b3f8700 1 --2- 172.21.15.59:0/737301858 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f692806ae00 0x7f692806d2c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:28.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.324+0000 7f694b3f8700 1 --2- 172.21.15.59:0/737301858 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f694415d690 0x7f69440c71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:28.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.324+0000 7f694b3f8700 1 --2- 172.21.15.59:0/737301858 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69440cedb0 0x7f69441f3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:28.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.324+0000 7f694b3f8700 1 --2- 172.21.15.59:0/737301858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6944143ce0 0x7f69440c6c80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:28.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.324+0000 7f694b3f8700 1 -- 172.21.15.59:0/737301858 >> 172.21.15.59:0/737301858 conn(0x7f69440d11e0 msgr2=0x7f69440cc060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:28.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.324+0000 7f694b3f8700 1 -- 172.21.15.59:0/737301858 shutdown_connections 2023-09-21T00:17:28.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.324+0000 7f694b3f8700 1 -- 172.21.15.59:0/737301858 wait complete. 2023-09-21T00:17:28.337 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-21T00:17:28.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.464+0000 7f8d33615700 1 Processor -- start 2023-09-21T00:17:28.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.464+0000 7f8d33615700 1 -- start start 2023-09-21T00:17:28.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.465+0000 7f8d33615700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8d2c15b2b0 0x7f8d2c0cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:28.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.465+0000 7f8d33615700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8d2c06a780 0x7f8d2c06abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:28.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.465+0000 7f8d33615700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d2c06b110 con 0x7f8d2c0ce420 2023-09-21T00:17:28.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.465+0000 7f8d33615700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d2c0ce250 con 0x7f8d2c15b2b0 2023-09-21T00:17:28.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.465+0000 7f8d33615700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d2c1618a0 con 0x7f8d2c06a780 2023-09-21T00:17:28.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.465+0000 7f8d313b1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8d2c15b2b0 0x7f8d2c0cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:28.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.465+0000 7f8d30bb0700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8d2c0ce420 0x7f8d2c161190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56894/0 (socket says 172.21.15.59:56894) 2023-09-21T00:17:28.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.465+0000 7f8d30bb0700 1 -- 172.21.15.59:0/3521466935 learned_addr learned my addr 172.21.15.59:0/3521466935 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:28.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.465+0000 7f8d31bb2700 1 --2- 172.21.15.59:0/3521466935 >> v2:172.21.15.83:3300/0 conn(0x7f8d2c06a780 0x7f8d2c06abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:28.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.466+0000 7f8d313b1700 1 -- 172.21.15.59:0/3521466935 >> v2:172.21.15.83:3300/0 conn(0x7f8d2c06a780 msgr2=0x7f8d2c06abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:28.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.466+0000 7f8d313b1700 1 --2- 172.21.15.59:0/3521466935 >> v2:172.21.15.83:3300/0 conn(0x7f8d2c06a780 0x7f8d2c06abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:28.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.466+0000 7f8d313b1700 1 -- 172.21.15.59:0/3521466935 >> v1:172.21.15.59:6789/0 conn(0x7f8d2c0ce420 legacy=0x7f8d2c161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:28.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.466+0000 7f8d313b1700 1 -- 172.21.15.59:0/3521466935 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d2c0cfee0 con 0x7f8d2c15b2b0 2023-09-21T00:17:28.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.466+0000 7f8d23fff700 1 -- 172.21.15.59:0/3521466935 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4217525295 0 0) 0x7f8d28001110 con 0x7f8d2c0ce420 2023-09-21T00:17:28.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.466+0000 7f8d313b1700 1 --2- 172.21.15.59:0/3521466935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d2c15b2b0 0x7f8d2c0cdd10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c0cbf10 tx=0x7f8d1c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a37cd2a6a1e2cc84 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:28.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.466+0000 7f8d23fff700 1 -- 172.21.15.59:0/3521466935 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c011830 con 0x7f8d2c15b2b0 2023-09-21T00:17:28.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.466+0000 7f8d23fff700 1 -- 172.21.15.59:0/3521466935 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d1c011990 con 0x7f8d2c15b2b0 2023-09-21T00:17:28.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.466+0000 7f8d23fff700 1 -- 172.21.15.59:0/3521466935 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c011d20 con 0x7f8d2c15b2b0 2023-09-21T00:17:28.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.467+0000 7f8d33615700 1 -- 172.21.15.59:0/3521466935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d2c15b2b0 msgr2=0x7f8d2c0cdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:28.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.467+0000 7f8d33615700 1 --2- 172.21.15.59:0/3521466935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d2c15b2b0 0x7f8d2c0cdd10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c0cbf10 tx=0x7f8d1c009b20 comp rx=0 tx=0).stop 2023-09-21T00:17:28.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.467+0000 7f8d33615700 1 -- 172.21.15.59:0/3521466935 shutdown_connections 2023-09-21T00:17:28.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.467+0000 7f8d33615700 1 --2- 172.21.15.59:0/3521466935 >> v2:172.21.15.83:3300/0 conn(0x7f8d2c06a780 0x7f8d2c06abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:28.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.467+0000 7f8d33615700 1 --2- 172.21.15.59:0/3521466935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d2c15b2b0 0x7f8d2c0cdd10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:28.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.467+0000 7f8d33615700 1 -- 172.21.15.59:0/3521466935 >> 172.21.15.59:0/3521466935 conn(0x7f8d2c0d0140 msgr2=0x7f8d2c0d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:28.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.467+0000 7f8d33615700 1 -- 172.21.15.59:0/3521466935 shutdown_connections 2023-09-21T00:17:28.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.467+0000 7f8d33615700 1 -- 172.21.15.59:0/3521466935 wait complete. 2023-09-21T00:17:28.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.468+0000 7f8d33615700 1 Processor -- start 2023-09-21T00:17:28.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.468+0000 7f8d33615700 1 -- start start 2023-09-21T00:17:28.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.469+0000 7f8d33615700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d2c06a780 0x7f8d2c15f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:28.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.469+0000 7f8d33615700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d2c0ce420 0x7f8d2c15e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:28.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.469+0000 7f8d33615700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d2c15b2b0 0x7f8d2c159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:28.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.469+0000 7f8d33615700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2c15f110 con 0x7f8d2c06a780 2023-09-21T00:17:28.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.469+0000 7f8d33615700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2c0affa0 con 0x7f8d2c15b2b0 2023-09-21T00:17:28.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.469+0000 7f8d33615700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2c15e610 con 0x7f8d2c0ce420 2023-09-21T00:17:28.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.469+0000 7f8d313b1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d2c06a780 0x7f8d2c15f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:28.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.469+0000 7f8d313b1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d2c06a780 0x7f8d2c15f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51330/0 (socket says 172.21.15.59:51330) 2023-09-21T00:17:28.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.469+0000 7f8d313b1700 1 -- 172.21.15.59:0/1520789051 learned_addr learned my addr 172.21.15.59:0/1520789051 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:28.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.469+0000 7f8d31bb2700 1 --2- 172.21.15.59:0/1520789051 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d2c15b2b0 0x7f8d2c159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:28.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.469+0000 7f8d30bb0700 1 --2- 172.21.15.59:0/1520789051 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d2c0ce420 0x7f8d2c15e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:28.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.469+0000 7f8d313b1700 1 -- 172.21.15.59:0/1520789051 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d2c0ce420 msgr2=0x7f8d2c15e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:28.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.469+0000 7f8d313b1700 1 --2- 172.21.15.59:0/1520789051 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d2c0ce420 0x7f8d2c15e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:28.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.469+0000 7f8d313b1700 1 -- 172.21.15.59:0/1520789051 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d2c15b2b0 msgr2=0x7f8d2c159f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:28.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.469+0000 7f8d313b1700 1 --2- 172.21.15.59:0/1520789051 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d2c15b2b0 0x7f8d2c159f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:28.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.469+0000 7f8d313b1700 1 -- 172.21.15.59:0/1520789051 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d1c0094a0 con 0x7f8d2c06a780 2023-09-21T00:17:28.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.469+0000 7f8d313b1700 1 --2- 172.21.15.59:0/1520789051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d2c06a780 0x7f8d2c15f780 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c0090b0 tx=0x7f8d1c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:28.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.469+0000 7f8d21ffb700 1 -- 172.21.15.59:0/1520789051 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c0036a0 con 0x7f8d2c06a780 2023-09-21T00:17:28.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.470+0000 7f8d21ffb700 1 -- 172.21.15.59:0/1520789051 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d1c01e070 con 0x7f8d2c06a780 2023-09-21T00:17:28.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.470+0000 7f8d33615700 1 -- 172.21.15.59:0/1520789051 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d2c15e870 con 0x7f8d2c06a780 2023-09-21T00:17:28.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.470+0000 7f8d21ffb700 1 -- 172.21.15.59:0/1520789051 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c003a60 con 0x7f8d2c06a780 2023-09-21T00:17:28.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.470+0000 7f8d33615700 1 -- 172.21.15.59:0/1520789051 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d2c15ee30 con 0x7f8d2c06a780 2023-09-21T00:17:28.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.471+0000 7f8d33615700 1 -- 172.21.15.59:0/1520789051 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d2c0ceea0 con 0x7f8d2c06a780 2023-09-21T00:17:28.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.471+0000 7f8d21ffb700 1 -- 172.21.15.59:0/1520789051 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f8d1c003bc0 con 0x7f8d2c06a780 2023-09-21T00:17:28.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.472+0000 7f8d21ffb700 1 --2- 172.21.15.59:0/1520789051 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f8d1006ae00 0x7f8d1006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:28.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.472+0000 7f8d21ffb700 1 -- 172.21.15.59:0/1520789051 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8d1c08a6a0 con 0x7f8d2c06a780 2023-09-21T00:17:28.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.472+0000 7f8d30bb0700 1 --2- 172.21.15.59:0/1520789051 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f8d1006ae00 0x7f8d1006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:28.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.472+0000 7f8d30bb0700 1 --2- 172.21.15.59:0/1520789051 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f8d1006ae00 0x7f8d1006d2c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c0c86d0 tx=0x7f8d28007c20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:28.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.476+0000 7f8d21ffb700 1 -- 172.21.15.59:0/1520789051 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f8d2c0ceea0 con 0x7f8d2c06a780 2023-09-21T00:17:28.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.721+0000 7f8d33615700 1 -- 172.21.15.59:0/1520789051 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8d2c0ceea0 con 0x7f8d2c06a780 2023-09-21T00:17:29.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:28.999+0000 7f8d21ffb700 1 -- 172.21.15.59:0/1520789051 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8d2c0ceea0 con 0x7f8d2c06a780 2023-09-21T00:17:29.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.001+0000 7f8d33615700 1 -- 172.21.15.59:0/1520789051 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f8d1006ae00 msgr2=0x7f8d1006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:29.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.001+0000 7f8d33615700 1 --2- 172.21.15.59:0/1520789051 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f8d1006ae00 0x7f8d1006d2c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c0c86d0 tx=0x7f8d28007c20 comp rx=0 tx=0).stop 2023-09-21T00:17:29.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.001+0000 7f8d33615700 1 -- 172.21.15.59:0/1520789051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d2c06a780 msgr2=0x7f8d2c15f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:29.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.001+0000 7f8d33615700 1 --2- 172.21.15.59:0/1520789051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d2c06a780 0x7f8d2c15f780 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c0090b0 tx=0x7f8d1c004750 comp rx=0 tx=0).stop 2023-09-21T00:17:29.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.001+0000 7f8d33615700 1 -- 172.21.15.59:0/1520789051 shutdown_connections 2023-09-21T00:17:29.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.001+0000 7f8d33615700 1 --2- 172.21.15.59:0/1520789051 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d2c15b2b0 0x7f8d2c159f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:29.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.002+0000 7f8d33615700 1 --2- 172.21.15.59:0/1520789051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d2c06a780 0x7f8d2c15f780 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:29.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.002+0000 7f8d33615700 1 --2- 172.21.15.59:0/1520789051 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f8d1006ae00 0x7f8d1006d2c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:29.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.002+0000 7f8d33615700 1 --2- 172.21.15.59:0/1520789051 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d2c0ce420 0x7f8d2c15e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:29.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.002+0000 7f8d33615700 1 -- 172.21.15.59:0/1520789051 >> 172.21.15.59:0/1520789051 conn(0x7f8d2c0d0140 msgr2=0x7f8d2c15a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:29.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.002+0000 7f8d33615700 1 -- 172.21.15.59:0/1520789051 shutdown_connections 2023-09-21T00:17:29.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.002+0000 7f8d33615700 1 -- 172.21.15.59:0/1520789051 wait complete. 2023-09-21T00:17:29.015 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-09-21T00:17:29.016 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-21T00:17:29.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.144+0000 7f9ee1375700 1 Processor -- start 2023-09-21T00:17:29.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.144+0000 7f9ee1375700 1 -- start start 2023-09-21T00:17:29.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.144+0000 7f9ee1375700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9edc0d2f80 0x7f9edc0b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:29.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.145+0000 7f9ee1375700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9edc0d1c30 con 0x7f9edc0b5460 2023-09-21T00:17:29.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.145+0000 7f9ee1375700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9edc0d1ee0 con 0x7f9edc15d690 2023-09-21T00:17:29.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.145+0000 7f9ee1375700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc0b58f0 con 0x7f9edc0d2f80 2023-09-21T00:17:29.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.145+0000 7f9edb7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9edc0b5460 0x7f9edc0b65d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56908/0 (socket says 172.21.15.59:56908) 2023-09-21T00:17:29.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.145+0000 7f9edb7fe700 1 -- 172.21.15.59:0/973191006 learned_addr learned my addr 172.21.15.59:0/973191006 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:29.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.145+0000 7f9eda7fc700 1 --2- 172.21.15.59:0/973191006 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9edc0d2f80 0x7f9edc0b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:29.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.145+0000 7f9ed9ffb700 1 -- 172.21.15.59:0/973191006 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 821843096 0 0) 0x7f9edc0d1c30 con 0x7f9edc0b5460 2023-09-21T00:17:29.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.145+0000 7f9ed9ffb700 1 -- 172.21.15.59:0/973191006 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ec40035b0 con 0x7f9edc0b5460 2023-09-21T00:17:29.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.145+0000 7f9ed9ffb700 1 -- 172.21.15.59:0/973191006 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2136857150 0 0) 0x7f9edc0d1ee0 con 0x7f9edc15d690 2023-09-21T00:17:29.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.145+0000 7f9ed9ffb700 1 -- 172.21.15.59:0/973191006 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9edc0d1c30 con 0x7f9edc15d690 2023-09-21T00:17:29.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.145+0000 7f9eda7fc700 1 -- 172.21.15.59:0/973191006 >> v1:172.21.15.83:6789/0 conn(0x7f9edc15d690 legacy=0x7f9edc0d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:29.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.145+0000 7f9eda7fc700 1 -- 172.21.15.59:0/973191006 >> v1:172.21.15.59:6789/0 conn(0x7f9edc0b5460 legacy=0x7f9edc0b65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:29.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.145+0000 7f9eda7fc700 1 -- 172.21.15.59:0/973191006 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9edc0d21c0 con 0x7f9edc0d2f80 2023-09-21T00:17:29.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.145+0000 7f9eda7fc700 1 --2- 172.21.15.59:0/973191006 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9edc0d2f80 0x7f9edc0b4f20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0009870 tx=0x7f9ed0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a6b5bd11306e75a server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:29.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.146+0000 7f9ed9ffb700 1 -- 172.21.15.59:0/973191006 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed0011830 con 0x7f9edc0d2f80 2023-09-21T00:17:29.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.146+0000 7f9ed9ffb700 1 -- 172.21.15.59:0/973191006 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed0011990 con 0x7f9edc0d2f80 2023-09-21T00:17:29.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.146+0000 7f9ed9ffb700 1 -- 172.21.15.59:0/973191006 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed0011d20 con 0x7f9edc0d2f80 2023-09-21T00:17:29.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.146+0000 7f9ee1375700 1 -- 172.21.15.59:0/973191006 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9edc0d2f80 msgr2=0x7f9edc0b4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:29.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.146+0000 7f9ee1375700 1 --2- 172.21.15.59:0/973191006 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9edc0d2f80 0x7f9edc0b4f20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0009870 tx=0x7f9ed0009b80 comp rx=0 tx=0).stop 2023-09-21T00:17:29.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.146+0000 7f9ee1375700 1 -- 172.21.15.59:0/973191006 shutdown_connections 2023-09-21T00:17:29.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.146+0000 7f9ee1375700 1 --2- 172.21.15.59:0/973191006 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9edc0d2f80 0x7f9edc0b4f20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:29.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.146+0000 7f9ee1375700 1 -- 172.21.15.59:0/973191006 >> 172.21.15.59:0/973191006 conn(0x7f9edc072560 msgr2=0x7f9edc0cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:29.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.146+0000 7f9ee1375700 1 -- 172.21.15.59:0/973191006 shutdown_connections 2023-09-21T00:17:29.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.146+0000 7f9ee1375700 1 -- 172.21.15.59:0/973191006 wait complete. 2023-09-21T00:17:29.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.147+0000 7f9ee1375700 1 Processor -- start 2023-09-21T00:17:29.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.148+0000 7f9ee1375700 1 -- start start 2023-09-21T00:17:29.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.148+0000 7f9ee1375700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9edc0b5460 0x7f9edc1f2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:29.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.148+0000 7f9ee1375700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9edc0d2f80 0x7f9edc158c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:29.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.148+0000 7f9ee1375700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9edc15d690 0x7f9edc0c7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:29.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.148+0000 7f9ee1375700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc15a680 con 0x7f9edc0d2f80 2023-09-21T00:17:29.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.148+0000 7f9ee1375700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc1f2c80 con 0x7f9edc15d690 2023-09-21T00:17:29.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.148+0000 7f9ee1375700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc1595e0 con 0x7f9edc0b5460 2023-09-21T00:17:29.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.148+0000 7f9eda7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9edc0d2f80 0x7f9edc158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:29.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.148+0000 7f9eda7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9edc0d2f80 0x7f9edc158c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51344/0 (socket says 172.21.15.59:51344) 2023-09-21T00:17:29.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.148+0000 7f9eda7fc700 1 -- 172.21.15.59:0/2817195069 learned_addr learned my addr 172.21.15.59:0/2817195069 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:29.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.149+0000 7f9edb7fe700 1 --2- 172.21.15.59:0/2817195069 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9edc15d690 0x7f9edc0c7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:29.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.149+0000 7f9edaffd700 1 --2- 172.21.15.59:0/2817195069 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9edc0b5460 0x7f9edc1f2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:29.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.149+0000 7f9eda7fc700 1 -- 172.21.15.59:0/2817195069 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9edc0b5460 msgr2=0x7f9edc1f2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:29.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.149+0000 7f9eda7fc700 1 --2- 172.21.15.59:0/2817195069 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9edc0b5460 0x7f9edc1f2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:29.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.149+0000 7f9eda7fc700 1 -- 172.21.15.59:0/2817195069 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9edc15d690 msgr2=0x7f9edc0c7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:29.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.149+0000 7f9eda7fc700 1 --2- 172.21.15.59:0/2817195069 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9edc15d690 0x7f9edc0c7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:29.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.149+0000 7f9eda7fc700 1 -- 172.21.15.59:0/2817195069 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed00094a0 con 0x7f9edc0d2f80 2023-09-21T00:17:29.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.149+0000 7f9eda7fc700 1 --2- 172.21.15.59:0/2817195069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9edc0d2f80 0x7f9edc158c20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9ed00090b0 tx=0x7f9ed0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:29.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.149+0000 7f9ec37fe700 1 -- 172.21.15.59:0/2817195069 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed001a6e0 con 0x7f9edc0d2f80 2023-09-21T00:17:29.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.149+0000 7f9ec37fe700 1 -- 172.21.15.59:0/2817195069 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed001a840 con 0x7f9edc0d2f80 2023-09-21T00:17:29.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.149+0000 7f9ee1375700 1 -- 172.21.15.59:0/2817195069 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9edc1598c0 con 0x7f9edc0d2f80 2023-09-21T00:17:29.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.149+0000 7f9ec37fe700 1 -- 172.21.15.59:0/2817195069 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed001abb0 con 0x7f9edc0d2f80 2023-09-21T00:17:29.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.149+0000 7f9ee1375700 1 -- 172.21.15.59:0/2817195069 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9edc159e80 con 0x7f9edc0d2f80 2023-09-21T00:17:29.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.150+0000 7f9ee1375700 1 -- 172.21.15.59:0/2817195069 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9edc067e50 con 0x7f9edc0d2f80 2023-09-21T00:17:29.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.151+0000 7f9ec37fe700 1 -- 172.21.15.59:0/2817195069 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f9ed0022070 con 0x7f9edc0d2f80 2023-09-21T00:17:29.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.151+0000 7f9ec37fe700 1 --2- 172.21.15.59:0/2817195069 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f9ec806ae00 0x7f9ec806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:29.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.151+0000 7f9ec37fe700 1 -- 172.21.15.59:0/2817195069 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9ed008a950 con 0x7f9edc0d2f80 2023-09-21T00:17:29.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.152+0000 7f9edaffd700 1 --2- 172.21.15.59:0/2817195069 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f9ec806ae00 0x7f9ec806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:29.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.152+0000 7f9edaffd700 1 --2- 172.21.15.59:0/2817195069 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f9ec806ae00 0x7f9ec806d2c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc001220 tx=0x7f9ecc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:29.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.156+0000 7f9ec37fe700 1 -- 172.21.15.59:0/2817195069 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f9ed0055890 con 0x7f9edc0d2f80 2023-09-21T00:17:29.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:29.400+0000 7f9ee1375700 1 -- 172.21.15.59:0/2817195069 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f9edc15b030 con 0x7f9edc0d2f80 2023-09-21T00:17:30.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.006+0000 7f9ec37fe700 1 -- 172.21.15.59:0/2817195069 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9ed00290c0 con 0x7f9edc0d2f80 2023-09-21T00:17:30.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.008+0000 7f9ee1375700 1 -- 172.21.15.59:0/2817195069 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f9ec806ae00 msgr2=0x7f9ec806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:30.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.008+0000 7f9ee1375700 1 --2- 172.21.15.59:0/2817195069 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f9ec806ae00 0x7f9ec806d2c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc001220 tx=0x7f9ecc009040 comp rx=0 tx=0).stop 2023-09-21T00:17:30.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.008+0000 7f9ee1375700 1 -- 172.21.15.59:0/2817195069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9edc0d2f80 msgr2=0x7f9edc158c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:30.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.008+0000 7f9ee1375700 1 --2- 172.21.15.59:0/2817195069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9edc0d2f80 0x7f9edc158c20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9ed00090b0 tx=0x7f9ed0004750 comp rx=0 tx=0).stop 2023-09-21T00:17:30.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.008+0000 7f9ee1375700 1 -- 172.21.15.59:0/2817195069 shutdown_connections 2023-09-21T00:17:30.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.008+0000 7f9ee1375700 1 --2- 172.21.15.59:0/2817195069 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9edc15d690 0x7f9edc0c7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:30.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.008+0000 7f9ee1375700 1 --2- 172.21.15.59:0/2817195069 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f9ec806ae00 0x7f9ec806d2c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:30.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.008+0000 7f9ee1375700 1 --2- 172.21.15.59:0/2817195069 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9edc0b5460 0x7f9edc1f2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:30.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.008+0000 7f9ee1375700 1 --2- 172.21.15.59:0/2817195069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9edc0d2f80 0x7f9edc158c20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:30.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.008+0000 7f9ee1375700 1 -- 172.21.15.59:0/2817195069 >> 172.21.15.59:0/2817195069 conn(0x7f9edc072560 msgr2=0x7f9edc154990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:30.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.009+0000 7f9ee1375700 1 -- 172.21.15.59:0/2817195069 shutdown_connections 2023-09-21T00:17:30.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.009+0000 7f9ee1375700 1 -- 172.21.15.59:0/2817195069 wait complete. 2023-09-21T00:17:30.024 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-09-21T00:17:30.025 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T00:17:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.155+0000 7f78f271c700 1 Processor -- start 2023-09-21T00:17:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.155+0000 7f78f271c700 1 -- start start 2023-09-21T00:17:30.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.156+0000 7f78f271c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f78ec15b2b0 0x7f78ec0cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:30.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.156+0000 7f78f271c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78ec0ce420 0x7f78ec161190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:30.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.156+0000 7f78f271c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78ec0cfee0 con 0x7f78ec06a780 2023-09-21T00:17:30.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.156+0000 7f78f271c700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78ec0ce250 con 0x7f78ec15b2b0 2023-09-21T00:17:30.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.156+0000 7f78f271c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec0ce900 con 0x7f78ec0ce420 2023-09-21T00:17:30.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.156+0000 7f78f0cb9700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f78ec06a780 0x7f78ec15e1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56922/0 (socket says 172.21.15.59:56922) 2023-09-21T00:17:30.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.156+0000 7f78f0cb9700 1 -- 172.21.15.59:0/1623279654 learned_addr learned my addr 172.21.15.59:0/1623279654 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:30.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.156+0000 7f78ebfff700 1 --2- 172.21.15.59:0/1623279654 >> v2:172.21.15.83:3300/0 conn(0x7f78ec15b2b0 0x7f78ec0cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:30.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.156+0000 7f78eb7fe700 1 --2- 172.21.15.59:0/1623279654 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78ec0ce420 0x7f78ec161190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:30.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.156+0000 7f78eaffd700 1 -- 172.21.15.59:0/1623279654 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2204397940 0 0) 0x7f78ec0cfee0 con 0x7f78ec06a780 2023-09-21T00:17:30.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.156+0000 7f78eaffd700 1 -- 172.21.15.59:0/1623279654 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78d40035b0 con 0x7f78ec06a780 2023-09-21T00:17:30.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.156+0000 7f78ebfff700 1 -- 172.21.15.59:0/1623279654 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78ec0ce420 msgr2=0x7f78ec161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:30.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.156+0000 7f78ebfff700 1 --2- 172.21.15.59:0/1623279654 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78ec0ce420 0x7f78ec161190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:30.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.156+0000 7f78ebfff700 1 -- 172.21.15.59:0/1623279654 >> v1:172.21.15.59:6789/0 conn(0x7f78ec06a780 legacy=0x7f78ec15e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:30.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.156+0000 7f78ebfff700 1 -- 172.21.15.59:0/1623279654 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ec0cebe0 con 0x7f78ec15b2b0 2023-09-21T00:17:30.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.157+0000 7f78ebfff700 1 --2- 172.21.15.59:0/1623279654 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78ec15b2b0 0x7f78ec0cdd10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f78dc009840 tx=0x7f78dc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fcff2afbb50c40 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:30.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.157+0000 7f78eaffd700 1 -- 172.21.15.59:0/1623279654 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc011830 con 0x7f78ec15b2b0 2023-09-21T00:17:30.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.157+0000 7f78eaffd700 1 -- 172.21.15.59:0/1623279654 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78dc011990 con 0x7f78ec15b2b0 2023-09-21T00:17:30.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.157+0000 7f78eaffd700 1 -- 172.21.15.59:0/1623279654 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc011d20 con 0x7f78ec15b2b0 2023-09-21T00:17:30.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.157+0000 7f78f271c700 1 -- 172.21.15.59:0/1623279654 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78ec15b2b0 msgr2=0x7f78ec0cdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:30.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.157+0000 7f78f271c700 1 --2- 172.21.15.59:0/1623279654 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78ec15b2b0 0x7f78ec0cdd10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f78dc009840 tx=0x7f78dc009b50 comp rx=0 tx=0).stop 2023-09-21T00:17:30.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.157+0000 7f78f271c700 1 -- 172.21.15.59:0/1623279654 shutdown_connections 2023-09-21T00:17:30.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.157+0000 7f78f271c700 1 --2- 172.21.15.59:0/1623279654 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78ec15b2b0 0x7f78ec0cdd10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:30.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.157+0000 7f78f271c700 1 --2- 172.21.15.59:0/1623279654 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78ec0ce420 0x7f78ec161190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:30.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.157+0000 7f78f271c700 1 -- 172.21.15.59:0/1623279654 >> 172.21.15.59:0/1623279654 conn(0x7f78ec0d0140 msgr2=0x7f78ec0d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:30.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.157+0000 7f78f271c700 1 -- 172.21.15.59:0/1623279654 shutdown_connections 2023-09-21T00:17:30.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.157+0000 7f78f271c700 1 -- 172.21.15.59:0/1623279654 wait complete. 2023-09-21T00:17:30.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.159+0000 7f78f271c700 1 Processor -- start 2023-09-21T00:17:30.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.159+0000 7f78f271c700 1 -- start start 2023-09-21T00:17:30.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.159+0000 7f78f271c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78ec06a780 0x7f78ec0c9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:30.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.160+0000 7f78f271c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78ec0ce420 0x7f78ec0c6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:30.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.160+0000 7f78f271c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78ec15b2b0 0x7f78ec152d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:30.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.160+0000 7f78f271c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec0c9c50 con 0x7f78ec0ce420 2023-09-21T00:17:30.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.160+0000 7f78f271c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec1e7c90 con 0x7f78ec06a780 2023-09-21T00:17:30.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.160+0000 7f78f271c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec0c6a60 con 0x7f78ec15b2b0 2023-09-21T00:17:30.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.160+0000 7f78eb7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78ec0ce420 0x7f78ec0c6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:30.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.160+0000 7f78eb7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78ec0ce420 0x7f78ec0c6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51358/0 (socket says 172.21.15.59:51358) 2023-09-21T00:17:30.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.160+0000 7f78eb7fe700 1 -- 172.21.15.59:0/2566855956 learned_addr learned my addr 172.21.15.59:0/2566855956 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:30.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.160+0000 7f78ebfff700 1 --2- 172.21.15.59:0/2566855956 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78ec06a780 0x7f78ec0c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:30.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.160+0000 7f78f0cb9700 1 --2- 172.21.15.59:0/2566855956 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78ec15b2b0 0x7f78ec152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:30.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.160+0000 7f78eb7fe700 1 -- 172.21.15.59:0/2566855956 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78ec15b2b0 msgr2=0x7f78ec152d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:30.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.160+0000 7f78eb7fe700 1 --2- 172.21.15.59:0/2566855956 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78ec15b2b0 0x7f78ec152d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:30.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.160+0000 7f78eb7fe700 1 -- 172.21.15.59:0/2566855956 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78ec06a780 msgr2=0x7f78ec0c9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:30.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.160+0000 7f78eb7fe700 1 --2- 172.21.15.59:0/2566855956 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78ec06a780 0x7f78ec0c9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:30.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.160+0000 7f78eb7fe700 1 -- 172.21.15.59:0/2566855956 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78dc0094a0 con 0x7f78ec0ce420 2023-09-21T00:17:30.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.160+0000 7f78ebfff700 1 --2- 172.21.15.59:0/2566855956 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78ec06a780 0x7f78ec0c9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:17:30.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.160+0000 7f78eb7fe700 1 --2- 172.21.15.59:0/2566855956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78ec0ce420 0x7f78ec0c6520 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f78e000e9b0 tx=0x7f78e000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:30.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.160+0000 7f78e8ff9700 1 -- 172.21.15.59:0/2566855956 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e0009710 con 0x7f78ec0ce420 2023-09-21T00:17:30.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.160+0000 7f78e8ff9700 1 -- 172.21.15.59:0/2566855956 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78e000c850 con 0x7f78ec0ce420 2023-09-21T00:17:30.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.160+0000 7f78e8ff9700 1 -- 172.21.15.59:0/2566855956 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e000cbc0 con 0x7f78ec0ce420 2023-09-21T00:17:30.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.160+0000 7f78f271c700 1 -- 172.21.15.59:0/2566855956 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78ec0c5760 con 0x7f78ec0ce420 2023-09-21T00:17:30.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.160+0000 7f78f271c700 1 -- 172.21.15.59:0/2566855956 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78ec0c5d20 con 0x7f78ec0ce420 2023-09-21T00:17:30.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.161+0000 7f78f271c700 1 -- 172.21.15.59:0/2566855956 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78ec0c6370 con 0x7f78ec0ce420 2023-09-21T00:17:30.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.162+0000 7f78e8ff9700 1 -- 172.21.15.59:0/2566855956 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f78e000cd20 con 0x7f78ec0ce420 2023-09-21T00:17:30.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.162+0000 7f78e8ff9700 1 --2- 172.21.15.59:0/2566855956 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f78d806ae00 0x7f78d806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:30.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.162+0000 7f78e8ff9700 1 -- 172.21.15.59:0/2566855956 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f78e00899e0 con 0x7f78ec0ce420 2023-09-21T00:17:30.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.162+0000 7f78ebfff700 1 --2- 172.21.15.59:0/2566855956 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f78d806ae00 0x7f78d806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:30.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.163+0000 7f78ebfff700 1 --2- 172.21.15.59:0/2566855956 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f78d806ae00 0x7f78d806d2c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f78dc000c00 tx=0x7f78dc01c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:30.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.167+0000 7f78e8ff9700 1 -- 172.21.15.59:0/2566855956 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f78e0054790 con 0x7f78ec0ce420 2023-09-21T00:17:30.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.411+0000 7f78f271c700 1 -- 172.21.15.59:0/2566855956 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f78ec067e50 con 0x7f78ec0ce420 2023-09-21T00:17:30.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.412+0000 7f78e8ff9700 1 -- 172.21.15.59:0/2566855956 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4903 (secure 0 0 0) 0x7f78e0057db0 con 0x7f78ec0ce420 2023-09-21T00:17:30.413 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:17:30.414 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/461673980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":461673980},{"type":"v1","addr":"172.21.15.59:6835","nonce":461673980}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/3148728526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3148728526},{"type":"v1","addr":"172.21.15.59:6834","nonce":3148728526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/3250481509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3250481509},{"type":"v1","addr":"172.21.15.83:6836","nonce":3250481509}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-21T00:17:06.338694+0000","modified":"2023-09-21T00:17:29.401478+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6837/792952552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":792952552},{"type":"v1","addr":"172.21.15.83:6837","nonce":792952552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-21T00:17:30.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.414+0000 7f78f271c700 1 -- 172.21.15.59:0/2566855956 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f78d806ae00 msgr2=0x7f78d806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:30.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.414+0000 7f78f271c700 1 --2- 172.21.15.59:0/2566855956 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f78d806ae00 0x7f78d806d2c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f78dc000c00 tx=0x7f78dc01c040 comp rx=0 tx=0).stop 2023-09-21T00:17:30.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.414+0000 7f78f271c700 1 -- 172.21.15.59:0/2566855956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78ec0ce420 msgr2=0x7f78ec0c6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:30.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.414+0000 7f78f271c700 1 --2- 172.21.15.59:0/2566855956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78ec0ce420 0x7f78ec0c6520 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f78e000e9b0 tx=0x7f78e000ed70 comp rx=0 tx=0).stop 2023-09-21T00:17:30.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.414+0000 7f78f271c700 1 -- 172.21.15.59:0/2566855956 shutdown_connections 2023-09-21T00:17:30.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.414+0000 7f78f271c700 1 --2- 172.21.15.59:0/2566855956 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f78d806ae00 0x7f78d806d2c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:30.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.414+0000 7f78f271c700 1 --2- 172.21.15.59:0/2566855956 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f78ec15b2b0 0x7f78ec152d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:30.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.414+0000 7f78f271c700 1 --2- 172.21.15.59:0/2566855956 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78ec06a780 0x7f78ec0c9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:30.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.414+0000 7f78f271c700 1 --2- 172.21.15.59:0/2566855956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78ec0ce420 0x7f78ec0c6520 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:30.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.414+0000 7f78f271c700 1 -- 172.21.15.59:0/2566855956 >> 172.21.15.59:0/2566855956 conn(0x7f78ec0d0140 msgr2=0x7f78ec073200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:30.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.414+0000 7f78f271c700 1 -- 172.21.15.59:0/2566855956 shutdown_connections 2023-09-21T00:17:30.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.414+0000 7f78f271c700 1 -- 172.21.15.59:0/2566855956 wait complete. 2023-09-21T00:17:30.419 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 8 2023-09-21T00:17:30.428 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T00:17:30.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.552+0000 7fcc8b4a9700 1 Processor -- start 2023-09-21T00:17:30.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.552+0000 7fcc8b4a9700 1 -- start start 2023-09-21T00:17:30.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.553+0000 7fcc8b4a9700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcc840cc250 0x7fcc840cc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:30.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.553+0000 7fcc8b4a9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcc8415ac90 0x7fcc84070de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:30.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.553+0000 7fcc8b4a9700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc84159f70 con 0x7fcc84071320 2023-09-21T00:17:30.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.553+0000 7fcc8b4a9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc8406d2c0 con 0x7fcc8415ac90 2023-09-21T00:17:30.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.553+0000 7fcc8b4a9700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8415a800 con 0x7fcc840cc250 2023-09-21T00:17:30.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.553+0000 7fcc88a44700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcc8415ac90 0x7fcc84070de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:30.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.553+0000 7fcc88a44700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcc8415ac90 0x7fcc84070de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51368/0 (socket says 172.21.15.59:51368) 2023-09-21T00:17:30.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.553+0000 7fcc88a44700 1 -- 172.21.15.59:0/3390393714 learned_addr learned my addr 172.21.15.59:0/3390393714 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:30.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.553+0000 7fcc89245700 1 --2- 172.21.15.59:0/3390393714 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcc840cc250 0x7fcc840cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:30.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.553+0000 7fcc88a44700 1 -- 172.21.15.59:0/3390393714 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcc840cc250 msgr2=0x7fcc840cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:30.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.553+0000 7fcc88a44700 1 --2- 172.21.15.59:0/3390393714 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcc840cc250 0x7fcc840cc630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:30.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.553+0000 7fcc88a44700 1 -- 172.21.15.59:0/3390393714 >> v1:172.21.15.83:6789/0 conn(0x7fcc84071320 legacy=0x7fcc840c9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:30.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.553+0000 7fcc88a44700 1 -- 172.21.15.59:0/3390393714 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc840717b0 con 0x7fcc8415ac90 2023-09-21T00:17:30.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.554+0000 7fcc88a44700 1 --2- 172.21.15.59:0/3390393714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc8415ac90 0x7fcc84070de0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fcc800098f0 tx=0x7fcc80009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cad9d3741a34806 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:30.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.554+0000 7fcc7bfff700 1 -- 172.21.15.59:0/3390393714 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8000b8a0 con 0x7fcc8415ac90 2023-09-21T00:17:30.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.554+0000 7fcc7bfff700 1 -- 172.21.15.59:0/3390393714 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc8000ba00 con 0x7fcc8415ac90 2023-09-21T00:17:30.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.554+0000 7fcc7bfff700 1 -- 172.21.15.59:0/3390393714 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8000bd90 con 0x7fcc8415ac90 2023-09-21T00:17:30.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.554+0000 7fcc8b4a9700 1 -- 172.21.15.59:0/3390393714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc8415ac90 msgr2=0x7fcc84070de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:30.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.554+0000 7fcc8b4a9700 1 --2- 172.21.15.59:0/3390393714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc8415ac90 0x7fcc84070de0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fcc800098f0 tx=0x7fcc80009c00 comp rx=0 tx=0).stop 2023-09-21T00:17:30.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.554+0000 7fcc8b4a9700 1 -- 172.21.15.59:0/3390393714 shutdown_connections 2023-09-21T00:17:30.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.554+0000 7fcc8b4a9700 1 --2- 172.21.15.59:0/3390393714 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcc840cc250 0x7fcc840cc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:30.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.554+0000 7fcc8b4a9700 1 --2- 172.21.15.59:0/3390393714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc8415ac90 0x7fcc84070de0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:30.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.554+0000 7fcc8b4a9700 1 -- 172.21.15.59:0/3390393714 >> 172.21.15.59:0/3390393714 conn(0x7fcc8406a780 msgr2=0x7fcc8406ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:30.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.554+0000 7fcc8b4a9700 1 -- 172.21.15.59:0/3390393714 shutdown_connections 2023-09-21T00:17:30.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.554+0000 7fcc8b4a9700 1 -- 172.21.15.59:0/3390393714 wait complete. 2023-09-21T00:17:30.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.556+0000 7fcc8b4a9700 1 Processor -- start 2023-09-21T00:17:30.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.556+0000 7fcc8b4a9700 1 -- start start 2023-09-21T00:17:30.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.556+0000 7fcc8b4a9700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcc84071320 0x7fcc840c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:30.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.556+0000 7fcc8b4a9700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcc840cc250 0x7fcc840c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:30.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.556+0000 7fcc8b4a9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc8415ac90 0x7fcc8415c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:30.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.556+0000 7fcc8b4a9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc840c8f40 con 0x7fcc8415ac90 2023-09-21T00:17:30.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.556+0000 7fcc8b4a9700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc840c8070 con 0x7fcc840cc250 2023-09-21T00:17:30.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.556+0000 7fcc8b4a9700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc840c4c20 con 0x7fcc84071320 2023-09-21T00:17:30.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.557+0000 7fcc89a46700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc8415ac90 0x7fcc8415c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:30.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.557+0000 7fcc89a46700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc8415ac90 0x7fcc8415c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51374/0 (socket says 172.21.15.59:51374) 2023-09-21T00:17:30.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.557+0000 7fcc89a46700 1 -- 172.21.15.59:0/790637704 learned_addr learned my addr 172.21.15.59:0/790637704 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:30.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.557+0000 7fcc89245700 1 --2- 172.21.15.59:0/790637704 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcc84071320 0x7fcc840c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:30.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.557+0000 7fcc88a44700 1 --2- 172.21.15.59:0/790637704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcc840cc250 0x7fcc840c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:30.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.557+0000 7fcc89a46700 1 -- 172.21.15.59:0/790637704 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcc84071320 msgr2=0x7fcc840c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:30.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.557+0000 7fcc89a46700 1 --2- 172.21.15.59:0/790637704 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcc84071320 0x7fcc840c7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:30.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.557+0000 7fcc89a46700 1 -- 172.21.15.59:0/790637704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcc840cc250 msgr2=0x7fcc840c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:30.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.557+0000 7fcc89a46700 1 --2- 172.21.15.59:0/790637704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcc840cc250 0x7fcc840c5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:30.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.557+0000 7fcc89a46700 1 -- 172.21.15.59:0/790637704 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc80009550 con 0x7fcc8415ac90 2023-09-21T00:17:30.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.557+0000 7fcc89a46700 1 --2- 172.21.15.59:0/790637704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc8415ac90 0x7fcc8415c540 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c00caf0 tx=0x7fcc7c00ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:30.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.557+0000 7fcc79ffb700 1 -- 172.21.15.59:0/790637704 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c003c50 con 0x7fcc8415ac90 2023-09-21T00:17:30.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.557+0000 7fcc79ffb700 1 -- 172.21.15.59:0/790637704 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7c003dd0 con 0x7fcc8415ac90 2023-09-21T00:17:30.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.557+0000 7fcc8b4a9700 1 -- 172.21.15.59:0/790637704 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc840c4ea0 con 0x7fcc8415ac90 2023-09-21T00:17:30.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.557+0000 7fcc79ffb700 1 -- 172.21.15.59:0/790637704 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c00aa20 con 0x7fcc8415ac90 2023-09-21T00:17:30.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.557+0000 7fcc8b4a9700 1 -- 172.21.15.59:0/790637704 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc840c5740 con 0x7fcc8415ac90 2023-09-21T00:17:30.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.558+0000 7fcc8b4a9700 1 -- 172.21.15.59:0/790637704 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc840c5290 con 0x7fcc8415ac90 2023-09-21T00:17:30.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.559+0000 7fcc79ffb700 1 -- 172.21.15.59:0/790637704 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fcc7c00ab80 con 0x7fcc8415ac90 2023-09-21T00:17:30.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.559+0000 7fcc79ffb700 1 --2- 172.21.15.59:0/790637704 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fcc6806ae00 0x7fcc6806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:30.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.559+0000 7fcc79ffb700 1 -- 172.21.15.59:0/790637704 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcc7c089570 con 0x7fcc8415ac90 2023-09-21T00:17:30.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.559+0000 7fcc89245700 1 --2- 172.21.15.59:0/790637704 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fcc6806ae00 0x7fcc6806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:30.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.560+0000 7fcc89245700 1 --2- 172.21.15.59:0/790637704 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fcc6806ae00 0x7fcc6806d2c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcc74006b20 tx=0x7fcc74008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:30.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.563+0000 7fcc79ffb700 1 -- 172.21.15.59:0/790637704 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fcc7c054430 con 0x7fcc8415ac90 2023-09-21T00:17:30.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.762+0000 7fcc8b4a9700 1 -- 172.21.15.59:0/790637704 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc84159f70 con 0x7fcc8415ac90 2023-09-21T00:17:30.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.764+0000 7fcc79ffb700 1 -- 172.21.15.59:0/790637704 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18262 (secure 0 0 0) 0x7fcc84159f70 con 0x7fcc8415ac90 2023-09-21T00:17:30.765 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:17:30.765 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":24,"fsid":"dd69925c-6e25-42fe-880b-2f60fc6f384b","created":"2023-09-21T00:16:43.074489+0000","modified":"2023-09-21T00:17:11.387529+0000","last_up_change":"2023-09-21T00:16:54.740101+0000","last_in_change":"2023-09-21T00:16:45.987089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T00:16:54.796248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-21T00:17:04.167102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-21T00:17:05.313188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-21T00:17:08.977609+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d4b18344-74c0-4f75-920b-7a9247e48914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6809","nonce":2418314235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6811","nonce":2418314235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6815","nonce":2418314235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6813","nonce":2418314235}]},"public_addr":"172.21.15.59:6809/2418314235","cluster_addr":"172.21.15.59:6811/2418314235","heartbeat_back_addr":"172.21.15.59:6815/2418314235","heartbeat_front_addr":"172.21.15.59:6813/2418314235","state":["exists","up"]},{"osd":1,"uuid":"80940d50-a248-4e64-a282-7ffcdad790ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6801","nonce":869668251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6803","nonce":869668251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6807","nonce":869668251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6805","nonce":869668251}]},"public_addr":"172.21.15.59:6801/869668251","cluster_addr":"172.21.15.59:6803/869668251","heartbeat_back_addr":"172.21.15.59:6807/869668251","heartbeat_front_addr":"172.21.15.59:6805/869668251","state":["exists","up"]},{"osd":2,"uuid":"55f2eceb-c54a-4879-a6ce-968c1c548b5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6817","nonce":372517778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6819","nonce":372517778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6823","nonce":372517778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6821","nonce":372517778}]},"public_addr":"172.21.15.59:6817/372517778","cluster_addr":"172.21.15.59:6819/372517778","heartbeat_back_addr":"172.21.15.59:6823/372517778","heartbeat_front_addr":"172.21.15.59:6821/372517778","state":["exists","up"]},{"osd":3,"uuid":"92b89cd0-869c-49b9-a9f9-97ac8423f304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6825","nonce":575188498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6827","nonce":575188498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6831","nonce":575188498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6829","nonce":575188498}]},"public_addr":"172.21.15.59:6825/575188498","cluster_addr":"172.21.15.59:6827/575188498","heartbeat_back_addr":"172.21.15.59:6831/575188498","heartbeat_front_addr":"172.21.15.59:6829/575188498","state":["exists","up"]},{"osd":4,"uuid":"25b80e94-e0e6-403d-b69f-61542f289637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6803","nonce":1741219098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6805","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6807","nonce":1741219098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6815","nonce":1741219098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6811","nonce":1741219098}]},"public_addr":"172.21.15.83:6803/1741219098","cluster_addr":"172.21.15.83:6807/1741219098","heartbeat_back_addr":"172.21.15.83:6815/1741219098","heartbeat_front_addr":"172.21.15.83:6811/1741219098","state":["exists","up"]},{"osd":5,"uuid":"5498d9ab-1086-4796-a199-9051e6dfea91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6817","nonce":156730565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6819","nonce":156730565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6823","nonce":156730565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6821","nonce":156730565}]},"public_addr":"172.21.15.83:6817/156730565","cluster_addr":"172.21.15.83:6819/156730565","heartbeat_back_addr":"172.21.15.83:6823/156730565","heartbeat_front_addr":"172.21.15.83:6821/156730565","state":["exists","up"]},{"osd":6,"uuid":"cfd810c0-5015-4d60-9a75-7efc93a32e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6801","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6800","nonce":1337723778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6806","nonce":1337723778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6814","nonce":1337723778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6810","nonce":1337723778}]},"public_addr":"172.21.15.83:6800/1337723778","cluster_addr":"172.21.15.83:6806/1337723778","heartbeat_back_addr":"172.21.15.83:6814/1337723778","heartbeat_front_addr":"172.21.15.83:6810/1337723778","state":["exists","up"]},{"osd":7,"uuid":"e992c8fa-0a3d-4b3c-85b5-2c511223dee4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6825","nonce":4204859272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6827","nonce":4204859272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6831","nonce":4204859272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6829","nonce":4204859272}]},"public_addr":"172.21.15.83:6825/4204859272","cluster_addr":"172.21.15.83:6827/4204859272","heartbeat_back_addr":"172.21.15.83:6831/4204859272","heartbeat_front_addr":"172.21.15.83:6829/4204859272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.156498+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.882707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.093978+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.158565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.173933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.888606+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.135525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.149712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T00:17:30.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.766+0000 7fcc8b4a9700 1 -- 172.21.15.59:0/790637704 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fcc6806ae00 msgr2=0x7fcc6806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:30.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.766+0000 7fcc8b4a9700 1 --2- 172.21.15.59:0/790637704 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fcc6806ae00 0x7fcc6806d2c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcc74006b20 tx=0x7fcc74008040 comp rx=0 tx=0).stop 2023-09-21T00:17:30.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.766+0000 7fcc8b4a9700 1 -- 172.21.15.59:0/790637704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc8415ac90 msgr2=0x7fcc8415c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:30.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.766+0000 7fcc8b4a9700 1 --2- 172.21.15.59:0/790637704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc8415ac90 0x7fcc8415c540 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c00caf0 tx=0x7fcc7c00ce00 comp rx=0 tx=0).stop 2023-09-21T00:17:30.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.766+0000 7fcc8b4a9700 1 -- 172.21.15.59:0/790637704 shutdown_connections 2023-09-21T00:17:30.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.766+0000 7fcc8b4a9700 1 --2- 172.21.15.59:0/790637704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc8415ac90 0x7fcc8415c540 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:30.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.766+0000 7fcc8b4a9700 1 --2- 172.21.15.59:0/790637704 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fcc6806ae00 0x7fcc6806d2c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:30.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.766+0000 7fcc8b4a9700 1 --2- 172.21.15.59:0/790637704 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcc84071320 0x7fcc840c7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:30.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.766+0000 7fcc8b4a9700 1 --2- 172.21.15.59:0/790637704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcc840cc250 0x7fcc840c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:30.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.766+0000 7fcc8b4a9700 1 -- 172.21.15.59:0/790637704 >> 172.21.15.59:0/790637704 conn(0x7fcc8406a780 msgr2=0x7fcc8406ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:30.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.766+0000 7fcc8b4a9700 1 -- 172.21.15.59:0/790637704 shutdown_connections 2023-09-21T00:17:30.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.766+0000 7fcc8b4a9700 1 -- 172.21.15.59:0/790637704 wait complete. 2023-09-21T00:17:30.779 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-21T00:17:30.780 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-21T00:17:30.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.904+0000 7ffa86672700 1 Processor -- start 2023-09-21T00:17:30.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.904+0000 7ffa86672700 1 -- start start 2023-09-21T00:17:30.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.905+0000 7ffa86672700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ffa8015b2b0 0x7ffa800cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:30.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.905+0000 7ffa86672700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa8006a780 0x7ffa8006abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:30.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.905+0000 7ffa86672700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa8006b110 con 0x7ffa800ce420 2023-09-21T00:17:30.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.905+0000 7ffa86672700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa800ce250 con 0x7ffa8015b2b0 2023-09-21T00:17:30.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.905+0000 7ffa86672700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa801618a0 con 0x7ffa8006a780 2023-09-21T00:17:30.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.905+0000 7ffa7f7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ffa800ce420 0x7ffa80161190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56946/0 (socket says 172.21.15.59:56946) 2023-09-21T00:17:30.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.905+0000 7ffa7f7fe700 1 -- 172.21.15.59:0/252200610 learned_addr learned my addr 172.21.15.59:0/252200610 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:30.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.905+0000 7ffa7ffff700 1 --2- 172.21.15.59:0/252200610 >> v2:172.21.15.83:3300/0 conn(0x7ffa8015b2b0 0x7ffa800cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:30.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.905+0000 7ffa84c0f700 1 --2- 172.21.15.59:0/252200610 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa8006a780 0x7ffa8006abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:30.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.905+0000 7ffa7effd700 1 -- 172.21.15.59:0/252200610 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2802579474 0 0) 0x7ffa74001110 con 0x7ffa800ce420 2023-09-21T00:17:30.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.905+0000 7ffa7effd700 1 -- 172.21.15.59:0/252200610 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa680035b0 con 0x7ffa800ce420 2023-09-21T00:17:30.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.905+0000 7ffa7effd700 1 -- 172.21.15.59:0/252200610 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3349253575 0 0) 0x7ffa680035b0 con 0x7ffa800ce420 2023-09-21T00:17:30.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.905+0000 7ffa7effd700 1 -- 172.21.15.59:0/252200610 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa8006a780 msgr2=0x7ffa8006abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:30.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.905+0000 7ffa7effd700 1 --2- 172.21.15.59:0/252200610 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa8006a780 0x7ffa8006abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:30.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.905+0000 7ffa7effd700 1 -- 172.21.15.59:0/252200610 >> v2:172.21.15.83:3300/0 conn(0x7ffa8015b2b0 msgr2=0x7ffa800cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:30.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.905+0000 7ffa7effd700 1 --2- 172.21.15.59:0/252200610 >> v2:172.21.15.83:3300/0 conn(0x7ffa8015b2b0 0x7ffa800cdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:30.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.905+0000 7ffa7effd700 1 -- 172.21.15.59:0/252200610 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa800cfee0 con 0x7ffa800ce420 2023-09-21T00:17:30.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.905+0000 7ffa7effd700 1 -- 172.21.15.59:0/252200610 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 710825841 0 0) 0x7ffa74001800 con 0x7ffa800ce420 2023-09-21T00:17:30.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.905+0000 7ffa7ffff700 1 --2- 172.21.15.59:0/252200610 >> v2:172.21.15.83:3300/0 conn(0x7ffa8015b2b0 0x7ffa800cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T00:17:30.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.905+0000 7ffa7effd700 1 -- 172.21.15.59:0/252200610 >> v1:172.21.15.59:6789/0 conn(0x7ffa800ce420 legacy=0x7ffa80161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:30.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.905+0000 7ffa7effd700 1 --2- 172.21.15.59:0/252200610 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa68003a70 0x7ffa68003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:30.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.905+0000 7ffa7effd700 1 --2- 172.21.15.59:0/252200610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa68004850 0x7ffa68004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:30.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.905+0000 7ffa7effd700 1 --2- 172.21.15.59:0/252200610 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa8006a780 0x7ffa68005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:30.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.905+0000 7ffa7effd700 1 -- 172.21.15.59:0/252200610 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa801618a0 con 0x7ffa68004850 2023-09-21T00:17:30.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.905+0000 7ffa7effd700 1 -- 172.21.15.59:0/252200610 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6800ba10 con 0x7ffa68003a70 2023-09-21T00:17:30.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.905+0000 7ffa7effd700 1 -- 172.21.15.59:0/252200610 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6800bb50 con 0x7ffa8006a780 2023-09-21T00:17:30.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.906+0000 7ffa7ffff700 1 --2- 172.21.15.59:0/252200610 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa68003a70 0x7ffa68003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:30.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.906+0000 7ffa7f7fe700 1 --2- 172.21.15.59:0/252200610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa68004850 0x7ffa68004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:30.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.906+0000 7ffa84c0f700 1 --2- 172.21.15.59:0/252200610 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa8006a780 0x7ffa68005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:30.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.906+0000 7ffa7f7fe700 1 -- 172.21.15.59:0/252200610 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa8006a780 msgr2=0x7ffa68005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:30.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.906+0000 7ffa7f7fe700 1 --2- 172.21.15.59:0/252200610 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa8006a780 0x7ffa68005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:30.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.906+0000 7ffa7f7fe700 1 -- 172.21.15.59:0/252200610 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa68003a70 msgr2=0x7ffa68003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:30.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.906+0000 7ffa7f7fe700 1 --2- 172.21.15.59:0/252200610 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa68003a70 0x7ffa68003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:30.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.906+0000 7ffa7f7fe700 1 -- 172.21.15.59:0/252200610 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa680035b0 con 0x7ffa68004850 2023-09-21T00:17:30.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.906+0000 7ffa7ffff700 1 --2- 172.21.15.59:0/252200610 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa68003a70 0x7ffa68003e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T00:17:30.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.906+0000 7ffa7f7fe700 1 --2- 172.21.15.59:0/252200610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa68004850 0x7ffa68004cd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ffa7400c240 tx=0x7ffa68005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a04ea54a955a853 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:30.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.906+0000 7ffa7effd700 1 -- 172.21.15.59:0/252200610 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7400cda0 con 0x7ffa68004850 2023-09-21T00:17:30.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.906+0000 7ffa7effd700 1 -- 172.21.15.59:0/252200610 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa74005960 con 0x7ffa68004850 2023-09-21T00:17:30.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.906+0000 7ffa7effd700 1 -- 172.21.15.59:0/252200610 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa74005d10 con 0x7ffa68004850 2023-09-21T00:17:30.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.907+0000 7ffa86672700 1 -- 172.21.15.59:0/252200610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa68004850 msgr2=0x7ffa68004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:30.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.907+0000 7ffa86672700 1 --2- 172.21.15.59:0/252200610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa68004850 0x7ffa68004cd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ffa7400c240 tx=0x7ffa68005880 comp rx=0 tx=0).stop 2023-09-21T00:17:30.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.907+0000 7ffa84c0f700 1 -- 172.21.15.59:0/252200610 reap_dead start 2023-09-21T00:17:30.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.907+0000 7ffa86672700 1 -- 172.21.15.59:0/252200610 shutdown_connections 2023-09-21T00:17:30.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.907+0000 7ffa86672700 1 -- 172.21.15.59:0/252200610 >> 172.21.15.59:0/252200610 conn(0x7ffa800d0140 msgr2=0x7ffa800d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:30.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.907+0000 7ffa86672700 1 -- 172.21.15.59:0/252200610 shutdown_connections 2023-09-21T00:17:30.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.907+0000 7ffa86672700 1 -- 172.21.15.59:0/252200610 wait complete. 2023-09-21T00:17:30.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.908+0000 7ffa86672700 1 Processor -- start 2023-09-21T00:17:30.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.908+0000 7ffa86672700 1 -- start start 2023-09-21T00:17:30.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.909+0000 7ffa86672700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa68004850 0x7ffa801545d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:30.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.909+0000 7ffa86672700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa80151f80 0x7ffa80155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:30.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.909+0000 7ffa86672700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa801f33c0 0x7ffa8006e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:30.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.909+0000 7ffa86672700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa80156350 con 0x7ffa68004850 2023-09-21T00:17:30.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.909+0000 7ffa86672700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa80152400 con 0x7ffa80151f80 2023-09-21T00:17:30.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.909+0000 7ffa86672700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa801f44e0 con 0x7ffa801f33c0 2023-09-21T00:17:30.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.909+0000 7ffa7ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa68004850 0x7ffa801545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:30.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.909+0000 7ffa7ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa68004850 0x7ffa801545d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51390/0 (socket says 172.21.15.59:51390) 2023-09-21T00:17:30.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.909+0000 7ffa7ffff700 1 -- 172.21.15.59:0/3432450698 learned_addr learned my addr 172.21.15.59:0/3432450698 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:30.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.909+0000 7ffa7f7fe700 1 --2- 172.21.15.59:0/3432450698 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa80151f80 0x7ffa80155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:30.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.909+0000 7ffa84c0f700 1 --2- 172.21.15.59:0/3432450698 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa801f33c0 0x7ffa8006e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:30.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.909+0000 7ffa7ffff700 1 -- 172.21.15.59:0/3432450698 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa801f33c0 msgr2=0x7ffa8006e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:30.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.909+0000 7ffa7ffff700 1 --2- 172.21.15.59:0/3432450698 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa801f33c0 0x7ffa8006e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:30.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.909+0000 7ffa7ffff700 1 -- 172.21.15.59:0/3432450698 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa80151f80 msgr2=0x7ffa80155e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:30.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.909+0000 7ffa7ffff700 1 --2- 172.21.15.59:0/3432450698 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa80151f80 0x7ffa80155e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:30.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.909+0000 7ffa7ffff700 1 -- 172.21.15.59:0/3432450698 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa801f3c40 con 0x7ffa68004850 2023-09-21T00:17:30.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.909+0000 7ffa84c0f700 1 --2- 172.21.15.59:0/3432450698 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa801f33c0 0x7ffa8006e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:17:30.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.909+0000 7ffa7f7fe700 1 --2- 172.21.15.59:0/3432450698 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa80151f80 0x7ffa80155e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:17:30.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.910+0000 7ffa7ffff700 1 --2- 172.21.15.59:0/3432450698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa68004850 0x7ffa801545d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ffa70011d70 tx=0x7ffa7000f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:30.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.910+0000 7ffa7cff9700 1 -- 172.21.15.59:0/3432450698 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7000fd40 con 0x7ffa68004850 2023-09-21T00:17:30.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.910+0000 7ffa7cff9700 1 -- 172.21.15.59:0/3432450698 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7000fea0 con 0x7ffa68004850 2023-09-21T00:17:30.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.910+0000 7ffa86672700 1 -- 172.21.15.59:0/3432450698 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa801f3f20 con 0x7ffa68004850 2023-09-21T00:17:30.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.910+0000 7ffa7cff9700 1 -- 172.21.15.59:0/3432450698 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa70014640 con 0x7ffa68004850 2023-09-21T00:17:30.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.910+0000 7ffa86672700 1 -- 172.21.15.59:0/3432450698 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa80152620 con 0x7ffa68004850 2023-09-21T00:17:30.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.911+0000 7ffa86672700 1 -- 172.21.15.59:0/3432450698 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa800ceea0 con 0x7ffa68004850 2023-09-21T00:17:30.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.911+0000 7ffa7cff9700 1 -- 172.21.15.59:0/3432450698 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7ffa700147a0 con 0x7ffa68004850 2023-09-21T00:17:30.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.912+0000 7ffa7cff9700 1 --2- 172.21.15.59:0/3432450698 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ffa6c06ae00 0x7ffa6c06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:30.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.912+0000 7ffa7cff9700 1 -- 172.21.15.59:0/3432450698 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ffa7008a290 con 0x7ffa68004850 2023-09-21T00:17:30.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.912+0000 7ffa7f7fe700 1 --2- 172.21.15.59:0/3432450698 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ffa6c06ae00 0x7ffa6c06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:30.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.913+0000 7ffa7f7fe700 1 --2- 172.21.15.59:0/3432450698 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ffa6c06ae00 0x7ffa6c06d2c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ffa8006e8c0 tx=0x7ffa7400a000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:30.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:30.916+0000 7ffa7cff9700 1 -- 172.21.15.59:0/3432450698 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7ffa800ceea0 con 0x7ffa68004850 2023-09-21T00:17:31.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.114+0000 7ffa86672700 1 -- 172.21.15.59:0/3432450698 --> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffa800cebe0 con 0x7ffa6c06ae00 2023-09-21T00:17:31.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.125+0000 7ffa7cff9700 1 -- 172.21.15.59:0/3432450698 <== mgr.4103 v2:172.21.15.83:6832/1736808576 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345298 (secure 0 0 0) 0x7ffa74022070 con 0x7ffa6c06ae00 2023-09-21T00:17:31.130 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:17:31.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.129+0000 7ffa86672700 1 -- 172.21.15.59:0/3432450698 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ffa6c06ae00 msgr2=0x7ffa6c06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:31.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.129+0000 7ffa86672700 1 --2- 172.21.15.59:0/3432450698 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ffa6c06ae00 0x7ffa6c06d2c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ffa8006e8c0 tx=0x7ffa7400a000 comp rx=0 tx=0).stop 2023-09-21T00:17:31.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.129+0000 7ffa86672700 1 -- 172.21.15.59:0/3432450698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa68004850 msgr2=0x7ffa801545d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:31.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.129+0000 7ffa86672700 1 --2- 172.21.15.59:0/3432450698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa68004850 0x7ffa801545d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ffa70011d70 tx=0x7ffa7000f520 comp rx=0 tx=0).stop 2023-09-21T00:17:31.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.129+0000 7ffa86672700 1 -- 172.21.15.59:0/3432450698 shutdown_connections 2023-09-21T00:17:31.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.129+0000 7ffa86672700 1 --2- 172.21.15.59:0/3432450698 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ffa6c06ae00 0x7ffa6c06d2c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:31.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.129+0000 7ffa86672700 1 --2- 172.21.15.59:0/3432450698 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa801f33c0 0x7ffa8006e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:31.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.129+0000 7ffa86672700 1 --2- 172.21.15.59:0/3432450698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa68004850 0x7ffa801545d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:31.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.129+0000 7ffa86672700 1 --2- 172.21.15.59:0/3432450698 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa80151f80 0x7ffa80155e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:31.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.129+0000 7ffa86672700 1 -- 172.21.15.59:0/3432450698 >> 172.21.15.59:0/3432450698 conn(0x7ffa800d0140 msgr2=0x7ffa8006dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:31.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.129+0000 7ffa86672700 1 -- 172.21.15.59:0/3432450698 shutdown_connections 2023-09-21T00:17:31.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.129+0000 7ffa86672700 1 -- 172.21.15.59:0/3432450698 wait complete. 2023-09-21T00:17:31.137 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2023-09-21T00:17:31.142 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2023-09-21T00:17:30.750419+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219368,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755352,"statfs":{"total":773094113280,"available":772869480448,"internally_reserved":0,"allocated":3284992,"data_stored":1988256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003262"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.140365+0000","last_change":"2023-09-21T00:17:06.944984+0000","last_active":"2023-09-21T00:17:11.140365+0000","last_peered":"2023-09-21T00:17:11.140365+0000","last_clean":"2023-09-21T00:17:11.140365+0000","last_became_active":"2023-09-21T00:17:06.944679+0000","last_became_peered":"2023-09-21T00:17:06.944679+0000","last_unstale":"2023-09-21T00:17:11.140365+0000","last_undegraded":"2023-09-21T00:17:11.140365+0000","last_fullsized":"2023-09-21T00:17:11.140365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T11:26:04.778746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.968438+0000","last_change":"2023-09-21T00:17:06.943812+0000","last_active":"2023-09-21T00:17:10.968438+0000","last_peered":"2023-09-21T00:17:10.968438+0000","last_clean":"2023-09-21T00:17:10.968438+0000","last_became_active":"2023-09-21T00:17:06.943477+0000","last_became_peered":"2023-09-21T00:17:06.943477+0000","last_unstale":"2023-09-21T00:17:10.968438+0000","last_undegraded":"2023-09-21T00:17:10.968438+0000","last_fullsized":"2023-09-21T00:17:10.968438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:34:25.102514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.966064+0000","last_change":"2023-09-21T00:17:06.937575+0000","last_active":"2023-09-21T00:17:10.966064+0000","last_peered":"2023-09-21T00:17:10.966064+0000","last_clean":"2023-09-21T00:17:10.966064+0000","last_became_active":"2023-09-21T00:17:06.937284+0000","last_became_peered":"2023-09-21T00:17:06.937284+0000","last_unstale":"2023-09-21T00:17:10.966064+0000","last_undegraded":"2023-09-21T00:17:10.966064+0000","last_fullsized":"2023-09-21T00:17:10.966064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:28:34.014683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963863+0000","last_change":"2023-09-21T00:17:06.949492+0000","last_active":"2023-09-21T00:17:10.963863+0000","last_peered":"2023-09-21T00:17:10.963863+0000","last_clean":"2023-09-21T00:17:10.963863+0000","last_became_active":"2023-09-21T00:17:06.948870+0000","last_became_peered":"2023-09-21T00:17:06.948870+0000","last_unstale":"2023-09-21T00:17:10.963863+0000","last_undegraded":"2023-09-21T00:17:10.963863+0000","last_fullsized":"2023-09-21T00:17:10.963863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T02:36:18.582664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.138593+0000","last_change":"2023-09-21T00:17:06.938470+0000","last_active":"2023-09-21T00:17:11.138593+0000","last_peered":"2023-09-21T00:17:11.138593+0000","last_clean":"2023-09-21T00:17:11.138593+0000","last_became_active":"2023-09-21T00:17:06.938081+0000","last_became_peered":"2023-09-21T00:17:06.938081+0000","last_unstale":"2023-09-21T00:17:11.138593+0000","last_undegraded":"2023-09-21T00:17:11.138593+0000","last_fullsized":"2023-09-21T00:17:11.138593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:11:37.302773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963823+0000","last_change":"2023-09-21T00:17:06.956095+0000","last_active":"2023-09-21T00:17:10.963823+0000","last_peered":"2023-09-21T00:17:10.963823+0000","last_clean":"2023-09-21T00:17:10.963823+0000","last_became_active":"2023-09-21T00:17:06.955148+0000","last_became_peered":"2023-09-21T00:17:06.955148+0000","last_unstale":"2023-09-21T00:17:10.963823+0000","last_undegraded":"2023-09-21T00:17:10.963823+0000","last_fullsized":"2023-09-21T00:17:10.963823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:11:37.302773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.138460+0000","last_change":"2023-09-21T00:17:06.952598+0000","last_active":"2023-09-21T00:17:11.138460+0000","last_peered":"2023-09-21T00:17:11.138460+0000","last_clean":"2023-09-21T00:17:11.138460+0000","last_became_active":"2023-09-21T00:17:06.951582+0000","last_became_peered":"2023-09-21T00:17:06.951582+0000","last_unstale":"2023-09-21T00:17:11.138460+0000","last_undegraded":"2023-09-21T00:17:11.138460+0000","last_fullsized":"2023-09-21T00:17:11.138460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:31:49.356708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.953276+0000","last_change":"2023-09-21T00:17:06.946327+0000","last_active":"2023-09-21T00:17:10.953276+0000","last_peered":"2023-09-21T00:17:10.953276+0000","last_clean":"2023-09-21T00:17:10.953276+0000","last_became_active":"2023-09-21T00:17:06.946035+0000","last_became_peered":"2023-09-21T00:17:06.946035+0000","last_unstale":"2023-09-21T00:17:10.953276+0000","last_undegraded":"2023-09-21T00:17:10.953276+0000","last_fullsized":"2023-09-21T00:17:10.953276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:10:02.229896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.140297+0000","last_change":"2023-09-21T00:17:06.949895+0000","last_active":"2023-09-21T00:17:11.140297+0000","last_peered":"2023-09-21T00:17:11.140297+0000","last_clean":"2023-09-21T00:17:11.140297+0000","last_became_active":"2023-09-21T00:17:06.949445+0000","last_became_peered":"2023-09-21T00:17:06.949445+0000","last_unstale":"2023-09-21T00:17:11.140297+0000","last_undegraded":"2023-09-21T00:17:11.140297+0000","last_fullsized":"2023-09-21T00:17:11.140297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:14:40.821557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.953209+0000","last_change":"2023-09-21T00:17:06.949062+0000","last_active":"2023-09-21T00:17:10.953209+0000","last_peered":"2023-09-21T00:17:10.953209+0000","last_clean":"2023-09-21T00:17:10.953209+0000","last_became_active":"2023-09-21T00:17:06.948581+0000","last_became_peered":"2023-09-21T00:17:06.948581+0000","last_unstale":"2023-09-21T00:17:10.953209+0000","last_undegraded":"2023-09-21T00:17:10.953209+0000","last_fullsized":"2023-09-21T00:17:10.953209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:33:02.098745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.955518+0000","last_change":"2023-09-21T00:17:06.947733+0000","last_active":"2023-09-21T00:17:10.955518+0000","last_peered":"2023-09-21T00:17:10.955518+0000","last_clean":"2023-09-21T00:17:10.955518+0000","last_became_active":"2023-09-21T00:17:06.947437+0000","last_became_peered":"2023-09-21T00:17:06.947437+0000","last_unstale":"2023-09-21T00:17:10.955518+0000","last_undegraded":"2023-09-21T00:17:10.955518+0000","last_fullsized":"2023-09-21T00:17:10.955518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:28:34.014683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.955972+0000","last_change":"2023-09-21T00:17:06.936684+0000","last_active":"2023-09-21T00:17:10.955972+0000","last_peered":"2023-09-21T00:17:10.955972+0000","last_clean":"2023-09-21T00:17:10.955972+0000","last_became_active":"2023-09-21T00:17:06.936417+0000","last_became_peered":"2023-09-21T00:17:06.936417+0000","last_unstale":"2023-09-21T00:17:10.955972+0000","last_undegraded":"2023-09-21T00:17:10.955972+0000","last_fullsized":"2023-09-21T00:17:10.955972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:53:27.597756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952565+0000","last_change":"2023-09-21T00:17:06.934467+0000","last_active":"2023-09-21T00:17:10.952565+0000","last_peered":"2023-09-21T00:17:10.952565+0000","last_clean":"2023-09-21T00:17:10.952565+0000","last_became_active":"2023-09-21T00:17:06.934042+0000","last_became_peered":"2023-09-21T00:17:06.934042+0000","last_unstale":"2023-09-21T00:17:10.952565+0000","last_undegraded":"2023-09-21T00:17:10.952565+0000","last_fullsized":"2023-09-21T00:17:10.952565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:17:22.988451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.960993+0000","last_change":"2023-09-21T00:17:06.933643+0000","last_active":"2023-09-21T00:17:10.960993+0000","last_peered":"2023-09-21T00:17:10.960993+0000","last_clean":"2023-09-21T00:17:10.960993+0000","last_became_active":"2023-09-21T00:17:06.933143+0000","last_became_peered":"2023-09-21T00:17:06.933143+0000","last_unstale":"2023-09-21T00:17:10.960993+0000","last_undegraded":"2023-09-21T00:17:10.960993+0000","last_fullsized":"2023-09-21T00:17:10.960993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:30:26.002264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.966806+0000","last_change":"2023-09-21T00:17:06.932408+0000","last_active":"2023-09-21T00:17:10.966806+0000","last_peered":"2023-09-21T00:17:10.966806+0000","last_clean":"2023-09-21T00:17:10.966806+0000","last_became_active":"2023-09-21T00:17:06.932137+0000","last_became_peered":"2023-09-21T00:17:06.932137+0000","last_unstale":"2023-09-21T00:17:10.966806+0000","last_undegraded":"2023-09-21T00:17:10.966806+0000","last_fullsized":"2023-09-21T00:17:10.966806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:28:34.014683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963484+0000","last_change":"2023-09-21T00:17:06.955886+0000","last_active":"2023-09-21T00:17:10.963484+0000","last_peered":"2023-09-21T00:17:10.963484+0000","last_clean":"2023-09-21T00:17:10.963484+0000","last_became_active":"2023-09-21T00:17:06.955591+0000","last_became_peered":"2023-09-21T00:17:06.955591+0000","last_unstale":"2023-09-21T00:17:10.963484+0000","last_undegraded":"2023-09-21T00:17:10.963484+0000","last_fullsized":"2023-09-21T00:17:10.963484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:34:25.102514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.964176+0000","last_change":"2023-09-21T00:17:06.947508+0000","last_active":"2023-09-21T00:17:10.964176+0000","last_peered":"2023-09-21T00:17:10.964176+0000","last_clean":"2023-09-21T00:17:10.964176+0000","last_became_active":"2023-09-21T00:17:06.947132+0000","last_became_peered":"2023-09-21T00:17:06.947132+0000","last_unstale":"2023-09-21T00:17:10.964176+0000","last_undegraded":"2023-09-21T00:17:10.964176+0000","last_fullsized":"2023-09-21T00:17:10.964176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:34:02.095171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.967783+0000","last_change":"2023-09-21T00:17:06.943217+0000","last_active":"2023-09-21T00:17:10.967783+0000","last_peered":"2023-09-21T00:17:10.967783+0000","last_clean":"2023-09-21T00:17:10.967783+0000","last_became_active":"2023-09-21T00:17:06.942936+0000","last_became_peered":"2023-09-21T00:17:06.942936+0000","last_unstale":"2023-09-21T00:17:10.967783+0000","last_undegraded":"2023-09-21T00:17:10.967783+0000","last_fullsized":"2023-09-21T00:17:10.967783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:53:27.597756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.140089+0000","last_change":"2023-09-21T00:17:06.940613+0000","last_active":"2023-09-21T00:17:11.140089+0000","last_peered":"2023-09-21T00:17:11.140089+0000","last_clean":"2023-09-21T00:17:11.140089+0000","last_became_active":"2023-09-21T00:17:06.939452+0000","last_became_peered":"2023-09-21T00:17:06.939452+0000","last_unstale":"2023-09-21T00:17:11.140089+0000","last_undegraded":"2023-09-21T00:17:11.140089+0000","last_fullsized":"2023-09-21T00:17:11.140089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:45:42.036094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.955621+0000","last_change":"2023-09-21T00:17:11.145149+0000","last_active":"2023-09-21T00:17:11.955621+0000","last_peered":"2023-09-21T00:17:11.955621+0000","last_clean":"2023-09-21T00:17:11.955621+0000","last_became_active":"2023-09-21T00:17:11.144318+0000","last_became_peered":"2023-09-21T00:17:11.144318+0000","last_unstale":"2023-09-21T00:17:11.955621+0000","last_undegraded":"2023-09-21T00:17:11.955621+0000","last_fullsized":"2023-09-21T00:17:11.955621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:46:38.332564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.961534+0000","last_change":"2023-09-21T00:17:05.926207+0000","last_active":"2023-09-21T00:17:10.961534+0000","last_peered":"2023-09-21T00:17:10.961534+0000","last_clean":"2023-09-21T00:17:10.961534+0000","last_became_active":"2023-09-21T00:17:05.925963+0000","last_became_peered":"2023-09-21T00:17:05.925963+0000","last_unstale":"2023-09-21T00:17:10.961534+0000","last_undegraded":"2023-09-21T00:17:10.961534+0000","last_fullsized":"2023-09-21T00:17:10.961534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:53:26.593335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952921+0000","last_change":"2023-09-21T00:17:06.935708+0000","last_active":"2023-09-21T00:17:10.952921+0000","last_peered":"2023-09-21T00:17:10.952921+0000","last_clean":"2023-09-21T00:17:10.952921+0000","last_became_active":"2023-09-21T00:17:06.935402+0000","last_became_peered":"2023-09-21T00:17:06.935402+0000","last_unstale":"2023-09-21T00:17:10.952921+0000","last_undegraded":"2023-09-21T00:17:10.952921+0000","last_fullsized":"2023-09-21T00:17:10.952921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:33:02.098745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.954136+0000","last_change":"2023-09-21T00:17:10.975756+0000","last_active":"2023-09-21T00:17:11.954136+0000","last_peered":"2023-09-21T00:17:11.954136+0000","last_clean":"2023-09-21T00:17:11.954136+0000","last_became_active":"2023-09-21T00:17:10.975403+0000","last_became_peered":"2023-09-21T00:17:10.975403+0000","last_unstale":"2023-09-21T00:17:11.954136+0000","last_undegraded":"2023-09-21T00:17:11.954136+0000","last_fullsized":"2023-09-21T00:17:11.954136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:44:35.401217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.953050+0000","last_change":"2023-09-21T00:17:05.928089+0000","last_active":"2023-09-21T00:17:10.953050+0000","last_peered":"2023-09-21T00:17:10.953050+0000","last_clean":"2023-09-21T00:17:10.953050+0000","last_became_active":"2023-09-21T00:17:05.927587+0000","last_became_peered":"2023-09-21T00:17:05.927587+0000","last_unstale":"2023-09-21T00:17:10.953050+0000","last_undegraded":"2023-09-21T00:17:10.953050+0000","last_fullsized":"2023-09-21T00:17:10.953050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T10:25:25.504437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.961320+0000","last_change":"2023-09-21T00:17:06.950961+0000","last_active":"2023-09-21T00:17:10.961320+0000","last_peered":"2023-09-21T00:17:10.961320+0000","last_clean":"2023-09-21T00:17:10.961320+0000","last_became_active":"2023-09-21T00:17:06.949285+0000","last_became_peered":"2023-09-21T00:17:06.949285+0000","last_unstale":"2023-09-21T00:17:10.961320+0000","last_undegraded":"2023-09-21T00:17:10.961320+0000","last_fullsized":"2023-09-21T00:17:10.961320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:10:02.229896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.954346+0000","last_change":"2023-09-21T00:17:10.976031+0000","last_active":"2023-09-21T00:17:11.954346+0000","last_peered":"2023-09-21T00:17:11.954346+0000","last_clean":"2023-09-21T00:17:11.954346+0000","last_became_active":"2023-09-21T00:17:10.975600+0000","last_became_peered":"2023-09-21T00:17:10.975600+0000","last_unstale":"2023-09-21T00:17:11.954346+0000","last_undegraded":"2023-09-21T00:17:11.954346+0000","last_fullsized":"2023-09-21T00:17:11.954346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:41:31.729189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.139027+0000","last_change":"2023-09-21T00:17:05.933223+0000","last_active":"2023-09-21T00:17:11.139027+0000","last_peered":"2023-09-21T00:17:11.139027+0000","last_clean":"2023-09-21T00:17:11.139027+0000","last_became_active":"2023-09-21T00:17:05.932282+0000","last_became_peered":"2023-09-21T00:17:05.932282+0000","last_unstale":"2023-09-21T00:17:11.139027+0000","last_undegraded":"2023-09-21T00:17:11.139027+0000","last_fullsized":"2023-09-21T00:17:11.139027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:16:30.197907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963765+0000","last_change":"2023-09-21T00:17:06.955597+0000","last_active":"2023-09-21T00:17:10.963765+0000","last_peered":"2023-09-21T00:17:10.963765+0000","last_clean":"2023-09-21T00:17:10.963765+0000","last_became_active":"2023-09-21T00:17:06.955247+0000","last_became_peered":"2023-09-21T00:17:06.955247+0000","last_unstale":"2023-09-21T00:17:10.963765+0000","last_undegraded":"2023-09-21T00:17:10.963765+0000","last_fullsized":"2023-09-21T00:17:10.963765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:44:31.363217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.954336+0000","last_change":"2023-09-21T00:17:10.969390+0000","last_active":"2023-09-21T00:17:11.954336+0000","last_peered":"2023-09-21T00:17:11.954336+0000","last_clean":"2023-09-21T00:17:11.954336+0000","last_became_active":"2023-09-21T00:17:10.969005+0000","last_became_peered":"2023-09-21T00:17:10.969005+0000","last_unstale":"2023-09-21T00:17:11.954336+0000","last_undegraded":"2023-09-21T00:17:11.954336+0000","last_fullsized":"2023-09-21T00:17:11.954336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:31:53.394708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.138610+0000","last_change":"2023-09-21T00:17:05.930194+0000","last_active":"2023-09-21T00:17:11.138610+0000","last_peered":"2023-09-21T00:17:11.138610+0000","last_clean":"2023-09-21T00:17:11.138610+0000","last_became_active":"2023-09-21T00:17:05.929856+0000","last_became_peered":"2023-09-21T00:17:05.929856+0000","last_unstale":"2023-09-21T00:17:11.138610+0000","last_undegraded":"2023-09-21T00:17:11.138610+0000","last_fullsized":"2023-09-21T00:17:11.138610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:53:26.593335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963977+0000","last_change":"2023-09-21T00:17:06.955503+0000","last_active":"2023-09-21T00:17:10.963977+0000","last_peered":"2023-09-21T00:17:10.963977+0000","last_clean":"2023-09-21T00:17:10.963977+0000","last_became_active":"2023-09-21T00:17:06.955193+0000","last_became_peered":"2023-09-21T00:17:06.955193+0000","last_unstale":"2023-09-21T00:17:10.963977+0000","last_undegraded":"2023-09-21T00:17:10.963977+0000","last_fullsized":"2023-09-21T00:17:10.963977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:47:58.590848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.955144+0000","last_change":"2023-09-21T00:17:10.973678+0000","last_active":"2023-09-21T00:17:11.955144+0000","last_peered":"2023-09-21T00:17:11.955144+0000","last_clean":"2023-09-21T00:17:11.955144+0000","last_became_active":"2023-09-21T00:17:10.973186+0000","last_became_peered":"2023-09-21T00:17:10.973186+0000","last_unstale":"2023-09-21T00:17:11.955144+0000","last_undegraded":"2023-09-21T00:17:11.955144+0000","last_fullsized":"2023-09-21T00:17:11.955144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:59:04.499583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952784+0000","last_change":"2023-09-21T00:17:05.925297+0000","last_active":"2023-09-21T00:17:10.952784+0000","last_peered":"2023-09-21T00:17:10.952784+0000","last_clean":"2023-09-21T00:17:10.952784+0000","last_became_active":"2023-09-21T00:17:05.924818+0000","last_became_peered":"2023-09-21T00:17:05.924818+0000","last_unstale":"2023-09-21T00:17:10.952784+0000","last_undegraded":"2023-09-21T00:17:10.952784+0000","last_fullsized":"2023-09-21T00:17:10.952784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:43:06.599691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.954797+0000","last_change":"2023-09-21T00:17:06.937094+0000","last_active":"2023-09-21T00:17:10.954797+0000","last_peered":"2023-09-21T00:17:10.954797+0000","last_clean":"2023-09-21T00:17:10.954797+0000","last_became_active":"2023-09-21T00:17:06.936793+0000","last_became_peered":"2023-09-21T00:17:06.936793+0000","last_unstale":"2023-09-21T00:17:10.954797+0000","last_undegraded":"2023-09-21T00:17:10.954797+0000","last_fullsized":"2023-09-21T00:17:10.954797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:36:18.989655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.954628+0000","last_change":"2023-09-21T00:17:10.979361+0000","last_active":"2023-09-21T00:17:11.954628+0000","last_peered":"2023-09-21T00:17:11.954628+0000","last_clean":"2023-09-21T00:17:11.954628+0000","last_became_active":"2023-09-21T00:17:10.978911+0000","last_became_peered":"2023-09-21T00:17:10.978911+0000","last_unstale":"2023-09-21T00:17:11.954628+0000","last_undegraded":"2023-09-21T00:17:11.954628+0000","last_fullsized":"2023-09-21T00:17:11.954628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:12:56.553383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.953305+0000","last_change":"2023-09-21T00:17:05.923018+0000","last_active":"2023-09-21T00:17:10.953305+0000","last_peered":"2023-09-21T00:17:10.953305+0000","last_clean":"2023-09-21T00:17:10.953305+0000","last_became_active":"2023-09-21T00:17:05.922305+0000","last_became_peered":"2023-09-21T00:17:05.922305+0000","last_unstale":"2023-09-21T00:17:10.953305+0000","last_undegraded":"2023-09-21T00:17:10.953305+0000","last_fullsized":"2023-09-21T00:17:10.953305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T10:25:25.504437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.960533+0000","last_change":"2023-09-21T00:17:06.930143+0000","last_active":"2023-09-21T00:17:10.960533+0000","last_peered":"2023-09-21T00:17:10.960533+0000","last_clean":"2023-09-21T00:17:10.960533+0000","last_became_active":"2023-09-21T00:17:06.929834+0000","last_became_peered":"2023-09-21T00:17:06.929834+0000","last_unstale":"2023-09-21T00:17:10.960533+0000","last_undegraded":"2023-09-21T00:17:10.960533+0000","last_fullsized":"2023-09-21T00:17:10.960533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:33:02.098745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.243648+0000","last_change":"2023-09-21T00:17:10.970839+0000","last_active":"2023-09-21T00:17:12.243648+0000","last_peered":"2023-09-21T00:17:12.243648+0000","last_clean":"2023-09-21T00:17:12.243648+0000","last_became_active":"2023-09-21T00:17:10.970381+0000","last_became_peered":"2023-09-21T00:17:10.970381+0000","last_unstale":"2023-09-21T00:17:12.243648+0000","last_undegraded":"2023-09-21T00:17:12.243648+0000","last_fullsized":"2023-09-21T00:17:12.243648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:34:06.133170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952254+0000","last_change":"2023-09-21T00:17:05.929568+0000","last_active":"2023-09-21T00:17:10.952254+0000","last_peered":"2023-09-21T00:17:10.952254+0000","last_clean":"2023-09-21T00:17:10.952254+0000","last_became_active":"2023-09-21T00:17:05.929279+0000","last_became_peered":"2023-09-21T00:17:05.929279+0000","last_unstale":"2023-09-21T00:17:10.952254+0000","last_undegraded":"2023-09-21T00:17:10.952254+0000","last_fullsized":"2023-09-21T00:17:10.952254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T07:24:34.111510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952180+0000","last_change":"2023-09-21T00:17:06.944506+0000","last_active":"2023-09-21T00:17:10.952180+0000","last_peered":"2023-09-21T00:17:10.952180+0000","last_clean":"2023-09-21T00:17:10.952180+0000","last_became_active":"2023-09-21T00:17:06.944205+0000","last_became_peered":"2023-09-21T00:17:06.944205+0000","last_unstale":"2023-09-21T00:17:10.952180+0000","last_undegraded":"2023-09-21T00:17:10.952180+0000","last_fullsized":"2023-09-21T00:17:10.952180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:12:52.515384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.243135+0000","last_change":"2023-09-21T00:17:11.141670+0000","last_active":"2023-09-21T00:17:12.243135+0000","last_peered":"2023-09-21T00:17:12.243135+0000","last_clean":"2023-09-21T00:17:12.243135+0000","last_became_active":"2023-09-21T00:17:11.141275+0000","last_became_peered":"2023-09-21T00:17:11.141275+0000","last_unstale":"2023-09-21T00:17:12.243135+0000","last_undegraded":"2023-09-21T00:17:12.243135+0000","last_fullsized":"2023-09-21T00:17:12.243135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:01:56.036095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963545+0000","last_change":"2023-09-21T00:17:05.932750+0000","last_active":"2023-09-21T00:17:10.963545+0000","last_peered":"2023-09-21T00:17:10.963545+0000","last_clean":"2023-09-21T00:17:10.963545+0000","last_became_active":"2023-09-21T00:17:05.930778+0000","last_became_peered":"2023-09-21T00:17:05.930778+0000","last_unstale":"2023-09-21T00:17:10.963545+0000","last_undegraded":"2023-09-21T00:17:10.963545+0000","last_fullsized":"2023-09-21T00:17:10.963545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:04:16.077149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.967014+0000","last_change":"2023-09-21T00:17:06.939961+0000","last_active":"2023-09-21T00:17:10.967014+0000","last_peered":"2023-09-21T00:17:10.967014+0000","last_clean":"2023-09-21T00:17:10.967014+0000","last_became_active":"2023-09-21T00:17:06.938086+0000","last_became_peered":"2023-09-21T00:17:06.938086+0000","last_unstale":"2023-09-21T00:17:10.967014+0000","last_undegraded":"2023-09-21T00:17:10.967014+0000","last_fullsized":"2023-09-21T00:17:10.967014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:16:31.202329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.955743+0000","last_change":"2023-09-21T00:17:11.144684+0000","last_active":"2023-09-21T00:17:11.955743+0000","last_peered":"2023-09-21T00:17:11.955743+0000","last_clean":"2023-09-21T00:17:11.955743+0000","last_became_active":"2023-09-21T00:17:11.144213+0000","last_became_peered":"2023-09-21T00:17:11.144213+0000","last_unstale":"2023-09-21T00:17:11.955743+0000","last_undegraded":"2023-09-21T00:17:11.955743+0000","last_fullsized":"2023-09-21T00:17:11.955743+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:16:57.981811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.955244+0000","last_change":"2023-09-21T00:17:05.930497+0000","last_active":"2023-09-21T00:17:10.955244+0000","last_peered":"2023-09-21T00:17:10.955244+0000","last_clean":"2023-09-21T00:17:10.955244+0000","last_became_active":"2023-09-21T00:17:05.930235+0000","last_became_peered":"2023-09-21T00:17:05.930235+0000","last_unstale":"2023-09-21T00:17:10.955244+0000","last_undegraded":"2023-09-21T00:17:10.955244+0000","last_fullsized":"2023-09-21T00:17:10.955244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:15:52.072888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.964068+0000","last_change":"2023-09-21T00:17:06.946691+0000","last_active":"2023-09-21T00:17:10.964068+0000","last_peered":"2023-09-21T00:17:10.964068+0000","last_clean":"2023-09-21T00:17:10.964068+0000","last_became_active":"2023-09-21T00:17:06.946467+0000","last_became_peered":"2023-09-21T00:17:06.946467+0000","last_unstale":"2023-09-21T00:17:10.964068+0000","last_undegraded":"2023-09-21T00:17:10.964068+0000","last_fullsized":"2023-09-21T00:17:10.964068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T12:07:09.891729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.953663+0000","last_change":"2023-09-21T00:17:10.974215+0000","last_active":"2023-09-21T00:17:11.953663+0000","last_peered":"2023-09-21T00:17:11.953663+0000","last_clean":"2023-09-21T00:17:11.953663+0000","last_became_active":"2023-09-21T00:17:10.973666+0000","last_became_peered":"2023-09-21T00:17:10.973666+0000","last_unstale":"2023-09-21T00:17:11.953663+0000","last_undegraded":"2023-09-21T00:17:11.953663+0000","last_fullsized":"2023-09-21T00:17:11.953663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T02:24:55.988982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.964045+0000","last_change":"2023-09-21T00:17:05.932595+0000","last_active":"2023-09-21T00:17:10.964045+0000","last_peered":"2023-09-21T00:17:10.964045+0000","last_clean":"2023-09-21T00:17:10.964045+0000","last_became_active":"2023-09-21T00:17:05.931183+0000","last_became_peered":"2023-09-21T00:17:05.931183+0000","last_unstale":"2023-09-21T00:17:10.964045+0000","last_undegraded":"2023-09-21T00:17:10.964045+0000","last_fullsized":"2023-09-21T00:17:10.964045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:53:26.593335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.961419+0000","last_change":"2023-09-21T00:17:06.953679+0000","last_active":"2023-09-21T00:17:10.961419+0000","last_peered":"2023-09-21T00:17:10.961419+0000","last_clean":"2023-09-21T00:17:10.961419+0000","last_became_active":"2023-09-21T00:17:06.949774+0000","last_became_peered":"2023-09-21T00:17:06.949774+0000","last_unstale":"2023-09-21T00:17:10.961419+0000","last_undegraded":"2023-09-21T00:17:10.961419+0000","last_fullsized":"2023-09-21T00:17:10.961419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:12:52.515384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.954755+0000","last_change":"2023-09-21T00:17:10.969803+0000","last_active":"2023-09-21T00:17:11.954755+0000","last_peered":"2023-09-21T00:17:11.954755+0000","last_clean":"2023-09-21T00:17:11.954755+0000","last_became_active":"2023-09-21T00:17:10.969402+0000","last_became_peered":"2023-09-21T00:17:10.969402+0000","last_unstale":"2023-09-21T00:17:11.954755+0000","last_undegraded":"2023-09-21T00:17:11.954755+0000","last_fullsized":"2023-09-21T00:17:11.954755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:11:41.340772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.971250+0000","last_change":"2023-09-21T00:17:05.924182+0000","last_active":"2023-09-21T00:17:10.971250+0000","last_peered":"2023-09-21T00:17:10.971250+0000","last_clean":"2023-09-21T00:17:10.971250+0000","last_became_active":"2023-09-21T00:17:05.923874+0000","last_became_peered":"2023-09-21T00:17:05.923874+0000","last_unstale":"2023-09-21T00:17:10.971250+0000","last_undegraded":"2023-09-21T00:17:10.971250+0000","last_fullsized":"2023-09-21T00:17:10.971250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T07:53:35.281829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.955876+0000","last_change":"2023-09-21T00:17:06.938055+0000","last_active":"2023-09-21T00:17:10.955876+0000","last_peered":"2023-09-21T00:17:10.955876+0000","last_clean":"2023-09-21T00:17:10.955876+0000","last_became_active":"2023-09-21T00:17:06.937477+0000","last_became_peered":"2023-09-21T00:17:06.937477+0000","last_unstale":"2023-09-21T00:17:10.955876+0000","last_undegraded":"2023-09-21T00:17:10.955876+0000","last_fullsized":"2023-09-21T00:17:10.955876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:43:07.604113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.242273+0000","last_change":"2023-09-21T00:17:10.969820+0000","last_active":"2023-09-21T00:17:12.242273+0000","last_peered":"2023-09-21T00:17:12.242273+0000","last_clean":"2023-09-21T00:17:12.242273+0000","last_became_active":"2023-09-21T00:17:10.969393+0000","last_became_peered":"2023-09-21T00:17:10.969393+0000","last_unstale":"2023-09-21T00:17:12.242273+0000","last_undegraded":"2023-09-21T00:17:12.242273+0000","last_fullsized":"2023-09-21T00:17:12.242273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:14:44.859557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:16.985242+0000","last_change":"2023-09-21T00:17:05.932498+0000","last_active":"2023-09-21T00:17:16.985242+0000","last_peered":"2023-09-21T00:17:16.985242+0000","last_clean":"2023-09-21T00:17:16.985242+0000","last_became_active":"2023-09-21T00:17:05.932192+0000","last_became_peered":"2023-09-21T00:17:05.932192+0000","last_unstale":"2023-09-21T00:17:16.985242+0000","last_undegraded":"2023-09-21T00:17:16.985242+0000","last_fullsized":"2023-09-21T00:17:16.985242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T07:24:34.111510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.139985+0000","last_change":"2023-09-21T00:17:06.944667+0000","last_active":"2023-09-21T00:17:11.139985+0000","last_peered":"2023-09-21T00:17:11.139985+0000","last_clean":"2023-09-21T00:17:11.139985+0000","last_became_active":"2023-09-21T00:17:06.943370+0000","last_became_peered":"2023-09-21T00:17:06.943370+0000","last_unstale":"2023-09-21T00:17:11.139985+0000","last_undegraded":"2023-09-21T00:17:11.139985+0000","last_fullsized":"2023-09-21T00:17:11.139985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T02:36:18.582664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.243233+0000","last_change":"2023-09-21T00:17:11.142786+0000","last_active":"2023-09-21T00:17:12.243233+0000","last_peered":"2023-09-21T00:17:12.243233+0000","last_clean":"2023-09-21T00:17:12.243233+0000","last_became_active":"2023-09-21T00:17:11.142355+0000","last_became_peered":"2023-09-21T00:17:11.142355+0000","last_unstale":"2023-09-21T00:17:12.243233+0000","last_undegraded":"2023-09-21T00:17:12.243233+0000","last_fullsized":"2023-09-21T00:17:12.243233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:32:25.199881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.960849+0000","last_change":"2023-09-21T00:17:05.926948+0000","last_active":"2023-09-21T00:17:10.960849+0000","last_peered":"2023-09-21T00:17:10.960849+0000","last_clean":"2023-09-21T00:17:10.960849+0000","last_became_active":"2023-09-21T00:17:05.926594+0000","last_became_peered":"2023-09-21T00:17:05.926594+0000","last_unstale":"2023-09-21T00:17:10.960849+0000","last_undegraded":"2023-09-21T00:17:10.960849+0000","last_fullsized":"2023-09-21T00:17:10.960849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:36:17.985234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.961082+0000","last_change":"2023-09-21T00:17:06.936852+0000","last_active":"2023-09-21T00:17:10.961082+0000","last_peered":"2023-09-21T00:17:10.961082+0000","last_clean":"2023-09-21T00:17:10.961082+0000","last_became_active":"2023-09-21T00:17:06.936544+0000","last_became_peered":"2023-09-21T00:17:06.936544+0000","last_unstale":"2023-09-21T00:17:10.961082+0000","last_undegraded":"2023-09-21T00:17:10.961082+0000","last_fullsized":"2023-09-21T00:17:10.961082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T11:15:08.495079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.954099+0000","last_change":"2023-09-21T00:17:11.144574+0000","last_active":"2023-09-21T00:17:11.954099+0000","last_peered":"2023-09-21T00:17:11.954099+0000","last_clean":"2023-09-21T00:17:11.954099+0000","last_became_active":"2023-09-21T00:17:11.144167+0000","last_became_peered":"2023-09-21T00:17:11.144167+0000","last_unstale":"2023-09-21T00:17:11.954099+0000","last_undegraded":"2023-09-21T00:17:11.954099+0000","last_fullsized":"2023-09-21T00:17:11.954099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:38:17.728778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963639+0000","last_change":"2023-09-21T00:17:05.933114+0000","last_active":"2023-09-21T00:17:10.963639+0000","last_peered":"2023-09-21T00:17:10.963639+0000","last_clean":"2023-09-21T00:17:10.963639+0000","last_became_active":"2023-09-21T00:17:05.932827+0000","last_became_peered":"2023-09-21T00:17:05.932827+0000","last_unstale":"2023-09-21T00:17:10.963639+0000","last_undegraded":"2023-09-21T00:17:10.963639+0000","last_fullsized":"2023-09-21T00:17:10.963639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:12:51.510962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.138749+0000","last_change":"2023-09-21T00:17:06.947936+0000","last_active":"2023-09-21T00:17:11.138749+0000","last_peered":"2023-09-21T00:17:11.138749+0000","last_clean":"2023-09-21T00:17:11.138749+0000","last_became_active":"2023-09-21T00:17:06.947663+0000","last_became_peered":"2023-09-21T00:17:06.947663+0000","last_unstale":"2023-09-21T00:17:11.138749+0000","last_undegraded":"2023-09-21T00:17:11.138749+0000","last_fullsized":"2023-09-21T00:17:11.138749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:47:58.590848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.955260+0000","last_change":"2023-09-21T00:17:11.146155+0000","last_active":"2023-09-21T00:17:11.955260+0000","last_peered":"2023-09-21T00:17:11.955260+0000","last_clean":"2023-09-21T00:17:11.955260+0000","last_became_active":"2023-09-21T00:17:11.145812+0000","last_became_peered":"2023-09-21T00:17:11.145812+0000","last_unstale":"2023-09-21T00:17:11.955260+0000","last_undegraded":"2023-09-21T00:17:11.955260+0000","last_fullsized":"2023-09-21T00:17:11.955260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:32:25.199881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952759+0000","last_change":"2023-09-21T00:17:05.930675+0000","last_active":"2023-09-21T00:17:10.952759+0000","last_peered":"2023-09-21T00:17:10.952759+0000","last_clean":"2023-09-21T00:17:10.952759+0000","last_became_active":"2023-09-21T00:17:05.930416+0000","last_became_peered":"2023-09-21T00:17:05.930416+0000","last_unstale":"2023-09-21T00:17:10.952759+0000","last_undegraded":"2023-09-21T00:17:10.952759+0000","last_fullsized":"2023-09-21T00:17:10.952759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:02:58.326166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952464+0000","last_change":"2023-09-21T00:17:06.934940+0000","last_active":"2023-09-21T00:17:10.952464+0000","last_peered":"2023-09-21T00:17:10.952464+0000","last_clean":"2023-09-21T00:17:10.952464+0000","last_became_active":"2023-09-21T00:17:06.934319+0000","last_became_peered":"2023-09-21T00:17:06.934319+0000","last_unstale":"2023-09-21T00:17:10.952464+0000","last_undegraded":"2023-09-21T00:17:10.952464+0000","last_fullsized":"2023-09-21T00:17:10.952464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:30:26.002264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.242887+0000","last_change":"2023-09-21T00:17:10.978508+0000","last_active":"2023-09-21T00:17:12.242887+0000","last_peered":"2023-09-21T00:17:12.242887+0000","last_clean":"2023-09-21T00:17:12.242887+0000","last_became_active":"2023-09-21T00:17:10.978085+0000","last_became_peered":"2023-09-21T00:17:10.978085+0000","last_unstale":"2023-09-21T00:17:12.242887+0000","last_undegraded":"2023-09-21T00:17:12.242887+0000","last_fullsized":"2023-09-21T00:17:12.242887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T11:26:08.816745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.965895+0000","last_change":"2023-09-21T00:17:05.917597+0000","last_active":"2023-09-21T00:17:10.965895+0000","last_peered":"2023-09-21T00:17:10.965895+0000","last_clean":"2023-09-21T00:17:10.965895+0000","last_became_active":"2023-09-21T00:17:05.917277+0000","last_became_peered":"2023-09-21T00:17:05.917277+0000","last_unstale":"2023-09-21T00:17:10.965895+0000","last_undegraded":"2023-09-21T00:17:10.965895+0000","last_fullsized":"2023-09-21T00:17:10.965895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:02:58.326166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.138679+0000","last_change":"2023-09-21T00:17:06.947371+0000","last_active":"2023-09-21T00:17:11.138679+0000","last_peered":"2023-09-21T00:17:11.138679+0000","last_clean":"2023-09-21T00:17:11.138679+0000","last_became_active":"2023-09-21T00:17:06.947072+0000","last_became_peered":"2023-09-21T00:17:06.947072+0000","last_unstale":"2023-09-21T00:17:11.138679+0000","last_undegraded":"2023-09-21T00:17:11.138679+0000","last_fullsized":"2023-09-21T00:17:11.138679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:41:27.691190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.954080+0000","last_change":"2023-09-21T00:17:10.974483+0000","last_active":"2023-09-21T00:17:11.954080+0000","last_peered":"2023-09-21T00:17:11.954080+0000","last_clean":"2023-09-21T00:17:11.954080+0000","last_became_active":"2023-09-21T00:17:10.974056+0000","last_became_peered":"2023-09-21T00:17:10.974056+0000","last_unstale":"2023-09-21T00:17:11.954080+0000","last_undegraded":"2023-09-21T00:17:11.954080+0000","last_fullsized":"2023-09-21T00:17:11.954080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T12:07:13.929729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.955489+0000","last_change":"2023-09-21T00:17:05.919312+0000","last_active":"2023-09-21T00:17:10.955489+0000","last_peered":"2023-09-21T00:17:10.955489+0000","last_clean":"2023-09-21T00:17:10.955489+0000","last_became_active":"2023-09-21T00:17:05.919020+0000","last_became_peered":"2023-09-21T00:17:05.919020+0000","last_unstale":"2023-09-21T00:17:10.955489+0000","last_undegraded":"2023-09-21T00:17:10.955489+0000","last_fullsized":"2023-09-21T00:17:10.955489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T12:05:24.959728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.140053+0000","last_change":"2023-09-21T00:17:06.947452+0000","last_active":"2023-09-21T00:17:11.140053+0000","last_peered":"2023-09-21T00:17:11.140053+0000","last_clean":"2023-09-21T00:17:11.140053+0000","last_became_active":"2023-09-21T00:17:06.947158+0000","last_became_peered":"2023-09-21T00:17:06.947158+0000","last_unstale":"2023-09-21T00:17:11.140053+0000","last_undegraded":"2023-09-21T00:17:11.140053+0000","last_fullsized":"2023-09-21T00:17:11.140053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:34:02.095171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.242117+0000","last_change":"2023-09-21T00:17:10.970581+0000","last_active":"2023-09-21T00:17:12.242117+0000","last_peered":"2023-09-21T00:17:12.242117+0000","last_clean":"2023-09-21T00:17:12.242117+0000","last_became_active":"2023-09-21T00:17:10.970163+0000","last_became_peered":"2023-09-21T00:17:10.970163+0000","last_unstale":"2023-09-21T00:17:12.242117+0000","last_undegraded":"2023-09-21T00:17:12.242117+0000","last_fullsized":"2023-09-21T00:17:12.242117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T02:36:22.620663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.967804+0000","last_change":"2023-09-21T00:17:05.927611+0000","last_active":"2023-09-21T00:17:10.967804+0000","last_peered":"2023-09-21T00:17:10.967804+0000","last_clean":"2023-09-21T00:17:10.967804+0000","last_became_active":"2023-09-21T00:17:05.926796+0000","last_became_peered":"2023-09-21T00:17:05.926796+0000","last_unstale":"2023-09-21T00:17:10.967804+0000","last_undegraded":"2023-09-21T00:17:10.967804+0000","last_fullsized":"2023-09-21T00:17:10.967804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:53:26.593335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.964059+0000","last_change":"2023-09-21T00:17:06.954874+0000","last_active":"2023-09-21T00:17:10.964059+0000","last_peered":"2023-09-21T00:17:10.964059+0000","last_clean":"2023-09-21T00:17:10.964059+0000","last_became_active":"2023-09-21T00:17:06.954591+0000","last_became_peered":"2023-09-21T00:17:06.954591+0000","last_unstale":"2023-09-21T00:17:10.964059+0000","last_undegraded":"2023-09-21T00:17:10.964059+0000","last_fullsized":"2023-09-21T00:17:10.964059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:28:47.396022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.242135+0000","last_change":"2023-09-21T00:17:10.978479+0000","last_active":"2023-09-21T00:17:12.242135+0000","last_peered":"2023-09-21T00:17:12.242135+0000","last_clean":"2023-09-21T00:17:12.242135+0000","last_became_active":"2023-09-21T00:17:10.978049+0000","last_became_peered":"2023-09-21T00:17:10.978049+0000","last_unstale":"2023-09-21T00:17:12.242135+0000","last_undegraded":"2023-09-21T00:17:12.242135+0000","last_fullsized":"2023-09-21T00:17:12.242135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:34:06.133170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963681+0000","last_change":"2023-09-21T00:17:05.931755+0000","last_active":"2023-09-21T00:17:10.963681+0000","last_peered":"2023-09-21T00:17:10.963681+0000","last_clean":"2023-09-21T00:17:10.963681+0000","last_became_active":"2023-09-21T00:17:05.931399+0000","last_became_peered":"2023-09-21T00:17:05.931399+0000","last_unstale":"2023-09-21T00:17:10.963681+0000","last_undegraded":"2023-09-21T00:17:10.963681+0000","last_fullsized":"2023-09-21T00:17:10.963681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:10:01.225475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.954552+0000","last_change":"2023-09-21T00:17:06.931255+0000","last_active":"2023-09-21T00:17:10.954552+0000","last_peered":"2023-09-21T00:17:10.954552+0000","last_clean":"2023-09-21T00:17:10.954552+0000","last_became_active":"2023-09-21T00:17:06.930984+0000","last_became_peered":"2023-09-21T00:17:06.930984+0000","last_unstale":"2023-09-21T00:17:10.954552+0000","last_undegraded":"2023-09-21T00:17:10.954552+0000","last_fullsized":"2023-09-21T00:17:10.954552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:15:53.077309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.242888+0000","last_change":"2023-09-21T00:17:10.977159+0000","last_active":"2023-09-21T00:17:12.242888+0000","last_peered":"2023-09-21T00:17:12.242888+0000","last_clean":"2023-09-21T00:17:12.242888+0000","last_became_active":"2023-09-21T00:17:10.976751+0000","last_became_peered":"2023-09-21T00:17:10.976751+0000","last_unstale":"2023-09-21T00:17:12.242888+0000","last_undegraded":"2023-09-21T00:17:12.242888+0000","last_fullsized":"2023-09-21T00:17:12.242888+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T11:26:08.816745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.967010+0000","last_change":"2023-09-21T00:17:06.940149+0000","last_active":"2023-09-21T00:17:10.967010+0000","last_peered":"2023-09-21T00:17:10.967010+0000","last_clean":"2023-09-21T00:17:10.967010+0000","last_became_active":"2023-09-21T00:17:06.939751+0000","last_became_peered":"2023-09-21T00:17:06.939751+0000","last_unstale":"2023-09-21T00:17:10.967010+0000","last_undegraded":"2023-09-21T00:17:10.967010+0000","last_fullsized":"2023-09-21T00:17:10.967010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:30:26.002264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.966501+0000","last_change":"2023-09-21T00:17:05.916234+0000","last_active":"2023-09-21T00:17:10.966501+0000","last_peered":"2023-09-21T00:17:10.966501+0000","last_clean":"2023-09-21T00:17:10.966501+0000","last_became_active":"2023-09-21T00:17:05.915879+0000","last_became_peered":"2023-09-21T00:17:05.915879+0000","last_unstale":"2023-09-21T00:17:10.966501+0000","last_undegraded":"2023-09-21T00:17:10.966501+0000","last_fullsized":"2023-09-21T00:17:10.966501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:06:51.096713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.242460+0000","last_change":"2023-09-21T00:17:11.141271+0000","last_active":"2023-09-21T00:17:12.242460+0000","last_peered":"2023-09-21T00:17:12.242460+0000","last_clean":"2023-09-21T00:17:12.242460+0000","last_became_active":"2023-09-21T00:17:11.140862+0000","last_became_peered":"2023-09-21T00:17:11.140862+0000","last_unstale":"2023-09-21T00:17:12.242460+0000","last_undegraded":"2023-09-21T00:17:12.242460+0000","last_fullsized":"2023-09-21T00:17:12.242460+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:28:51.434022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.953597+0000","last_change":"2023-09-21T00:17:06.948232+0000","last_active":"2023-09-21T00:17:10.953597+0000","last_peered":"2023-09-21T00:17:10.953597+0000","last_clean":"2023-09-21T00:17:10.953597+0000","last_became_active":"2023-09-21T00:17:06.947981+0000","last_became_peered":"2023-09-21T00:17:06.947981+0000","last_unstale":"2023-09-21T00:17:10.953597+0000","last_undegraded":"2023-09-21T00:17:10.953597+0000","last_fullsized":"2023-09-21T00:17:10.953597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:16:31.202329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963721+0000","last_change":"2023-09-21T00:17:05.918340+0000","last_active":"2023-09-21T00:17:10.963721+0000","last_peered":"2023-09-21T00:17:10.963721+0000","last_clean":"2023-09-21T00:17:10.963721+0000","last_became_active":"2023-09-21T00:17:05.918052+0000","last_became_peered":"2023-09-21T00:17:05.918052+0000","last_unstale":"2023-09-21T00:17:10.963721+0000","last_undegraded":"2023-09-21T00:17:10.963721+0000","last_fullsized":"2023-09-21T00:17:10.963721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:05:24.892446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.138422+0000","last_change":"2023-09-21T00:16:57.071188+0000","last_active":"2023-09-21T00:17:11.138422+0000","last_peered":"2023-09-21T00:17:11.138422+0000","last_clean":"2023-09-21T00:17:11.138422+0000","last_became_active":"2023-09-21T00:16:57.070240+0000","last_became_peered":"2023-09-21T00:16:57.070240+0000","last_unstale":"2023-09-21T00:17:11.138422+0000","last_undegraded":"2023-09-21T00:17:11.138422+0000","last_fullsized":"2023-09-21T00:17:11.138422+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:16:55.741965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:16:55.741965+0000","last_clean_scrub_stamp":"2023-09-21T00:16:55.741965+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:21:26.215032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.243013+0000","last_change":"2023-09-21T00:17:11.141697+0000","last_active":"2023-09-21T00:17:12.243013+0000","last_peered":"2023-09-21T00:17:12.243013+0000","last_clean":"2023-09-21T00:17:12.243013+0000","last_became_active":"2023-09-21T00:17:11.141334+0000","last_became_peered":"2023-09-21T00:17:11.141334+0000","last_unstale":"2023-09-21T00:17:12.243013+0000","last_undegraded":"2023-09-21T00:17:12.243013+0000","last_fullsized":"2023-09-21T00:17:12.243013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:53:19.217753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.960197+0000","last_change":"2023-09-21T00:17:06.930523+0000","last_active":"2023-09-21T00:17:10.960197+0000","last_peered":"2023-09-21T00:17:10.960197+0000","last_clean":"2023-09-21T00:17:10.960197+0000","last_became_active":"2023-09-21T00:17:06.929200+0000","last_became_peered":"2023-09-21T00:17:06.929200+0000","last_unstale":"2023-09-21T00:17:10.960197+0000","last_undegraded":"2023-09-21T00:17:10.960197+0000","last_fullsized":"2023-09-21T00:17:10.960197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T07:53:36.286251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.138459+0000","last_change":"2023-09-21T00:17:05.928845+0000","last_active":"2023-09-21T00:17:11.138459+0000","last_peered":"2023-09-21T00:17:11.138459+0000","last_clean":"2023-09-21T00:17:11.138459+0000","last_became_active":"2023-09-21T00:17:05.928617+0000","last_became_peered":"2023-09-21T00:17:05.928617+0000","last_unstale":"2023-09-21T00:17:11.138459+0000","last_undegraded":"2023-09-21T00:17:11.138459+0000","last_fullsized":"2023-09-21T00:17:11.138459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:56:48.483420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.242213+0000","last_change":"2023-09-21T00:17:11.140948+0000","last_active":"2023-09-21T00:17:12.242213+0000","last_peered":"2023-09-21T00:17:12.242213+0000","last_clean":"2023-09-21T00:17:12.242213+0000","last_became_active":"2023-09-21T00:17:11.140588+0000","last_became_peered":"2023-09-21T00:17:11.140588+0000","last_unstale":"2023-09-21T00:17:12.242213+0000","last_undegraded":"2023-09-21T00:17:12.242213+0000","last_fullsized":"2023-09-21T00:17:12.242213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:14:44.859557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.138729+0000","last_change":"2023-09-21T00:17:05.932021+0000","last_active":"2023-09-21T00:17:11.138729+0000","last_peered":"2023-09-21T00:17:11.138729+0000","last_clean":"2023-09-21T00:17:11.138729+0000","last_became_active":"2023-09-21T00:17:05.931524+0000","last_became_peered":"2023-09-21T00:17:05.931524+0000","last_unstale":"2023-09-21T00:17:11.138729+0000","last_undegraded":"2023-09-21T00:17:11.138729+0000","last_fullsized":"2023-09-21T00:17:11.138729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:28:33.010261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.967904+0000","last_change":"2023-09-21T00:17:06.938686+0000","last_active":"2023-09-21T00:17:10.967904+0000","last_peered":"2023-09-21T00:17:10.967904+0000","last_clean":"2023-09-21T00:17:10.967904+0000","last_became_active":"2023-09-21T00:17:06.938296+0000","last_became_peered":"2023-09-21T00:17:06.938296+0000","last_unstale":"2023-09-21T00:17:10.967904+0000","last_undegraded":"2023-09-21T00:17:10.967904+0000","last_fullsized":"2023-09-21T00:17:10.967904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:17:22.988451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.953741+0000","last_change":"2023-09-21T00:17:11.144700+0000","last_active":"2023-09-21T00:17:11.953741+0000","last_peered":"2023-09-21T00:17:11.953741+0000","last_clean":"2023-09-21T00:17:11.953741+0000","last_became_active":"2023-09-21T00:17:11.144270+0000","last_became_peered":"2023-09-21T00:17:11.144270+0000","last_unstale":"2023-09-21T00:17:11.953741+0000","last_undegraded":"2023-09-21T00:17:11.953741+0000","last_fullsized":"2023-09-21T00:17:11.953741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:19:20.916794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.719452+0000","last_change":"2023-09-21T00:17:05.931903+0000","last_active":"2023-09-21T00:17:11.719452+0000","last_peered":"2023-09-21T00:17:11.719452+0000","last_clean":"2023-09-21T00:17:11.719452+0000","last_became_active":"2023-09-21T00:17:05.931473+0000","last_became_peered":"2023-09-21T00:17:05.931473+0000","last_unstale":"2023-09-21T00:17:11.719452+0000","last_undegraded":"2023-09-21T00:17:11.719452+0000","last_fullsized":"2023-09-21T00:17:11.719452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T10:25:25.504437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.953301+0000","last_change":"2023-09-21T00:17:06.937019+0000","last_active":"2023-09-21T00:17:10.953301+0000","last_peered":"2023-09-21T00:17:10.953301+0000","last_clean":"2023-09-21T00:17:10.953301+0000","last_became_active":"2023-09-21T00:17:06.936738+0000","last_became_peered":"2023-09-21T00:17:06.936738+0000","last_unstale":"2023-09-21T00:17:10.953301+0000","last_undegraded":"2023-09-21T00:17:10.953301+0000","last_fullsized":"2023-09-21T00:17:10.953301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T11:15:08.495079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.954064+0000","last_change":"2023-09-21T00:17:11.141893+0000","last_active":"2023-09-21T00:17:11.954064+0000","last_peered":"2023-09-21T00:17:11.954064+0000","last_clean":"2023-09-21T00:17:11.954064+0000","last_became_active":"2023-09-21T00:17:11.141460+0000","last_became_peered":"2023-09-21T00:17:11.141460+0000","last_unstale":"2023-09-21T00:17:11.954064+0000","last_undegraded":"2023-09-21T00:17:11.954064+0000","last_fullsized":"2023-09-21T00:17:11.954064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T11:15:12.533079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.956194+0000","last_change":"2023-09-21T00:17:05.926473+0000","last_active":"2023-09-21T00:17:10.956194+0000","last_peered":"2023-09-21T00:17:10.956194+0000","last_clean":"2023-09-21T00:17:10.956194+0000","last_became_active":"2023-09-21T00:17:05.926158+0000","last_became_peered":"2023-09-21T00:17:05.926158+0000","last_unstale":"2023-09-21T00:17:10.956194+0000","last_undegraded":"2023-09-21T00:17:10.956194+0000","last_fullsized":"2023-09-21T00:17:10.956194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T12:05:24.959728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.964279+0000","last_change":"2023-09-21T00:17:06.933680+0000","last_active":"2023-09-21T00:17:10.964279+0000","last_peered":"2023-09-21T00:17:10.964279+0000","last_clean":"2023-09-21T00:17:10.964279+0000","last_became_active":"2023-09-21T00:17:06.933307+0000","last_became_peered":"2023-09-21T00:17:06.933307+0000","last_unstale":"2023-09-21T00:17:10.964279+0000","last_undegraded":"2023-09-21T00:17:10.964279+0000","last_fullsized":"2023-09-21T00:17:10.964279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:17:22.988451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.955461+0000","last_change":"2023-09-21T00:17:10.974600+0000","last_active":"2023-09-21T00:17:11.955461+0000","last_peered":"2023-09-21T00:17:11.955461+0000","last_clean":"2023-09-21T00:17:11.955461+0000","last_became_active":"2023-09-21T00:17:10.974003+0000","last_became_peered":"2023-09-21T00:17:10.974003+0000","last_unstale":"2023-09-21T00:17:11.955461+0000","last_undegraded":"2023-09-21T00:17:11.955461+0000","last_fullsized":"2023-09-21T00:17:11.955461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:28:51.434022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.138370+0000","last_change":"2023-09-21T00:17:05.931013+0000","last_active":"2023-09-21T00:17:11.138370+0000","last_peered":"2023-09-21T00:17:11.138370+0000","last_clean":"2023-09-21T00:17:11.138370+0000","last_became_active":"2023-09-21T00:17:05.930722+0000","last_became_peered":"2023-09-21T00:17:05.930722+0000","last_unstale":"2023-09-21T00:17:11.138370+0000","last_undegraded":"2023-09-21T00:17:11.138370+0000","last_fullsized":"2023-09-21T00:17:11.138370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:43:06.599691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.954572+0000","last_change":"2023-09-21T00:17:06.939541+0000","last_active":"2023-09-21T00:17:10.954572+0000","last_peered":"2023-09-21T00:17:10.954572+0000","last_clean":"2023-09-21T00:17:10.954572+0000","last_became_active":"2023-09-21T00:17:06.939222+0000","last_became_peered":"2023-09-21T00:17:06.939222+0000","last_unstale":"2023-09-21T00:17:10.954572+0000","last_undegraded":"2023-09-21T00:17:10.954572+0000","last_fullsized":"2023-09-21T00:17:10.954572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:04:17.081570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.243107+0000","last_change":"2023-09-21T00:17:11.141846+0000","last_active":"2023-09-21T00:17:12.243107+0000","last_peered":"2023-09-21T00:17:12.243107+0000","last_clean":"2023-09-21T00:17:12.243107+0000","last_became_active":"2023-09-21T00:17:11.141470+0000","last_became_peered":"2023-09-21T00:17:11.141470+0000","last_unstale":"2023-09-21T00:17:12.243107+0000","last_undegraded":"2023-09-21T00:17:12.243107+0000","last_fullsized":"2023-09-21T00:17:12.243107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:53:19.217753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.966909+0000","last_change":"2023-09-21T00:17:05.929236+0000","last_active":"2023-09-21T00:17:10.966909+0000","last_peered":"2023-09-21T00:17:10.966909+0000","last_clean":"2023-09-21T00:17:10.966909+0000","last_became_active":"2023-09-21T00:17:05.928922+0000","last_became_peered":"2023-09-21T00:17:05.928922+0000","last_unstale":"2023-09-21T00:17:10.966909+0000","last_undegraded":"2023-09-21T00:17:10.966909+0000","last_fullsized":"2023-09-21T00:17:10.966909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:04:16.077149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952071+0000","last_change":"2023-09-21T00:17:06.936721+0000","last_active":"2023-09-21T00:17:10.952071+0000","last_peered":"2023-09-21T00:17:10.952071+0000","last_clean":"2023-09-21T00:17:10.952071+0000","last_became_active":"2023-09-21T00:17:06.936421+0000","last_became_peered":"2023-09-21T00:17:06.936421+0000","last_unstale":"2023-09-21T00:17:10.952071+0000","last_undegraded":"2023-09-21T00:17:10.952071+0000","last_fullsized":"2023-09-21T00:17:10.952071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:28:34.014683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.955164+0000","last_change":"2023-09-21T00:17:10.974427+0000","last_active":"2023-09-21T00:17:11.955164+0000","last_peered":"2023-09-21T00:17:11.955164+0000","last_clean":"2023-09-21T00:17:11.955164+0000","last_became_active":"2023-09-21T00:17:10.973986+0000","last_became_peered":"2023-09-21T00:17:10.973986+0000","last_unstale":"2023-09-21T00:17:11.955164+0000","last_undegraded":"2023-09-21T00:17:11.955164+0000","last_fullsized":"2023-09-21T00:17:11.955164+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:48:02.628848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.968204+0000","last_change":"2023-09-21T00:17:05.920076+0000","last_active":"2023-09-21T00:17:10.968204+0000","last_peered":"2023-09-21T00:17:10.968204+0000","last_clean":"2023-09-21T00:17:10.968204+0000","last_became_active":"2023-09-21T00:17:05.919755+0000","last_became_peered":"2023-09-21T00:17:05.919755+0000","last_unstale":"2023-09-21T00:17:10.968204+0000","last_undegraded":"2023-09-21T00:17:10.968204+0000","last_fullsized":"2023-09-21T00:17:10.968204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T07:24:34.111510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952901+0000","last_change":"2023-09-21T00:17:06.944470+0000","last_active":"2023-09-21T00:17:10.952901+0000","last_peered":"2023-09-21T00:17:10.952901+0000","last_clean":"2023-09-21T00:17:10.952901+0000","last_became_active":"2023-09-21T00:17:06.944166+0000","last_became_peered":"2023-09-21T00:17:06.944166+0000","last_unstale":"2023-09-21T00:17:10.952901+0000","last_undegraded":"2023-09-21T00:17:10.952901+0000","last_fullsized":"2023-09-21T00:17:10.952901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T12:07:09.891729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.955249+0000","last_change":"2023-09-21T00:17:10.970352+0000","last_active":"2023-09-21T00:17:11.955249+0000","last_peered":"2023-09-21T00:17:11.955249+0000","last_clean":"2023-09-21T00:17:11.955249+0000","last_became_active":"2023-09-21T00:17:10.969785+0000","last_became_peered":"2023-09-21T00:17:10.969785+0000","last_unstale":"2023-09-21T00:17:11.955249+0000","last_undegraded":"2023-09-21T00:17:11.955249+0000","last_fullsized":"2023-09-21T00:17:11.955249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:45:46.074093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.140070+0000","last_change":"2023-09-21T00:17:05.925648+0000","last_active":"2023-09-21T00:17:11.140070+0000","last_peered":"2023-09-21T00:17:11.140070+0000","last_clean":"2023-09-21T00:17:11.140070+0000","last_became_active":"2023-09-21T00:17:05.925319+0000","last_became_peered":"2023-09-21T00:17:05.925319+0000","last_unstale":"2023-09-21T00:17:11.140070+0000","last_undegraded":"2023-09-21T00:17:11.140070+0000","last_fullsized":"2023-09-21T00:17:11.140070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:01:37.682581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.953404+0000","last_change":"2023-09-21T00:17:06.931298+0000","last_active":"2023-09-21T00:17:10.953404+0000","last_peered":"2023-09-21T00:17:10.953404+0000","last_clean":"2023-09-21T00:17:10.953404+0000","last_became_active":"2023-09-21T00:17:06.931014+0000","last_became_peered":"2023-09-21T00:17:06.931014+0000","last_unstale":"2023-09-21T00:17:10.953404+0000","last_undegraded":"2023-09-21T00:17:10.953404+0000","last_fullsized":"2023-09-21T00:17:10.953404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:12:52.515384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.242802+0000","last_change":"2023-09-21T00:17:11.139811+0000","last_active":"2023-09-21T00:17:12.242802+0000","last_peered":"2023-09-21T00:17:12.242802+0000","last_clean":"2023-09-21T00:17:12.242802+0000","last_became_active":"2023-09-21T00:17:11.139325+0000","last_became_peered":"2023-09-21T00:17:11.139325+0000","last_unstale":"2023-09-21T00:17:12.242802+0000","last_undegraded":"2023-09-21T00:17:12.242802+0000","last_fullsized":"2023-09-21T00:17:12.242802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T02:36:22.620663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.967086+0000","last_change":"2023-09-21T00:17:05.920539+0000","last_active":"2023-09-21T00:17:10.967086+0000","last_peered":"2023-09-21T00:17:10.967086+0000","last_clean":"2023-09-21T00:17:10.967086+0000","last_became_active":"2023-09-21T00:17:05.920322+0000","last_became_peered":"2023-09-21T00:17:05.920322+0000","last_unstale":"2023-09-21T00:17:10.967086+0000","last_undegraded":"2023-09-21T00:17:10.967086+0000","last_fullsized":"2023-09-21T00:17:10.967086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:05:24.892446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.139033+0000","last_change":"2023-09-21T00:17:06.948781+0000","last_active":"2023-09-21T00:17:11.139033+0000","last_peered":"2023-09-21T00:17:11.139033+0000","last_clean":"2023-09-21T00:17:11.139033+0000","last_became_active":"2023-09-21T00:17:06.948444+0000","last_became_peered":"2023-09-21T00:17:06.948444+0000","last_unstale":"2023-09-21T00:17:11.139033+0000","last_undegraded":"2023-09-21T00:17:11.139033+0000","last_fullsized":"2023-09-21T00:17:11.139033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:28:47.396022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.242087+0000","last_change":"2023-09-21T00:17:10.975994+0000","last_active":"2023-09-21T00:17:12.242087+0000","last_peered":"2023-09-21T00:17:12.242087+0000","last_clean":"2023-09-21T00:17:12.242087+0000","last_became_active":"2023-09-21T00:17:10.975468+0000","last_became_peered":"2023-09-21T00:17:10.975468+0000","last_unstale":"2023-09-21T00:17:12.242087+0000","last_undegraded":"2023-09-21T00:17:12.242087+0000","last_fullsized":"2023-09-21T00:17:12.242087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:34:06.133170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.971145+0000","last_change":"2023-09-21T00:17:05.921232+0000","last_active":"2023-09-21T00:17:10.971145+0000","last_peered":"2023-09-21T00:17:10.971145+0000","last_clean":"2023-09-21T00:17:10.971145+0000","last_became_active":"2023-09-21T00:17:05.920883+0000","last_became_peered":"2023-09-21T00:17:05.920883+0000","last_unstale":"2023-09-21T00:17:10.971145+0000","last_undegraded":"2023-09-21T00:17:10.971145+0000","last_fullsized":"2023-09-21T00:17:10.971145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:56:48.483420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963842+0000","last_change":"2023-09-21T00:17:06.949150+0000","last_active":"2023-09-21T00:17:10.963842+0000","last_peered":"2023-09-21T00:17:10.963842+0000","last_clean":"2023-09-21T00:17:10.963842+0000","last_became_active":"2023-09-21T00:17:06.948425+0000","last_became_peered":"2023-09-21T00:17:06.948425+0000","last_unstale":"2023-09-21T00:17:10.963842+0000","last_undegraded":"2023-09-21T00:17:10.963842+0000","last_fullsized":"2023-09-21T00:17:10.963842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:45:42.036094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.242401+0000","last_change":"2023-09-21T00:17:11.139787+0000","last_active":"2023-09-21T00:17:12.242401+0000","last_peered":"2023-09-21T00:17:12.242401+0000","last_clean":"2023-09-21T00:17:12.242401+0000","last_became_active":"2023-09-21T00:17:11.139473+0000","last_became_peered":"2023-09-21T00:17:11.139473+0000","last_unstale":"2023-09-21T00:17:12.242401+0000","last_undegraded":"2023-09-21T00:17:12.242401+0000","last_fullsized":"2023-09-21T00:17:12.242401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:38:17.728778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.967627+0000","last_change":"2023-09-21T00:17:05.919490+0000","last_active":"2023-09-21T00:17:10.967627+0000","last_peered":"2023-09-21T00:17:10.967627+0000","last_clean":"2023-09-21T00:17:10.967627+0000","last_became_active":"2023-09-21T00:17:05.919182+0000","last_became_peered":"2023-09-21T00:17:05.919182+0000","last_unstale":"2023-09-21T00:17:10.967627+0000","last_undegraded":"2023-09-21T00:17:10.967627+0000","last_fullsized":"2023-09-21T00:17:10.967627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T12:05:24.959728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.140401+0000","last_change":"2023-09-21T00:17:06.947423+0000","last_active":"2023-09-21T00:17:11.140401+0000","last_peered":"2023-09-21T00:17:11.140401+0000","last_clean":"2023-09-21T00:17:11.140401+0000","last_became_active":"2023-09-21T00:17:06.947138+0000","last_became_peered":"2023-09-21T00:17:06.947138+0000","last_unstale":"2023-09-21T00:17:11.140401+0000","last_undegraded":"2023-09-21T00:17:11.140401+0000","last_fullsized":"2023-09-21T00:17:11.140401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:53:15.179754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952567+0000","last_change":"2023-09-21T00:17:06.935110+0000","last_active":"2023-09-21T00:17:10.952567+0000","last_peered":"2023-09-21T00:17:10.952567+0000","last_clean":"2023-09-21T00:17:10.952567+0000","last_became_active":"2023-09-21T00:17:06.934658+0000","last_became_peered":"2023-09-21T00:17:06.934658+0000","last_unstale":"2023-09-21T00:17:10.952567+0000","last_undegraded":"2023-09-21T00:17:10.952567+0000","last_fullsized":"2023-09-21T00:17:10.952567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:17:22.988451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.966596+0000","last_change":"2023-09-21T00:17:06.947131+0000","last_active":"2023-09-21T00:17:10.966596+0000","last_peered":"2023-09-21T00:17:10.966596+0000","last_clean":"2023-09-21T00:17:10.966596+0000","last_became_active":"2023-09-21T00:17:06.946817+0000","last_became_peered":"2023-09-21T00:17:06.946817+0000","last_unstale":"2023-09-21T00:17:10.966596+0000","last_undegraded":"2023-09-21T00:17:10.966596+0000","last_fullsized":"2023-09-21T00:17:10.966596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:43:07.604113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963724+0000","last_change":"2023-09-21T00:17:06.950723+0000","last_active":"2023-09-21T00:17:10.963724+0000","last_peered":"2023-09-21T00:17:10.963724+0000","last_clean":"2023-09-21T00:17:10.963724+0000","last_became_active":"2023-09-21T00:17:06.950464+0000","last_became_peered":"2023-09-21T00:17:06.950464+0000","last_unstale":"2023-09-21T00:17:10.963724+0000","last_undegraded":"2023-09-21T00:17:10.963724+0000","last_fullsized":"2023-09-21T00:17:10.963724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:31:49.356708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.960636+0000","last_change":"2023-09-21T00:17:06.931583+0000","last_active":"2023-09-21T00:17:10.960636+0000","last_peered":"2023-09-21T00:17:10.960636+0000","last_clean":"2023-09-21T00:17:10.960636+0000","last_became_active":"2023-09-21T00:17:06.931288+0000","last_became_peered":"2023-09-21T00:17:06.931288+0000","last_unstale":"2023-09-21T00:17:10.960636+0000","last_undegraded":"2023-09-21T00:17:10.960636+0000","last_fullsized":"2023-09-21T00:17:10.960636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:16:31.202329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952778+0000","last_change":"2023-09-21T00:17:06.935897+0000","last_active":"2023-09-21T00:17:10.952778+0000","last_peered":"2023-09-21T00:17:10.952778+0000","last_clean":"2023-09-21T00:17:10.952778+0000","last_became_active":"2023-09-21T00:17:06.934839+0000","last_became_peered":"2023-09-21T00:17:06.934839+0000","last_unstale":"2023-09-21T00:17:10.952778+0000","last_undegraded":"2023-09-21T00:17:10.952778+0000","last_fullsized":"2023-09-21T00:17:10.952778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:44:31.363217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.971043+0000","last_change":"2023-09-21T00:17:06.938775+0000","last_active":"2023-09-21T00:17:10.971043+0000","last_peered":"2023-09-21T00:17:10.971043+0000","last_clean":"2023-09-21T00:17:10.971043+0000","last_became_active":"2023-09-21T00:17:06.938299+0000","last_became_peered":"2023-09-21T00:17:06.938299+0000","last_unstale":"2023-09-21T00:17:10.971043+0000","last_undegraded":"2023-09-21T00:17:10.971043+0000","last_fullsized":"2023-09-21T00:17:10.971043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:33:02.098745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.953339+0000","last_change":"2023-09-21T00:17:06.936698+0000","last_active":"2023-09-21T00:17:10.953339+0000","last_peered":"2023-09-21T00:17:10.953339+0000","last_clean":"2023-09-21T00:17:10.953339+0000","last_became_active":"2023-09-21T00:17:06.936405+0000","last_became_peered":"2023-09-21T00:17:06.936405+0000","last_unstale":"2023-09-21T00:17:10.953339+0000","last_undegraded":"2023-09-21T00:17:10.953339+0000","last_fullsized":"2023-09-21T00:17:10.953339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:34:25.102514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.953420+0000","last_change":"2023-09-21T00:17:06.934511+0000","last_active":"2023-09-21T00:17:10.953420+0000","last_peered":"2023-09-21T00:17:10.953420+0000","last_clean":"2023-09-21T00:17:10.953420+0000","last_became_active":"2023-09-21T00:17:06.934142+0000","last_became_peered":"2023-09-21T00:17:06.934142+0000","last_unstale":"2023-09-21T00:17:10.953420+0000","last_undegraded":"2023-09-21T00:17:10.953420+0000","last_fullsized":"2023-09-21T00:17:10.953420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:34:25.102514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963582+0000","last_change":"2023-09-21T00:17:06.948765+0000","last_active":"2023-09-21T00:17:10.963582+0000","last_peered":"2023-09-21T00:17:10.963582+0000","last_clean":"2023-09-21T00:17:10.963582+0000","last_became_active":"2023-09-21T00:17:06.948437+0000","last_became_peered":"2023-09-21T00:17:06.948437+0000","last_unstale":"2023-09-21T00:17:10.963582+0000","last_undegraded":"2023-09-21T00:17:10.963582+0000","last_fullsized":"2023-09-21T00:17:10.963582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T11:15:08.495079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952376+0000","last_change":"2023-09-21T00:17:06.934818+0000","last_active":"2023-09-21T00:17:10.952376+0000","last_peered":"2023-09-21T00:17:10.952376+0000","last_clean":"2023-09-21T00:17:10.952376+0000","last_became_active":"2023-09-21T00:17:06.934520+0000","last_became_peered":"2023-09-21T00:17:06.934520+0000","last_unstale":"2023-09-21T00:17:10.952376+0000","last_undegraded":"2023-09-21T00:17:10.952376+0000","last_fullsized":"2023-09-21T00:17:10.952376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:30:26.002264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963843+0000","last_change":"2023-09-21T00:17:06.947489+0000","last_active":"2023-09-21T00:17:10.963843+0000","last_peered":"2023-09-21T00:17:10.963843+0000","last_clean":"2023-09-21T00:17:10.963843+0000","last_became_active":"2023-09-21T00:17:06.947209+0000","last_became_peered":"2023-09-21T00:17:06.947209+0000","last_unstale":"2023-09-21T00:17:10.963843+0000","last_undegraded":"2023-09-21T00:17:10.963843+0000","last_fullsized":"2023-09-21T00:17:10.963843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:41:27.691190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.960736+0000","last_change":"2023-09-21T00:17:06.938924+0000","last_active":"2023-09-21T00:17:10.960736+0000","last_peered":"2023-09-21T00:17:10.960736+0000","last_clean":"2023-09-21T00:17:10.960736+0000","last_became_active":"2023-09-21T00:17:06.938643+0000","last_became_peered":"2023-09-21T00:17:06.938643+0000","last_unstale":"2023-09-21T00:17:10.960736+0000","last_undegraded":"2023-09-21T00:17:10.960736+0000","last_fullsized":"2023-09-21T00:17:10.960736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:34:25.102514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.953697+0000","last_change":"2023-09-21T00:17:06.931839+0000","last_active":"2023-09-21T00:17:10.953697+0000","last_peered":"2023-09-21T00:17:10.953697+0000","last_clean":"2023-09-21T00:17:10.953697+0000","last_became_active":"2023-09-21T00:17:06.931573+0000","last_became_peered":"2023-09-21T00:17:06.931573+0000","last_unstale":"2023-09-21T00:17:10.953697+0000","last_undegraded":"2023-09-21T00:17:10.953697+0000","last_fullsized":"2023-09-21T00:17:10.953697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:16:31.202329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":690786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-21T00:17:31.150 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-21T00:17:31.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.306+0000 7f38d8bfa700 1 Processor -- start 2023-09-21T00:17:31.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.306+0000 7f38d8bfa700 1 -- start start 2023-09-21T00:17:31.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.307+0000 7f38d8bfa700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f38d415b480 0x7f38d406f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:31.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.307+0000 7f38d8bfa700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f38d40d0820 0x7f38d40701e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:31.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.307+0000 7f38d8bfa700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38d40b4030 con 0x7f38d4070720 2023-09-21T00:17:31.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.307+0000 7f38d8bfa700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38d4070b90 con 0x7f38d40d0820 2023-09-21T00:17:31.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.307+0000 7f38d8bfa700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d40cb8d0 con 0x7f38d415b480 2023-09-21T00:17:31.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.307+0000 7f38d1d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f38d40d0820 0x7f38d40701e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:31.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.308+0000 7f38d1d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f38d40d0820 0x7f38d40701e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51400/0 (socket says 172.21.15.59:51400) 2023-09-21T00:17:31.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.308+0000 7f38d1d9b700 1 -- 172.21.15.59:0/455230070 learned_addr learned my addr 172.21.15.59:0/455230070 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:31.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.308+0000 7f38d259c700 1 --2- 172.21.15.59:0/455230070 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f38d415b480 0x7f38d406f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:31.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.308+0000 7f38d1d9b700 1 -- 172.21.15.59:0/455230070 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f38d415b480 msgr2=0x7f38d406f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:31.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.308+0000 7f38d1d9b700 1 --2- 172.21.15.59:0/455230070 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f38d415b480 0x7f38d406f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:31.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.308+0000 7f38d1d9b700 1 -- 172.21.15.59:0/455230070 >> v1:172.21.15.83:6789/0 conn(0x7f38d4070720 legacy=0x7f38d40cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:31.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.308+0000 7f38d1d9b700 1 -- 172.21.15.59:0/455230070 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d40cbb40 con 0x7f38d40d0820 2023-09-21T00:17:31.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.308+0000 7f38d1d9b700 1 --2- 172.21.15.59:0/455230070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38d40d0820 0x7f38d40701e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f38bc0098f0 tx=0x7f38bc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=817ba4dbb31c4a4f server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:31.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.308+0000 7f38d159a700 1 -- 172.21.15.59:0/455230070 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc004230 con 0x7f38d40d0820 2023-09-21T00:17:31.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.308+0000 7f38d159a700 1 -- 172.21.15.59:0/455230070 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38bc004390 con 0x7f38d40d0820 2023-09-21T00:17:31.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.308+0000 7f38d159a700 1 -- 172.21.15.59:0/455230070 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc0036a0 con 0x7f38d40d0820 2023-09-21T00:17:31.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.309+0000 7f38d8bfa700 1 -- 172.21.15.59:0/455230070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38d40d0820 msgr2=0x7f38d40701e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:31.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.309+0000 7f38d8bfa700 1 --2- 172.21.15.59:0/455230070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38d40d0820 0x7f38d40701e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f38bc0098f0 tx=0x7f38bc009c00 comp rx=0 tx=0).stop 2023-09-21T00:17:31.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.309+0000 7f38d8bfa700 1 -- 172.21.15.59:0/455230070 shutdown_connections 2023-09-21T00:17:31.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.309+0000 7f38d8bfa700 1 --2- 172.21.15.59:0/455230070 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f38d415b480 0x7f38d406f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:31.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.309+0000 7f38d8bfa700 1 --2- 172.21.15.59:0/455230070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38d40d0820 0x7f38d40701e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:31.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.309+0000 7f38d8bfa700 1 -- 172.21.15.59:0/455230070 >> 172.21.15.59:0/455230070 conn(0x7f38d40d11e0 msgr2=0x7f38d40d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:31.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.309+0000 7f38d8bfa700 1 -- 172.21.15.59:0/455230070 shutdown_connections 2023-09-21T00:17:31.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.309+0000 7f38d8bfa700 1 -- 172.21.15.59:0/455230070 wait complete. 2023-09-21T00:17:31.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.310+0000 7f38d8bfa700 1 Processor -- start 2023-09-21T00:17:31.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.310+0000 7f38d8bfa700 1 -- start start 2023-09-21T00:17:31.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.311+0000 7f38d8bfa700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f38d4070720 0x7f38d40b5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:31.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.311+0000 7f38d8bfa700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38d40d0820 0x7f38d415d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:31.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.311+0000 7f38d8bfa700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38d415b480 0x7f38d415d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:31.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.311+0000 7f38d8bfa700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d414f560 con 0x7f38d40d0820 2023-09-21T00:17:31.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.311+0000 7f38d8bfa700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d414f840 con 0x7f38d415b480 2023-09-21T00:17:31.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.311+0000 7f38d8bfa700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d414fb20 con 0x7f38d4070720 2023-09-21T00:17:31.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.311+0000 7f38d1d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38d40d0820 0x7f38d415d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:31.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.311+0000 7f38d1d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38d40d0820 0x7f38d415d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51406/0 (socket says 172.21.15.59:51406) 2023-09-21T00:17:31.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.311+0000 7f38d1d9b700 1 -- 172.21.15.59:0/689049438 learned_addr learned my addr 172.21.15.59:0/689049438 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:31.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.311+0000 7f38d2d9d700 1 --2- 172.21.15.59:0/689049438 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38d415b480 0x7f38d415d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:31.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.311+0000 7f38d259c700 1 --2- 172.21.15.59:0/689049438 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f38d4070720 0x7f38d40b5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:31.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.311+0000 7f38d1d9b700 1 -- 172.21.15.59:0/689049438 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f38d4070720 msgr2=0x7f38d40b5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:31.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.311+0000 7f38d1d9b700 1 --2- 172.21.15.59:0/689049438 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f38d4070720 0x7f38d40b5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:31.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.311+0000 7f38d1d9b700 1 -- 172.21.15.59:0/689049438 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38d415b480 msgr2=0x7f38d415d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:31.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.311+0000 7f38d1d9b700 1 --2- 172.21.15.59:0/689049438 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38d415b480 0x7f38d415d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:31.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.311+0000 7f38d1d9b700 1 -- 172.21.15.59:0/689049438 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38bc009550 con 0x7f38d40d0820 2023-09-21T00:17:31.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.312+0000 7f38d1d9b700 1 --2- 172.21.15.59:0/689049438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38d40d0820 0x7f38d415d200 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f38bc009130 tx=0x7f38bc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:31.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.312+0000 7f38caffd700 1 -- 172.21.15.59:0/689049438 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc003cd0 con 0x7f38d40d0820 2023-09-21T00:17:31.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.312+0000 7f38caffd700 1 -- 172.21.15.59:0/689049438 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38bc01f070 con 0x7f38d40d0820 2023-09-21T00:17:31.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.312+0000 7f38d8bfa700 1 -- 172.21.15.59:0/689049438 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38d414fe00 con 0x7f38d40d0820 2023-09-21T00:17:31.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.312+0000 7f38caffd700 1 -- 172.21.15.59:0/689049438 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc00b8a0 con 0x7f38d40d0820 2023-09-21T00:17:31.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.312+0000 7f38d8bfa700 1 -- 172.21.15.59:0/689049438 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38d40b5d50 con 0x7f38d40d0820 2023-09-21T00:17:31.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.313+0000 7f38d8bfa700 1 -- 172.21.15.59:0/689049438 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38d40b5ee0 con 0x7f38d40d0820 2023-09-21T00:17:31.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.313+0000 7f38caffd700 1 -- 172.21.15.59:0/689049438 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f38bc021030 con 0x7f38d40d0820 2023-09-21T00:17:31.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.314+0000 7f38caffd700 1 --2- 172.21.15.59:0/689049438 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f38b406ae00 0x7f38b406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:31.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.314+0000 7f38caffd700 1 -- 172.21.15.59:0/689049438 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f38bc08ad80 con 0x7f38d40d0820 2023-09-21T00:17:31.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.314+0000 7f38d259c700 1 --2- 172.21.15.59:0/689049438 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f38b406ae00 0x7f38b406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:31.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.314+0000 7f38d259c700 1 --2- 172.21.15.59:0/689049438 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f38b406ae00 0x7f38b406d2c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f38d40c4fa0 tx=0x7f38c4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:31.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.318+0000 7f38caffd700 1 -- 172.21.15.59:0/689049438 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f38bc055c40 con 0x7f38d40d0820 2023-09-21T00:17:31.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.514+0000 7f38d8bfa700 1 -- 172.21.15.59:0/689049438 --> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f38d414f9b0 con 0x7f38b406ae00 2023-09-21T00:17:31.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.525+0000 7f38caffd700 1 -- 172.21.15.59:0/689049438 <== mgr.4103 v2:172.21.15.83:6832/1736808576 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345298 (secure 0 0 0) 0x7f38d414f9b0 con 0x7f38b406ae00 2023-09-21T00:17:31.530 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:17:31.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.528+0000 7f38d8bfa700 1 -- 172.21.15.59:0/689049438 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f38b406ae00 msgr2=0x7f38b406d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:31.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.528+0000 7f38d8bfa700 1 --2- 172.21.15.59:0/689049438 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f38b406ae00 0x7f38b406d2c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f38d40c4fa0 tx=0x7f38c4008040 comp rx=0 tx=0).stop 2023-09-21T00:17:31.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.528+0000 7f38d8bfa700 1 -- 172.21.15.59:0/689049438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38d40d0820 msgr2=0x7f38d415d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:31.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.528+0000 7f38d8bfa700 1 --2- 172.21.15.59:0/689049438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38d40d0820 0x7f38d415d200 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f38bc009130 tx=0x7f38bc004750 comp rx=0 tx=0).stop 2023-09-21T00:17:31.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.528+0000 7f38d8bfa700 1 -- 172.21.15.59:0/689049438 shutdown_connections 2023-09-21T00:17:31.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.528+0000 7f38d8bfa700 1 --2- 172.21.15.59:0/689049438 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38d415b480 0x7f38d415d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:31.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.528+0000 7f38d8bfa700 1 --2- 172.21.15.59:0/689049438 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f38b406ae00 0x7f38b406d2c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:31.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.528+0000 7f38d8bfa700 1 --2- 172.21.15.59:0/689049438 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f38d4070720 0x7f38d40b5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:31.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.528+0000 7f38d8bfa700 1 --2- 172.21.15.59:0/689049438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38d40d0820 0x7f38d415d200 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:31.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.528+0000 7f38d8bfa700 1 -- 172.21.15.59:0/689049438 >> 172.21.15.59:0/689049438 conn(0x7f38d40d11e0 msgr2=0x7f38d40b24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:31.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.528+0000 7f38d8bfa700 1 -- 172.21.15.59:0/689049438 shutdown_connections 2023-09-21T00:17:31.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.528+0000 7f38d8bfa700 1 -- 172.21.15.59:0/689049438 wait complete. 2023-09-21T00:17:31.536 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2023-09-21T00:17:31.541 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2023-09-21T00:17:30.750419+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219368,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755352,"statfs":{"total":773094113280,"available":772869480448,"internally_reserved":0,"allocated":3284992,"data_stored":1988256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003262"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.140365+0000","last_change":"2023-09-21T00:17:06.944984+0000","last_active":"2023-09-21T00:17:11.140365+0000","last_peered":"2023-09-21T00:17:11.140365+0000","last_clean":"2023-09-21T00:17:11.140365+0000","last_became_active":"2023-09-21T00:17:06.944679+0000","last_became_peered":"2023-09-21T00:17:06.944679+0000","last_unstale":"2023-09-21T00:17:11.140365+0000","last_undegraded":"2023-09-21T00:17:11.140365+0000","last_fullsized":"2023-09-21T00:17:11.140365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T11:26:04.778746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.968438+0000","last_change":"2023-09-21T00:17:06.943812+0000","last_active":"2023-09-21T00:17:10.968438+0000","last_peered":"2023-09-21T00:17:10.968438+0000","last_clean":"2023-09-21T00:17:10.968438+0000","last_became_active":"2023-09-21T00:17:06.943477+0000","last_became_peered":"2023-09-21T00:17:06.943477+0000","last_unstale":"2023-09-21T00:17:10.968438+0000","last_undegraded":"2023-09-21T00:17:10.968438+0000","last_fullsized":"2023-09-21T00:17:10.968438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:34:25.102514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.966064+0000","last_change":"2023-09-21T00:17:06.937575+0000","last_active":"2023-09-21T00:17:10.966064+0000","last_peered":"2023-09-21T00:17:10.966064+0000","last_clean":"2023-09-21T00:17:10.966064+0000","last_became_active":"2023-09-21T00:17:06.937284+0000","last_became_peered":"2023-09-21T00:17:06.937284+0000","last_unstale":"2023-09-21T00:17:10.966064+0000","last_undegraded":"2023-09-21T00:17:10.966064+0000","last_fullsized":"2023-09-21T00:17:10.966064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:28:34.014683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963863+0000","last_change":"2023-09-21T00:17:06.949492+0000","last_active":"2023-09-21T00:17:10.963863+0000","last_peered":"2023-09-21T00:17:10.963863+0000","last_clean":"2023-09-21T00:17:10.963863+0000","last_became_active":"2023-09-21T00:17:06.948870+0000","last_became_peered":"2023-09-21T00:17:06.948870+0000","last_unstale":"2023-09-21T00:17:10.963863+0000","last_undegraded":"2023-09-21T00:17:10.963863+0000","last_fullsized":"2023-09-21T00:17:10.963863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T02:36:18.582664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.138593+0000","last_change":"2023-09-21T00:17:06.938470+0000","last_active":"2023-09-21T00:17:11.138593+0000","last_peered":"2023-09-21T00:17:11.138593+0000","last_clean":"2023-09-21T00:17:11.138593+0000","last_became_active":"2023-09-21T00:17:06.938081+0000","last_became_peered":"2023-09-21T00:17:06.938081+0000","last_unstale":"2023-09-21T00:17:11.138593+0000","last_undegraded":"2023-09-21T00:17:11.138593+0000","last_fullsized":"2023-09-21T00:17:11.138593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:11:37.302773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963823+0000","last_change":"2023-09-21T00:17:06.956095+0000","last_active":"2023-09-21T00:17:10.963823+0000","last_peered":"2023-09-21T00:17:10.963823+0000","last_clean":"2023-09-21T00:17:10.963823+0000","last_became_active":"2023-09-21T00:17:06.955148+0000","last_became_peered":"2023-09-21T00:17:06.955148+0000","last_unstale":"2023-09-21T00:17:10.963823+0000","last_undegraded":"2023-09-21T00:17:10.963823+0000","last_fullsized":"2023-09-21T00:17:10.963823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:11:37.302773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.138460+0000","last_change":"2023-09-21T00:17:06.952598+0000","last_active":"2023-09-21T00:17:11.138460+0000","last_peered":"2023-09-21T00:17:11.138460+0000","last_clean":"2023-09-21T00:17:11.138460+0000","last_became_active":"2023-09-21T00:17:06.951582+0000","last_became_peered":"2023-09-21T00:17:06.951582+0000","last_unstale":"2023-09-21T00:17:11.138460+0000","last_undegraded":"2023-09-21T00:17:11.138460+0000","last_fullsized":"2023-09-21T00:17:11.138460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:31:49.356708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.953276+0000","last_change":"2023-09-21T00:17:06.946327+0000","last_active":"2023-09-21T00:17:10.953276+0000","last_peered":"2023-09-21T00:17:10.953276+0000","last_clean":"2023-09-21T00:17:10.953276+0000","last_became_active":"2023-09-21T00:17:06.946035+0000","last_became_peered":"2023-09-21T00:17:06.946035+0000","last_unstale":"2023-09-21T00:17:10.953276+0000","last_undegraded":"2023-09-21T00:17:10.953276+0000","last_fullsized":"2023-09-21T00:17:10.953276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:10:02.229896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.140297+0000","last_change":"2023-09-21T00:17:06.949895+0000","last_active":"2023-09-21T00:17:11.140297+0000","last_peered":"2023-09-21T00:17:11.140297+0000","last_clean":"2023-09-21T00:17:11.140297+0000","last_became_active":"2023-09-21T00:17:06.949445+0000","last_became_peered":"2023-09-21T00:17:06.949445+0000","last_unstale":"2023-09-21T00:17:11.140297+0000","last_undegraded":"2023-09-21T00:17:11.140297+0000","last_fullsized":"2023-09-21T00:17:11.140297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:14:40.821557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.953209+0000","last_change":"2023-09-21T00:17:06.949062+0000","last_active":"2023-09-21T00:17:10.953209+0000","last_peered":"2023-09-21T00:17:10.953209+0000","last_clean":"2023-09-21T00:17:10.953209+0000","last_became_active":"2023-09-21T00:17:06.948581+0000","last_became_peered":"2023-09-21T00:17:06.948581+0000","last_unstale":"2023-09-21T00:17:10.953209+0000","last_undegraded":"2023-09-21T00:17:10.953209+0000","last_fullsized":"2023-09-21T00:17:10.953209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:33:02.098745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.955518+0000","last_change":"2023-09-21T00:17:06.947733+0000","last_active":"2023-09-21T00:17:10.955518+0000","last_peered":"2023-09-21T00:17:10.955518+0000","last_clean":"2023-09-21T00:17:10.955518+0000","last_became_active":"2023-09-21T00:17:06.947437+0000","last_became_peered":"2023-09-21T00:17:06.947437+0000","last_unstale":"2023-09-21T00:17:10.955518+0000","last_undegraded":"2023-09-21T00:17:10.955518+0000","last_fullsized":"2023-09-21T00:17:10.955518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:28:34.014683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.955972+0000","last_change":"2023-09-21T00:17:06.936684+0000","last_active":"2023-09-21T00:17:10.955972+0000","last_peered":"2023-09-21T00:17:10.955972+0000","last_clean":"2023-09-21T00:17:10.955972+0000","last_became_active":"2023-09-21T00:17:06.936417+0000","last_became_peered":"2023-09-21T00:17:06.936417+0000","last_unstale":"2023-09-21T00:17:10.955972+0000","last_undegraded":"2023-09-21T00:17:10.955972+0000","last_fullsized":"2023-09-21T00:17:10.955972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:53:27.597756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952565+0000","last_change":"2023-09-21T00:17:06.934467+0000","last_active":"2023-09-21T00:17:10.952565+0000","last_peered":"2023-09-21T00:17:10.952565+0000","last_clean":"2023-09-21T00:17:10.952565+0000","last_became_active":"2023-09-21T00:17:06.934042+0000","last_became_peered":"2023-09-21T00:17:06.934042+0000","last_unstale":"2023-09-21T00:17:10.952565+0000","last_undegraded":"2023-09-21T00:17:10.952565+0000","last_fullsized":"2023-09-21T00:17:10.952565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:17:22.988451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.960993+0000","last_change":"2023-09-21T00:17:06.933643+0000","last_active":"2023-09-21T00:17:10.960993+0000","last_peered":"2023-09-21T00:17:10.960993+0000","last_clean":"2023-09-21T00:17:10.960993+0000","last_became_active":"2023-09-21T00:17:06.933143+0000","last_became_peered":"2023-09-21T00:17:06.933143+0000","last_unstale":"2023-09-21T00:17:10.960993+0000","last_undegraded":"2023-09-21T00:17:10.960993+0000","last_fullsized":"2023-09-21T00:17:10.960993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:30:26.002264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.966806+0000","last_change":"2023-09-21T00:17:06.932408+0000","last_active":"2023-09-21T00:17:10.966806+0000","last_peered":"2023-09-21T00:17:10.966806+0000","last_clean":"2023-09-21T00:17:10.966806+0000","last_became_active":"2023-09-21T00:17:06.932137+0000","last_became_peered":"2023-09-21T00:17:06.932137+0000","last_unstale":"2023-09-21T00:17:10.966806+0000","last_undegraded":"2023-09-21T00:17:10.966806+0000","last_fullsized":"2023-09-21T00:17:10.966806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:28:34.014683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963484+0000","last_change":"2023-09-21T00:17:06.955886+0000","last_active":"2023-09-21T00:17:10.963484+0000","last_peered":"2023-09-21T00:17:10.963484+0000","last_clean":"2023-09-21T00:17:10.963484+0000","last_became_active":"2023-09-21T00:17:06.955591+0000","last_became_peered":"2023-09-21T00:17:06.955591+0000","last_unstale":"2023-09-21T00:17:10.963484+0000","last_undegraded":"2023-09-21T00:17:10.963484+0000","last_fullsized":"2023-09-21T00:17:10.963484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:34:25.102514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.964176+0000","last_change":"2023-09-21T00:17:06.947508+0000","last_active":"2023-09-21T00:17:10.964176+0000","last_peered":"2023-09-21T00:17:10.964176+0000","last_clean":"2023-09-21T00:17:10.964176+0000","last_became_active":"2023-09-21T00:17:06.947132+0000","last_became_peered":"2023-09-21T00:17:06.947132+0000","last_unstale":"2023-09-21T00:17:10.964176+0000","last_undegraded":"2023-09-21T00:17:10.964176+0000","last_fullsized":"2023-09-21T00:17:10.964176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:34:02.095171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.967783+0000","last_change":"2023-09-21T00:17:06.943217+0000","last_active":"2023-09-21T00:17:10.967783+0000","last_peered":"2023-09-21T00:17:10.967783+0000","last_clean":"2023-09-21T00:17:10.967783+0000","last_became_active":"2023-09-21T00:17:06.942936+0000","last_became_peered":"2023-09-21T00:17:06.942936+0000","last_unstale":"2023-09-21T00:17:10.967783+0000","last_undegraded":"2023-09-21T00:17:10.967783+0000","last_fullsized":"2023-09-21T00:17:10.967783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:53:27.597756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.140089+0000","last_change":"2023-09-21T00:17:06.940613+0000","last_active":"2023-09-21T00:17:11.140089+0000","last_peered":"2023-09-21T00:17:11.140089+0000","last_clean":"2023-09-21T00:17:11.140089+0000","last_became_active":"2023-09-21T00:17:06.939452+0000","last_became_peered":"2023-09-21T00:17:06.939452+0000","last_unstale":"2023-09-21T00:17:11.140089+0000","last_undegraded":"2023-09-21T00:17:11.140089+0000","last_fullsized":"2023-09-21T00:17:11.140089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:45:42.036094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.955621+0000","last_change":"2023-09-21T00:17:11.145149+0000","last_active":"2023-09-21T00:17:11.955621+0000","last_peered":"2023-09-21T00:17:11.955621+0000","last_clean":"2023-09-21T00:17:11.955621+0000","last_became_active":"2023-09-21T00:17:11.144318+0000","last_became_peered":"2023-09-21T00:17:11.144318+0000","last_unstale":"2023-09-21T00:17:11.955621+0000","last_undegraded":"2023-09-21T00:17:11.955621+0000","last_fullsized":"2023-09-21T00:17:11.955621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:46:38.332564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.961534+0000","last_change":"2023-09-21T00:17:05.926207+0000","last_active":"2023-09-21T00:17:10.961534+0000","last_peered":"2023-09-21T00:17:10.961534+0000","last_clean":"2023-09-21T00:17:10.961534+0000","last_became_active":"2023-09-21T00:17:05.925963+0000","last_became_peered":"2023-09-21T00:17:05.925963+0000","last_unstale":"2023-09-21T00:17:10.961534+0000","last_undegraded":"2023-09-21T00:17:10.961534+0000","last_fullsized":"2023-09-21T00:17:10.961534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:53:26.593335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952921+0000","last_change":"2023-09-21T00:17:06.935708+0000","last_active":"2023-09-21T00:17:10.952921+0000","last_peered":"2023-09-21T00:17:10.952921+0000","last_clean":"2023-09-21T00:17:10.952921+0000","last_became_active":"2023-09-21T00:17:06.935402+0000","last_became_peered":"2023-09-21T00:17:06.935402+0000","last_unstale":"2023-09-21T00:17:10.952921+0000","last_undegraded":"2023-09-21T00:17:10.952921+0000","last_fullsized":"2023-09-21T00:17:10.952921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:33:02.098745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.954136+0000","last_change":"2023-09-21T00:17:10.975756+0000","last_active":"2023-09-21T00:17:11.954136+0000","last_peered":"2023-09-21T00:17:11.954136+0000","last_clean":"2023-09-21T00:17:11.954136+0000","last_became_active":"2023-09-21T00:17:10.975403+0000","last_became_peered":"2023-09-21T00:17:10.975403+0000","last_unstale":"2023-09-21T00:17:11.954136+0000","last_undegraded":"2023-09-21T00:17:11.954136+0000","last_fullsized":"2023-09-21T00:17:11.954136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:44:35.401217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.953050+0000","last_change":"2023-09-21T00:17:05.928089+0000","last_active":"2023-09-21T00:17:10.953050+0000","last_peered":"2023-09-21T00:17:10.953050+0000","last_clean":"2023-09-21T00:17:10.953050+0000","last_became_active":"2023-09-21T00:17:05.927587+0000","last_became_peered":"2023-09-21T00:17:05.927587+0000","last_unstale":"2023-09-21T00:17:10.953050+0000","last_undegraded":"2023-09-21T00:17:10.953050+0000","last_fullsized":"2023-09-21T00:17:10.953050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T10:25:25.504437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.961320+0000","last_change":"2023-09-21T00:17:06.950961+0000","last_active":"2023-09-21T00:17:10.961320+0000","last_peered":"2023-09-21T00:17:10.961320+0000","last_clean":"2023-09-21T00:17:10.961320+0000","last_became_active":"2023-09-21T00:17:06.949285+0000","last_became_peered":"2023-09-21T00:17:06.949285+0000","last_unstale":"2023-09-21T00:17:10.961320+0000","last_undegraded":"2023-09-21T00:17:10.961320+0000","last_fullsized":"2023-09-21T00:17:10.961320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:10:02.229896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.954346+0000","last_change":"2023-09-21T00:17:10.976031+0000","last_active":"2023-09-21T00:17:11.954346+0000","last_peered":"2023-09-21T00:17:11.954346+0000","last_clean":"2023-09-21T00:17:11.954346+0000","last_became_active":"2023-09-21T00:17:10.975600+0000","last_became_peered":"2023-09-21T00:17:10.975600+0000","last_unstale":"2023-09-21T00:17:11.954346+0000","last_undegraded":"2023-09-21T00:17:11.954346+0000","last_fullsized":"2023-09-21T00:17:11.954346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:41:31.729189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.139027+0000","last_change":"2023-09-21T00:17:05.933223+0000","last_active":"2023-09-21T00:17:11.139027+0000","last_peered":"2023-09-21T00:17:11.139027+0000","last_clean":"2023-09-21T00:17:11.139027+0000","last_became_active":"2023-09-21T00:17:05.932282+0000","last_became_peered":"2023-09-21T00:17:05.932282+0000","last_unstale":"2023-09-21T00:17:11.139027+0000","last_undegraded":"2023-09-21T00:17:11.139027+0000","last_fullsized":"2023-09-21T00:17:11.139027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:16:30.197907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963765+0000","last_change":"2023-09-21T00:17:06.955597+0000","last_active":"2023-09-21T00:17:10.963765+0000","last_peered":"2023-09-21T00:17:10.963765+0000","last_clean":"2023-09-21T00:17:10.963765+0000","last_became_active":"2023-09-21T00:17:06.955247+0000","last_became_peered":"2023-09-21T00:17:06.955247+0000","last_unstale":"2023-09-21T00:17:10.963765+0000","last_undegraded":"2023-09-21T00:17:10.963765+0000","last_fullsized":"2023-09-21T00:17:10.963765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:44:31.363217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.954336+0000","last_change":"2023-09-21T00:17:10.969390+0000","last_active":"2023-09-21T00:17:11.954336+0000","last_peered":"2023-09-21T00:17:11.954336+0000","last_clean":"2023-09-21T00:17:11.954336+0000","last_became_active":"2023-09-21T00:17:10.969005+0000","last_became_peered":"2023-09-21T00:17:10.969005+0000","last_unstale":"2023-09-21T00:17:11.954336+0000","last_undegraded":"2023-09-21T00:17:11.954336+0000","last_fullsized":"2023-09-21T00:17:11.954336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:31:53.394708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.138610+0000","last_change":"2023-09-21T00:17:05.930194+0000","last_active":"2023-09-21T00:17:11.138610+0000","last_peered":"2023-09-21T00:17:11.138610+0000","last_clean":"2023-09-21T00:17:11.138610+0000","last_became_active":"2023-09-21T00:17:05.929856+0000","last_became_peered":"2023-09-21T00:17:05.929856+0000","last_unstale":"2023-09-21T00:17:11.138610+0000","last_undegraded":"2023-09-21T00:17:11.138610+0000","last_fullsized":"2023-09-21T00:17:11.138610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:53:26.593335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963977+0000","last_change":"2023-09-21T00:17:06.955503+0000","last_active":"2023-09-21T00:17:10.963977+0000","last_peered":"2023-09-21T00:17:10.963977+0000","last_clean":"2023-09-21T00:17:10.963977+0000","last_became_active":"2023-09-21T00:17:06.955193+0000","last_became_peered":"2023-09-21T00:17:06.955193+0000","last_unstale":"2023-09-21T00:17:10.963977+0000","last_undegraded":"2023-09-21T00:17:10.963977+0000","last_fullsized":"2023-09-21T00:17:10.963977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:47:58.590848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.955144+0000","last_change":"2023-09-21T00:17:10.973678+0000","last_active":"2023-09-21T00:17:11.955144+0000","last_peered":"2023-09-21T00:17:11.955144+0000","last_clean":"2023-09-21T00:17:11.955144+0000","last_became_active":"2023-09-21T00:17:10.973186+0000","last_became_peered":"2023-09-21T00:17:10.973186+0000","last_unstale":"2023-09-21T00:17:11.955144+0000","last_undegraded":"2023-09-21T00:17:11.955144+0000","last_fullsized":"2023-09-21T00:17:11.955144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:59:04.499583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952784+0000","last_change":"2023-09-21T00:17:05.925297+0000","last_active":"2023-09-21T00:17:10.952784+0000","last_peered":"2023-09-21T00:17:10.952784+0000","last_clean":"2023-09-21T00:17:10.952784+0000","last_became_active":"2023-09-21T00:17:05.924818+0000","last_became_peered":"2023-09-21T00:17:05.924818+0000","last_unstale":"2023-09-21T00:17:10.952784+0000","last_undegraded":"2023-09-21T00:17:10.952784+0000","last_fullsized":"2023-09-21T00:17:10.952784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:43:06.599691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.954797+0000","last_change":"2023-09-21T00:17:06.937094+0000","last_active":"2023-09-21T00:17:10.954797+0000","last_peered":"2023-09-21T00:17:10.954797+0000","last_clean":"2023-09-21T00:17:10.954797+0000","last_became_active":"2023-09-21T00:17:06.936793+0000","last_became_peered":"2023-09-21T00:17:06.936793+0000","last_unstale":"2023-09-21T00:17:10.954797+0000","last_undegraded":"2023-09-21T00:17:10.954797+0000","last_fullsized":"2023-09-21T00:17:10.954797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:36:18.989655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.954628+0000","last_change":"2023-09-21T00:17:10.979361+0000","last_active":"2023-09-21T00:17:11.954628+0000","last_peered":"2023-09-21T00:17:11.954628+0000","last_clean":"2023-09-21T00:17:11.954628+0000","last_became_active":"2023-09-21T00:17:10.978911+0000","last_became_peered":"2023-09-21T00:17:10.978911+0000","last_unstale":"2023-09-21T00:17:11.954628+0000","last_undegraded":"2023-09-21T00:17:11.954628+0000","last_fullsized":"2023-09-21T00:17:11.954628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:12:56.553383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.953305+0000","last_change":"2023-09-21T00:17:05.923018+0000","last_active":"2023-09-21T00:17:10.953305+0000","last_peered":"2023-09-21T00:17:10.953305+0000","last_clean":"2023-09-21T00:17:10.953305+0000","last_became_active":"2023-09-21T00:17:05.922305+0000","last_became_peered":"2023-09-21T00:17:05.922305+0000","last_unstale":"2023-09-21T00:17:10.953305+0000","last_undegraded":"2023-09-21T00:17:10.953305+0000","last_fullsized":"2023-09-21T00:17:10.953305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T10:25:25.504437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.960533+0000","last_change":"2023-09-21T00:17:06.930143+0000","last_active":"2023-09-21T00:17:10.960533+0000","last_peered":"2023-09-21T00:17:10.960533+0000","last_clean":"2023-09-21T00:17:10.960533+0000","last_became_active":"2023-09-21T00:17:06.929834+0000","last_became_peered":"2023-09-21T00:17:06.929834+0000","last_unstale":"2023-09-21T00:17:10.960533+0000","last_undegraded":"2023-09-21T00:17:10.960533+0000","last_fullsized":"2023-09-21T00:17:10.960533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:33:02.098745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.243648+0000","last_change":"2023-09-21T00:17:10.970839+0000","last_active":"2023-09-21T00:17:12.243648+0000","last_peered":"2023-09-21T00:17:12.243648+0000","last_clean":"2023-09-21T00:17:12.243648+0000","last_became_active":"2023-09-21T00:17:10.970381+0000","last_became_peered":"2023-09-21T00:17:10.970381+0000","last_unstale":"2023-09-21T00:17:12.243648+0000","last_undegraded":"2023-09-21T00:17:12.243648+0000","last_fullsized":"2023-09-21T00:17:12.243648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:34:06.133170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952254+0000","last_change":"2023-09-21T00:17:05.929568+0000","last_active":"2023-09-21T00:17:10.952254+0000","last_peered":"2023-09-21T00:17:10.952254+0000","last_clean":"2023-09-21T00:17:10.952254+0000","last_became_active":"2023-09-21T00:17:05.929279+0000","last_became_peered":"2023-09-21T00:17:05.929279+0000","last_unstale":"2023-09-21T00:17:10.952254+0000","last_undegraded":"2023-09-21T00:17:10.952254+0000","last_fullsized":"2023-09-21T00:17:10.952254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T07:24:34.111510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952180+0000","last_change":"2023-09-21T00:17:06.944506+0000","last_active":"2023-09-21T00:17:10.952180+0000","last_peered":"2023-09-21T00:17:10.952180+0000","last_clean":"2023-09-21T00:17:10.952180+0000","last_became_active":"2023-09-21T00:17:06.944205+0000","last_became_peered":"2023-09-21T00:17:06.944205+0000","last_unstale":"2023-09-21T00:17:10.952180+0000","last_undegraded":"2023-09-21T00:17:10.952180+0000","last_fullsized":"2023-09-21T00:17:10.952180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:12:52.515384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.243135+0000","last_change":"2023-09-21T00:17:11.141670+0000","last_active":"2023-09-21T00:17:12.243135+0000","last_peered":"2023-09-21T00:17:12.243135+0000","last_clean":"2023-09-21T00:17:12.243135+0000","last_became_active":"2023-09-21T00:17:11.141275+0000","last_became_peered":"2023-09-21T00:17:11.141275+0000","last_unstale":"2023-09-21T00:17:12.243135+0000","last_undegraded":"2023-09-21T00:17:12.243135+0000","last_fullsized":"2023-09-21T00:17:12.243135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:01:56.036095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963545+0000","last_change":"2023-09-21T00:17:05.932750+0000","last_active":"2023-09-21T00:17:10.963545+0000","last_peered":"2023-09-21T00:17:10.963545+0000","last_clean":"2023-09-21T00:17:10.963545+0000","last_became_active":"2023-09-21T00:17:05.930778+0000","last_became_peered":"2023-09-21T00:17:05.930778+0000","last_unstale":"2023-09-21T00:17:10.963545+0000","last_undegraded":"2023-09-21T00:17:10.963545+0000","last_fullsized":"2023-09-21T00:17:10.963545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:04:16.077149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.967014+0000","last_change":"2023-09-21T00:17:06.939961+0000","last_active":"2023-09-21T00:17:10.967014+0000","last_peered":"2023-09-21T00:17:10.967014+0000","last_clean":"2023-09-21T00:17:10.967014+0000","last_became_active":"2023-09-21T00:17:06.938086+0000","last_became_peered":"2023-09-21T00:17:06.938086+0000","last_unstale":"2023-09-21T00:17:10.967014+0000","last_undegraded":"2023-09-21T00:17:10.967014+0000","last_fullsized":"2023-09-21T00:17:10.967014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:16:31.202329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.955743+0000","last_change":"2023-09-21T00:17:11.144684+0000","last_active":"2023-09-21T00:17:11.955743+0000","last_peered":"2023-09-21T00:17:11.955743+0000","last_clean":"2023-09-21T00:17:11.955743+0000","last_became_active":"2023-09-21T00:17:11.144213+0000","last_became_peered":"2023-09-21T00:17:11.144213+0000","last_unstale":"2023-09-21T00:17:11.955743+0000","last_undegraded":"2023-09-21T00:17:11.955743+0000","last_fullsized":"2023-09-21T00:17:11.955743+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:16:57.981811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.955244+0000","last_change":"2023-09-21T00:17:05.930497+0000","last_active":"2023-09-21T00:17:10.955244+0000","last_peered":"2023-09-21T00:17:10.955244+0000","last_clean":"2023-09-21T00:17:10.955244+0000","last_became_active":"2023-09-21T00:17:05.930235+0000","last_became_peered":"2023-09-21T00:17:05.930235+0000","last_unstale":"2023-09-21T00:17:10.955244+0000","last_undegraded":"2023-09-21T00:17:10.955244+0000","last_fullsized":"2023-09-21T00:17:10.955244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:15:52.072888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.964068+0000","last_change":"2023-09-21T00:17:06.946691+0000","last_active":"2023-09-21T00:17:10.964068+0000","last_peered":"2023-09-21T00:17:10.964068+0000","last_clean":"2023-09-21T00:17:10.964068+0000","last_became_active":"2023-09-21T00:17:06.946467+0000","last_became_peered":"2023-09-21T00:17:06.946467+0000","last_unstale":"2023-09-21T00:17:10.964068+0000","last_undegraded":"2023-09-21T00:17:10.964068+0000","last_fullsized":"2023-09-21T00:17:10.964068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T12:07:09.891729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.953663+0000","last_change":"2023-09-21T00:17:10.974215+0000","last_active":"2023-09-21T00:17:11.953663+0000","last_peered":"2023-09-21T00:17:11.953663+0000","last_clean":"2023-09-21T00:17:11.953663+0000","last_became_active":"2023-09-21T00:17:10.973666+0000","last_became_peered":"2023-09-21T00:17:10.973666+0000","last_unstale":"2023-09-21T00:17:11.953663+0000","last_undegraded":"2023-09-21T00:17:11.953663+0000","last_fullsized":"2023-09-21T00:17:11.953663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T02:24:55.988982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.964045+0000","last_change":"2023-09-21T00:17:05.932595+0000","last_active":"2023-09-21T00:17:10.964045+0000","last_peered":"2023-09-21T00:17:10.964045+0000","last_clean":"2023-09-21T00:17:10.964045+0000","last_became_active":"2023-09-21T00:17:05.931183+0000","last_became_peered":"2023-09-21T00:17:05.931183+0000","last_unstale":"2023-09-21T00:17:10.964045+0000","last_undegraded":"2023-09-21T00:17:10.964045+0000","last_fullsized":"2023-09-21T00:17:10.964045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:53:26.593335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.961419+0000","last_change":"2023-09-21T00:17:06.953679+0000","last_active":"2023-09-21T00:17:10.961419+0000","last_peered":"2023-09-21T00:17:10.961419+0000","last_clean":"2023-09-21T00:17:10.961419+0000","last_became_active":"2023-09-21T00:17:06.949774+0000","last_became_peered":"2023-09-21T00:17:06.949774+0000","last_unstale":"2023-09-21T00:17:10.961419+0000","last_undegraded":"2023-09-21T00:17:10.961419+0000","last_fullsized":"2023-09-21T00:17:10.961419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:12:52.515384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.954755+0000","last_change":"2023-09-21T00:17:10.969803+0000","last_active":"2023-09-21T00:17:11.954755+0000","last_peered":"2023-09-21T00:17:11.954755+0000","last_clean":"2023-09-21T00:17:11.954755+0000","last_became_active":"2023-09-21T00:17:10.969402+0000","last_became_peered":"2023-09-21T00:17:10.969402+0000","last_unstale":"2023-09-21T00:17:11.954755+0000","last_undegraded":"2023-09-21T00:17:11.954755+0000","last_fullsized":"2023-09-21T00:17:11.954755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:11:41.340772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.971250+0000","last_change":"2023-09-21T00:17:05.924182+0000","last_active":"2023-09-21T00:17:10.971250+0000","last_peered":"2023-09-21T00:17:10.971250+0000","last_clean":"2023-09-21T00:17:10.971250+0000","last_became_active":"2023-09-21T00:17:05.923874+0000","last_became_peered":"2023-09-21T00:17:05.923874+0000","last_unstale":"2023-09-21T00:17:10.971250+0000","last_undegraded":"2023-09-21T00:17:10.971250+0000","last_fullsized":"2023-09-21T00:17:10.971250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T07:53:35.281829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.955876+0000","last_change":"2023-09-21T00:17:06.938055+0000","last_active":"2023-09-21T00:17:10.955876+0000","last_peered":"2023-09-21T00:17:10.955876+0000","last_clean":"2023-09-21T00:17:10.955876+0000","last_became_active":"2023-09-21T00:17:06.937477+0000","last_became_peered":"2023-09-21T00:17:06.937477+0000","last_unstale":"2023-09-21T00:17:10.955876+0000","last_undegraded":"2023-09-21T00:17:10.955876+0000","last_fullsized":"2023-09-21T00:17:10.955876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:43:07.604113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.242273+0000","last_change":"2023-09-21T00:17:10.969820+0000","last_active":"2023-09-21T00:17:12.242273+0000","last_peered":"2023-09-21T00:17:12.242273+0000","last_clean":"2023-09-21T00:17:12.242273+0000","last_became_active":"2023-09-21T00:17:10.969393+0000","last_became_peered":"2023-09-21T00:17:10.969393+0000","last_unstale":"2023-09-21T00:17:12.242273+0000","last_undegraded":"2023-09-21T00:17:12.242273+0000","last_fullsized":"2023-09-21T00:17:12.242273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:14:44.859557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:16.985242+0000","last_change":"2023-09-21T00:17:05.932498+0000","last_active":"2023-09-21T00:17:16.985242+0000","last_peered":"2023-09-21T00:17:16.985242+0000","last_clean":"2023-09-21T00:17:16.985242+0000","last_became_active":"2023-09-21T00:17:05.932192+0000","last_became_peered":"2023-09-21T00:17:05.932192+0000","last_unstale":"2023-09-21T00:17:16.985242+0000","last_undegraded":"2023-09-21T00:17:16.985242+0000","last_fullsized":"2023-09-21T00:17:16.985242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T07:24:34.111510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.139985+0000","last_change":"2023-09-21T00:17:06.944667+0000","last_active":"2023-09-21T00:17:11.139985+0000","last_peered":"2023-09-21T00:17:11.139985+0000","last_clean":"2023-09-21T00:17:11.139985+0000","last_became_active":"2023-09-21T00:17:06.943370+0000","last_became_peered":"2023-09-21T00:17:06.943370+0000","last_unstale":"2023-09-21T00:17:11.139985+0000","last_undegraded":"2023-09-21T00:17:11.139985+0000","last_fullsized":"2023-09-21T00:17:11.139985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T02:36:18.582664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.243233+0000","last_change":"2023-09-21T00:17:11.142786+0000","last_active":"2023-09-21T00:17:12.243233+0000","last_peered":"2023-09-21T00:17:12.243233+0000","last_clean":"2023-09-21T00:17:12.243233+0000","last_became_active":"2023-09-21T00:17:11.142355+0000","last_became_peered":"2023-09-21T00:17:11.142355+0000","last_unstale":"2023-09-21T00:17:12.243233+0000","last_undegraded":"2023-09-21T00:17:12.243233+0000","last_fullsized":"2023-09-21T00:17:12.243233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:32:25.199881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.960849+0000","last_change":"2023-09-21T00:17:05.926948+0000","last_active":"2023-09-21T00:17:10.960849+0000","last_peered":"2023-09-21T00:17:10.960849+0000","last_clean":"2023-09-21T00:17:10.960849+0000","last_became_active":"2023-09-21T00:17:05.926594+0000","last_became_peered":"2023-09-21T00:17:05.926594+0000","last_unstale":"2023-09-21T00:17:10.960849+0000","last_undegraded":"2023-09-21T00:17:10.960849+0000","last_fullsized":"2023-09-21T00:17:10.960849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:36:17.985234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.961082+0000","last_change":"2023-09-21T00:17:06.936852+0000","last_active":"2023-09-21T00:17:10.961082+0000","last_peered":"2023-09-21T00:17:10.961082+0000","last_clean":"2023-09-21T00:17:10.961082+0000","last_became_active":"2023-09-21T00:17:06.936544+0000","last_became_peered":"2023-09-21T00:17:06.936544+0000","last_unstale":"2023-09-21T00:17:10.961082+0000","last_undegraded":"2023-09-21T00:17:10.961082+0000","last_fullsized":"2023-09-21T00:17:10.961082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T11:15:08.495079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.954099+0000","last_change":"2023-09-21T00:17:11.144574+0000","last_active":"2023-09-21T00:17:11.954099+0000","last_peered":"2023-09-21T00:17:11.954099+0000","last_clean":"2023-09-21T00:17:11.954099+0000","last_became_active":"2023-09-21T00:17:11.144167+0000","last_became_peered":"2023-09-21T00:17:11.144167+0000","last_unstale":"2023-09-21T00:17:11.954099+0000","last_undegraded":"2023-09-21T00:17:11.954099+0000","last_fullsized":"2023-09-21T00:17:11.954099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:38:17.728778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963639+0000","last_change":"2023-09-21T00:17:05.933114+0000","last_active":"2023-09-21T00:17:10.963639+0000","last_peered":"2023-09-21T00:17:10.963639+0000","last_clean":"2023-09-21T00:17:10.963639+0000","last_became_active":"2023-09-21T00:17:05.932827+0000","last_became_peered":"2023-09-21T00:17:05.932827+0000","last_unstale":"2023-09-21T00:17:10.963639+0000","last_undegraded":"2023-09-21T00:17:10.963639+0000","last_fullsized":"2023-09-21T00:17:10.963639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:12:51.510962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.138749+0000","last_change":"2023-09-21T00:17:06.947936+0000","last_active":"2023-09-21T00:17:11.138749+0000","last_peered":"2023-09-21T00:17:11.138749+0000","last_clean":"2023-09-21T00:17:11.138749+0000","last_became_active":"2023-09-21T00:17:06.947663+0000","last_became_peered":"2023-09-21T00:17:06.947663+0000","last_unstale":"2023-09-21T00:17:11.138749+0000","last_undegraded":"2023-09-21T00:17:11.138749+0000","last_fullsized":"2023-09-21T00:17:11.138749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:47:58.590848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.955260+0000","last_change":"2023-09-21T00:17:11.146155+0000","last_active":"2023-09-21T00:17:11.955260+0000","last_peered":"2023-09-21T00:17:11.955260+0000","last_clean":"2023-09-21T00:17:11.955260+0000","last_became_active":"2023-09-21T00:17:11.145812+0000","last_became_peered":"2023-09-21T00:17:11.145812+0000","last_unstale":"2023-09-21T00:17:11.955260+0000","last_undegraded":"2023-09-21T00:17:11.955260+0000","last_fullsized":"2023-09-21T00:17:11.955260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:32:25.199881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952759+0000","last_change":"2023-09-21T00:17:05.930675+0000","last_active":"2023-09-21T00:17:10.952759+0000","last_peered":"2023-09-21T00:17:10.952759+0000","last_clean":"2023-09-21T00:17:10.952759+0000","last_became_active":"2023-09-21T00:17:05.930416+0000","last_became_peered":"2023-09-21T00:17:05.930416+0000","last_unstale":"2023-09-21T00:17:10.952759+0000","last_undegraded":"2023-09-21T00:17:10.952759+0000","last_fullsized":"2023-09-21T00:17:10.952759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:02:58.326166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952464+0000","last_change":"2023-09-21T00:17:06.934940+0000","last_active":"2023-09-21T00:17:10.952464+0000","last_peered":"2023-09-21T00:17:10.952464+0000","last_clean":"2023-09-21T00:17:10.952464+0000","last_became_active":"2023-09-21T00:17:06.934319+0000","last_became_peered":"2023-09-21T00:17:06.934319+0000","last_unstale":"2023-09-21T00:17:10.952464+0000","last_undegraded":"2023-09-21T00:17:10.952464+0000","last_fullsized":"2023-09-21T00:17:10.952464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:30:26.002264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.242887+0000","last_change":"2023-09-21T00:17:10.978508+0000","last_active":"2023-09-21T00:17:12.242887+0000","last_peered":"2023-09-21T00:17:12.242887+0000","last_clean":"2023-09-21T00:17:12.242887+0000","last_became_active":"2023-09-21T00:17:10.978085+0000","last_became_peered":"2023-09-21T00:17:10.978085+0000","last_unstale":"2023-09-21T00:17:12.242887+0000","last_undegraded":"2023-09-21T00:17:12.242887+0000","last_fullsized":"2023-09-21T00:17:12.242887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T11:26:08.816745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.965895+0000","last_change":"2023-09-21T00:17:05.917597+0000","last_active":"2023-09-21T00:17:10.965895+0000","last_peered":"2023-09-21T00:17:10.965895+0000","last_clean":"2023-09-21T00:17:10.965895+0000","last_became_active":"2023-09-21T00:17:05.917277+0000","last_became_peered":"2023-09-21T00:17:05.917277+0000","last_unstale":"2023-09-21T00:17:10.965895+0000","last_undegraded":"2023-09-21T00:17:10.965895+0000","last_fullsized":"2023-09-21T00:17:10.965895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:02:58.326166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.138679+0000","last_change":"2023-09-21T00:17:06.947371+0000","last_active":"2023-09-21T00:17:11.138679+0000","last_peered":"2023-09-21T00:17:11.138679+0000","last_clean":"2023-09-21T00:17:11.138679+0000","last_became_active":"2023-09-21T00:17:06.947072+0000","last_became_peered":"2023-09-21T00:17:06.947072+0000","last_unstale":"2023-09-21T00:17:11.138679+0000","last_undegraded":"2023-09-21T00:17:11.138679+0000","last_fullsized":"2023-09-21T00:17:11.138679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:41:27.691190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.954080+0000","last_change":"2023-09-21T00:17:10.974483+0000","last_active":"2023-09-21T00:17:11.954080+0000","last_peered":"2023-09-21T00:17:11.954080+0000","last_clean":"2023-09-21T00:17:11.954080+0000","last_became_active":"2023-09-21T00:17:10.974056+0000","last_became_peered":"2023-09-21T00:17:10.974056+0000","last_unstale":"2023-09-21T00:17:11.954080+0000","last_undegraded":"2023-09-21T00:17:11.954080+0000","last_fullsized":"2023-09-21T00:17:11.954080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T12:07:13.929729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.955489+0000","last_change":"2023-09-21T00:17:05.919312+0000","last_active":"2023-09-21T00:17:10.955489+0000","last_peered":"2023-09-21T00:17:10.955489+0000","last_clean":"2023-09-21T00:17:10.955489+0000","last_became_active":"2023-09-21T00:17:05.919020+0000","last_became_peered":"2023-09-21T00:17:05.919020+0000","last_unstale":"2023-09-21T00:17:10.955489+0000","last_undegraded":"2023-09-21T00:17:10.955489+0000","last_fullsized":"2023-09-21T00:17:10.955489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T12:05:24.959728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.140053+0000","last_change":"2023-09-21T00:17:06.947452+0000","last_active":"2023-09-21T00:17:11.140053+0000","last_peered":"2023-09-21T00:17:11.140053+0000","last_clean":"2023-09-21T00:17:11.140053+0000","last_became_active":"2023-09-21T00:17:06.947158+0000","last_became_peered":"2023-09-21T00:17:06.947158+0000","last_unstale":"2023-09-21T00:17:11.140053+0000","last_undegraded":"2023-09-21T00:17:11.140053+0000","last_fullsized":"2023-09-21T00:17:11.140053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:34:02.095171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.242117+0000","last_change":"2023-09-21T00:17:10.970581+0000","last_active":"2023-09-21T00:17:12.242117+0000","last_peered":"2023-09-21T00:17:12.242117+0000","last_clean":"2023-09-21T00:17:12.242117+0000","last_became_active":"2023-09-21T00:17:10.970163+0000","last_became_peered":"2023-09-21T00:17:10.970163+0000","last_unstale":"2023-09-21T00:17:12.242117+0000","last_undegraded":"2023-09-21T00:17:12.242117+0000","last_fullsized":"2023-09-21T00:17:12.242117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T02:36:22.620663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.967804+0000","last_change":"2023-09-21T00:17:05.927611+0000","last_active":"2023-09-21T00:17:10.967804+0000","last_peered":"2023-09-21T00:17:10.967804+0000","last_clean":"2023-09-21T00:17:10.967804+0000","last_became_active":"2023-09-21T00:17:05.926796+0000","last_became_peered":"2023-09-21T00:17:05.926796+0000","last_unstale":"2023-09-21T00:17:10.967804+0000","last_undegraded":"2023-09-21T00:17:10.967804+0000","last_fullsized":"2023-09-21T00:17:10.967804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:53:26.593335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.964059+0000","last_change":"2023-09-21T00:17:06.954874+0000","last_active":"2023-09-21T00:17:10.964059+0000","last_peered":"2023-09-21T00:17:10.964059+0000","last_clean":"2023-09-21T00:17:10.964059+0000","last_became_active":"2023-09-21T00:17:06.954591+0000","last_became_peered":"2023-09-21T00:17:06.954591+0000","last_unstale":"2023-09-21T00:17:10.964059+0000","last_undegraded":"2023-09-21T00:17:10.964059+0000","last_fullsized":"2023-09-21T00:17:10.964059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:28:47.396022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.242135+0000","last_change":"2023-09-21T00:17:10.978479+0000","last_active":"2023-09-21T00:17:12.242135+0000","last_peered":"2023-09-21T00:17:12.242135+0000","last_clean":"2023-09-21T00:17:12.242135+0000","last_became_active":"2023-09-21T00:17:10.978049+0000","last_became_peered":"2023-09-21T00:17:10.978049+0000","last_unstale":"2023-09-21T00:17:12.242135+0000","last_undegraded":"2023-09-21T00:17:12.242135+0000","last_fullsized":"2023-09-21T00:17:12.242135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:34:06.133170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963681+0000","last_change":"2023-09-21T00:17:05.931755+0000","last_active":"2023-09-21T00:17:10.963681+0000","last_peered":"2023-09-21T00:17:10.963681+0000","last_clean":"2023-09-21T00:17:10.963681+0000","last_became_active":"2023-09-21T00:17:05.931399+0000","last_became_peered":"2023-09-21T00:17:05.931399+0000","last_unstale":"2023-09-21T00:17:10.963681+0000","last_undegraded":"2023-09-21T00:17:10.963681+0000","last_fullsized":"2023-09-21T00:17:10.963681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:10:01.225475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.954552+0000","last_change":"2023-09-21T00:17:06.931255+0000","last_active":"2023-09-21T00:17:10.954552+0000","last_peered":"2023-09-21T00:17:10.954552+0000","last_clean":"2023-09-21T00:17:10.954552+0000","last_became_active":"2023-09-21T00:17:06.930984+0000","last_became_peered":"2023-09-21T00:17:06.930984+0000","last_unstale":"2023-09-21T00:17:10.954552+0000","last_undegraded":"2023-09-21T00:17:10.954552+0000","last_fullsized":"2023-09-21T00:17:10.954552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:15:53.077309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.242888+0000","last_change":"2023-09-21T00:17:10.977159+0000","last_active":"2023-09-21T00:17:12.242888+0000","last_peered":"2023-09-21T00:17:12.242888+0000","last_clean":"2023-09-21T00:17:12.242888+0000","last_became_active":"2023-09-21T00:17:10.976751+0000","last_became_peered":"2023-09-21T00:17:10.976751+0000","last_unstale":"2023-09-21T00:17:12.242888+0000","last_undegraded":"2023-09-21T00:17:12.242888+0000","last_fullsized":"2023-09-21T00:17:12.242888+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T11:26:08.816745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.967010+0000","last_change":"2023-09-21T00:17:06.940149+0000","last_active":"2023-09-21T00:17:10.967010+0000","last_peered":"2023-09-21T00:17:10.967010+0000","last_clean":"2023-09-21T00:17:10.967010+0000","last_became_active":"2023-09-21T00:17:06.939751+0000","last_became_peered":"2023-09-21T00:17:06.939751+0000","last_unstale":"2023-09-21T00:17:10.967010+0000","last_undegraded":"2023-09-21T00:17:10.967010+0000","last_fullsized":"2023-09-21T00:17:10.967010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:30:26.002264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.966501+0000","last_change":"2023-09-21T00:17:05.916234+0000","last_active":"2023-09-21T00:17:10.966501+0000","last_peered":"2023-09-21T00:17:10.966501+0000","last_clean":"2023-09-21T00:17:10.966501+0000","last_became_active":"2023-09-21T00:17:05.915879+0000","last_became_peered":"2023-09-21T00:17:05.915879+0000","last_unstale":"2023-09-21T00:17:10.966501+0000","last_undegraded":"2023-09-21T00:17:10.966501+0000","last_fullsized":"2023-09-21T00:17:10.966501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:06:51.096713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.242460+0000","last_change":"2023-09-21T00:17:11.141271+0000","last_active":"2023-09-21T00:17:12.242460+0000","last_peered":"2023-09-21T00:17:12.242460+0000","last_clean":"2023-09-21T00:17:12.242460+0000","last_became_active":"2023-09-21T00:17:11.140862+0000","last_became_peered":"2023-09-21T00:17:11.140862+0000","last_unstale":"2023-09-21T00:17:12.242460+0000","last_undegraded":"2023-09-21T00:17:12.242460+0000","last_fullsized":"2023-09-21T00:17:12.242460+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:28:51.434022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.953597+0000","last_change":"2023-09-21T00:17:06.948232+0000","last_active":"2023-09-21T00:17:10.953597+0000","last_peered":"2023-09-21T00:17:10.953597+0000","last_clean":"2023-09-21T00:17:10.953597+0000","last_became_active":"2023-09-21T00:17:06.947981+0000","last_became_peered":"2023-09-21T00:17:06.947981+0000","last_unstale":"2023-09-21T00:17:10.953597+0000","last_undegraded":"2023-09-21T00:17:10.953597+0000","last_fullsized":"2023-09-21T00:17:10.953597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:16:31.202329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963721+0000","last_change":"2023-09-21T00:17:05.918340+0000","last_active":"2023-09-21T00:17:10.963721+0000","last_peered":"2023-09-21T00:17:10.963721+0000","last_clean":"2023-09-21T00:17:10.963721+0000","last_became_active":"2023-09-21T00:17:05.918052+0000","last_became_peered":"2023-09-21T00:17:05.918052+0000","last_unstale":"2023-09-21T00:17:10.963721+0000","last_undegraded":"2023-09-21T00:17:10.963721+0000","last_fullsized":"2023-09-21T00:17:10.963721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:05:24.892446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.138422+0000","last_change":"2023-09-21T00:16:57.071188+0000","last_active":"2023-09-21T00:17:11.138422+0000","last_peered":"2023-09-21T00:17:11.138422+0000","last_clean":"2023-09-21T00:17:11.138422+0000","last_became_active":"2023-09-21T00:16:57.070240+0000","last_became_peered":"2023-09-21T00:16:57.070240+0000","last_unstale":"2023-09-21T00:17:11.138422+0000","last_undegraded":"2023-09-21T00:17:11.138422+0000","last_fullsized":"2023-09-21T00:17:11.138422+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:16:55.741965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:16:55.741965+0000","last_clean_scrub_stamp":"2023-09-21T00:16:55.741965+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:21:26.215032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.243013+0000","last_change":"2023-09-21T00:17:11.141697+0000","last_active":"2023-09-21T00:17:12.243013+0000","last_peered":"2023-09-21T00:17:12.243013+0000","last_clean":"2023-09-21T00:17:12.243013+0000","last_became_active":"2023-09-21T00:17:11.141334+0000","last_became_peered":"2023-09-21T00:17:11.141334+0000","last_unstale":"2023-09-21T00:17:12.243013+0000","last_undegraded":"2023-09-21T00:17:12.243013+0000","last_fullsized":"2023-09-21T00:17:12.243013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:53:19.217753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.960197+0000","last_change":"2023-09-21T00:17:06.930523+0000","last_active":"2023-09-21T00:17:10.960197+0000","last_peered":"2023-09-21T00:17:10.960197+0000","last_clean":"2023-09-21T00:17:10.960197+0000","last_became_active":"2023-09-21T00:17:06.929200+0000","last_became_peered":"2023-09-21T00:17:06.929200+0000","last_unstale":"2023-09-21T00:17:10.960197+0000","last_undegraded":"2023-09-21T00:17:10.960197+0000","last_fullsized":"2023-09-21T00:17:10.960197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T07:53:36.286251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.138459+0000","last_change":"2023-09-21T00:17:05.928845+0000","last_active":"2023-09-21T00:17:11.138459+0000","last_peered":"2023-09-21T00:17:11.138459+0000","last_clean":"2023-09-21T00:17:11.138459+0000","last_became_active":"2023-09-21T00:17:05.928617+0000","last_became_peered":"2023-09-21T00:17:05.928617+0000","last_unstale":"2023-09-21T00:17:11.138459+0000","last_undegraded":"2023-09-21T00:17:11.138459+0000","last_fullsized":"2023-09-21T00:17:11.138459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:56:48.483420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.242213+0000","last_change":"2023-09-21T00:17:11.140948+0000","last_active":"2023-09-21T00:17:12.242213+0000","last_peered":"2023-09-21T00:17:12.242213+0000","last_clean":"2023-09-21T00:17:12.242213+0000","last_became_active":"2023-09-21T00:17:11.140588+0000","last_became_peered":"2023-09-21T00:17:11.140588+0000","last_unstale":"2023-09-21T00:17:12.242213+0000","last_undegraded":"2023-09-21T00:17:12.242213+0000","last_fullsized":"2023-09-21T00:17:12.242213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:14:44.859557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.138729+0000","last_change":"2023-09-21T00:17:05.932021+0000","last_active":"2023-09-21T00:17:11.138729+0000","last_peered":"2023-09-21T00:17:11.138729+0000","last_clean":"2023-09-21T00:17:11.138729+0000","last_became_active":"2023-09-21T00:17:05.931524+0000","last_became_peered":"2023-09-21T00:17:05.931524+0000","last_unstale":"2023-09-21T00:17:11.138729+0000","last_undegraded":"2023-09-21T00:17:11.138729+0000","last_fullsized":"2023-09-21T00:17:11.138729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:28:33.010261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.967904+0000","last_change":"2023-09-21T00:17:06.938686+0000","last_active":"2023-09-21T00:17:10.967904+0000","last_peered":"2023-09-21T00:17:10.967904+0000","last_clean":"2023-09-21T00:17:10.967904+0000","last_became_active":"2023-09-21T00:17:06.938296+0000","last_became_peered":"2023-09-21T00:17:06.938296+0000","last_unstale":"2023-09-21T00:17:10.967904+0000","last_undegraded":"2023-09-21T00:17:10.967904+0000","last_fullsized":"2023-09-21T00:17:10.967904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:17:22.988451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.953741+0000","last_change":"2023-09-21T00:17:11.144700+0000","last_active":"2023-09-21T00:17:11.953741+0000","last_peered":"2023-09-21T00:17:11.953741+0000","last_clean":"2023-09-21T00:17:11.953741+0000","last_became_active":"2023-09-21T00:17:11.144270+0000","last_became_peered":"2023-09-21T00:17:11.144270+0000","last_unstale":"2023-09-21T00:17:11.953741+0000","last_undegraded":"2023-09-21T00:17:11.953741+0000","last_fullsized":"2023-09-21T00:17:11.953741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:19:20.916794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.719452+0000","last_change":"2023-09-21T00:17:05.931903+0000","last_active":"2023-09-21T00:17:11.719452+0000","last_peered":"2023-09-21T00:17:11.719452+0000","last_clean":"2023-09-21T00:17:11.719452+0000","last_became_active":"2023-09-21T00:17:05.931473+0000","last_became_peered":"2023-09-21T00:17:05.931473+0000","last_unstale":"2023-09-21T00:17:11.719452+0000","last_undegraded":"2023-09-21T00:17:11.719452+0000","last_fullsized":"2023-09-21T00:17:11.719452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T10:25:25.504437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.953301+0000","last_change":"2023-09-21T00:17:06.937019+0000","last_active":"2023-09-21T00:17:10.953301+0000","last_peered":"2023-09-21T00:17:10.953301+0000","last_clean":"2023-09-21T00:17:10.953301+0000","last_became_active":"2023-09-21T00:17:06.936738+0000","last_became_peered":"2023-09-21T00:17:06.936738+0000","last_unstale":"2023-09-21T00:17:10.953301+0000","last_undegraded":"2023-09-21T00:17:10.953301+0000","last_fullsized":"2023-09-21T00:17:10.953301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T11:15:08.495079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.954064+0000","last_change":"2023-09-21T00:17:11.141893+0000","last_active":"2023-09-21T00:17:11.954064+0000","last_peered":"2023-09-21T00:17:11.954064+0000","last_clean":"2023-09-21T00:17:11.954064+0000","last_became_active":"2023-09-21T00:17:11.141460+0000","last_became_peered":"2023-09-21T00:17:11.141460+0000","last_unstale":"2023-09-21T00:17:11.954064+0000","last_undegraded":"2023-09-21T00:17:11.954064+0000","last_fullsized":"2023-09-21T00:17:11.954064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T11:15:12.533079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.956194+0000","last_change":"2023-09-21T00:17:05.926473+0000","last_active":"2023-09-21T00:17:10.956194+0000","last_peered":"2023-09-21T00:17:10.956194+0000","last_clean":"2023-09-21T00:17:10.956194+0000","last_became_active":"2023-09-21T00:17:05.926158+0000","last_became_peered":"2023-09-21T00:17:05.926158+0000","last_unstale":"2023-09-21T00:17:10.956194+0000","last_undegraded":"2023-09-21T00:17:10.956194+0000","last_fullsized":"2023-09-21T00:17:10.956194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T12:05:24.959728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.964279+0000","last_change":"2023-09-21T00:17:06.933680+0000","last_active":"2023-09-21T00:17:10.964279+0000","last_peered":"2023-09-21T00:17:10.964279+0000","last_clean":"2023-09-21T00:17:10.964279+0000","last_became_active":"2023-09-21T00:17:06.933307+0000","last_became_peered":"2023-09-21T00:17:06.933307+0000","last_unstale":"2023-09-21T00:17:10.964279+0000","last_undegraded":"2023-09-21T00:17:10.964279+0000","last_fullsized":"2023-09-21T00:17:10.964279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:17:22.988451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.955461+0000","last_change":"2023-09-21T00:17:10.974600+0000","last_active":"2023-09-21T00:17:11.955461+0000","last_peered":"2023-09-21T00:17:11.955461+0000","last_clean":"2023-09-21T00:17:11.955461+0000","last_became_active":"2023-09-21T00:17:10.974003+0000","last_became_peered":"2023-09-21T00:17:10.974003+0000","last_unstale":"2023-09-21T00:17:11.955461+0000","last_undegraded":"2023-09-21T00:17:11.955461+0000","last_fullsized":"2023-09-21T00:17:11.955461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:28:51.434022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.138370+0000","last_change":"2023-09-21T00:17:05.931013+0000","last_active":"2023-09-21T00:17:11.138370+0000","last_peered":"2023-09-21T00:17:11.138370+0000","last_clean":"2023-09-21T00:17:11.138370+0000","last_became_active":"2023-09-21T00:17:05.930722+0000","last_became_peered":"2023-09-21T00:17:05.930722+0000","last_unstale":"2023-09-21T00:17:11.138370+0000","last_undegraded":"2023-09-21T00:17:11.138370+0000","last_fullsized":"2023-09-21T00:17:11.138370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:43:06.599691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.954572+0000","last_change":"2023-09-21T00:17:06.939541+0000","last_active":"2023-09-21T00:17:10.954572+0000","last_peered":"2023-09-21T00:17:10.954572+0000","last_clean":"2023-09-21T00:17:10.954572+0000","last_became_active":"2023-09-21T00:17:06.939222+0000","last_became_peered":"2023-09-21T00:17:06.939222+0000","last_unstale":"2023-09-21T00:17:10.954572+0000","last_undegraded":"2023-09-21T00:17:10.954572+0000","last_fullsized":"2023-09-21T00:17:10.954572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:04:17.081570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.243107+0000","last_change":"2023-09-21T00:17:11.141846+0000","last_active":"2023-09-21T00:17:12.243107+0000","last_peered":"2023-09-21T00:17:12.243107+0000","last_clean":"2023-09-21T00:17:12.243107+0000","last_became_active":"2023-09-21T00:17:11.141470+0000","last_became_peered":"2023-09-21T00:17:11.141470+0000","last_unstale":"2023-09-21T00:17:12.243107+0000","last_undegraded":"2023-09-21T00:17:12.243107+0000","last_fullsized":"2023-09-21T00:17:12.243107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:53:19.217753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.966909+0000","last_change":"2023-09-21T00:17:05.929236+0000","last_active":"2023-09-21T00:17:10.966909+0000","last_peered":"2023-09-21T00:17:10.966909+0000","last_clean":"2023-09-21T00:17:10.966909+0000","last_became_active":"2023-09-21T00:17:05.928922+0000","last_became_peered":"2023-09-21T00:17:05.928922+0000","last_unstale":"2023-09-21T00:17:10.966909+0000","last_undegraded":"2023-09-21T00:17:10.966909+0000","last_fullsized":"2023-09-21T00:17:10.966909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:04:16.077149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952071+0000","last_change":"2023-09-21T00:17:06.936721+0000","last_active":"2023-09-21T00:17:10.952071+0000","last_peered":"2023-09-21T00:17:10.952071+0000","last_clean":"2023-09-21T00:17:10.952071+0000","last_became_active":"2023-09-21T00:17:06.936421+0000","last_became_peered":"2023-09-21T00:17:06.936421+0000","last_unstale":"2023-09-21T00:17:10.952071+0000","last_undegraded":"2023-09-21T00:17:10.952071+0000","last_fullsized":"2023-09-21T00:17:10.952071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:28:34.014683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.955164+0000","last_change":"2023-09-21T00:17:10.974427+0000","last_active":"2023-09-21T00:17:11.955164+0000","last_peered":"2023-09-21T00:17:11.955164+0000","last_clean":"2023-09-21T00:17:11.955164+0000","last_became_active":"2023-09-21T00:17:10.973986+0000","last_became_peered":"2023-09-21T00:17:10.973986+0000","last_unstale":"2023-09-21T00:17:11.955164+0000","last_undegraded":"2023-09-21T00:17:11.955164+0000","last_fullsized":"2023-09-21T00:17:11.955164+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:48:02.628848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.968204+0000","last_change":"2023-09-21T00:17:05.920076+0000","last_active":"2023-09-21T00:17:10.968204+0000","last_peered":"2023-09-21T00:17:10.968204+0000","last_clean":"2023-09-21T00:17:10.968204+0000","last_became_active":"2023-09-21T00:17:05.919755+0000","last_became_peered":"2023-09-21T00:17:05.919755+0000","last_unstale":"2023-09-21T00:17:10.968204+0000","last_undegraded":"2023-09-21T00:17:10.968204+0000","last_fullsized":"2023-09-21T00:17:10.968204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T07:24:34.111510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952901+0000","last_change":"2023-09-21T00:17:06.944470+0000","last_active":"2023-09-21T00:17:10.952901+0000","last_peered":"2023-09-21T00:17:10.952901+0000","last_clean":"2023-09-21T00:17:10.952901+0000","last_became_active":"2023-09-21T00:17:06.944166+0000","last_became_peered":"2023-09-21T00:17:06.944166+0000","last_unstale":"2023-09-21T00:17:10.952901+0000","last_undegraded":"2023-09-21T00:17:10.952901+0000","last_fullsized":"2023-09-21T00:17:10.952901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T12:07:09.891729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.955249+0000","last_change":"2023-09-21T00:17:10.970352+0000","last_active":"2023-09-21T00:17:11.955249+0000","last_peered":"2023-09-21T00:17:11.955249+0000","last_clean":"2023-09-21T00:17:11.955249+0000","last_became_active":"2023-09-21T00:17:10.969785+0000","last_became_peered":"2023-09-21T00:17:10.969785+0000","last_unstale":"2023-09-21T00:17:11.955249+0000","last_undegraded":"2023-09-21T00:17:11.955249+0000","last_fullsized":"2023-09-21T00:17:11.955249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:45:46.074093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.140070+0000","last_change":"2023-09-21T00:17:05.925648+0000","last_active":"2023-09-21T00:17:11.140070+0000","last_peered":"2023-09-21T00:17:11.140070+0000","last_clean":"2023-09-21T00:17:11.140070+0000","last_became_active":"2023-09-21T00:17:05.925319+0000","last_became_peered":"2023-09-21T00:17:05.925319+0000","last_unstale":"2023-09-21T00:17:11.140070+0000","last_undegraded":"2023-09-21T00:17:11.140070+0000","last_fullsized":"2023-09-21T00:17:11.140070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:01:37.682581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.953404+0000","last_change":"2023-09-21T00:17:06.931298+0000","last_active":"2023-09-21T00:17:10.953404+0000","last_peered":"2023-09-21T00:17:10.953404+0000","last_clean":"2023-09-21T00:17:10.953404+0000","last_became_active":"2023-09-21T00:17:06.931014+0000","last_became_peered":"2023-09-21T00:17:06.931014+0000","last_unstale":"2023-09-21T00:17:10.953404+0000","last_undegraded":"2023-09-21T00:17:10.953404+0000","last_fullsized":"2023-09-21T00:17:10.953404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:12:52.515384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.242802+0000","last_change":"2023-09-21T00:17:11.139811+0000","last_active":"2023-09-21T00:17:12.242802+0000","last_peered":"2023-09-21T00:17:12.242802+0000","last_clean":"2023-09-21T00:17:12.242802+0000","last_became_active":"2023-09-21T00:17:11.139325+0000","last_became_peered":"2023-09-21T00:17:11.139325+0000","last_unstale":"2023-09-21T00:17:12.242802+0000","last_undegraded":"2023-09-21T00:17:12.242802+0000","last_fullsized":"2023-09-21T00:17:12.242802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T02:36:22.620663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.967086+0000","last_change":"2023-09-21T00:17:05.920539+0000","last_active":"2023-09-21T00:17:10.967086+0000","last_peered":"2023-09-21T00:17:10.967086+0000","last_clean":"2023-09-21T00:17:10.967086+0000","last_became_active":"2023-09-21T00:17:05.920322+0000","last_became_peered":"2023-09-21T00:17:05.920322+0000","last_unstale":"2023-09-21T00:17:10.967086+0000","last_undegraded":"2023-09-21T00:17:10.967086+0000","last_fullsized":"2023-09-21T00:17:10.967086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:05:24.892446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.139033+0000","last_change":"2023-09-21T00:17:06.948781+0000","last_active":"2023-09-21T00:17:11.139033+0000","last_peered":"2023-09-21T00:17:11.139033+0000","last_clean":"2023-09-21T00:17:11.139033+0000","last_became_active":"2023-09-21T00:17:06.948444+0000","last_became_peered":"2023-09-21T00:17:06.948444+0000","last_unstale":"2023-09-21T00:17:11.139033+0000","last_undegraded":"2023-09-21T00:17:11.139033+0000","last_fullsized":"2023-09-21T00:17:11.139033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:28:47.396022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.242087+0000","last_change":"2023-09-21T00:17:10.975994+0000","last_active":"2023-09-21T00:17:12.242087+0000","last_peered":"2023-09-21T00:17:12.242087+0000","last_clean":"2023-09-21T00:17:12.242087+0000","last_became_active":"2023-09-21T00:17:10.975468+0000","last_became_peered":"2023-09-21T00:17:10.975468+0000","last_unstale":"2023-09-21T00:17:12.242087+0000","last_undegraded":"2023-09-21T00:17:12.242087+0000","last_fullsized":"2023-09-21T00:17:12.242087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:34:06.133170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.971145+0000","last_change":"2023-09-21T00:17:05.921232+0000","last_active":"2023-09-21T00:17:10.971145+0000","last_peered":"2023-09-21T00:17:10.971145+0000","last_clean":"2023-09-21T00:17:10.971145+0000","last_became_active":"2023-09-21T00:17:05.920883+0000","last_became_peered":"2023-09-21T00:17:05.920883+0000","last_unstale":"2023-09-21T00:17:10.971145+0000","last_undegraded":"2023-09-21T00:17:10.971145+0000","last_fullsized":"2023-09-21T00:17:10.971145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:56:48.483420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963842+0000","last_change":"2023-09-21T00:17:06.949150+0000","last_active":"2023-09-21T00:17:10.963842+0000","last_peered":"2023-09-21T00:17:10.963842+0000","last_clean":"2023-09-21T00:17:10.963842+0000","last_became_active":"2023-09-21T00:17:06.948425+0000","last_became_peered":"2023-09-21T00:17:06.948425+0000","last_unstale":"2023-09-21T00:17:10.963842+0000","last_undegraded":"2023-09-21T00:17:10.963842+0000","last_fullsized":"2023-09-21T00:17:10.963842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:45:42.036094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.242401+0000","last_change":"2023-09-21T00:17:11.139787+0000","last_active":"2023-09-21T00:17:12.242401+0000","last_peered":"2023-09-21T00:17:12.242401+0000","last_clean":"2023-09-21T00:17:12.242401+0000","last_became_active":"2023-09-21T00:17:11.139473+0000","last_became_peered":"2023-09-21T00:17:11.139473+0000","last_unstale":"2023-09-21T00:17:12.242401+0000","last_undegraded":"2023-09-21T00:17:12.242401+0000","last_fullsized":"2023-09-21T00:17:12.242401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:38:17.728778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.967627+0000","last_change":"2023-09-21T00:17:05.919490+0000","last_active":"2023-09-21T00:17:10.967627+0000","last_peered":"2023-09-21T00:17:10.967627+0000","last_clean":"2023-09-21T00:17:10.967627+0000","last_became_active":"2023-09-21T00:17:05.919182+0000","last_became_peered":"2023-09-21T00:17:05.919182+0000","last_unstale":"2023-09-21T00:17:10.967627+0000","last_undegraded":"2023-09-21T00:17:10.967627+0000","last_fullsized":"2023-09-21T00:17:10.967627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T12:05:24.959728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.140401+0000","last_change":"2023-09-21T00:17:06.947423+0000","last_active":"2023-09-21T00:17:11.140401+0000","last_peered":"2023-09-21T00:17:11.140401+0000","last_clean":"2023-09-21T00:17:11.140401+0000","last_became_active":"2023-09-21T00:17:06.947138+0000","last_became_peered":"2023-09-21T00:17:06.947138+0000","last_unstale":"2023-09-21T00:17:11.140401+0000","last_undegraded":"2023-09-21T00:17:11.140401+0000","last_fullsized":"2023-09-21T00:17:11.140401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:53:15.179754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952567+0000","last_change":"2023-09-21T00:17:06.935110+0000","last_active":"2023-09-21T00:17:10.952567+0000","last_peered":"2023-09-21T00:17:10.952567+0000","last_clean":"2023-09-21T00:17:10.952567+0000","last_became_active":"2023-09-21T00:17:06.934658+0000","last_became_peered":"2023-09-21T00:17:06.934658+0000","last_unstale":"2023-09-21T00:17:10.952567+0000","last_undegraded":"2023-09-21T00:17:10.952567+0000","last_fullsized":"2023-09-21T00:17:10.952567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:17:22.988451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.966596+0000","last_change":"2023-09-21T00:17:06.947131+0000","last_active":"2023-09-21T00:17:10.966596+0000","last_peered":"2023-09-21T00:17:10.966596+0000","last_clean":"2023-09-21T00:17:10.966596+0000","last_became_active":"2023-09-21T00:17:06.946817+0000","last_became_peered":"2023-09-21T00:17:06.946817+0000","last_unstale":"2023-09-21T00:17:10.966596+0000","last_undegraded":"2023-09-21T00:17:10.966596+0000","last_fullsized":"2023-09-21T00:17:10.966596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:43:07.604113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963724+0000","last_change":"2023-09-21T00:17:06.950723+0000","last_active":"2023-09-21T00:17:10.963724+0000","last_peered":"2023-09-21T00:17:10.963724+0000","last_clean":"2023-09-21T00:17:10.963724+0000","last_became_active":"2023-09-21T00:17:06.950464+0000","last_became_peered":"2023-09-21T00:17:06.950464+0000","last_unstale":"2023-09-21T00:17:10.963724+0000","last_undegraded":"2023-09-21T00:17:10.963724+0000","last_fullsized":"2023-09-21T00:17:10.963724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:31:49.356708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.960636+0000","last_change":"2023-09-21T00:17:06.931583+0000","last_active":"2023-09-21T00:17:10.960636+0000","last_peered":"2023-09-21T00:17:10.960636+0000","last_clean":"2023-09-21T00:17:10.960636+0000","last_became_active":"2023-09-21T00:17:06.931288+0000","last_became_peered":"2023-09-21T00:17:06.931288+0000","last_unstale":"2023-09-21T00:17:10.960636+0000","last_undegraded":"2023-09-21T00:17:10.960636+0000","last_fullsized":"2023-09-21T00:17:10.960636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:16:31.202329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952778+0000","last_change":"2023-09-21T00:17:06.935897+0000","last_active":"2023-09-21T00:17:10.952778+0000","last_peered":"2023-09-21T00:17:10.952778+0000","last_clean":"2023-09-21T00:17:10.952778+0000","last_became_active":"2023-09-21T00:17:06.934839+0000","last_became_peered":"2023-09-21T00:17:06.934839+0000","last_unstale":"2023-09-21T00:17:10.952778+0000","last_undegraded":"2023-09-21T00:17:10.952778+0000","last_fullsized":"2023-09-21T00:17:10.952778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:44:31.363217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.971043+0000","last_change":"2023-09-21T00:17:06.938775+0000","last_active":"2023-09-21T00:17:10.971043+0000","last_peered":"2023-09-21T00:17:10.971043+0000","last_clean":"2023-09-21T00:17:10.971043+0000","last_became_active":"2023-09-21T00:17:06.938299+0000","last_became_peered":"2023-09-21T00:17:06.938299+0000","last_unstale":"2023-09-21T00:17:10.971043+0000","last_undegraded":"2023-09-21T00:17:10.971043+0000","last_fullsized":"2023-09-21T00:17:10.971043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:33:02.098745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.953339+0000","last_change":"2023-09-21T00:17:06.936698+0000","last_active":"2023-09-21T00:17:10.953339+0000","last_peered":"2023-09-21T00:17:10.953339+0000","last_clean":"2023-09-21T00:17:10.953339+0000","last_became_active":"2023-09-21T00:17:06.936405+0000","last_became_peered":"2023-09-21T00:17:06.936405+0000","last_unstale":"2023-09-21T00:17:10.953339+0000","last_undegraded":"2023-09-21T00:17:10.953339+0000","last_fullsized":"2023-09-21T00:17:10.953339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:34:25.102514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.953420+0000","last_change":"2023-09-21T00:17:06.934511+0000","last_active":"2023-09-21T00:17:10.953420+0000","last_peered":"2023-09-21T00:17:10.953420+0000","last_clean":"2023-09-21T00:17:10.953420+0000","last_became_active":"2023-09-21T00:17:06.934142+0000","last_became_peered":"2023-09-21T00:17:06.934142+0000","last_unstale":"2023-09-21T00:17:10.953420+0000","last_undegraded":"2023-09-21T00:17:10.953420+0000","last_fullsized":"2023-09-21T00:17:10.953420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:34:25.102514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963582+0000","last_change":"2023-09-21T00:17:06.948765+0000","last_active":"2023-09-21T00:17:10.963582+0000","last_peered":"2023-09-21T00:17:10.963582+0000","last_clean":"2023-09-21T00:17:10.963582+0000","last_became_active":"2023-09-21T00:17:06.948437+0000","last_became_peered":"2023-09-21T00:17:06.948437+0000","last_unstale":"2023-09-21T00:17:10.963582+0000","last_undegraded":"2023-09-21T00:17:10.963582+0000","last_fullsized":"2023-09-21T00:17:10.963582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T11:15:08.495079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952376+0000","last_change":"2023-09-21T00:17:06.934818+0000","last_active":"2023-09-21T00:17:10.952376+0000","last_peered":"2023-09-21T00:17:10.952376+0000","last_clean":"2023-09-21T00:17:10.952376+0000","last_became_active":"2023-09-21T00:17:06.934520+0000","last_became_peered":"2023-09-21T00:17:06.934520+0000","last_unstale":"2023-09-21T00:17:10.952376+0000","last_undegraded":"2023-09-21T00:17:10.952376+0000","last_fullsized":"2023-09-21T00:17:10.952376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:30:26.002264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963843+0000","last_change":"2023-09-21T00:17:06.947489+0000","last_active":"2023-09-21T00:17:10.963843+0000","last_peered":"2023-09-21T00:17:10.963843+0000","last_clean":"2023-09-21T00:17:10.963843+0000","last_became_active":"2023-09-21T00:17:06.947209+0000","last_became_peered":"2023-09-21T00:17:06.947209+0000","last_unstale":"2023-09-21T00:17:10.963843+0000","last_undegraded":"2023-09-21T00:17:10.963843+0000","last_fullsized":"2023-09-21T00:17:10.963843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:41:27.691190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.960736+0000","last_change":"2023-09-21T00:17:06.938924+0000","last_active":"2023-09-21T00:17:10.960736+0000","last_peered":"2023-09-21T00:17:10.960736+0000","last_clean":"2023-09-21T00:17:10.960736+0000","last_became_active":"2023-09-21T00:17:06.938643+0000","last_became_peered":"2023-09-21T00:17:06.938643+0000","last_unstale":"2023-09-21T00:17:10.960736+0000","last_undegraded":"2023-09-21T00:17:10.960736+0000","last_fullsized":"2023-09-21T00:17:10.960736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:34:25.102514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.953697+0000","last_change":"2023-09-21T00:17:06.931839+0000","last_active":"2023-09-21T00:17:10.953697+0000","last_peered":"2023-09-21T00:17:10.953697+0000","last_clean":"2023-09-21T00:17:10.953697+0000","last_became_active":"2023-09-21T00:17:06.931573+0000","last_became_peered":"2023-09-21T00:17:06.931573+0000","last_unstale":"2023-09-21T00:17:10.953697+0000","last_undegraded":"2023-09-21T00:17:10.953697+0000","last_fullsized":"2023-09-21T00:17:10.953697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:16:31.202329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":690786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-21T00:17:31.548 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-21T00:17:31.549 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-09-21T00:17:31.549 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-09-21T00:17:31.550 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-09-21T00:17:31.550 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-09-21T00:17:31.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.706+0000 7faaca628700 1 Processor -- start 2023-09-21T00:17:31.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.706+0000 7faaca628700 1 -- start start 2023-09-21T00:17:31.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.707+0000 7faaca628700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faac415ac90 0x7faac4070de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:31.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.707+0000 7faaca628700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faac4159f70 con 0x7faac40cc250 2023-09-21T00:17:31.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.707+0000 7faaca628700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faac415a800 con 0x7faac4071320 2023-09-21T00:17:31.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.707+0000 7faaca628700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac406d2c0 con 0x7faac415ac90 2023-09-21T00:17:31.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.707+0000 7faac3fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7faac40cc250 0x7faac40cc630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56980/0 (socket says 172.21.15.59:56980) 2023-09-21T00:17:31.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.707+0000 7faac3fff700 1 -- 172.21.15.59:0/4078329174 learned_addr learned my addr 172.21.15.59:0/4078329174 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:31.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.708+0000 7faac37fe700 1 --2- 172.21.15.59:0/4078329174 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faac415ac90 0x7faac4070de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:31.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.708+0000 7faac2ffd700 1 -- 172.21.15.59:0/4078329174 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3200243000 0 0) 0x7faab4001110 con 0x7faac40cc250 2023-09-21T00:17:31.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.708+0000 7faac2ffd700 1 -- 172.21.15.59:0/4078329174 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faaac0035b0 con 0x7faac40cc250 2023-09-21T00:17:31.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.708+0000 7faac2ffd700 1 -- 172.21.15.59:0/4078329174 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1939851092 0 0) 0x7faaac0035b0 con 0x7faac40cc250 2023-09-21T00:17:31.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.708+0000 7faac2ffd700 1 -- 172.21.15.59:0/4078329174 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faac415ac90 msgr2=0x7faac4070de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:31.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.708+0000 7faac2ffd700 1 --2- 172.21.15.59:0/4078329174 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faac415ac90 0x7faac4070de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:31.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.708+0000 7faac2ffd700 1 -- 172.21.15.59:0/4078329174 >> v1:172.21.15.83:6789/0 conn(0x7faac4071320 legacy=0x7faac40b3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:31.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.708+0000 7faac2ffd700 1 -- 172.21.15.59:0/4078329174 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac40717b0 con 0x7faac40cc250 2023-09-21T00:17:31.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.708+0000 7faac2ffd700 1 -- 172.21.15.59:0/4078329174 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 710825841 0 0) 0x7faab4001800 con 0x7faac40cc250 2023-09-21T00:17:31.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.708+0000 7faac2ffd700 1 -- 172.21.15.59:0/4078329174 >> v1:172.21.15.59:6789/0 conn(0x7faac40cc250 legacy=0x7faac40cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:31.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.708+0000 7faac2ffd700 1 --2- 172.21.15.59:0/4078329174 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faac415ac90 0x7faaac003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:31.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.708+0000 7faac2ffd700 1 --2- 172.21.15.59:0/4078329174 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faaac003fe0 0x7faaac004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:31.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.708+0000 7faac2ffd700 1 --2- 172.21.15.59:0/4078329174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faaac004d90 0x7faaac005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:31.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.708+0000 7faac2ffd700 1 -- 172.21.15.59:0/4078329174 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac406d2c0 con 0x7faaac004d90 2023-09-21T00:17:31.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.708+0000 7faac2ffd700 1 -- 172.21.15.59:0/4078329174 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaac00baf0 con 0x7faaac003fe0 2023-09-21T00:17:31.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.708+0000 7faac2ffd700 1 -- 172.21.15.59:0/4078329174 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaac00bcb0 con 0x7faac415ac90 2023-09-21T00:17:31.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.708+0000 7faac8bc5700 1 --2- 172.21.15.59:0/4078329174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faaac004d90 0x7faaac005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:31.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.708+0000 7faac37fe700 1 --2- 172.21.15.59:0/4078329174 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faaac003fe0 0x7faaac004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:31.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.708+0000 7faac3fff700 1 --2- 172.21.15.59:0/4078329174 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faac415ac90 0x7faaac003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:31.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.708+0000 7faac8bc5700 1 -- 172.21.15.59:0/4078329174 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faac415ac90 msgr2=0x7faaac003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:31.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.708+0000 7faac8bc5700 1 --2- 172.21.15.59:0/4078329174 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faac415ac90 0x7faaac003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:31.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.708+0000 7faac8bc5700 1 -- 172.21.15.59:0/4078329174 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faaac003fe0 msgr2=0x7faaac004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:31.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.708+0000 7faac8bc5700 1 --2- 172.21.15.59:0/4078329174 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faaac003fe0 0x7faaac004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:31.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.708+0000 7faac8bc5700 1 -- 172.21.15.59:0/4078329174 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaac0035b0 con 0x7faaac004d90 2023-09-21T00:17:31.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.708+0000 7faac37fe700 1 --2- 172.21.15.59:0/4078329174 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faaac003fe0 0x7faaac004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T00:17:31.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.709+0000 7faac8bc5700 1 --2- 172.21.15.59:0/4078329174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faaac004d90 0x7faaac005210 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7faabc00c290 tx=0x7faaac005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7083769fcbf01c2 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:31.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.709+0000 7faac2ffd700 1 -- 172.21.15.59:0/4078329174 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faabc001e60 con 0x7faaac004d90 2023-09-21T00:17:31.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.709+0000 7faac2ffd700 1 -- 172.21.15.59:0/4078329174 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faabc00cdf0 con 0x7faaac004d90 2023-09-21T00:17:31.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.709+0000 7faac2ffd700 1 -- 172.21.15.59:0/4078329174 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faabc012660 con 0x7faaac004d90 2023-09-21T00:17:31.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.709+0000 7faaca628700 1 -- 172.21.15.59:0/4078329174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faaac004d90 msgr2=0x7faaac005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:31.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.709+0000 7faaca628700 1 --2- 172.21.15.59:0/4078329174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faaac004d90 0x7faaac005210 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7faabc00c290 tx=0x7faaac005880 comp rx=0 tx=0).stop 2023-09-21T00:17:31.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.709+0000 7faac8bc5700 1 -- 172.21.15.59:0/4078329174 reap_dead start 2023-09-21T00:17:31.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.709+0000 7faaca628700 1 -- 172.21.15.59:0/4078329174 shutdown_connections 2023-09-21T00:17:31.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.709+0000 7faaca628700 1 -- 172.21.15.59:0/4078329174 >> 172.21.15.59:0/4078329174 conn(0x7faac406a780 msgr2=0x7faac406ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:31.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.709+0000 7faaca628700 1 -- 172.21.15.59:0/4078329174 shutdown_connections 2023-09-21T00:17:31.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.709+0000 7faaca628700 1 -- 172.21.15.59:0/4078329174 wait complete. 2023-09-21T00:17:31.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.711+0000 7faaca628700 1 Processor -- start 2023-09-21T00:17:31.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.711+0000 7faaca628700 1 -- start start 2023-09-21T00:17:31.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.712+0000 7faaca628700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faac4158a10 0x7faac4145da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:31.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.712+0000 7faaca628700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faac4158df0 0x7faac41462e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:31.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.712+0000 7faaca628700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac41e2560 0x7faac41e29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:31.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.712+0000 7faaca628700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac41e3ee0 con 0x7faac41e2560 2023-09-21T00:17:31.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.712+0000 7faaca628700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac41f09a0 con 0x7faac4158df0 2023-09-21T00:17:31.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.712+0000 7faaca628700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac41e32d0 con 0x7faac4158a10 2023-09-21T00:17:31.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.712+0000 7faac8bc5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac41e2560 0x7faac41e29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:31.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.712+0000 7faac8bc5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac41e2560 0x7faac41e29e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51428/0 (socket says 172.21.15.59:51428) 2023-09-21T00:17:31.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.712+0000 7faac8bc5700 1 -- 172.21.15.59:0/437214567 learned_addr learned my addr 172.21.15.59:0/437214567 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:31.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.712+0000 7faac37fe700 1 --2- 172.21.15.59:0/437214567 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faac4158df0 0x7faac41462e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:31.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.712+0000 7faac3fff700 1 --2- 172.21.15.59:0/437214567 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faac4158a10 0x7faac4145da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:31.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.712+0000 7faac8bc5700 1 -- 172.21.15.59:0/437214567 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faac4158a10 msgr2=0x7faac4145da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:31.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.712+0000 7faac8bc5700 1 --2- 172.21.15.59:0/437214567 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faac4158a10 0x7faac4145da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:31.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.712+0000 7faac8bc5700 1 -- 172.21.15.59:0/437214567 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faac4158df0 msgr2=0x7faac41462e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:31.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.712+0000 7faac8bc5700 1 --2- 172.21.15.59:0/437214567 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faac4158df0 0x7faac41462e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:31.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.712+0000 7faac8bc5700 1 -- 172.21.15.59:0/437214567 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac41e35b0 con 0x7faac41e2560 2023-09-21T00:17:31.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.713+0000 7faac8bc5700 1 --2- 172.21.15.59:0/437214567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac41e2560 0x7faac41e29e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7faabc013000 tx=0x7faabc001600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:31.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.713+0000 7faac0ff9700 1 -- 172.21.15.59:0/437214567 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faabc003cd0 con 0x7faac41e2560 2023-09-21T00:17:31.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.713+0000 7faac0ff9700 1 -- 172.21.15.59:0/437214567 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faabc020070 con 0x7faac41e2560 2023-09-21T00:17:31.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.713+0000 7faac0ff9700 1 -- 172.21.15.59:0/437214567 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faabc005300 con 0x7faac41e2560 2023-09-21T00:17:31.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.713+0000 7faaca628700 1 -- 172.21.15.59:0/437214567 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faac41e3890 con 0x7faac41e2560 2023-09-21T00:17:31.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.713+0000 7faaca628700 1 -- 172.21.15.59:0/437214567 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faac41e2f20 con 0x7faac41e2560 2023-09-21T00:17:31.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.714+0000 7faaca628700 1 -- 172.21.15.59:0/437214567 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faac41f0b10 con 0x7faac41e2560 2023-09-21T00:17:31.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.714+0000 7faac0ff9700 1 -- 172.21.15.59:0/437214567 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7faabc022030 con 0x7faac41e2560 2023-09-21T00:17:31.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.715+0000 7faac0ff9700 1 --2- 172.21.15.59:0/437214567 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7faab006ae00 0x7faab006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:31.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.715+0000 7faac0ff9700 1 -- 172.21.15.59:0/437214567 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faabc08a630 con 0x7faac41e2560 2023-09-21T00:17:31.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.715+0000 7faac3fff700 1 --2- 172.21.15.59:0/437214567 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7faab006ae00 0x7faab006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:31.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.715+0000 7faac3fff700 1 --2- 172.21.15.59:0/437214567 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7faab006ae00 0x7faab006d2c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7faab4001050 tx=0x7faab4001230 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:31.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.719+0000 7faac0ff9700 1 -- 172.21.15.59:0/437214567 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7faac41f0b10 con 0x7faac41e2560 2023-09-21T00:17:31.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.976+0000 7faaca628700 1 -- 172.21.15.59:0/437214567 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7faac40b5680 con 0x7faac41e2560 2023-09-21T00:17:31.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.979+0000 7faac0ff9700 1 -- 172.21.15.59:0/437214567 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171115 (secure 0 0 0) 0x7faabc0555b0 con 0x7faac41e2560 2023-09-21T00:17:31.982 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:17:31.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.982+0000 7faaca628700 1 -- 172.21.15.59:0/437214567 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7faab006ae00 msgr2=0x7faab006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:31.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.982+0000 7faaca628700 1 --2- 172.21.15.59:0/437214567 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7faab006ae00 0x7faab006d2c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7faab4001050 tx=0x7faab4001230 comp rx=0 tx=0).stop 2023-09-21T00:17:31.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.982+0000 7faaca628700 1 -- 172.21.15.59:0/437214567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac41e2560 msgr2=0x7faac41e29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:31.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.982+0000 7faaca628700 1 --2- 172.21.15.59:0/437214567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac41e2560 0x7faac41e29e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7faabc013000 tx=0x7faabc001600 comp rx=0 tx=0).stop 2023-09-21T00:17:31.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.982+0000 7faaca628700 1 -- 172.21.15.59:0/437214567 shutdown_connections 2023-09-21T00:17:31.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.982+0000 7faaca628700 1 --2- 172.21.15.59:0/437214567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac41e2560 0x7faac41e29e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:31.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.982+0000 7faaca628700 1 --2- 172.21.15.59:0/437214567 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7faab006ae00 0x7faab006d2c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:31.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.982+0000 7faaca628700 1 --2- 172.21.15.59:0/437214567 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faac4158a10 0x7faac4145da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:31.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.982+0000 7faaca628700 1 --2- 172.21.15.59:0/437214567 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faac4158df0 0x7faac41462e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:31.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.982+0000 7faaca628700 1 -- 172.21.15.59:0/437214567 >> 172.21.15.59:0/437214567 conn(0x7faac406a780 msgr2=0x7faac40cd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:31.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.982+0000 7faaca628700 1 -- 172.21.15.59:0/437214567 shutdown_connections 2023-09-21T00:17:31.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:31.982+0000 7faaca628700 1 -- 172.21.15.59:0/437214567 wait complete. 2023-09-21T00:17:31.995 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":5,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1736808576},{"type":"v1","addr":"172.21.15.83:6833","nonce":1736808576}]},"active_addr":"172.21.15.83:6833/1736808576","active_change":"2023-09-21T00:16:48.735341+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.83:0","nonce":188477329}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.83:0","nonce":675776917}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.83:0","nonce":3491811445}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.83:0","nonce":121633288}]}]} 2023-09-21T00:17:31.999 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-09-21T00:17:32.000 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-09-21T00:17:32.000 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T00:17:32.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.124+0000 7fc8408bb700 1 Processor -- start 2023-09-21T00:17:32.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.124+0000 7fc8408bb700 1 -- start start 2023-09-21T00:17:32.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.125+0000 7fc8408bb700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc83c15a230 0x7fc83c15e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:32.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.125+0000 7fc8408bb700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc83c071d90 0x7fc83c06eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:32.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.125+0000 7fc8408bb700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc83c0cb1c0 con 0x7fc83c0ca790 2023-09-21T00:17:32.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.125+0000 7fc8408bb700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc83c0cb780 con 0x7fc83c15a230 2023-09-21T00:17:32.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.125+0000 7fc8408bb700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c0cb4a0 con 0x7fc83c071d90 2023-09-21T00:17:32.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.125+0000 7fc839d9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc83c0ca790 0x7fc83c071680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57000/0 (socket says 172.21.15.59:57000) 2023-09-21T00:17:32.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.125+0000 7fc839d9b700 1 -- 172.21.15.59:0/1919174458 learned_addr learned my addr 172.21.15.59:0/1919174458 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:32.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.126+0000 7fc83a59c700 1 --2- 172.21.15.59:0/1919174458 >> v2:172.21.15.83:3300/0 conn(0x7fc83c15a230 0x7fc83c15e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:32.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.126+0000 7fc83ad9d700 1 --2- 172.21.15.59:0/1919174458 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc83c071d90 0x7fc83c06eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:32.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.126+0000 7fc83959a700 1 -- 172.21.15.59:0/1919174458 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3555572425 0 0) 0x7fc83c0cb1c0 con 0x7fc83c0ca790 2023-09-21T00:17:32.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.126+0000 7fc83959a700 1 -- 172.21.15.59:0/1919174458 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8280035b0 con 0x7fc83c0ca790 2023-09-21T00:17:32.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.126+0000 7fc83959a700 1 -- 172.21.15.59:0/1919174458 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2110013709 0 0) 0x7fc8280035b0 con 0x7fc83c0ca790 2023-09-21T00:17:32.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.126+0000 7fc83959a700 1 -- 172.21.15.59:0/1919174458 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc83c071d90 msgr2=0x7fc83c06eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:32.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.126+0000 7fc83959a700 1 --2- 172.21.15.59:0/1919174458 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc83c071d90 0x7fc83c06eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:32.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.126+0000 7fc83959a700 1 -- 172.21.15.59:0/1919174458 >> v2:172.21.15.83:3300/0 conn(0x7fc83c15a230 msgr2=0x7fc83c15e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:32.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.126+0000 7fc83959a700 1 --2- 172.21.15.59:0/1919174458 >> v2:172.21.15.83:3300/0 conn(0x7fc83c15a230 0x7fc83c15e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:32.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.126+0000 7fc83959a700 1 -- 172.21.15.59:0/1919174458 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83c15e0b0 con 0x7fc83c0ca790 2023-09-21T00:17:32.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.126+0000 7fc83959a700 1 -- 172.21.15.59:0/1919174458 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 710825841 0 0) 0x7fc824001670 con 0x7fc83c0ca790 2023-09-21T00:17:32.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.126+0000 7fc83959a700 1 -- 172.21.15.59:0/1919174458 >> v1:172.21.15.59:6789/0 conn(0x7fc83c0ca790 legacy=0x7fc83c071680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:32.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.126+0000 7fc83959a700 1 --2- 172.21.15.59:0/1919174458 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc83c071d90 0x7fc828003a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:32.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.126+0000 7fc83959a700 1 --2- 172.21.15.59:0/1919174458 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc828003ff0 0x7fc828004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:32.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.126+0000 7fc83959a700 1 --2- 172.21.15.59:0/1919174458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc828004d90 0x7fc828005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:32.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.126+0000 7fc83959a700 1 -- 172.21.15.59:0/1919174458 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c0cb780 con 0x7fc828004d90 2023-09-21T00:17:32.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.126+0000 7fc83959a700 1 -- 172.21.15.59:0/1919174458 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c0cb4a0 con 0x7fc828003ff0 2023-09-21T00:17:32.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.126+0000 7fc83959a700 1 -- 172.21.15.59:0/1919174458 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc82800dc50 con 0x7fc83c071d90 2023-09-21T00:17:32.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.126+0000 7fc83ad9d700 1 --2- 172.21.15.59:0/1919174458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc828004d90 0x7fc828005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:32.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.126+0000 7fc83a59c700 1 --2- 172.21.15.59:0/1919174458 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc83c071d90 0x7fc828003a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:32.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.126+0000 7fc839d9b700 1 --2- 172.21.15.59:0/1919174458 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc828003ff0 0x7fc828004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:32.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.126+0000 7fc83ad9d700 1 -- 172.21.15.59:0/1919174458 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc83c071d90 msgr2=0x7fc828003a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:32.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.126+0000 7fc83ad9d700 1 --2- 172.21.15.59:0/1919174458 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc83c071d90 0x7fc828003a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:32.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.127+0000 7fc83ad9d700 1 -- 172.21.15.59:0/1919174458 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc828003ff0 msgr2=0x7fc828004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:32.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.127+0000 7fc83ad9d700 1 --2- 172.21.15.59:0/1919174458 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc828003ff0 0x7fc828004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:32.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.127+0000 7fc83ad9d700 1 -- 172.21.15.59:0/1919174458 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8280035b0 con 0x7fc828004d90 2023-09-21T00:17:32.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.127+0000 7fc83ad9d700 1 --2- 172.21.15.59:0/1919174458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc828004d90 0x7fc828005210 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc834009fc0 tx=0x7fc828005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cf443bbfd468059 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:32.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.127+0000 7fc83959a700 1 -- 172.21.15.59:0/1919174458 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83400ec30 con 0x7fc828004d90 2023-09-21T00:17:32.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.127+0000 7fc83959a700 1 -- 172.21.15.59:0/1919174458 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83400f040 con 0x7fc828004d90 2023-09-21T00:17:32.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.127+0000 7fc83959a700 1 -- 172.21.15.59:0/1919174458 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc834014480 con 0x7fc828004d90 2023-09-21T00:17:32.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.127+0000 7fc8408bb700 1 -- 172.21.15.59:0/1919174458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc828004d90 msgr2=0x7fc828005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:32.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.127+0000 7fc8408bb700 1 --2- 172.21.15.59:0/1919174458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc828004d90 0x7fc828005210 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc834009fc0 tx=0x7fc828005880 comp rx=0 tx=0).stop 2023-09-21T00:17:32.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.127+0000 7fc83ad9d700 1 -- 172.21.15.59:0/1919174458 reap_dead start 2023-09-21T00:17:32.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.127+0000 7fc8408bb700 1 -- 172.21.15.59:0/1919174458 shutdown_connections 2023-09-21T00:17:32.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.127+0000 7fc8408bb700 1 -- 172.21.15.59:0/1919174458 >> 172.21.15.59:0/1919174458 conn(0x7fc83c0d0140 msgr2=0x7fc83c0d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:32.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.127+0000 7fc8408bb700 1 -- 172.21.15.59:0/1919174458 shutdown_connections 2023-09-21T00:17:32.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.127+0000 7fc8408bb700 1 -- 172.21.15.59:0/1919174458 wait complete. 2023-09-21T00:17:32.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.129+0000 7fc8408bb700 1 Processor -- start 2023-09-21T00:17:32.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.129+0000 7fc8408bb700 1 -- start start 2023-09-21T00:17:32.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.130+0000 7fc8408bb700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc828004d90 0x7fc83c1ef660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:32.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.130+0000 7fc8408bb700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc83c0b56a0 0x7fc83c1f2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:32.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.130+0000 7fc8408bb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc83c0b5b20 0x7fc83c1f2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:32.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.130+0000 7fc8408bb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c1f2c70 con 0x7fc83c0b5b20 2023-09-21T00:17:32.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.130+0000 7fc8408bb700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c1f2f50 con 0x7fc828004d90 2023-09-21T00:17:32.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.130+0000 7fc8408bb700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c1eee60 con 0x7fc83c0b56a0 2023-09-21T00:17:32.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.130+0000 7fc83ad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc83c0b5b20 0x7fc83c1f2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:32.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.130+0000 7fc83ad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc83c0b5b20 0x7fc83c1f2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51446/0 (socket says 172.21.15.59:51446) 2023-09-21T00:17:32.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.130+0000 7fc83ad9d700 1 -- 172.21.15.59:0/754815673 learned_addr learned my addr 172.21.15.59:0/754815673 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:32.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.131+0000 7fc83a59c700 1 --2- 172.21.15.59:0/754815673 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc828004d90 0x7fc83c1ef660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:32.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.131+0000 7fc839d9b700 1 --2- 172.21.15.59:0/754815673 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc83c0b56a0 0x7fc83c1f2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:32.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.131+0000 7fc83ad9d700 1 -- 172.21.15.59:0/754815673 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc83c0b56a0 msgr2=0x7fc83c1f2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:32.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.131+0000 7fc83ad9d700 1 --2- 172.21.15.59:0/754815673 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc83c0b56a0 0x7fc83c1f2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:32.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.131+0000 7fc83ad9d700 1 -- 172.21.15.59:0/754815673 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc828004d90 msgr2=0x7fc83c1ef660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:32.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.131+0000 7fc83ad9d700 1 --2- 172.21.15.59:0/754815673 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc828004d90 0x7fc83c1ef660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:32.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.131+0000 7fc83ad9d700 1 -- 172.21.15.59:0/754815673 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83c1ef140 con 0x7fc83c0b5b20 2023-09-21T00:17:32.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.131+0000 7fc83a59c700 1 --2- 172.21.15.59:0/754815673 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc828004d90 0x7fc83c1ef660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:17:32.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.131+0000 7fc83ad9d700 1 --2- 172.21.15.59:0/754815673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc83c0b5b20 0x7fc83c1f2640 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc834017040 tx=0x7fc834009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:32.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.131+0000 7fc832ffd700 1 -- 172.21.15.59:0/754815673 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc834004450 con 0x7fc83c0b5b20 2023-09-21T00:17:32.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.131+0000 7fc832ffd700 1 -- 172.21.15.59:0/754815673 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8340045f0 con 0x7fc83c0b5b20 2023-09-21T00:17:32.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.131+0000 7fc832ffd700 1 -- 172.21.15.59:0/754815673 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc834003e10 con 0x7fc83c0b5b20 2023-09-21T00:17:32.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.131+0000 7fc8408bb700 1 -- 172.21.15.59:0/754815673 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc83c0b4df0 con 0x7fc83c0b5b20 2023-09-21T00:17:32.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.131+0000 7fc8408bb700 1 -- 172.21.15.59:0/754815673 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc83c1562d0 con 0x7fc83c0b5b20 2023-09-21T00:17:32.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.132+0000 7fc8408bb700 1 -- 172.21.15.59:0/754815673 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc83c1eeca0 con 0x7fc83c0b5b20 2023-09-21T00:17:32.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.133+0000 7fc832ffd700 1 -- 172.21.15.59:0/754815673 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fc834023070 con 0x7fc83c0b5b20 2023-09-21T00:17:32.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.133+0000 7fc832ffd700 1 --2- 172.21.15.59:0/754815673 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fc81c06ae00 0x7fc81c06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:32.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.133+0000 7fc832ffd700 1 -- 172.21.15.59:0/754815673 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc83408abe0 con 0x7fc83c0b5b20 2023-09-21T00:17:32.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.133+0000 7fc83a59c700 1 --2- 172.21.15.59:0/754815673 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fc81c06ae00 0x7fc81c06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:32.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.134+0000 7fc83a59c700 1 --2- 172.21.15.59:0/754815673 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fc81c06ae00 0x7fc81c06d2c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc82c009ce0 tx=0x7fc82c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:32.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.137+0000 7fc832ffd700 1 -- 172.21.15.59:0/754815673 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fc834055aa0 con 0x7fc83c0b5b20 2023-09-21T00:17:32.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.339+0000 7fc8408bb700 1 -- 172.21.15.59:0/754815673 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc83c067e50 con 0x7fc83c0b5b20 2023-09-21T00:17:32.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.340+0000 7fc832ffd700 1 -- 172.21.15.59:0/754815673 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18262 (secure 0 0 0) 0x7fc834018020 con 0x7fc83c0b5b20 2023-09-21T00:17:32.341 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:17:32.341 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":24,"fsid":"dd69925c-6e25-42fe-880b-2f60fc6f384b","created":"2023-09-21T00:16:43.074489+0000","modified":"2023-09-21T00:17:11.387529+0000","last_up_change":"2023-09-21T00:16:54.740101+0000","last_in_change":"2023-09-21T00:16:45.987089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T00:16:54.796248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-21T00:17:04.167102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-21T00:17:05.313188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-21T00:17:08.977609+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d4b18344-74c0-4f75-920b-7a9247e48914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6809","nonce":2418314235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6811","nonce":2418314235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6815","nonce":2418314235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6813","nonce":2418314235}]},"public_addr":"172.21.15.59:6809/2418314235","cluster_addr":"172.21.15.59:6811/2418314235","heartbeat_back_addr":"172.21.15.59:6815/2418314235","heartbeat_front_addr":"172.21.15.59:6813/2418314235","state":["exists","up"]},{"osd":1,"uuid":"80940d50-a248-4e64-a282-7ffcdad790ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6801","nonce":869668251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6803","nonce":869668251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6807","nonce":869668251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6805","nonce":869668251}]},"public_addr":"172.21.15.59:6801/869668251","cluster_addr":"172.21.15.59:6803/869668251","heartbeat_back_addr":"172.21.15.59:6807/869668251","heartbeat_front_addr":"172.21.15.59:6805/869668251","state":["exists","up"]},{"osd":2,"uuid":"55f2eceb-c54a-4879-a6ce-968c1c548b5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6817","nonce":372517778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6819","nonce":372517778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6823","nonce":372517778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6821","nonce":372517778}]},"public_addr":"172.21.15.59:6817/372517778","cluster_addr":"172.21.15.59:6819/372517778","heartbeat_back_addr":"172.21.15.59:6823/372517778","heartbeat_front_addr":"172.21.15.59:6821/372517778","state":["exists","up"]},{"osd":3,"uuid":"92b89cd0-869c-49b9-a9f9-97ac8423f304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6825","nonce":575188498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6827","nonce":575188498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6831","nonce":575188498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6829","nonce":575188498}]},"public_addr":"172.21.15.59:6825/575188498","cluster_addr":"172.21.15.59:6827/575188498","heartbeat_back_addr":"172.21.15.59:6831/575188498","heartbeat_front_addr":"172.21.15.59:6829/575188498","state":["exists","up"]},{"osd":4,"uuid":"25b80e94-e0e6-403d-b69f-61542f289637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6803","nonce":1741219098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6805","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6807","nonce":1741219098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6815","nonce":1741219098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6811","nonce":1741219098}]},"public_addr":"172.21.15.83:6803/1741219098","cluster_addr":"172.21.15.83:6807/1741219098","heartbeat_back_addr":"172.21.15.83:6815/1741219098","heartbeat_front_addr":"172.21.15.83:6811/1741219098","state":["exists","up"]},{"osd":5,"uuid":"5498d9ab-1086-4796-a199-9051e6dfea91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6817","nonce":156730565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6819","nonce":156730565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6823","nonce":156730565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6821","nonce":156730565}]},"public_addr":"172.21.15.83:6817/156730565","cluster_addr":"172.21.15.83:6819/156730565","heartbeat_back_addr":"172.21.15.83:6823/156730565","heartbeat_front_addr":"172.21.15.83:6821/156730565","state":["exists","up"]},{"osd":6,"uuid":"cfd810c0-5015-4d60-9a75-7efc93a32e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6801","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6800","nonce":1337723778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6806","nonce":1337723778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6814","nonce":1337723778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6810","nonce":1337723778}]},"public_addr":"172.21.15.83:6800/1337723778","cluster_addr":"172.21.15.83:6806/1337723778","heartbeat_back_addr":"172.21.15.83:6814/1337723778","heartbeat_front_addr":"172.21.15.83:6810/1337723778","state":["exists","up"]},{"osd":7,"uuid":"e992c8fa-0a3d-4b3c-85b5-2c511223dee4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6825","nonce":4204859272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6827","nonce":4204859272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6831","nonce":4204859272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6829","nonce":4204859272}]},"public_addr":"172.21.15.83:6825/4204859272","cluster_addr":"172.21.15.83:6827/4204859272","heartbeat_back_addr":"172.21.15.83:6831/4204859272","heartbeat_front_addr":"172.21.15.83:6829/4204859272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.156498+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.882707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.093978+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.158565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.173933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.888606+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.135525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.149712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T00:17:32.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.342+0000 7fc8408bb700 1 -- 172.21.15.59:0/754815673 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fc81c06ae00 msgr2=0x7fc81c06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:32.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.342+0000 7fc8408bb700 1 --2- 172.21.15.59:0/754815673 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fc81c06ae00 0x7fc81c06d2c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc82c009ce0 tx=0x7fc82c008040 comp rx=0 tx=0).stop 2023-09-21T00:17:32.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.342+0000 7fc8408bb700 1 -- 172.21.15.59:0/754815673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc83c0b5b20 msgr2=0x7fc83c1f2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:32.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.342+0000 7fc8408bb700 1 --2- 172.21.15.59:0/754815673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc83c0b5b20 0x7fc83c1f2640 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc834017040 tx=0x7fc834009750 comp rx=0 tx=0).stop 2023-09-21T00:17:32.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.342+0000 7fc8408bb700 1 -- 172.21.15.59:0/754815673 shutdown_connections 2023-09-21T00:17:32.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.342+0000 7fc8408bb700 1 --2- 172.21.15.59:0/754815673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc83c0b5b20 0x7fc83c1f2640 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:32.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.342+0000 7fc8408bb700 1 --2- 172.21.15.59:0/754815673 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc828004d90 0x7fc83c1ef660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:32.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.342+0000 7fc8408bb700 1 --2- 172.21.15.59:0/754815673 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fc81c06ae00 0x7fc81c06d2c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:32.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.342+0000 7fc8408bb700 1 --2- 172.21.15.59:0/754815673 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc83c0b56a0 0x7fc83c1f2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:32.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.342+0000 7fc8408bb700 1 -- 172.21.15.59:0/754815673 >> 172.21.15.59:0/754815673 conn(0x7fc83c0d0140 msgr2=0x7fc83c159820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:32.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.342+0000 7fc8408bb700 1 -- 172.21.15.59:0/754815673 shutdown_connections 2023-09-21T00:17:32.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.342+0000 7fc8408bb700 1 -- 172.21.15.59:0/754815673 wait complete. 2023-09-21T00:17:32.355 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-09-21T00:17:32.356 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T00:17:32.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.480+0000 7fc492d73700 1 Processor -- start 2023-09-21T00:17:32.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.480+0000 7fc492d73700 1 -- start start 2023-09-21T00:17:32.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.480+0000 7fc492d73700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc48c15a230 0x7fc48c15e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:32.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.480+0000 7fc492d73700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc48c0ca790 0x7fc48c071680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:32.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.480+0000 7fc492d73700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc48c0cabf0 0x7fc48c071bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:32.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.480+0000 7fc492d73700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc48c0cb780 con 0x7fc48c0cabf0 2023-09-21T00:17:32.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.480+0000 7fc492d73700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc48c0cb1c0 con 0x7fc48c15a230 2023-09-21T00:17:32.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.480+0000 7fc492d73700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c0cb4a0 con 0x7fc48c0ca790 2023-09-21T00:17:32.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.481+0000 7fc491310700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc48c0cabf0 0x7fc48c071bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:32.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.481+0000 7fc491310700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc48c0cabf0 0x7fc48c071bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51452/0 (socket says 172.21.15.59:51452) 2023-09-21T00:17:32.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.481+0000 7fc491310700 1 -- 172.21.15.59:0/1148339836 learned_addr learned my addr 172.21.15.59:0/1148339836 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:32.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.481+0000 7fc48bfff700 1 --2- 172.21.15.59:0/1148339836 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc48c0ca790 0x7fc48c071680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:32.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.481+0000 7fc490b0f700 1 --2- 172.21.15.59:0/1148339836 >> v2:172.21.15.83:3300/0 conn(0x7fc48c15a230 0x7fc48c15e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:32.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.481+0000 7fc491310700 1 -- 172.21.15.59:0/1148339836 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc48c0ca790 msgr2=0x7fc48c071680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:32.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.481+0000 7fc491310700 1 --2- 172.21.15.59:0/1148339836 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc48c0ca790 0x7fc48c071680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:32.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.481+0000 7fc491310700 1 -- 172.21.15.59:0/1148339836 >> v2:172.21.15.83:3300/0 conn(0x7fc48c15a230 msgr2=0x7fc48c15e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:32.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.481+0000 7fc491310700 1 --2- 172.21.15.59:0/1148339836 >> v2:172.21.15.83:3300/0 conn(0x7fc48c15a230 0x7fc48c15e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:32.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.481+0000 7fc491310700 1 -- 172.21.15.59:0/1148339836 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc48c15e0b0 con 0x7fc48c0cabf0 2023-09-21T00:17:32.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.481+0000 7fc48bfff700 1 --2- 172.21.15.59:0/1148339836 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc48c0ca790 0x7fc48c071680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:17:32.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.481+0000 7fc491310700 1 --2- 172.21.15.59:0/1148339836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc48c0cabf0 0x7fc48c071bc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc48c0cbb60 tx=0x7fc48400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=476855bf880b17b3 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:32.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.481+0000 7fc48b7fe700 1 -- 172.21.15.59:0/1148339836 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48400e070 con 0x7fc48c0cabf0 2023-09-21T00:17:32.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.481+0000 7fc48b7fe700 1 -- 172.21.15.59:0/1148339836 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc48400b910 con 0x7fc48c0cabf0 2023-09-21T00:17:32.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.481+0000 7fc48b7fe700 1 -- 172.21.15.59:0/1148339836 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48400bcc0 con 0x7fc48c0cabf0 2023-09-21T00:17:32.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.482+0000 7fc492d73700 1 -- 172.21.15.59:0/1148339836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc48c0cabf0 msgr2=0x7fc48c071bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:32.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.482+0000 7fc492d73700 1 --2- 172.21.15.59:0/1148339836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc48c0cabf0 0x7fc48c071bc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc48c0cbb60 tx=0x7fc48400b330 comp rx=0 tx=0).stop 2023-09-21T00:17:32.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.482+0000 7fc492d73700 1 -- 172.21.15.59:0/1148339836 shutdown_connections 2023-09-21T00:17:32.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.482+0000 7fc492d73700 1 --2- 172.21.15.59:0/1148339836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc48c0cabf0 0x7fc48c071bc0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:32.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.482+0000 7fc492d73700 1 --2- 172.21.15.59:0/1148339836 >> v2:172.21.15.83:3300/0 conn(0x7fc48c15a230 0x7fc48c15e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:32.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.482+0000 7fc492d73700 1 --2- 172.21.15.59:0/1148339836 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc48c0ca790 0x7fc48c071680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:32.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.482+0000 7fc492d73700 1 -- 172.21.15.59:0/1148339836 >> 172.21.15.59:0/1148339836 conn(0x7fc48c0d0140 msgr2=0x7fc48c0d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:32.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.482+0000 7fc492d73700 1 -- 172.21.15.59:0/1148339836 shutdown_connections 2023-09-21T00:17:32.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.482+0000 7fc492d73700 1 -- 172.21.15.59:0/1148339836 wait complete. 2023-09-21T00:17:32.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.483+0000 7fc492d73700 1 Processor -- start 2023-09-21T00:17:32.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.483+0000 7fc492d73700 1 -- start start 2023-09-21T00:17:32.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.484+0000 7fc492d73700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc48c0ca790 0x7fc48c158700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:32.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.484+0000 7fc492d73700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc48c0cabf0 0x7fc48c0c5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:32.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.484+0000 7fc492d73700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc48c15a230 0x7fc48c0c6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:32.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.484+0000 7fc492d73700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c15b9e0 con 0x7fc48c0ca790 2023-09-21T00:17:32.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.484+0000 7fc492d73700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c15bcc0 con 0x7fc48c0cabf0 2023-09-21T00:17:32.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.484+0000 7fc492d73700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c15bfa0 con 0x7fc48c15a230 2023-09-21T00:17:32.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.484+0000 7fc490b0f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc48c0ca790 0x7fc48c158700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:32.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.484+0000 7fc490b0f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc48c0ca790 0x7fc48c158700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51454/0 (socket says 172.21.15.59:51454) 2023-09-21T00:17:32.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.484+0000 7fc490b0f700 1 -- 172.21.15.59:0/551572437 learned_addr learned my addr 172.21.15.59:0/551572437 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:32.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.484+0000 7fc48bfff700 1 --2- 172.21.15.59:0/551572437 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc48c0cabf0 0x7fc48c0c5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:32.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.484+0000 7fc491310700 1 --2- 172.21.15.59:0/551572437 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc48c15a230 0x7fc48c0c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:32.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.484+0000 7fc490b0f700 1 -- 172.21.15.59:0/551572437 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc48c15a230 msgr2=0x7fc48c0c6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:32.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.484+0000 7fc490b0f700 1 --2- 172.21.15.59:0/551572437 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc48c15a230 0x7fc48c0c6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:32.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.485+0000 7fc490b0f700 1 -- 172.21.15.59:0/551572437 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc48c0cabf0 msgr2=0x7fc48c0c5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:32.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.485+0000 7fc490b0f700 1 --2- 172.21.15.59:0/551572437 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc48c0cabf0 0x7fc48c0c5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:32.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.485+0000 7fc490b0f700 1 -- 172.21.15.59:0/551572437 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc484009b30 con 0x7fc48c0ca790 2023-09-21T00:17:32.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.485+0000 7fc491310700 1 --2- 172.21.15.59:0/551572437 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc48c15a230 0x7fc48c0c6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:17:32.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.485+0000 7fc48bfff700 1 --2- 172.21.15.59:0/551572437 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc48c0cabf0 0x7fc48c0c5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:17:32.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.485+0000 7fc490b0f700 1 --2- 172.21.15.59:0/551572437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc48c0ca790 0x7fc48c158700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc48000e870 tx=0x7fc48000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:32.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.485+0000 7fc4897fa700 1 -- 172.21.15.59:0/551572437 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc480009590 con 0x7fc48c0ca790 2023-09-21T00:17:32.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.485+0000 7fc4897fa700 1 -- 172.21.15.59:0/551572437 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc48000ee70 con 0x7fc48c0ca790 2023-09-21T00:17:32.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.485+0000 7fc492d73700 1 -- 172.21.15.59:0/551572437 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc48c15c280 con 0x7fc48c0ca790 2023-09-21T00:17:32.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.485+0000 7fc4897fa700 1 -- 172.21.15.59:0/551572437 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48000ca50 con 0x7fc48c0ca790 2023-09-21T00:17:32.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.485+0000 7fc492d73700 1 -- 172.21.15.59:0/551572437 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc48c15ca80 con 0x7fc48c0ca790 2023-09-21T00:17:32.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.486+0000 7fc492d73700 1 -- 172.21.15.59:0/551572437 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc48c067e50 con 0x7fc48c0ca790 2023-09-21T00:17:32.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.486+0000 7fc4897fa700 1 -- 172.21.15.59:0/551572437 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fc48000cbb0 con 0x7fc48c0ca790 2023-09-21T00:17:32.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.487+0000 7fc4897fa700 1 --2- 172.21.15.59:0/551572437 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fc47006ae00 0x7fc47006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:32.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.487+0000 7fc4897fa700 1 -- 172.21.15.59:0/551572437 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc480089730 con 0x7fc48c0ca790 2023-09-21T00:17:32.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.487+0000 7fc48bfff700 1 --2- 172.21.15.59:0/551572437 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fc47006ae00 0x7fc47006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:32.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.487+0000 7fc48bfff700 1 --2- 172.21.15.59:0/551572437 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fc47006ae00 0x7fc47006d2c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc4780099e0 tx=0x7fc478008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:32.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.491+0000 7fc4897fa700 1 -- 172.21.15.59:0/551572437 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fc4800545f0 con 0x7fc48c0ca790 2023-09-21T00:17:32.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.692+0000 7fc492d73700 1 -- 172.21.15.59:0/551572437 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc48c15c8d0 con 0x7fc48c0ca790 2023-09-21T00:17:32.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.693+0000 7fc4897fa700 1 -- 172.21.15.59:0/551572437 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18262 (secure 0 0 0) 0x7fc48000ce60 con 0x7fc48c0ca790 2023-09-21T00:17:32.695 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:17:32.695 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":24,"fsid":"dd69925c-6e25-42fe-880b-2f60fc6f384b","created":"2023-09-21T00:16:43.074489+0000","modified":"2023-09-21T00:17:11.387529+0000","last_up_change":"2023-09-21T00:16:54.740101+0000","last_in_change":"2023-09-21T00:16:45.987089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T00:16:54.796248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-21T00:17:04.167102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-21T00:17:05.313188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-21T00:17:08.977609+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d4b18344-74c0-4f75-920b-7a9247e48914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6809","nonce":2418314235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6811","nonce":2418314235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6815","nonce":2418314235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6813","nonce":2418314235}]},"public_addr":"172.21.15.59:6809/2418314235","cluster_addr":"172.21.15.59:6811/2418314235","heartbeat_back_addr":"172.21.15.59:6815/2418314235","heartbeat_front_addr":"172.21.15.59:6813/2418314235","state":["exists","up"]},{"osd":1,"uuid":"80940d50-a248-4e64-a282-7ffcdad790ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6801","nonce":869668251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6803","nonce":869668251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6807","nonce":869668251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6805","nonce":869668251}]},"public_addr":"172.21.15.59:6801/869668251","cluster_addr":"172.21.15.59:6803/869668251","heartbeat_back_addr":"172.21.15.59:6807/869668251","heartbeat_front_addr":"172.21.15.59:6805/869668251","state":["exists","up"]},{"osd":2,"uuid":"55f2eceb-c54a-4879-a6ce-968c1c548b5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6817","nonce":372517778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6819","nonce":372517778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6823","nonce":372517778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6821","nonce":372517778}]},"public_addr":"172.21.15.59:6817/372517778","cluster_addr":"172.21.15.59:6819/372517778","heartbeat_back_addr":"172.21.15.59:6823/372517778","heartbeat_front_addr":"172.21.15.59:6821/372517778","state":["exists","up"]},{"osd":3,"uuid":"92b89cd0-869c-49b9-a9f9-97ac8423f304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6825","nonce":575188498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6827","nonce":575188498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6831","nonce":575188498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6829","nonce":575188498}]},"public_addr":"172.21.15.59:6825/575188498","cluster_addr":"172.21.15.59:6827/575188498","heartbeat_back_addr":"172.21.15.59:6831/575188498","heartbeat_front_addr":"172.21.15.59:6829/575188498","state":["exists","up"]},{"osd":4,"uuid":"25b80e94-e0e6-403d-b69f-61542f289637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6803","nonce":1741219098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6805","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6807","nonce":1741219098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6815","nonce":1741219098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6811","nonce":1741219098}]},"public_addr":"172.21.15.83:6803/1741219098","cluster_addr":"172.21.15.83:6807/1741219098","heartbeat_back_addr":"172.21.15.83:6815/1741219098","heartbeat_front_addr":"172.21.15.83:6811/1741219098","state":["exists","up"]},{"osd":5,"uuid":"5498d9ab-1086-4796-a199-9051e6dfea91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6817","nonce":156730565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6819","nonce":156730565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6823","nonce":156730565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6821","nonce":156730565}]},"public_addr":"172.21.15.83:6817/156730565","cluster_addr":"172.21.15.83:6819/156730565","heartbeat_back_addr":"172.21.15.83:6823/156730565","heartbeat_front_addr":"172.21.15.83:6821/156730565","state":["exists","up"]},{"osd":6,"uuid":"cfd810c0-5015-4d60-9a75-7efc93a32e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6801","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6800","nonce":1337723778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6806","nonce":1337723778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6814","nonce":1337723778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6810","nonce":1337723778}]},"public_addr":"172.21.15.83:6800/1337723778","cluster_addr":"172.21.15.83:6806/1337723778","heartbeat_back_addr":"172.21.15.83:6814/1337723778","heartbeat_front_addr":"172.21.15.83:6810/1337723778","state":["exists","up"]},{"osd":7,"uuid":"e992c8fa-0a3d-4b3c-85b5-2c511223dee4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6825","nonce":4204859272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6827","nonce":4204859272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6831","nonce":4204859272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6829","nonce":4204859272}]},"public_addr":"172.21.15.83:6825/4204859272","cluster_addr":"172.21.15.83:6827/4204859272","heartbeat_back_addr":"172.21.15.83:6831/4204859272","heartbeat_front_addr":"172.21.15.83:6829/4204859272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.156498+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.882707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.093978+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.158565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.173933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.888606+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.135525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.149712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T00:17:32.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.696+0000 7fc492d73700 1 -- 172.21.15.59:0/551572437 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fc47006ae00 msgr2=0x7fc47006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:32.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.696+0000 7fc492d73700 1 --2- 172.21.15.59:0/551572437 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fc47006ae00 0x7fc47006d2c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc4780099e0 tx=0x7fc478008040 comp rx=0 tx=0).stop 2023-09-21T00:17:32.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.696+0000 7fc492d73700 1 -- 172.21.15.59:0/551572437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc48c0ca790 msgr2=0x7fc48c158700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:32.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.696+0000 7fc492d73700 1 --2- 172.21.15.59:0/551572437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc48c0ca790 0x7fc48c158700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc48000e870 tx=0x7fc48000ec30 comp rx=0 tx=0).stop 2023-09-21T00:17:32.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.696+0000 7fc492d73700 1 -- 172.21.15.59:0/551572437 shutdown_connections 2023-09-21T00:17:32.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.696+0000 7fc492d73700 1 --2- 172.21.15.59:0/551572437 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fc47006ae00 0x7fc47006d2c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:32.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.696+0000 7fc492d73700 1 --2- 172.21.15.59:0/551572437 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc48c15a230 0x7fc48c0c6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:32.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.696+0000 7fc492d73700 1 --2- 172.21.15.59:0/551572437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc48c0ca790 0x7fc48c158700 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:32.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.696+0000 7fc492d73700 1 --2- 172.21.15.59:0/551572437 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc48c0cabf0 0x7fc48c0c5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:32.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.696+0000 7fc492d73700 1 -- 172.21.15.59:0/551572437 >> 172.21.15.59:0/551572437 conn(0x7fc48c0d0140 msgr2=0x7fc48c1598b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:32.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.696+0000 7fc492d73700 1 -- 172.21.15.59:0/551572437 shutdown_connections 2023-09-21T00:17:32.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.696+0000 7fc492d73700 1 -- 172.21.15.59:0/551572437 wait complete. 2023-09-21T00:17:32.710 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-09-21T00:17:32.710 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-09-21T00:17:32.711 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-09-21T00:17:32.711 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-09-21T00:17:32.712 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-09-21T00:17:32.712 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-09-21T00:17:32.713 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-09-21T00:17:32.713 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-09-21T00:17:32.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.929+0000 7f8d0f9cf700 1 Processor -- start 2023-09-21T00:17:32.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.929+0000 7f8d0f9cf700 1 -- start start 2023-09-21T00:17:32.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.930+0000 7f8d0f9cf700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8d0816a540 0x7f8d080cf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:32.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.930+0000 7f8d0f9cf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8d0808a2a0 0x7f8d0808a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:32.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.930+0000 7f8d0f9cf700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d0806e5e0 con 0x7f8d080cf680 2023-09-21T00:17:32.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.930+0000 7f8d0f9cf700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d0808ac90 con 0x7f8d0808a2a0 2023-09-21T00:17:32.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.930+0000 7f8d0f9cf700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d080ce380 con 0x7f8d0816a540 2023-09-21T00:17:32.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.930+0000 7f8d0df6c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8d0808a2a0 0x7f8d0808a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:32.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.930+0000 7f8d0df6c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8d0808a2a0 0x7f8d0808a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51466/0 (socket says 172.21.15.59:51466) 2023-09-21T00:17:32.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.931+0000 7f8d0df6c700 1 -- 172.21.15.59:0/703753828 learned_addr learned my addr 172.21.15.59:0/703753828 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:32.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.931+0000 7f8d0d76b700 1 --2- 172.21.15.59:0/703753828 >> v2:172.21.15.83:3300/0 conn(0x7f8d0816a540 0x7f8d080cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:32.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.933+0000 7fbdc354f700 1 Processor -- start 2023-09-21T00:17:32.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.933+0000 7f8d0df6c700 1 -- 172.21.15.59:0/703753828 >> v2:172.21.15.83:3300/0 conn(0x7f8d0816a540 msgr2=0x7f8d080cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:32.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.933+0000 7f8d0df6c700 1 --2- 172.21.15.59:0/703753828 >> v2:172.21.15.83:3300/0 conn(0x7f8d0816a540 0x7f8d080cf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:32.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.933+0000 7f8d0df6c700 1 -- 172.21.15.59:0/703753828 >> v1:172.21.15.83:6789/0 conn(0x7f8d080cf680 legacy=0x7f8d080b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:32.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.933+0000 7f8d0df6c700 1 -- 172.21.15.59:0/703753828 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d080ce660 con 0x7f8d0808a2a0 2023-09-21T00:17:32.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.933+0000 7f8d0df6c700 1 --2- 172.21.15.59:0/703753828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d0808a2a0 0x7f8d0808a750 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8d080ccaf0 tx=0x7f8d0000a870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29a391663cafe77e server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:32.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.934+0000 7fd94fa35700 1 Processor -- start 2023-09-21T00:17:32.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.934+0000 7fd94fa35700 1 -- start start 2023-09-21T00:17:32.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.935+0000 7fd94fa35700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd9480ae130 0x7fd94815e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:32.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.935+0000 7fd94fa35700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9480ae510 0x7fd94806e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:32.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.935+0000 7fd94fa35700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd9480cf240 0x7fd948154200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:32.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.935+0000 7fd94fa35700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd94806ef80 con 0x7fd9480cf240 2023-09-21T00:17:32.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.935+0000 7fd94fa35700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd94806ed20 con 0x7fd9480ae130 2023-09-21T00:17:32.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.935+0000 7fd94fa35700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9480ce480 con 0x7fd9480ae510 2023-09-21T00:17:32.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.935+0000 7fd94dfd2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd9480cf240 0x7fd948154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:32.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.935+0000 7fd94dfd2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd9480cf240 0x7fd948154200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51472/0 (socket says 172.21.15.59:51472) 2023-09-21T00:17:32.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.935+0000 7fd94dfd2700 1 -- 172.21.15.59:0/2869567097 learned_addr learned my addr 172.21.15.59:0/2869567097 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:32.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.935+0000 7fd94d7d1700 1 --2- 172.21.15.59:0/2869567097 >> v2:172.21.15.83:3300/0 conn(0x7fd9480ae130 0x7fd94815e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:32.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.935+0000 7fd94cfd0700 1 --2- 172.21.15.59:0/2869567097 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9480ae510 0x7fd94806e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:32.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.935+0000 7fd94d7d1700 1 -- 172.21.15.59:0/2869567097 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9480ae510 msgr2=0x7fd94806e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:32.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.935+0000 7fd94d7d1700 1 --2- 172.21.15.59:0/2869567097 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9480ae510 0x7fd94806e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:32.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.935+0000 7fd94d7d1700 1 -- 172.21.15.59:0/2869567097 >> v2:172.21.15.59:3300/0 conn(0x7fd9480cf240 msgr2=0x7fd948154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:32.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.935+0000 7fd94d7d1700 1 --2- 172.21.15.59:0/2869567097 >> v2:172.21.15.59:3300/0 conn(0x7fd9480cf240 0x7fd948154200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:32.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.935+0000 7fd94d7d1700 1 -- 172.21.15.59:0/2869567097 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9480ce760 con 0x7fd9480ae130 2023-09-21T00:17:32.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.936+0000 7fd94cfd0700 1 --2- 172.21.15.59:0/2869567097 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9480ae510 0x7fd94806e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T00:17:32.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.936+0000 7fd94d7d1700 1 --2- 172.21.15.59:0/2869567097 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9480ae130 0x7fd94815e7e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd9480d0070 tx=0x7fd944009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98eeceaee8cdb400 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:32.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.936+0000 7fd93ffff700 1 -- 172.21.15.59:0/2869567097 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd944011830 con 0x7fd9480ae130 2023-09-21T00:17:32.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.936+0000 7fd93ffff700 1 -- 172.21.15.59:0/2869567097 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd944011990 con 0x7fd9480ae130 2023-09-21T00:17:32.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.936+0000 7fd93ffff700 1 -- 172.21.15.59:0/2869567097 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd944011d20 con 0x7fd9480ae130 2023-09-21T00:17:32.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.931+0000 7f8cfffff700 1 -- 172.21.15.59:0/703753828 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1998714462 0 0) 0x7f8d0806e5e0 con 0x7f8d080cf680 2023-09-21T00:17:32.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.933+0000 7f6a174bd700 1 Processor -- start 2023-09-21T00:17:32.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.934+0000 7f6a174bd700 1 -- start start 2023-09-21T00:17:32.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.935+0000 7f6a174bd700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6a100ca8c0 0x7f6a100c2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:32.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.935+0000 7f6a174bd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6a100caca0 0x7f6a1006d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:32.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.935+0000 7f6a174bd700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a100c3430 con 0x7f6a100cf000 2023-09-21T00:17:32.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.935+0000 7f6a174bd700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a100cdf60 con 0x7f6a100ca8c0 2023-09-21T00:17:32.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.935+0000 7f6a174bd700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a100ce240 con 0x7f6a100caca0 2023-09-21T00:17:32.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.935+0000 7f6a14a58700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6a100caca0 0x7f6a1006d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:32.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.935+0000 7f6a14a58700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6a100caca0 0x7f6a1006d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.59:52090/0 (socket says 172.21.15.59:52090) 2023-09-21T00:17:32.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.935+0000 7f6a14a58700 1 -- 172.21.15.59:0/105268867 learned_addr learned my addr 172.21.15.59:0/105268867 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:32.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.936+0000 7f6a14a58700 1 -- 172.21.15.59:0/105268867 >> v2:172.21.15.83:3300/0 conn(0x7f6a100ca8c0 msgr2=0x7f6a100c2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:32.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.936+0000 7f6a14a58700 1 --2- 172.21.15.59:0/105268867 >> v2:172.21.15.83:3300/0 conn(0x7f6a100ca8c0 0x7f6a100c2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:32.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.936+0000 7f6a14a58700 1 -- 172.21.15.59:0/105268867 >> v1:172.21.15.59:6789/0 conn(0x7f6a100cf000 legacy=0x7f6a100cf490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:32.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.936+0000 7f6a14a58700 1 -- 172.21.15.59:0/105268867 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a100ce520 con 0x7f6a100caca0 2023-09-21T00:17:32.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.936+0000 7f6a14a58700 1 --2- 172.21.15.59:0/105268867 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6a100caca0 0x7f6a1006d920 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6a000098f0 tx=0x7f6a00009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82d4b345293a72b0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:32.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.936+0000 7f6a07fff700 1 -- 172.21.15.59:0/105268867 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0000b8a0 con 0x7f6a100caca0 2023-09-21T00:17:32.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.936+0000 7f6a07fff700 1 -- 172.21.15.59:0/105268867 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0000ba00 con 0x7f6a100caca0 2023-09-21T00:17:32.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.936+0000 7f6a07fff700 1 -- 172.21.15.59:0/105268867 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0000bd90 con 0x7f6a100caca0 2023-09-21T00:17:32.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.937+0000 7fbdc354f700 1 -- start start 2023-09-21T00:17:32.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.937+0000 7fd94fa35700 1 -- 172.21.15.59:0/2869567097 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9480ae130 msgr2=0x7fd94815e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:32.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.937+0000 7fd94fa35700 1 --2- 172.21.15.59:0/2869567097 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9480ae130 0x7fd94815e7e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd9480d0070 tx=0x7fd944009b20 comp rx=0 tx=0).stop 2023-09-21T00:17:32.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.937+0000 7fd94fa35700 1 -- 172.21.15.59:0/2869567097 shutdown_connections 2023-09-21T00:17:32.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.937+0000 7fd94fa35700 1 --2- 172.21.15.59:0/2869567097 >> v2:172.21.15.59:3300/0 conn(0x7fd9480cf240 0x7fd948154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:32.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.937+0000 7fd94fa35700 1 --2- 172.21.15.59:0/2869567097 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9480ae130 0x7fd94815e7e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:32.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.937+0000 7fd94fa35700 1 --2- 172.21.15.59:0/2869567097 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9480ae510 0x7fd94806e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:32.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.937+0000 7fd94fa35700 1 -- 172.21.15.59:0/2869567097 >> 172.21.15.59:0/2869567097 conn(0x7fd94806c7c0 msgr2=0x7fd94806cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:32.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.937+0000 7fd94fa35700 1 -- 172.21.15.59:0/2869567097 shutdown_connections 2023-09-21T00:17:32.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.937+0000 7f6a174bd700 1 -- 172.21.15.59:0/105268867 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6a100caca0 msgr2=0x7f6a1006d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:32.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.937+0000 7f6a174bd700 1 --2- 172.21.15.59:0/105268867 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6a100caca0 0x7f6a1006d920 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6a000098f0 tx=0x7f6a00009c00 comp rx=0 tx=0).stop 2023-09-21T00:17:32.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.938+0000 7fbdc354f700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbdbc159a20 0x7fbdbc0b1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:32.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.938+0000 7fbdc354f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbdbc0ce9a0 0x7fbdbc072320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:32.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.938+0000 7fbdc354f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbdbc0b0b90 0x7fbdbc0b1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:32.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.938+0000 7fbdc354f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdbc0b1580 con 0x7fbdbc0ce9a0 2023-09-21T00:17:32.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.938+0000 7fbdc354f700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdbc0cfc90 con 0x7fbdbc159a20 2023-09-21T00:17:32.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.938+0000 7fbdc354f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc072860 con 0x7fbdbc0b0b90 2023-09-21T00:17:32.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.938+0000 7fbdc1aec700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbdbc0b0b90 0x7fbdbc0b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:32.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.938+0000 7fbdc12eb700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbdbc159a20 0x7fbdbc0b1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:32.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.938+0000 7fbdc1aec700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbdbc0b0b90 0x7fbdbc0b1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.59:52098/0 (socket says 172.21.15.59:52098) 2023-09-21T00:17:32.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.938+0000 7fbdc1aec700 1 -- 172.21.15.59:0/3269869898 learned_addr learned my addr 172.21.15.59:0/3269869898 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:32.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.938+0000 7fbdc0aea700 1 --2- 172.21.15.59:0/3269869898 >> v2:172.21.15.59:3300/0 conn(0x7fbdbc0ce9a0 0x7fbdbc072320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:32.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.938+0000 7fbdc12eb700 1 -- 172.21.15.59:0/3269869898 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbdbc0b0b90 msgr2=0x7fbdbc0b1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:32.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.938+0000 7fbdc12eb700 1 --2- 172.21.15.59:0/3269869898 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbdbc0b0b90 0x7fbdbc0b1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:32.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.938+0000 7fbdc12eb700 1 -- 172.21.15.59:0/3269869898 >> v2:172.21.15.59:3300/0 conn(0x7fbdbc0ce9a0 msgr2=0x7fbdbc072320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:32.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.939+0000 7fbdc12eb700 1 --2- 172.21.15.59:0/3269869898 >> v2:172.21.15.59:3300/0 conn(0x7fbdbc0ce9a0 0x7fbdbc072320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:32.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.939+0000 7fbdc12eb700 1 -- 172.21.15.59:0/3269869898 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdbc0cf080 con 0x7fbdbc159a20 2023-09-21T00:17:32.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.939+0000 7fbdc0aea700 1 --2- 172.21.15.59:0/3269869898 >> v2:172.21.15.59:3300/0 conn(0x7fbdbc0ce9a0 0x7fbdbc072320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:17:32.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.939+0000 7fbdc12eb700 1 --2- 172.21.15.59:0/3269869898 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbdbc159a20 0x7fbdbc0b1f00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc0cbfc0 tx=0x7fbdb8009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ed024534ac29214 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:32.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.937+0000 7fd94fa35700 1 -- 172.21.15.59:0/2869567097 wait complete. 2023-09-21T00:17:32.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.939+0000 7fbdb3fff700 1 -- 172.21.15.59:0/3269869898 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb8011830 con 0x7fbdbc159a20 2023-09-21T00:17:32.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.939+0000 7fd94fa35700 1 Processor -- start 2023-09-21T00:17:32.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.939+0000 7fbdb3fff700 1 -- 172.21.15.59:0/3269869898 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb8011990 con 0x7fbdbc159a20 2023-09-21T00:17:32.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.939+0000 7fbdb3fff700 1 -- 172.21.15.59:0/3269869898 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb8011d20 con 0x7fbdbc159a20 2023-09-21T00:17:32.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.940+0000 7fbdc354f700 1 -- 172.21.15.59:0/3269869898 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbdbc159a20 msgr2=0x7fbdbc0b1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:32.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.940+0000 7fbdc354f700 1 --2- 172.21.15.59:0/3269869898 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbdbc159a20 0x7fbdbc0b1f00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc0cbfc0 tx=0x7fbdb8009b20 comp rx=0 tx=0).stop 2023-09-21T00:17:32.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.940+0000 7fbdc354f700 1 -- 172.21.15.59:0/3269869898 shutdown_connections 2023-09-21T00:17:32.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.940+0000 7fbdc354f700 1 --2- 172.21.15.59:0/3269869898 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbdbc0b0b90 0x7fbdbc0b1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:32.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.940+0000 7fbdc354f700 1 --2- 172.21.15.59:0/3269869898 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbdbc159a20 0x7fbdbc0b1f00 secure :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc0cbfc0 tx=0x7fbdb8009b20 comp rx=0 tx=0).stop 2023-09-21T00:17:32.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.940+0000 7fbdc354f700 1 --2- 172.21.15.59:0/3269869898 >> v2:172.21.15.59:3300/0 conn(0x7fbdbc0ce9a0 0x7fbdbc072320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:32.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.940+0000 7fbdc354f700 1 -- 172.21.15.59:0/3269869898 >> 172.21.15.59:0/3269869898 conn(0x7fbdbc06de70 msgr2=0x7fbdbc06a780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:32.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.940+0000 7f8cfffff700 1 -- 172.21.15.59:0/703753828 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d00003a70 con 0x7f8d0808a2a0 2023-09-21T00:17:32.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.940+0000 7f8cfffff700 1 -- 172.21.15.59:0/703753828 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d00003bd0 con 0x7f8d0808a2a0 2023-09-21T00:17:32.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.940+0000 7f8cfffff700 1 -- 172.21.15.59:0/703753828 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0000b9d0 con 0x7f8d0808a2a0 2023-09-21T00:17:32.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.939+0000 7fd94fa35700 1 -- start start 2023-09-21T00:17:32.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.940+0000 7fd94fa35700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9480ae130 0x7fd948200960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:32.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.940+0000 7fd94fa35700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9480ae510 0x7fd948159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:32.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.940+0000 7fd94fa35700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9480cf240 0x7fd9480b2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:32.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.940+0000 7fd94fa35700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd948200ea0 con 0x7fd9480cf240 2023-09-21T00:17:32.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.940+0000 7fd94fa35700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd948157ec0 con 0x7fd9480ae510 2023-09-21T00:17:32.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.940+0000 7fd94fa35700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9481581a0 con 0x7fd9480ae130 2023-09-21T00:17:32.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.940+0000 7fbdc354f700 1 -- 172.21.15.59:0/3269869898 shutdown_connections 2023-09-21T00:17:32.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.941+0000 7fd94dfd2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9480cf240 0x7fd9480b2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:32.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.941+0000 7fd94dfd2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9480cf240 0x7fd9480b2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51486/0 (socket says 172.21.15.59:51486) 2023-09-21T00:17:32.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.941+0000 7fd94dfd2700 1 -- 172.21.15.59:0/1287875828 learned_addr learned my addr 172.21.15.59:0/1287875828 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:32.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.941+0000 7fd94d7d1700 1 --2- 172.21.15.59:0/1287875828 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9480ae130 0x7fd948200960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:32.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.941+0000 7fd94cfd0700 1 --2- 172.21.15.59:0/1287875828 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9480ae510 0x7fd948159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:32.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.941+0000 7fd94dfd2700 1 -- 172.21.15.59:0/1287875828 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9480ae130 msgr2=0x7fd948200960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:32.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.941+0000 7fd94dfd2700 1 --2- 172.21.15.59:0/1287875828 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9480ae130 0x7fd948200960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:32.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.941+0000 7fd94dfd2700 1 -- 172.21.15.59:0/1287875828 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9480ae510 msgr2=0x7fd948159cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:32.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.941+0000 7fd94dfd2700 1 --2- 172.21.15.59:0/1287875828 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9480ae510 0x7fd948159cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:32.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.941+0000 7fd94dfd2700 1 -- 172.21.15.59:0/1287875828 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9380094a0 con 0x7fd9480cf240 2023-09-21T00:17:32.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.941+0000 7f8d0f9cf700 1 -- 172.21.15.59:0/703753828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d0808a2a0 msgr2=0x7f8d0808a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:32.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.941+0000 7f8d0f9cf700 1 --2- 172.21.15.59:0/703753828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d0808a2a0 0x7f8d0808a750 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8d080ccaf0 tx=0x7f8d0000a870 comp rx=0 tx=0).stop 2023-09-21T00:17:32.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.941+0000 7fd94dfd2700 1 --2- 172.21.15.59:0/1287875828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9480cf240 0x7fd9480b2f70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd94000efc0 tx=0x7fd94000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:32.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.942+0000 7f8d0f9cf700 1 -- 172.21.15.59:0/703753828 shutdown_connections 2023-09-21T00:17:32.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.942+0000 7f8d0f9cf700 1 --2- 172.21.15.59:0/703753828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d0808a2a0 0x7f8d0808a750 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:32.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.942+0000 7f8d0f9cf700 1 --2- 172.21.15.59:0/703753828 >> v2:172.21.15.83:3300/0 conn(0x7f8d0816a540 0x7f8d080cf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:32.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.942+0000 7f8d0f9cf700 1 -- 172.21.15.59:0/703753828 >> 172.21.15.59:0/703753828 conn(0x7f8d0806c7c0 msgr2=0x7f8d0806cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:32.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.942+0000 7fd93dffb700 1 -- 172.21.15.59:0/1287875828 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd940003c70 con 0x7fd9480cf240 2023-09-21T00:17:32.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.942+0000 7fd93dffb700 1 -- 172.21.15.59:0/1287875828 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd94000f040 con 0x7fd9480cf240 2023-09-21T00:17:32.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.942+0000 7fd93dffb700 1 -- 172.21.15.59:0/1287875828 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd940009e60 con 0x7fd9480cf240 2023-09-21T00:17:32.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.942+0000 7fd94fa35700 1 -- 172.21.15.59:0/1287875828 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9440094a0 con 0x7fd9480cf240 2023-09-21T00:17:32.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.942+0000 7f8d0f9cf700 1 -- 172.21.15.59:0/703753828 shutdown_connections 2023-09-21T00:17:32.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.942+0000 7f8d0f9cf700 1 -- 172.21.15.59:0/703753828 wait complete. 2023-09-21T00:17:32.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.940+0000 7fbdc354f700 1 -- 172.21.15.59:0/3269869898 wait complete. 2023-09-21T00:17:32.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.942+0000 7fbdc354f700 1 Processor -- start 2023-09-21T00:17:32.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.942+0000 7fd94fa35700 1 -- 172.21.15.59:0/1287875828 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd948158760 con 0x7fd9480cf240 2023-09-21T00:17:32.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.943+0000 7fee3deb4700 1 Processor -- start 2023-09-21T00:17:32.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.943+0000 7fee3deb4700 1 -- start start 2023-09-21T00:17:32.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.943+0000 7fbdc354f700 1 -- start start 2023-09-21T00:17:32.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.944+0000 7fbdc354f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbdbc0b0b90 0x7fbdbc200580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:32.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.944+0000 7fbdc354f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbdbc0ce9a0 0x7fbdbc0a8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:32.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.944+0000 7fbdc354f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdbc0a8fa0 0x7fbdbc167bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:32.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.944+0000 7fbdc354f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc150250 con 0x7fbdbc0a8fa0 2023-09-21T00:17:32.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.944+0000 7fbdc354f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc0a9430 con 0x7fbdbc0ce9a0 2023-09-21T00:17:32.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.944+0000 7fbdc354f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc1688c0 con 0x7fbdbc0b0b90 2023-09-21T00:17:32.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.944+0000 7fbdc0aea700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbdbc0ce9a0 0x7fbdbc0a8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:32.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.944+0000 7fbdc0aea700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbdbc0ce9a0 0x7fbdbc0a8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.59:37610/0 (socket says 172.21.15.59:37610) 2023-09-21T00:17:32.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.944+0000 7fbdc0aea700 1 -- 172.21.15.59:0/1128075088 learned_addr learned my addr 172.21.15.59:0/1128075088 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:32.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.944+0000 7fbdc12eb700 1 --2- 172.21.15.59:0/1128075088 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbdbc0b0b90 0x7fbdbc200580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:32.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.944+0000 7f8d0f9cf700 1 Processor -- start 2023-09-21T00:17:32.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.944+0000 7f8d0f9cf700 1 -- start start 2023-09-21T00:17:32.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.944+0000 7fee3deb4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fee3808a2a0 0x7fee3808a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:32.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.944+0000 7fee3deb4700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fee380b3140 0x7fee38071ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:32.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.944+0000 7fee3deb4700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee3808abc0 con 0x7fee380b35f0 2023-09-21T00:17:32.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.944+0000 7fee3deb4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee380b2450 con 0x7fee3808a2a0 2023-09-21T00:17:32.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.944+0000 7fee3deb4700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee3816a780 con 0x7fee380b3140 2023-09-21T00:17:32.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.945+0000 7fee377fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fee3808a2a0 0x7fee3808a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:32.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.945+0000 7fee377fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fee3808a2a0 0x7fee3808a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51498/0 (socket says 172.21.15.59:51498) 2023-09-21T00:17:32.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.945+0000 7fee377fe700 1 -- 172.21.15.59:0/3053676830 learned_addr learned my addr 172.21.15.59:0/3053676830 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:32.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.943+0000 7f6a174bd700 1 -- 172.21.15.59:0/105268867 shutdown_connections 2023-09-21T00:17:32.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.943+0000 7f6a174bd700 1 --2- 172.21.15.59:0/105268867 >> v2:172.21.15.83:3300/0 conn(0x7f6a100ca8c0 0x7f6a100c2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:32.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.943+0000 7f6a174bd700 1 --2- 172.21.15.59:0/105268867 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6a100caca0 0x7f6a1006d920 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:32.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.943+0000 7f6a174bd700 1 -- 172.21.15.59:0/105268867 >> 172.21.15.59:0/105268867 conn(0x7f6a100ccae0 msgr2=0x7f6a100ccef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:32.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.945+0000 7f6a174bd700 1 -- 172.21.15.59:0/105268867 shutdown_connections 2023-09-21T00:17:32.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.945+0000 7f6a174bd700 1 -- 172.21.15.59:0/105268867 wait complete. 2023-09-21T00:17:32.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.946+0000 7f8d0f9cf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d0808a2a0 0x7f8d082052c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:32.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.946+0000 7f8d0f9cf700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d080cf680 0x7f8d0816bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:32.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.946+0000 7f8d0f9cf700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d08160c10 0x7f8d0820b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:32.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.946+0000 7f8d0f9cf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d08161de0 con 0x7f8d0808a2a0 2023-09-21T00:17:32.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.946+0000 7f8d0f9cf700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d081611d0 con 0x7f8d080cf680 2023-09-21T00:17:32.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.946+0000 7f8d0f9cf700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d081614b0 con 0x7f8d08160c10 2023-09-21T00:17:32.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.946+0000 7fee377fe700 1 -- 172.21.15.59:0/3053676830 >> v2:172.21.15.83:3300/0 conn(0x7fee380b3140 msgr2=0x7fee38071ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:32.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.946+0000 7fee377fe700 1 --2- 172.21.15.59:0/3053676830 >> v2:172.21.15.83:3300/0 conn(0x7fee380b3140 0x7fee38071ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:32.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.946+0000 7fee377fe700 1 -- 172.21.15.59:0/3053676830 >> v1:172.21.15.83:6789/0 conn(0x7fee380b35f0 legacy=0x7fee380ce2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-21T00:17:32.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.946+0000 7fee377fe700 1 -- 172.21.15.59:0/3053676830 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee38072690 con 0x7fee3808a2a0 2023-09-21T00:17:32.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.945+0000 7f791f161700 1 Processor -- start 2023-09-21T00:17:32.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.946+0000 7f791f161700 1 -- start start 2023-09-21T00:17:32.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.946+0000 7f8d0cf6a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d080cf680 0x7f8d0816bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:32.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.946+0000 7f8d0cf6a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d080cf680 0x7f8d0816bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.59:37622/0 (socket says 172.21.15.59:37622) 2023-09-21T00:17:32.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.946+0000 7f8d0cf6a700 1 -- 172.21.15.59:0/351107548 learned_addr learned my addr 172.21.15.59:0/351107548 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:32.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.946+0000 7f8d0df6c700 1 --2- 172.21.15.59:0/351107548 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d08160c10 0x7f8d0820b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:32.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.946+0000 7f6a174bd700 1 Processor -- start 2023-09-21T00:17:32.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.946+0000 7fee377fe700 1 --2- 172.21.15.59:0/3053676830 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee3808a2a0 0x7fee3808a680 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fee3806e030 tx=0x7fee280095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=411b7a52618a9b15 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:32.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.947+0000 7f8d0df6c700 1 -- 172.21.15.59:0/351107548 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d080cf680 msgr2=0x7f8d0816bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:32.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.947+0000 7f8d0df6c700 1 --2- 172.21.15.59:0/351107548 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d080cf680 0x7f8d0816bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:32.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.947+0000 7f8d0df6c700 1 -- 172.21.15.59:0/351107548 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d0808a2a0 msgr2=0x7f8d082052c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:32.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.947+0000 7f8d0df6c700 1 --2- 172.21.15.59:0/351107548 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d0808a2a0 0x7f8d082052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:32.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.947+0000 7f8d0df6c700 1 -- 172.21.15.59:0/351107548 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d0000ab50 con 0x7f8d08160c10 2023-09-21T00:17:32.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.946+0000 7f6a174bd700 1 -- start start 2023-09-21T00:17:32.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.946+0000 7fd93dffb700 1 -- 172.21.15.59:0/1287875828 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fd94000c930 con 0x7fd9480cf240 2023-09-21T00:17:32.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.947+0000 7fd93dffb700 1 --2- 172.21.15.59:0/1287875828 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd92c06aed0 0x7fd92c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:32.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.947+0000 7fd93dffb700 1 -- 172.21.15.59:0/1287875828 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd940089a00 con 0x7fd9480cf240 2023-09-21T00:17:32.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.947+0000 7f8d0df6c700 1 --2- 172.21.15.59:0/351107548 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d08160c10 0x7f8d0820b500 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8d00014000 tx=0x7f8d00004b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:32.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.947+0000 7fd94d7d1700 1 --2- 172.21.15.59:0/1287875828 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd92c06aed0 0x7fd92c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:32.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.947+0000 7f791f161700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f79180b26f0 0x7f79180b66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:32.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.947+0000 7f791f161700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79180b2ca0 con 0x7f79180b6240 2023-09-21T00:17:32.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.947+0000 7f791f161700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7918161dc0 con 0x7f79181619e0 2023-09-21T00:17:32.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.947+0000 7f791f161700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79180b6c00 con 0x7f79180b26f0 2023-09-21T00:17:32.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.947+0000 7f8cfdffb700 1 -- 172.21.15.59:0/351107548 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0000bde0 con 0x7f8d08160c10 2023-09-21T00:17:32.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.947+0000 7f8cfdffb700 1 -- 172.21.15.59:0/351107548 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d00004030 con 0x7f8d08160c10 2023-09-21T00:17:32.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.947+0000 7f8cfdffb700 1 -- 172.21.15.59:0/351107548 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d000043c0 con 0x7f8d08160c10 2023-09-21T00:17:32.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.947+0000 7f8d0f9cf700 1 -- 172.21.15.59:0/351107548 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d08161790 con 0x7f8d08160c10 2023-09-21T00:17:32.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.948+0000 7fd94fa35700 1 --2- 172.21.15.59:0/1287875828 >> [v2:172.21.15.59:6800/869668251,v1:172.21.15.59:6801/869668251] conn(0x7fd9280015e0 0x7fd928003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:32.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.948+0000 7fd94fa35700 1 -- 172.21.15.59:0/1287875828 --> [v2:172.21.15.59:6800/869668251,v1:172.21.15.59:6801/869668251] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd928006bd0 con 0x7fd9280015e0 2023-09-21T00:17:32.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.948+0000 7f791d6fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f79180b26f0 0x7f79180b66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:32.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.948+0000 7f791d6fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f79180b26f0 0x7f79180b66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51514/0 (socket says 172.21.15.59:51514) 2023-09-21T00:17:32.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.948+0000 7f791d6fe700 1 -- 172.21.15.59:0/401499288 learned_addr learned my addr 172.21.15.59:0/401499288 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:32.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.948+0000 7f6a174bd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a100ca8c0 0x7f6a10152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:32.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.948+0000 7f6a174bd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a100caca0 0x7f6a101f1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:32.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.948+0000 7f6a174bd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6a100cf000 0x7f6a101f23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:32.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.948+0000 7f6a174bd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a10153120 con 0x7f6a100ca8c0 2023-09-21T00:17:32.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.948+0000 7f6a174bd700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a10151b40 con 0x7f6a100caca0 2023-09-21T00:17:32.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.948+0000 7f6a174bd700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a10151e20 con 0x7f6a100cf000 2023-09-21T00:17:32.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.948+0000 7f6a14a58700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a100caca0 0x7f6a101f1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:32.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.948+0000 7f6a14a58700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a100caca0 0x7f6a101f1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.59:37636/0 (socket says 172.21.15.59:37636) 2023-09-21T00:17:32.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.948+0000 7f6a14a58700 1 -- 172.21.15.59:0/2425425358 learned_addr learned my addr 172.21.15.59:0/2425425358 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:32.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.948+0000 7f6a15a5a700 1 --2- 172.21.15.59:0/2425425358 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6a100cf000 0x7f6a101f23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:32.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.946+0000 7fee367fc700 1 -- 172.21.15.59:0/3053676830 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee28004230 con 0x7fee3808a2a0 2023-09-21T00:17:32.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.947+0000 7fee367fc700 1 -- 172.21.15.59:0/3053676830 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee28004390 con 0x7fee3808a2a0 2023-09-21T00:17:32.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.947+0000 7fee367fc700 1 -- 172.21.15.59:0/3053676830 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2800c740 con 0x7fee3808a2a0 2023-09-21T00:17:32.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.948+0000 7fee3deb4700 1 -- 172.21.15.59:0/3053676830 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee3808a2a0 msgr2=0x7fee3808a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:32.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.948+0000 7fee3deb4700 1 --2- 172.21.15.59:0/3053676830 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee3808a2a0 0x7fee3808a680 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fee3806e030 tx=0x7fee280095c0 comp rx=0 tx=0).stop 2023-09-21T00:17:32.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.948+0000 7f8d0f9cf700 1 -- 172.21.15.59:0/351107548 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d08162270 con 0x7f8d08160c10 2023-09-21T00:17:33.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.948+0000 7fd94cfd0700 1 --2- 172.21.15.59:0/1287875828 >> [v2:172.21.15.59:6800/869668251,v1:172.21.15.59:6801/869668251] conn(0x7fd9280015e0 0x7fd928003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.948+0000 7fd94d7d1700 1 --2- 172.21.15.59:0/1287875828 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd92c06aed0 0x7fd92c06d390 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd9440090b0 tx=0x7fd94401c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.949+0000 7f6a14a58700 1 -- 172.21.15.59:0/2425425358 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6a100cf000 msgr2=0x7f6a101f23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.949+0000 7f6a14a58700 1 --2- 172.21.15.59:0/2425425358 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6a100cf000 0x7f6a101f23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.949+0000 7f6a14a58700 1 -- 172.21.15.59:0/2425425358 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a100ca8c0 msgr2=0x7f6a10152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.949+0000 7f6a14a58700 1 --2- 172.21.15.59:0/2425425358 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a100ca8c0 0x7f6a10152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.949+0000 7f6a14a58700 1 -- 172.21.15.59:0/2425425358 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a00009550 con 0x7f6a100caca0 2023-09-21T00:17:33.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.949+0000 7f791d6fe700 1 -- 172.21.15.59:0/401499288 >> v1:172.21.15.83:6789/0 conn(0x7f79181619e0 legacy=0x7f79180d0fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-21T00:17:33.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.949+0000 7f791d6fe700 1 -- 172.21.15.59:0/401499288 >> v1:172.21.15.59:6789/0 conn(0x7f79180b6240 legacy=0x7f79180b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.949+0000 7f791d6fe700 1 -- 172.21.15.59:0/401499288 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79180cddc0 con 0x7f79180b26f0 2023-09-21T00:17:33.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.949+0000 7f8d0f9cf700 1 -- 172.21.15.59:0/351107548 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8d080cec20 con 0x7f8d08160c10 2023-09-21T00:17:33.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.949+0000 7fd94cfd0700 1 --2- 172.21.15.59:0/1287875828 >> [v2:172.21.15.59:6800/869668251,v1:172.21.15.59:6801/869668251] conn(0x7fd9280015e0 0x7fd928003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.949+0000 7f6a14a58700 1 --2- 172.21.15.59:0/2425425358 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a100caca0 0x7f6a101f1e90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6a00014040 tx=0x7f6a00004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.949+0000 7f791d6fe700 1 --2- 172.21.15.59:0/401499288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79180b26f0 0x7f79180b66c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7910009e50 tx=0x7f791000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3c76e4ae519bcd0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.949+0000 7f790f7fe700 1 -- 172.21.15.59:0/401499288 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791000e070 con 0x7f79180b26f0 2023-09-21T00:17:33.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.949+0000 7f790f7fe700 1 -- 172.21.15.59:0/401499288 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7910003a20 con 0x7f79180b26f0 2023-09-21T00:17:33.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.949+0000 7f790f7fe700 1 -- 172.21.15.59:0/401499288 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7910003dd0 con 0x7f79180b26f0 2023-09-21T00:17:33.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.950+0000 7f8cfdffb700 1 -- 172.21.15.59:0/351107548 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f8d00004520 con 0x7f8d08160c10 2023-09-21T00:17:33.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.945+0000 7fbdc1aec700 1 --2- 172.21.15.59:0/1128075088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdbc0a8fa0 0x7fbdbc167bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.945+0000 7fbdc12eb700 1 -- 172.21.15.59:0/1128075088 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbdbc0ce9a0 msgr2=0x7fbdbc0a8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.945+0000 7fbdc12eb700 1 --2- 172.21.15.59:0/1128075088 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbdbc0ce9a0 0x7fbdbc0a8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.945+0000 7fbdc12eb700 1 -- 172.21.15.59:0/1128075088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdbc0a8fa0 msgr2=0x7fbdbc167bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.945+0000 7fbdc12eb700 1 --2- 172.21.15.59:0/1128075088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdbc0a8fa0 0x7fbdbc167bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.950+0000 7fee3deb4700 1 -- 172.21.15.59:0/3053676830 shutdown_connections 2023-09-21T00:17:33.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.950+0000 7fee3deb4700 1 --2- 172.21.15.59:0/3053676830 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee3808a2a0 0x7fee3808a680 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.950+0000 7fee3deb4700 1 --2- 172.21.15.59:0/3053676830 >> v2:172.21.15.83:3300/0 conn(0x7fee380b3140 0x7fee38071ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.950+0000 7fee3deb4700 1 -- 172.21.15.59:0/3053676830 >> 172.21.15.59:0/3053676830 conn(0x7fee3806c7c0 msgr2=0x7fee3806cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:33.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.945+0000 7fbdc12eb700 1 -- 172.21.15.59:0/1128075088 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb80094a0 con 0x7fbdbc0b0b90 2023-09-21T00:17:33.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.945+0000 7fbdc1aec700 1 --2- 172.21.15.59:0/1128075088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdbc0a8fa0 0x7fbdbc167bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:17:33.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.946+0000 7fbdc12eb700 1 --2- 172.21.15.59:0/1128075088 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbdbc0b0b90 0x7fbdbc200580 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbdb8016000 tx=0x7fbdb8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.947+0000 7fbdb1ffb700 1 -- 172.21.15.59:0/1128075088 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb8004450 con 0x7fbdbc0b0b90 2023-09-21T00:17:33.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.948+0000 7fbdb1ffb700 1 -- 172.21.15.59:0/1128075088 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb801f070 con 0x7fbdbc0b0b90 2023-09-21T00:17:33.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.948+0000 7fbdb1ffb700 1 -- 172.21.15.59:0/1128075088 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb80038c0 con 0x7fbdbc0b0b90 2023-09-21T00:17:33.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.948+0000 7fbdc354f700 1 -- 172.21.15.59:0/1128075088 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdbc168ba0 con 0x7fbdbc0b0b90 2023-09-21T00:17:33.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.948+0000 7fbdc354f700 1 -- 172.21.15.59:0/1128075088 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdbc169160 con 0x7fbdbc0b0b90 2023-09-21T00:17:33.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.949+0000 7fbdc354f700 1 -- 172.21.15.59:0/1128075088 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbdbc0cf640 con 0x7fbdbc0b0b90 2023-09-21T00:17:33.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.950+0000 7f6a05ffb700 1 -- 172.21.15.59:0/2425425358 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a000036a0 con 0x7f6a100caca0 2023-09-21T00:17:33.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.950+0000 7f791f161700 1 -- 172.21.15.59:0/401499288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79180b26f0 msgr2=0x7f79180b66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.950+0000 7f791f161700 1 --2- 172.21.15.59:0/401499288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79180b26f0 0x7f79180b66c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7910009e50 tx=0x7f791000b330 comp rx=0 tx=0).stop 2023-09-21T00:17:33.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.950+0000 7f8cfdffb700 1 --2- 172.21.15.59:0/351107548 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f8cec06ae00 0x7f8cec06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.950+0000 7f8cfdffb700 1 -- 172.21.15.59:0/351107548 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8d0008b040 con 0x7f8d08160c10 2023-09-21T00:17:33.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.950+0000 7f8cfdffb700 1 --2- 172.21.15.59:0/351107548 >> [v2:172.21.15.59:6808/2418314235,v1:172.21.15.59:6809/2418314235] conn(0x7f8cec0743c0 0x7f8cec076800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.951+0000 7f8cfdffb700 1 -- 172.21.15.59:0/351107548 --> [v2:172.21.15.59:6808/2418314235,v1:172.21.15.59:6809/2418314235] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8cec076ed0 con 0x7f8cec0743c0 2023-09-21T00:17:33.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.951+0000 7f8cfdffb700 1 -- 172.21.15.59:0/351107548 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d0008d700 con 0x7f8d08160c10 2023-09-21T00:17:33.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.951+0000 7f791f161700 1 -- 172.21.15.59:0/401499288 shutdown_connections 2023-09-21T00:17:33.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.951+0000 7f791f161700 1 --2- 172.21.15.59:0/401499288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79180b26f0 0x7f79180b66c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.951+0000 7f791f161700 1 -- 172.21.15.59:0/401499288 >> 172.21.15.59:0/401499288 conn(0x7f79180b4ee0 msgr2=0x7f79180b52f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:33.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.951+0000 7f791f161700 1 -- 172.21.15.59:0/401499288 shutdown_connections 2023-09-21T00:17:33.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.951+0000 7f8d0cf6a700 1 --2- 172.21.15.59:0/351107548 >> [v2:172.21.15.59:6808/2418314235,v1:172.21.15.59:6809/2418314235] conn(0x7f8cec0743c0 0x7f8cec076800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.951+0000 7f8d0cf6a700 1 --2- 172.21.15.59:0/351107548 >> [v2:172.21.15.59:6808/2418314235,v1:172.21.15.59:6809/2418314235] conn(0x7f8cec0743c0 0x7f8cec076800 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.952+0000 7f8d0d76b700 1 --2- 172.21.15.59:0/351107548 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f8cec06ae00 0x7f8cec06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.953+0000 7f8cfdffb700 1 -- 172.21.15.59:0/351107548 <== osd.0 v2:172.21.15.59:6808/2418314235 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f8cec076ed0 con 0x7f8cec0743c0 2023-09-21T00:17:33.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.951+0000 7fbdb1ffb700 1 -- 172.21.15.59:0/1128075088 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fbdb8003a20 con 0x7fbdbc0b0b90 2023-09-21T00:17:33.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.951+0000 7fbdb1ffb700 1 --2- 172.21.15.59:0/1128075088 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fbda006ae50 0x7fbda006d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.951+0000 7fbdb1ffb700 1 -- 172.21.15.59:0/1128075088 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbdb8021070 con 0x7fbdbc0b0b90 2023-09-21T00:17:33.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.952+0000 7fbdb1ffb700 1 --2- 172.21.15.59:0/1128075088 >> [v2:172.21.15.59:6816/372517778,v1:172.21.15.59:6817/372517778] conn(0x7fbda0074490 0x7fbda00768d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.952+0000 7fbdb1ffb700 1 -- 172.21.15.59:0/1128075088 --> [v2:172.21.15.59:6816/372517778,v1:172.21.15.59:6817/372517778] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbda0076fa0 con 0x7fbda0074490 2023-09-21T00:17:33.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.952+0000 7fbdb1ffb700 1 -- 172.21.15.59:0/1128075088 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbdb808b600 con 0x7fbdbc0b0b90 2023-09-21T00:17:33.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.952+0000 7fbdc0aea700 1 --2- 172.21.15.59:0/1128075088 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fbda006ae50 0x7fbda006d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.952+0000 7fbdc1aec700 1 --2- 172.21.15.59:0/1128075088 >> [v2:172.21.15.59:6816/372517778,v1:172.21.15.59:6817/372517778] conn(0x7fbda0074490 0x7fbda00768d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.952+0000 7fbdc0aea700 1 --2- 172.21.15.59:0/1128075088 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fbda006ae50 0x7fbda006d310 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc167a10 tx=0x7fbdac008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.953+0000 7fbdc1aec700 1 --2- 172.21.15.59:0/1128075088 >> [v2:172.21.15.59:6816/372517778,v1:172.21.15.59:6817/372517778] conn(0x7fbda0074490 0x7fbda00768d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.951+0000 7f791f161700 1 -- 172.21.15.59:0/401499288 wait complete. 2023-09-21T00:17:33.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.953+0000 7f791f161700 1 Processor -- start 2023-09-21T00:17:33.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.950+0000 7f6a05ffb700 1 -- 172.21.15.59:0/2425425358 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0001e070 con 0x7f6a100caca0 2023-09-21T00:17:33.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.950+0000 7f6a05ffb700 1 -- 172.21.15.59:0/2425425358 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a00003a60 con 0x7f6a100caca0 2023-09-21T00:17:33.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.950+0000 7f6a174bd700 1 -- 172.21.15.59:0/2425425358 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a10152100 con 0x7f6a100caca0 2023-09-21T00:17:33.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.950+0000 7f6a174bd700 1 -- 172.21.15.59:0/2425425358 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a101526c0 con 0x7f6a100caca0 2023-09-21T00:17:33.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.953+0000 7f69fb7fe700 1 -- 172.21.15.59:0/2425425358 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6a100ceae0 con 0x7f6a100caca0 2023-09-21T00:17:33.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.951+0000 7fee3deb4700 1 -- 172.21.15.59:0/3053676830 shutdown_connections 2023-09-21T00:17:33.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.951+0000 7fee3deb4700 1 -- 172.21.15.59:0/3053676830 wait complete. 2023-09-21T00:17:33.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.954+0000 7f8d0d76b700 1 --2- 172.21.15.59:0/351107548 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f8cec06ae00 0x7f8cec06d2c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8005de0 tx=0x7f8cf8006ee0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.954+0000 7f6a05ffb700 1 -- 172.21.15.59:0/2425425358 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f6a00003bc0 con 0x7f6a100caca0 2023-09-21T00:17:33.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.954+0000 7f6a05ffb700 1 --2- 172.21.15.59:0/2425425358 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f69fc08cf20 0x7f69fc08f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.954+0000 7f6a05ffb700 1 -- 172.21.15.59:0/2425425358 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6a00020070 con 0x7f6a100caca0 2023-09-21T00:17:33.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.954+0000 7f6a15259700 1 --2- 172.21.15.59:0/2425425358 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f69fc08cf20 0x7f69fc08f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.954+0000 7f6a05ffb700 1 --2- 172.21.15.59:0/2425425358 >> [v2:172.21.15.83:6802/1741219098,v1:172.21.15.83:6803/1741219098] conn(0x7f69fc0964e0 0x7f69fc098920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.954+0000 7f6a05ffb700 1 -- 172.21.15.59:0/2425425358 --> [v2:172.21.15.83:6802/1741219098,v1:172.21.15.83:6803/1741219098] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f69fc098ff0 con 0x7f69fc0964e0 2023-09-21T00:17:33.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.954+0000 7f6a05ffb700 1 -- 172.21.15.59:0/2425425358 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a0008f260 con 0x7f6a100caca0 2023-09-21T00:17:33.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.954+0000 7f6a15a5a700 1 --2- 172.21.15.59:0/2425425358 >> [v2:172.21.15.83:6802/1741219098,v1:172.21.15.83:6803/1741219098] conn(0x7f69fc0964e0 0x7f69fc098920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.955+0000 7fbdb1ffb700 1 -- 172.21.15.59:0/1128075088 <== osd.2 v2:172.21.15.59:6816/372517778 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fbda0076fa0 con 0x7fbda0074490 2023-09-21T00:17:33.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.955+0000 7f6a15259700 1 --2- 172.21.15.59:0/2425425358 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f69fc08cf20 0x7f69fc08f3e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6a10160e30 tx=0x7f6a0c006c80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.953+0000 7f791f161700 1 -- start start 2023-09-21T00:17:33.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.955+0000 7f791f161700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79180b26f0 0x7f7918153bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.955+0000 7f791f161700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79180b6240 0x7f7918163a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.955+0000 7f791f161700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79181619e0 0x7f79181573e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.955+0000 7f791f161700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7918158fa0 con 0x7f79181619e0 2023-09-21T00:17:33.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.955+0000 7f791f161700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79181642a0 con 0x7f79180b26f0 2023-09-21T00:17:33.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.955+0000 7f791f161700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7918164580 con 0x7f79180b6240 2023-09-21T00:17:33.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.955+0000 7f791cefd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79180b26f0 0x7f7918153bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.955+0000 7f791cefd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79180b26f0 0x7f7918153bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.59:37654/0 (socket says 172.21.15.59:37654) 2023-09-21T00:17:33.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.955+0000 7f791cefd700 1 -- 172.21.15.59:0/2822358778 learned_addr learned my addr 172.21.15.59:0/2822358778 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:33.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.955+0000 7f790ffff700 1 --2- 172.21.15.59:0/2822358778 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79180b6240 0x7f7918163a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.955+0000 7f791d6fe700 1 --2- 172.21.15.59:0/2822358778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79181619e0 0x7f79181573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.955+0000 7f6a15a5a700 1 --2- 172.21.15.59:0/2425425358 >> [v2:172.21.15.83:6802/1741219098,v1:172.21.15.83:6803/1741219098] conn(0x7f69fc0964e0 0x7f69fc098920 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.955+0000 7f9c5499e700 1 Processor -- start 2023-09-21T00:17:33.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.955+0000 7f791cefd700 1 -- 172.21.15.59:0/2822358778 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79180b6240 msgr2=0x7f7918163a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.955+0000 7f791cefd700 1 --2- 172.21.15.59:0/2822358778 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79180b6240 0x7f7918163a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.955+0000 7f791cefd700 1 -- 172.21.15.59:0/2822358778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79181619e0 msgr2=0x7f79181573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.955+0000 7f791cefd700 1 --2- 172.21.15.59:0/2822358778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79181619e0 0x7f79181573e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.955+0000 7f791cefd700 1 -- 172.21.15.59:0/2822358778 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7910009b30 con 0x7f79180b26f0 2023-09-21T00:17:33.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.956+0000 7f791cefd700 1 --2- 172.21.15.59:0/2822358778 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79180b26f0 0x7f7918153bd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f791400b470 tx=0x7f791400b780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.956+0000 7f790d7fa700 1 -- 172.21.15.59:0/2822358778 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7914011830 con 0x7f79180b26f0 2023-09-21T00:17:33.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.956+0000 7f790d7fa700 1 -- 172.21.15.59:0/2822358778 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79140119b0 con 0x7f79180b26f0 2023-09-21T00:17:33.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.956+0000 7f790d7fa700 1 -- 172.21.15.59:0/2822358778 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7914011d60 con 0x7f79180b26f0 2023-09-21T00:17:33.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.956+0000 7f6a05ffb700 1 -- 172.21.15.59:0/2425425358 <== osd.4 v2:172.21.15.83:6802/1741219098 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f69fc098ff0 con 0x7f69fc0964e0 2023-09-21T00:17:33.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.953+0000 7fee3deb4700 1 Processor -- start 2023-09-21T00:17:33.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.957+0000 7fee3deb4700 1 -- start start 2023-09-21T00:17:33.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.957+0000 7fee3deb4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fee3808a2a0 0x7fee380aa750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.958+0000 7fee3deb4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fee380b35f0 0x7fee3815d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.958+0000 7fee3deb4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee3815dbb0 0x7fee381f4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.958+0000 7fee3deb4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee3815e040 con 0x7fee3815dbb0 2023-09-21T00:17:33.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.958+0000 7fee3deb4700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee381f54e0 con 0x7fee3808a2a0 2023-09-21T00:17:33.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.958+0000 7fee3deb4700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee3815e4e0 con 0x7fee380b35f0 2023-09-21T00:17:33.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.958+0000 7fee36ffd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fee380b35f0 0x7fee3815d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.958+0000 7fee36ffd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fee380b35f0 0x7fee3815d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.59:52162/0 (socket says 172.21.15.59:52162) 2023-09-21T00:17:33.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.958+0000 7fee36ffd700 1 -- 172.21.15.59:0/3125886832 learned_addr learned my addr 172.21.15.59:0/3125886832 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:33.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.958+0000 7fee377fe700 1 --2- 172.21.15.59:0/3125886832 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fee3808a2a0 0x7fee380aa750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.958+0000 7fee36ffd700 1 -- 172.21.15.59:0/3125886832 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fee3808a2a0 msgr2=0x7fee380aa750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.958+0000 7fee36ffd700 1 --2- 172.21.15.59:0/3125886832 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fee3808a2a0 0x7fee380aa750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.958+0000 7fee36ffd700 1 -- 172.21.15.59:0/3125886832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee3815dbb0 msgr2=0x7fee381f4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.958+0000 7fee36ffd700 1 --2- 172.21.15.59:0/3125886832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee3815dbb0 0x7fee381f4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.958+0000 7fee36ffd700 1 -- 172.21.15.59:0/3125886832 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee28009de0 con 0x7fee380b35f0 2023-09-21T00:17:33.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.958+0000 7fee36ffd700 1 --2- 172.21.15.59:0/3125886832 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fee380b35f0 0x7fee3815d670 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fee3000be00 tx=0x7fee3000be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.958+0000 7fee1ffff700 1 -- 172.21.15.59:0/3125886832 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3000cd10 con 0x7fee380b35f0 2023-09-21T00:17:33.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.958+0000 7fee1ffff700 1 -- 172.21.15.59:0/3125886832 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee3000ce90 con 0x7fee380b35f0 2023-09-21T00:17:33.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.958+0000 7fee3deb4700 1 -- 172.21.15.59:0/3125886832 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee381f5200 con 0x7fee380b35f0 2023-09-21T00:17:33.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.959+0000 7fee1ffff700 1 -- 172.21.15.59:0/3125886832 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee30014680 con 0x7fee380b35f0 2023-09-21T00:17:33.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.959+0000 7fee3deb4700 1 -- 172.21.15.59:0/3125886832 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee380a8860 con 0x7fee380b35f0 2023-09-21T00:17:33.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.959+0000 7fee3deb4700 1 -- 172.21.15.59:0/3125886832 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fee380b2940 con 0x7fee380b35f0 2023-09-21T00:17:33.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.960+0000 7fee1ffff700 1 -- 172.21.15.59:0/3125886832 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fee300147e0 con 0x7fee380b35f0 2023-09-21T00:17:33.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.960+0000 7fee1ffff700 1 --2- 172.21.15.59:0/3125886832 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fee2406ae00 0x7fee2406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.961+0000 7fee1ffff700 1 -- 172.21.15.59:0/3125886832 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fee30006e40 con 0x7fee380b35f0 2023-09-21T00:17:33.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.961+0000 7fee377fe700 1 --2- 172.21.15.59:0/3125886832 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fee2406ae00 0x7fee2406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.961+0000 7fee1ffff700 1 --2- 172.21.15.59:0/3125886832 >> [v2:172.21.15.83:6801/1337723778,v1:172.21.15.83:6800/1337723778] conn(0x7fee240743c0 0x7fee24076800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.961+0000 7fee1ffff700 1 -- 172.21.15.59:0/3125886832 --> [v2:172.21.15.83:6801/1337723778,v1:172.21.15.83:6800/1337723778] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fee24076ed0 con 0x7fee240743c0 2023-09-21T00:17:33.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.961+0000 7fee1ffff700 1 -- 172.21.15.59:0/3125886832 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee30037ea0 con 0x7fee380b35f0 2023-09-21T00:17:33.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.961+0000 7fee37fff700 1 --2- 172.21.15.59:0/3125886832 >> [v2:172.21.15.83:6801/1337723778,v1:172.21.15.83:6800/1337723778] conn(0x7fee240743c0 0x7fee24076800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.961+0000 7fee377fe700 1 --2- 172.21.15.59:0/3125886832 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fee2406ae00 0x7fee2406d2c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fee28000c00 tx=0x7fee28008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.961+0000 7fee37fff700 1 --2- 172.21.15.59:0/3125886832 >> [v2:172.21.15.83:6801/1337723778,v1:172.21.15.83:6800/1337723778] conn(0x7fee240743c0 0x7fee24076800 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.951+0000 7fd93dffb700 1 -- 172.21.15.59:0/1287875828 <== osd.1 v2:172.21.15.59:6800/869668251 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fd928006bd0 con 0x7fd9280015e0 2023-09-21T00:17:33.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.962+0000 7f791f161700 1 -- 172.21.15.59:0/2822358778 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7918164860 con 0x7f79180b26f0 2023-09-21T00:17:33.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.962+0000 7f791f161700 1 -- 172.21.15.59:0/2822358778 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7918163f60 con 0x7f79180b26f0 2023-09-21T00:17:33.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.962+0000 7f9c5499e700 1 -- start start 2023-09-21T00:17:33.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.963+0000 7f791f161700 1 -- 172.21.15.59:0/2822358778 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f79180ce0a0 con 0x7f79180b26f0 2023-09-21T00:17:33.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.964+0000 7f790d7fa700 1 -- 172.21.15.59:0/2822358778 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f791401a400 con 0x7f79180b26f0 2023-09-21T00:17:33.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.963+0000 7f9c5499e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9c500cc490 0x7f9c500b0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.963+0000 7f9c5499e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c500b10d0 0x7f9c500b2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.963+0000 7f9c5499e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c500cc000 con 0x7f9c50157eb0 2023-09-21T00:17:33.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.963+0000 7f9c5499e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c500b1540 con 0x7f9c500cc490 2023-09-21T00:17:33.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.963+0000 7f9c5499e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c500b4030 con 0x7f9c500b10d0 2023-09-21T00:17:33.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.963+0000 7f9c4e59c700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f9c50157eb0 0x7f9c500b3920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.59:47622/0 (socket says 172.21.15.59:47622) 2023-09-21T00:17:33.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.963+0000 7f9c4e59c700 1 -- 172.21.15.59:0/1699349278 learned_addr learned my addr 172.21.15.59:0/1699349278 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:33.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.962+0000 7fee1ffff700 1 -- 172.21.15.59:0/3125886832 <== osd.6 v2:172.21.15.83:6801/1337723778 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fee24076ed0 con 0x7fee240743c0 2023-09-21T00:17:33.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.964+0000 7f790d7fa700 1 --2- 172.21.15.59:0/2822358778 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f790406ae00 0x7f790406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.964+0000 7f9c4ed9d700 1 --2- 172.21.15.59:0/1699349278 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c500b10d0 0x7f9c500b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.964+0000 7f9c4ed9d700 1 -- 172.21.15.59:0/1699349278 >> v2:172.21.15.59:3300/0 conn(0x7f9c500cc490 msgr2=0x7f9c500b0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:33.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.964+0000 7f9c4ed9d700 1 --2- 172.21.15.59:0/1699349278 >> v2:172.21.15.59:3300/0 conn(0x7f9c500cc490 0x7f9c500b0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.964+0000 7f9c4ed9d700 1 -- 172.21.15.59:0/1699349278 >> v1:172.21.15.83:6789/0 conn(0x7f9c50157eb0 legacy=0x7f9c500b3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.964+0000 7f9c4ed9d700 1 -- 172.21.15.59:0/1699349278 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c50158290 con 0x7f9c500b10d0 2023-09-21T00:17:33.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.965+0000 7f9c4ed9d700 1 --2- 172.21.15.59:0/1699349278 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c500b10d0 0x7f9c500b2140 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9c44009820 tx=0x7f9c44009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2aad8a72a4034bac server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.965+0000 7f790d7fa700 1 -- 172.21.15.59:0/2822358778 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f79140896d0 con 0x7f79180b26f0 2023-09-21T00:17:33.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.965+0000 7f790d7fa700 1 --2- 172.21.15.59:0/2822358778 >> [v2:172.21.15.59:6824/575188498,v1:172.21.15.59:6825/575188498] conn(0x7f79040743c0 0x7f7904076800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.965+0000 7f790d7fa700 1 -- 172.21.15.59:0/2822358778 --> [v2:172.21.15.59:6824/575188498,v1:172.21.15.59:6825/575188498] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7904076ed0 con 0x7f79040743c0 2023-09-21T00:17:33.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.965+0000 7f790d7fa700 1 -- 172.21.15.59:0/2822358778 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f791408bd90 con 0x7f79180b26f0 2023-09-21T00:17:33.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.965+0000 7f791d6fe700 1 --2- 172.21.15.59:0/2822358778 >> [v2:172.21.15.59:6824/575188498,v1:172.21.15.59:6825/575188498] conn(0x7f79040743c0 0x7f7904076800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.965+0000 7f791d6fe700 1 --2- 172.21.15.59:0/2822358778 >> [v2:172.21.15.59:6824/575188498,v1:172.21.15.59:6825/575188498] conn(0x7f79040743c0 0x7f7904076800 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.966+0000 7f790ffff700 1 --2- 172.21.15.59:0/2822358778 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f790406ae00 0x7f790406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.965+0000 7f9c4d59a700 1 -- 172.21.15.59:0/1699349278 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c44005e80 con 0x7f9c500b10d0 2023-09-21T00:17:33.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.965+0000 7f9c4d59a700 1 -- 172.21.15.59:0/1699349278 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c44006030 con 0x7f9c500b10d0 2023-09-21T00:17:33.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.965+0000 7f9c4d59a700 1 -- 172.21.15.59:0/1699349278 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c440063a0 con 0x7f9c500b10d0 2023-09-21T00:17:33.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.966+0000 7f9c5499e700 1 -- 172.21.15.59:0/1699349278 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c500b10d0 msgr2=0x7f9c500b2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.966+0000 7f9c5499e700 1 --2- 172.21.15.59:0/1699349278 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c500b10d0 0x7f9c500b2140 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9c44009820 tx=0x7f9c44009b30 comp rx=0 tx=0).stop 2023-09-21T00:17:33.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.966+0000 7f790ffff700 1 --2- 172.21.15.59:0/2822358778 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f790406ae00 0x7f790406d2c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f79181fab40 tx=0x7f7908009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.966+0000 7f9c5499e700 1 -- 172.21.15.59:0/1699349278 shutdown_connections 2023-09-21T00:17:33.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.966+0000 7f9c5499e700 1 --2- 172.21.15.59:0/1699349278 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c500b10d0 0x7f9c500b2140 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.966+0000 7f9c5499e700 1 --2- 172.21.15.59:0/1699349278 >> v2:172.21.15.59:3300/0 conn(0x7f9c500cc490 0x7f9c500b0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.966+0000 7f9c5499e700 1 -- 172.21.15.59:0/1699349278 >> 172.21.15.59:0/1699349278 conn(0x7f9c5006de70 msgr2=0x7f9c5006a780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:33.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.966+0000 7f9c5499e700 1 -- 172.21.15.59:0/1699349278 shutdown_connections 2023-09-21T00:17:33.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.966+0000 7f9c5499e700 1 -- 172.21.15.59:0/1699349278 wait complete. 2023-09-21T00:17:33.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.967+0000 7f7f900ec700 1 Processor -- start 2023-09-21T00:17:33.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.967+0000 7f7f900ec700 1 -- start start 2023-09-21T00:17:33.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.968+0000 7f7f900ec700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7f8815d4c0 0x7f7f880d14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.968+0000 7f7f900ec700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7f880d2e80 0x7f7f880b4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.968+0000 7f7f900ec700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f880b8d80 0x7f7f880b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.968+0000 7f7f900ec700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f880d1de0 con 0x7f7f880d2e80 2023-09-21T00:17:33.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.968+0000 7f7f900ec700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f880d20c0 con 0x7f7f8815d4c0 2023-09-21T00:17:33.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.968+0000 7f7f900ec700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f880d23a0 con 0x7f7f880b8d80 2023-09-21T00:17:33.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.968+0000 7f7f8d687700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7f880d2e80 0x7f7f880b4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.968+0000 7f7f8d687700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7f880d2e80 0x7f7f880b4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51566/0 (socket says 172.21.15.59:51566) 2023-09-21T00:17:33.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.968+0000 7f7f8d687700 1 -- 172.21.15.59:0/2020032933 learned_addr learned my addr 172.21.15.59:0/2020032933 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:33.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.968+0000 7f7f8de88700 1 --2- 172.21.15.59:0/2020032933 >> v2:172.21.15.83:3300/0 conn(0x7f7f8815d4c0 0x7f7f880d14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.968+0000 7f790d7fa700 1 -- 172.21.15.59:0/2822358778 <== osd.3 v2:172.21.15.59:6824/575188498 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f7904076ed0 con 0x7f79040743c0 2023-09-21T00:17:33.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.968+0000 7f9c5499e700 1 Processor -- start 2023-09-21T00:17:33.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.969+0000 7f7f8d687700 1 -- 172.21.15.59:0/2020032933 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f880b8d80 msgr2=0x7f7f880b53b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-21T00:17:33.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.969+0000 7f7f8d687700 1 --2- 172.21.15.59:0/2020032933 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f880b8d80 0x7f7f880b53b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.969+0000 7f7f8d687700 1 -- 172.21.15.59:0/2020032933 >> v2:172.21.15.83:3300/0 conn(0x7f7f8815d4c0 msgr2=0x7f7f880d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:33.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.969+0000 7f7f8d687700 1 --2- 172.21.15.59:0/2020032933 >> v2:172.21.15.83:3300/0 conn(0x7f7f8815d4c0 0x7f7f880d14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.969+0000 7f7f8d687700 1 -- 172.21.15.59:0/2020032933 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f880d2680 con 0x7f7f880d2e80 2023-09-21T00:17:33.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.969+0000 7f7f8de88700 1 --2- 172.21.15.59:0/2020032933 >> v2:172.21.15.83:3300/0 conn(0x7f7f8815d4c0 0x7f7f880d14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T00:17:33.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.969+0000 7f7f8d687700 1 --2- 172.21.15.59:0/2020032933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f880d2e80 0x7f7f880b4e70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7f8806c780 tx=0x7f7f84009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccd6e7772e943000 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.969+0000 7f7f8ce86700 1 -- 172.21.15.59:0/2020032933 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f84011830 con 0x7f7f880d2e80 2023-09-21T00:17:33.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.969+0000 7f7f8ce86700 1 -- 172.21.15.59:0/2020032933 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f84011990 con 0x7f7f880d2e80 2023-09-21T00:17:33.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.969+0000 7f7f8ce86700 1 -- 172.21.15.59:0/2020032933 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f84011d20 con 0x7f7f880d2e80 2023-09-21T00:17:33.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.969+0000 7f9c5499e700 1 -- start start 2023-09-21T00:17:33.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.970+0000 7f9c5499e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c500b10d0 0x7f9c5013ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.970+0000 7f9c5499e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c500cc490 0x7f9c5015ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.970+0000 7f9c5499e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c50157eb0 0x7f9c500b2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.970+0000 7f9c5499e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c50141590 con 0x7f9c500cc490 2023-09-21T00:17:33.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.970+0000 7f9c5499e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c50142380 con 0x7f9c50157eb0 2023-09-21T00:17:33.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.970+0000 7f9c5499e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5013f1f0 con 0x7f9c500b10d0 2023-09-21T00:17:33.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.970+0000 7f9c4dd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c500cc490 0x7f9c5015ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.970+0000 7f9c4dd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c500cc490 0x7f9c5015ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51572/0 (socket says 172.21.15.59:51572) 2023-09-21T00:17:33.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.970+0000 7f9c4dd9b700 1 -- 172.21.15.59:0/839681692 learned_addr learned my addr 172.21.15.59:0/839681692 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:33.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.970+0000 7f9c4e59c700 1 --2- 172.21.15.59:0/839681692 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c500b10d0 0x7f9c5013ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.970+0000 7f9c4e59c700 1 -- 172.21.15.59:0/839681692 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c50157eb0 msgr2=0x7f9c500b2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.970+0000 7f9c4e59c700 1 --2- 172.21.15.59:0/839681692 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c50157eb0 0x7f9c500b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.970+0000 7f9c4e59c700 1 -- 172.21.15.59:0/839681692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c500cc490 msgr2=0x7f9c5015ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.971+0000 7f9c4e59c700 1 --2- 172.21.15.59:0/839681692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c500cc490 0x7f9c5015ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.971+0000 7f9c4e59c700 1 -- 172.21.15.59:0/839681692 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c44009480 con 0x7f9c500b10d0 2023-09-21T00:17:33.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.971+0000 7f9c4dd9b700 1 --2- 172.21.15.59:0/839681692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c500cc490 0x7f9c5015ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T00:17:33.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.971+0000 7f9c4e59c700 1 --2- 172.21.15.59:0/839681692 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c500b10d0 0x7f9c5013ecb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9c4000c3c0 tx=0x7f9c4000c6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.971+0000 7f7f900ec700 1 -- 172.21.15.59:0/2020032933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f880d2e80 msgr2=0x7f7f880b4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.971+0000 7f7f900ec700 1 --2- 172.21.15.59:0/2020032933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f880d2e80 0x7f7f880b4e70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7f8806c780 tx=0x7f7f84009bd0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.971+0000 7f7f900ec700 1 -- 172.21.15.59:0/2020032933 shutdown_connections 2023-09-21T00:17:33.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.971+0000 7f7f900ec700 1 --2- 172.21.15.59:0/2020032933 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f880b8d80 0x7f7f880b53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.971+0000 7f7f900ec700 1 --2- 172.21.15.59:0/2020032933 >> v2:172.21.15.83:3300/0 conn(0x7f7f8815d4c0 0x7f7f880d14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.971+0000 7f7f900ec700 1 --2- 172.21.15.59:0/2020032933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f880d2e80 0x7f7f880b4e70 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.971+0000 7f7f900ec700 1 -- 172.21.15.59:0/2020032933 >> 172.21.15.59:0/2020032933 conn(0x7f7f880724e0 msgr2=0x7f7f880cfe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:33.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.971+0000 7f7f900ec700 1 -- 172.21.15.59:0/2020032933 shutdown_connections 2023-09-21T00:17:33.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.971+0000 7f7f900ec700 1 -- 172.21.15.59:0/2020032933 wait complete. 2023-09-21T00:17:33.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.973+0000 7f7f900ec700 1 Processor -- start 2023-09-21T00:17:33.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.973+0000 7f7f900ec700 1 -- start start 2023-09-21T00:17:33.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.973+0000 7f7f900ec700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f880b8d80 0x7f7f880caea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.973+0000 7f7f900ec700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f880d2e80 0x7f7f880c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.973+0000 7f7f900ec700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f8815d4c0 0x7f7f881545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.973+0000 7f7f900ec700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f880cb3e0 con 0x7f7f8815d4c0 2023-09-21T00:17:33.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.973+0000 7f7f900ec700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f880cb640 con 0x7f7f880b8d80 2023-09-21T00:17:33.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.973+0000 7f7f900ec700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f880cb920 con 0x7f7f880d2e80 2023-09-21T00:17:33.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.974+0000 7f7f8d687700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f880d2e80 0x7f7f880c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.974+0000 7f7f8d687700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f880d2e80 0x7f7f880c8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.59:52192/0 (socket says 172.21.15.59:52192) 2023-09-21T00:17:33.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.974+0000 7f7f8d687700 1 -- 172.21.15.59:0/3745845972 learned_addr learned my addr 172.21.15.59:0/3745845972 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:33.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.974+0000 7f7f8de88700 1 --2- 172.21.15.59:0/3745845972 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f880b8d80 0x7f7f880caea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.974+0000 7f7f8e689700 1 --2- 172.21.15.59:0/3745845972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f8815d4c0 0x7f7f881545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.974+0000 7f7f8d687700 1 -- 172.21.15.59:0/3745845972 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f880b8d80 msgr2=0x7f7f880caea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.974+0000 7f7f8d687700 1 --2- 172.21.15.59:0/3745845972 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7f880b8d80 0x7f7f880caea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.974+0000 7f7f8d687700 1 -- 172.21.15.59:0/3745845972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f8815d4c0 msgr2=0x7f7f881545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.974+0000 7f7f8d687700 1 --2- 172.21.15.59:0/3745845972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f8815d4c0 0x7f7f881545c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.974+0000 7f7f8d687700 1 -- 172.21.15.59:0/3745845972 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f80009a70 con 0x7f7f880d2e80 2023-09-21T00:17:33.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.974+0000 7f7f8e689700 1 --2- 172.21.15.59:0/3745845972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f8815d4c0 0x7f7f881545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:17:33.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.974+0000 7f7f8d687700 1 --2- 172.21.15.59:0/3745845972 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f880d2e80 0x7f7f880c8fb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7f84000c00 tx=0x7f7f84004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.975+0000 7f7f7e7fc700 1 -- 172.21.15.59:0/3745845972 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f84004300 con 0x7f7f880d2e80 2023-09-21T00:17:33.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.975+0000 7f7f7e7fc700 1 -- 172.21.15.59:0/3745845972 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f8401f070 con 0x7f7f880d2e80 2023-09-21T00:17:33.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.975+0000 7f7f900ec700 1 -- 172.21.15.59:0/3745845972 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f84009550 con 0x7f7f880d2e80 2023-09-21T00:17:33.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.975+0000 7f7f900ec700 1 -- 172.21.15.59:0/3745845972 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f880cbee0 con 0x7f7f880d2e80 2023-09-21T00:17:33.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.976+0000 7f7f7e7fc700 1 -- 172.21.15.59:0/3745845972 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f840036a0 con 0x7f7f880d2e80 2023-09-21T00:17:33.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.978+0000 7f7f7e7fc700 1 -- 172.21.15.59:0/3745845972 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f7f84021030 con 0x7f7f880d2e80 2023-09-21T00:17:33.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.978+0000 7f7f7e7fc700 1 --2- 172.21.15.59:0/3745845972 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f7f6c073610 0x7f7f6c075ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.978+0000 7f7f7e7fc700 1 -- 172.21.15.59:0/3745845972 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7f8408a930 con 0x7f7f880d2e80 2023-09-21T00:17:33.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.978+0000 7f7f8de88700 1 --2- 172.21.15.59:0/3745845972 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f7f6c073610 0x7f7f6c075ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.979+0000 7f7f8de88700 1 --2- 172.21.15.59:0/3745845972 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f7f6c073610 0x7f7f6c075ad0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7f800114e0 tx=0x7f7f8000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.981+0000 7f9c3effd700 1 -- 172.21.15.59:0/839681692 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c40004a70 con 0x7f9c500b10d0 2023-09-21T00:17:33.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.981+0000 7f9c3effd700 1 -- 172.21.15.59:0/839681692 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c40004bd0 con 0x7f9c500b10d0 2023-09-21T00:17:33.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.981+0000 7f9c3effd700 1 -- 172.21.15.59:0/839681692 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4000ce40 con 0x7f9c500b10d0 2023-09-21T00:17:33.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.982+0000 7f9c5499e700 1 -- 172.21.15.59:0/839681692 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c50141770 con 0x7f9c500b10d0 2023-09-21T00:17:33.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.982+0000 7f9c5499e700 1 -- 172.21.15.59:0/839681692 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c50141d30 con 0x7f9c500b10d0 2023-09-21T00:17:33.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.982+0000 7f9c5499e700 1 -- 172.21.15.59:0/839681692 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9c500cb6d0 con 0x7f9c500b10d0 2023-09-21T00:17:33.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.983+0000 7fd94fa35700 1 -- 172.21.15.59:0/1287875828 --> [v2:172.21.15.59:6800/869668251,v1:172.21.15.59:6801/869668251] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd928005cb0 con 0x7fd9280015e0 2023-09-21T00:17:33.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.984+0000 7fd93dffb700 1 -- 172.21.15.59:0/1287875828 <== osd.1 v2:172.21.15.59:6800/869668251 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd928005cb0 con 0x7fd9280015e0 2023-09-21T00:17:33.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.985+0000 7f7f900ec700 1 --2- 172.21.15.59:0/3745845972 >> [v2:172.21.15.83:6824/4204859272,v1:172.21.15.83:6825/4204859272] conn(0x7f7f700015e0 0x7f7f70003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.985+0000 7f7f900ec700 1 -- 172.21.15.59:0/3745845972 --> [v2:172.21.15.83:6824/4204859272,v1:172.21.15.83:6825/4204859272] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7f70006bd0 con 0x7f7f700015e0 2023-09-21T00:17:33.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.984+0000 7f9c3effd700 1 -- 172.21.15.59:0/839681692 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f9c40011070 con 0x7f9c500b10d0 2023-09-21T00:17:33.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.984+0000 7f9c3effd700 1 --2- 172.21.15.59:0/839681692 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f9c3006aed0 0x7f9c3006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.985+0000 7f9c3effd700 1 -- 172.21.15.59:0/839681692 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9c40088fe0 con 0x7f9c500b10d0 2023-09-21T00:17:33.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.985+0000 7f9c3effd700 1 --2- 172.21.15.59:0/839681692 >> [v2:172.21.15.83:6816/156730565,v1:172.21.15.83:6817/156730565] conn(0x7f9c30074510 0x7f9c30076950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.985+0000 7f9c3effd700 1 -- 172.21.15.59:0/839681692 --> [v2:172.21.15.83:6816/156730565,v1:172.21.15.83:6817/156730565] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9c30077020 con 0x7f9c30074510 2023-09-21T00:17:33.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.985+0000 7f9c3effd700 1 -- 172.21.15.59:0/839681692 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c40089390 con 0x7f9c500b10d0 2023-09-21T00:17:33.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.985+0000 7f9c4ed9d700 1 --2- 172.21.15.59:0/839681692 >> [v2:172.21.15.83:6816/156730565,v1:172.21.15.83:6817/156730565] conn(0x7f9c30074510 0x7f9c30076950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.985+0000 7f9c4ed9d700 1 --2- 172.21.15.59:0/839681692 >> [v2:172.21.15.83:6816/156730565,v1:172.21.15.83:6817/156730565] conn(0x7f9c30074510 0x7f9c30076950 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.986+0000 7f9c4dd9b700 1 --2- 172.21.15.59:0/839681692 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f9c3006aed0 0x7f9c3006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.986+0000 7f9c4dd9b700 1 --2- 172.21.15.59:0/839681692 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f9c3006aed0 0x7f9c3006d390 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9c500ce0e0 tx=0x7f9c4800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.986+0000 7f9c3effd700 1 -- 172.21.15.59:0/839681692 <== osd.5 v2:172.21.15.83:6816/156730565 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f9c30077020 con 0x7f9c30074510 2023-09-21T00:17:33.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.987+0000 7f7f8e689700 1 --2- 172.21.15.59:0/3745845972 >> [v2:172.21.15.83:6824/4204859272,v1:172.21.15.83:6825/4204859272] conn(0x7f7f700015e0 0x7f7f70003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.987+0000 7fee3deb4700 1 -- 172.21.15.59:0/3125886832 --> [v2:172.21.15.83:6801/1337723778,v1:172.21.15.83:6800/1337723778] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fee380b2660 con 0x7fee240743c0 2023-09-21T00:17:33.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.987+0000 7f7f8e689700 1 --2- 172.21.15.59:0/3745845972 >> [v2:172.21.15.83:6824/4204859272,v1:172.21.15.83:6825/4204859272] conn(0x7f7f700015e0 0x7f7f70003aa0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.987+0000 7fee1ffff700 1 -- 172.21.15.59:0/3125886832 <== osd.6 v2:172.21.15.83:6801/1337723778 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fee2c009280 con 0x7fee240743c0 2023-09-21T00:17:33.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.988+0000 7fee3deb4700 1 -- 172.21.15.59:0/3125886832 >> [v2:172.21.15.83:6801/1337723778,v1:172.21.15.83:6800/1337723778] conn(0x7fee240743c0 msgr2=0x7fee24076800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.988+0000 7fee3deb4700 1 --2- 172.21.15.59:0/3125886832 >> [v2:172.21.15.83:6801/1337723778,v1:172.21.15.83:6800/1337723778] conn(0x7fee240743c0 0x7fee24076800 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.988+0000 7fee3deb4700 1 -- 172.21.15.59:0/3125886832 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fee2406ae00 msgr2=0x7fee2406d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.988+0000 7fee3deb4700 1 --2- 172.21.15.59:0/3125886832 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fee2406ae00 0x7fee2406d2c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fee28000c00 tx=0x7fee28008030 comp rx=0 tx=0).stop 2023-09-21T00:17:33.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.988+0000 7fee3deb4700 1 -- 172.21.15.59:0/3125886832 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fee380b35f0 msgr2=0x7fee3815d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.988+0000 7f7f7e7fc700 1 -- 172.21.15.59:0/3745845972 <== osd.7 v2:172.21.15.83:6824/4204859272 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f7f70006bd0 con 0x7f7f700015e0 2023-09-21T00:17:33.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.988+0000 7fee3deb4700 1 --2- 172.21.15.59:0/3125886832 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fee380b35f0 0x7fee3815d670 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fee3000be00 tx=0x7fee3000be30 comp rx=0 tx=0).stop 2023-09-21T00:17:33.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.988+0000 7fee37fff700 1 -- 172.21.15.59:0/3125886832 reap_dead start 2023-09-21T00:17:33.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.988+0000 7fee3deb4700 1 -- 172.21.15.59:0/3125886832 shutdown_connections 2023-09-21T00:17:33.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.988+0000 7fee3deb4700 1 -- 172.21.15.59:0/3125886832 >> 172.21.15.59:0/3125886832 conn(0x7fee3806c7c0 msgr2=0x7fee381f80a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:33.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.988+0000 7fee3deb4700 1 -- 172.21.15.59:0/3125886832 shutdown_connections 2023-09-21T00:17:33.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.988+0000 7fee3deb4700 1 -- 172.21.15.59:0/3125886832 wait complete. 2023-09-21T00:17:33.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.989+0000 7fd94fa35700 1 -- 172.21.15.59:0/1287875828 >> [v2:172.21.15.59:6800/869668251,v1:172.21.15.59:6801/869668251] conn(0x7fd9280015e0 msgr2=0x7fd928003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.989+0000 7fd94fa35700 1 --2- 172.21.15.59:0/1287875828 >> [v2:172.21.15.59:6800/869668251,v1:172.21.15.59:6801/869668251] conn(0x7fd9280015e0 0x7fd928003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.989+0000 7f69fb7fe700 1 -- 172.21.15.59:0/2425425358 --> [v2:172.21.15.83:6802/1741219098,v1:172.21.15.83:6803/1741219098] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6a100ce800 con 0x7f69fc0964e0 2023-09-21T00:17:33.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.992+0000 7f8d0f9cf700 1 -- 172.21.15.59:0/351107548 --> [v2:172.21.15.59:6808/2418314235,v1:172.21.15.59:6809/2418314235] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8d080ce940 con 0x7f8cec0743c0 2023-09-21T00:17:33.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.992+0000 7fd94fa35700 1 -- 172.21.15.59:0/1287875828 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd92c06aed0 msgr2=0x7fd92c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.992+0000 7fd94fa35700 1 --2- 172.21.15.59:0/1287875828 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd92c06aed0 0x7fd92c06d390 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd9440090b0 tx=0x7fd94401c040 comp rx=0 tx=0).stop 2023-09-21T00:17:33.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.992+0000 7fd94fa35700 1 -- 172.21.15.59:0/1287875828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9480cf240 msgr2=0x7fd9480b2f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.992+0000 7fd94fa35700 1 --2- 172.21.15.59:0/1287875828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9480cf240 0x7fd9480b2f70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd94000efc0 tx=0x7fd94000c3a0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.992+0000 7fd94dfd2700 1 -- 172.21.15.59:0/1287875828 reap_dead start 2023-09-21T00:17:33.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.992+0000 7fd94fa35700 1 -- 172.21.15.59:0/1287875828 shutdown_connections 2023-09-21T00:17:33.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.992+0000 7fd94fa35700 1 -- 172.21.15.59:0/1287875828 >> 172.21.15.59:0/1287875828 conn(0x7fd94806c7c0 msgr2=0x7fd9480cc340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:33.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.992+0000 7fd94fa35700 1 -- 172.21.15.59:0/1287875828 shutdown_connections 2023-09-21T00:17:33.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.992+0000 7fd94fa35700 1 -- 172.21.15.59:0/1287875828 wait complete. 2023-09-21T00:17:33.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.993+0000 7f8cfdffb700 1 -- 172.21.15.59:0/351107548 <== osd.0 v2:172.21.15.59:6808/2418314235 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8d04001670 con 0x7f8cec0743c0 2023-09-21T00:17:33.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.993+0000 7f8d0f9cf700 1 -- 172.21.15.59:0/351107548 >> [v2:172.21.15.59:6808/2418314235,v1:172.21.15.59:6809/2418314235] conn(0x7f8cec0743c0 msgr2=0x7f8cec076800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.993+0000 7f8d0f9cf700 1 --2- 172.21.15.59:0/351107548 >> [v2:172.21.15.59:6808/2418314235,v1:172.21.15.59:6809/2418314235] conn(0x7f8cec0743c0 0x7f8cec076800 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.994+0000 7f8d0f9cf700 1 -- 172.21.15.59:0/351107548 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f8cec06ae00 msgr2=0x7f8cec06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.994+0000 7f8d0f9cf700 1 --2- 172.21.15.59:0/351107548 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f8cec06ae00 0x7f8cec06d2c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8005de0 tx=0x7f8cf8006ee0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.994+0000 7f8d0f9cf700 1 -- 172.21.15.59:0/351107548 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d08160c10 msgr2=0x7f8d0820b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.994+0000 7f8d0f9cf700 1 --2- 172.21.15.59:0/351107548 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8d08160c10 0x7f8d0820b500 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8d00014000 tx=0x7f8d00004b20 comp rx=0 tx=0).stop 2023-09-21T00:17:33.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.994+0000 7f8d0df6c700 1 -- 172.21.15.59:0/351107548 reap_dead start 2023-09-21T00:17:33.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.994+0000 7f8d0f9cf700 1 -- 172.21.15.59:0/351107548 shutdown_connections 2023-09-21T00:17:33.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.994+0000 7f8d0f9cf700 1 -- 172.21.15.59:0/351107548 >> 172.21.15.59:0/351107548 conn(0x7f8d0806c7c0 msgr2=0x7f8d08163c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:33.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.994+0000 7f8d0f9cf700 1 -- 172.21.15.59:0/351107548 shutdown_connections 2023-09-21T00:17:33.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.994+0000 7f8d0f9cf700 1 -- 172.21.15.59:0/351107548 wait complete. 2023-09-21T00:17:33.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.998+0000 7fbdc354f700 1 -- 172.21.15.59:0/1128075088 --> [v2:172.21.15.59:6816/372517778,v1:172.21.15.59:6817/372517778] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbdbc0cf360 con 0x7fbda0074490 2023-09-21T00:17:33.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.999+0000 7fbdb1ffb700 1 -- 172.21.15.59:0/1128075088 <== osd.2 v2:172.21.15.59:6816/372517778 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbdb400f040 con 0x7fbda0074490 2023-09-21T00:17:33.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:32.999+0000 7f6a05ffb700 1 -- 172.21.15.59:0/2425425358 <== osd.4 v2:172.21.15.83:6802/1741219098 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6a08001f20 con 0x7f69fc0964e0 2023-09-21T00:17:33.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.000+0000 7fbdc354f700 1 -- 172.21.15.59:0/1128075088 >> [v2:172.21.15.59:6816/372517778,v1:172.21.15.59:6817/372517778] conn(0x7fbda0074490 msgr2=0x7fbda00768d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.000+0000 7fbdc354f700 1 --2- 172.21.15.59:0/1128075088 >> [v2:172.21.15.59:6816/372517778,v1:172.21.15.59:6817/372517778] conn(0x7fbda0074490 0x7fbda00768d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.000+0000 7f69fb7fe700 1 -- 172.21.15.59:0/2425425358 >> [v2:172.21.15.83:6802/1741219098,v1:172.21.15.83:6803/1741219098] conn(0x7f69fc0964e0 msgr2=0x7f69fc098920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.000+0000 7f69fb7fe700 1 --2- 172.21.15.59:0/2425425358 >> [v2:172.21.15.83:6802/1741219098,v1:172.21.15.83:6803/1741219098] conn(0x7f69fc0964e0 0x7f69fc098920 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.000+0000 7f69fb7fe700 1 -- 172.21.15.59:0/2425425358 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f69fc08cf20 msgr2=0x7f69fc08f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.000+0000 7f69fb7fe700 1 --2- 172.21.15.59:0/2425425358 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f69fc08cf20 0x7f69fc08f3e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6a10160e30 tx=0x7f6a0c006c80 comp rx=0 tx=0).stop 2023-09-21T00:17:33.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.000+0000 7f69fb7fe700 1 -- 172.21.15.59:0/2425425358 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a100caca0 msgr2=0x7f6a101f1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.000+0000 7f69fb7fe700 1 --2- 172.21.15.59:0/2425425358 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a100caca0 0x7f6a101f1e90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6a00014040 tx=0x7f6a00004750 comp rx=0 tx=0).stop 2023-09-21T00:17:33.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.000+0000 7f6a15a5a700 1 -- 172.21.15.59:0/2425425358 reap_dead start 2023-09-21T00:17:33.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.001+0000 7fbdc354f700 1 -- 172.21.15.59:0/1128075088 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fbda006ae50 msgr2=0x7fbda006d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.001+0000 7fbdc354f700 1 --2- 172.21.15.59:0/1128075088 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fbda006ae50 0x7fbda006d310 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc167a10 tx=0x7fbdac008040 comp rx=0 tx=0).stop 2023-09-21T00:17:33.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.001+0000 7fbdc354f700 1 -- 172.21.15.59:0/1128075088 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbdbc0b0b90 msgr2=0x7fbdbc200580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.001+0000 7fbdc354f700 1 --2- 172.21.15.59:0/1128075088 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbdbc0b0b90 0x7fbdbc200580 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbdb8016000 tx=0x7fbdb8004750 comp rx=0 tx=0).stop 2023-09-21T00:17:33.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.001+0000 7fbdc1aec700 1 -- 172.21.15.59:0/1128075088 reap_dead start 2023-09-21T00:17:33.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.001+0000 7f69fb7fe700 1 -- 172.21.15.59:0/2425425358 shutdown_connections 2023-09-21T00:17:33.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.001+0000 7f69fb7fe700 1 -- 172.21.15.59:0/2425425358 >> 172.21.15.59:0/2425425358 conn(0x7f6a100ccae0 msgr2=0x7f6a100afce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:33.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.002+0000 7f791f161700 1 -- 172.21.15.59:0/2822358778 --> [v2:172.21.15.59:6824/575188498,v1:172.21.15.59:6825/575188498] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f79181646f0 con 0x7f79040743c0 2023-09-21T00:17:33.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.002+0000 7f69fb7fe700 1 -- 172.21.15.59:0/2425425358 shutdown_connections 2023-09-21T00:17:33.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.002+0000 7f69fb7fe700 1 -- 172.21.15.59:0/2425425358 wait complete. 2023-09-21T00:17:33.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.003+0000 7f790d7fa700 1 -- 172.21.15.59:0/2822358778 <== osd.3 v2:172.21.15.59:6824/575188498 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f79181646f0 con 0x7f79040743c0 2023-09-21T00:17:33.098 INFO:teuthology.orchestra.run.smithi059.stdout:55834574859 2023-09-21T00:17:33.099 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-09-21T00:17:33.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.007+0000 7f791f161700 1 -- 172.21.15.59:0/2822358778 >> [v2:172.21.15.59:6824/575188498,v1:172.21.15.59:6825/575188498] conn(0x7f79040743c0 msgr2=0x7f7904076800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.007+0000 7f791f161700 1 --2- 172.21.15.59:0/2822358778 >> [v2:172.21.15.59:6824/575188498,v1:172.21.15.59:6825/575188498] conn(0x7f79040743c0 0x7f7904076800 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.008+0000 7f791f161700 1 -- 172.21.15.59:0/2822358778 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f790406ae00 msgr2=0x7f790406d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.008+0000 7f791f161700 1 --2- 172.21.15.59:0/2822358778 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f790406ae00 0x7f790406d2c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f79181fab40 tx=0x7f7908009040 comp rx=0 tx=0).stop 2023-09-21T00:17:33.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.008+0000 7f791f161700 1 -- 172.21.15.59:0/2822358778 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79180b26f0 msgr2=0x7f7918153bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.008+0000 7f791f161700 1 --2- 172.21.15.59:0/2822358778 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79180b26f0 0x7f7918153bd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f791400b470 tx=0x7f791400b780 comp rx=0 tx=0).stop 2023-09-21T00:17:33.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.008+0000 7f791d6fe700 1 -- 172.21.15.59:0/2822358778 reap_dead start 2023-09-21T00:17:33.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.009+0000 7fbdc354f700 1 -- 172.21.15.59:0/1128075088 shutdown_connections 2023-09-21T00:17:33.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.009+0000 7fbdc354f700 1 -- 172.21.15.59:0/1128075088 >> 172.21.15.59:0/1128075088 conn(0x7fbdbc06de70 msgr2=0x7fbdbc0af5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:33.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.009+0000 7f791f161700 1 -- 172.21.15.59:0/2822358778 shutdown_connections 2023-09-21T00:17:33.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.009+0000 7f791f161700 1 -- 172.21.15.59:0/2822358778 >> 172.21.15.59:0/2822358778 conn(0x7f79180b4ee0 msgr2=0x7f79180b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:33.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.009+0000 7f791f161700 1 -- 172.21.15.59:0/2822358778 shutdown_connections 2023-09-21T00:17:33.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.009+0000 7f791f161700 1 -- 172.21.15.59:0/2822358778 wait complete. 2023-09-21T00:17:33.105 INFO:teuthology.orchestra.run.smithi059.stdout:55834574858 2023-09-21T00:17:33.106 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-21T00:17:33.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.014+0000 7f7f900ec700 1 -- 172.21.15.59:0/3745845972 --> [v2:172.21.15.83:6824/4204859272,v1:172.21.15.83:6825/4204859272] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7f70005cb0 con 0x7f7f700015e0 2023-09-21T00:17:33.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.016+0000 7f7f7e7fc700 1 -- 172.21.15.59:0/3745845972 <== osd.7 v2:172.21.15.83:6824/4204859272 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7f70005cb0 con 0x7f7f700015e0 2023-09-21T00:17:33.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.014+0000 7fbdc354f700 1 -- 172.21.15.59:0/1128075088 shutdown_connections 2023-09-21T00:17:33.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.014+0000 7fbdc354f700 1 -- 172.21.15.59:0/1128075088 wait complete. 2023-09-21T00:17:33.109 INFO:teuthology.orchestra.run.smithi059.stdout:55834574860 2023-09-21T00:17:33.110 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-21T00:17:33.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.016+0000 7f9c5499e700 1 -- 172.21.15.59:0/839681692 --> [v2:172.21.15.83:6816/156730565,v1:172.21.15.83:6817/156730565] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9c500b42c0 con 0x7f9c30074510 2023-09-21T00:17:33.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.018+0000 7f7f900ec700 1 -- 172.21.15.59:0/3745845972 >> [v2:172.21.15.83:6824/4204859272,v1:172.21.15.83:6825/4204859272] conn(0x7f7f700015e0 msgr2=0x7f7f70003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.018+0000 7f7f900ec700 1 --2- 172.21.15.59:0/3745845972 >> [v2:172.21.15.83:6824/4204859272,v1:172.21.15.83:6825/4204859272] conn(0x7f7f700015e0 0x7f7f70003aa0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.018+0000 7f7f900ec700 1 -- 172.21.15.59:0/3745845972 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f7f6c073610 msgr2=0x7f7f6c075ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.018+0000 7f7f900ec700 1 --2- 172.21.15.59:0/3745845972 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f7f6c073610 0x7f7f6c075ad0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7f800114e0 tx=0x7f7f8000b040 comp rx=0 tx=0).stop 2023-09-21T00:17:33.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.018+0000 7f7f900ec700 1 -- 172.21.15.59:0/3745845972 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f880d2e80 msgr2=0x7f7f880c8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.018+0000 7f7f900ec700 1 --2- 172.21.15.59:0/3745845972 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7f880d2e80 0x7f7f880c8fb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7f84000c00 tx=0x7f7f84004750 comp rx=0 tx=0).stop 2023-09-21T00:17:33.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.018+0000 7f7f8e689700 1 -- 172.21.15.59:0/3745845972 reap_dead start 2023-09-21T00:17:33.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.018+0000 7f7f900ec700 1 -- 172.21.15.59:0/3745845972 shutdown_connections 2023-09-21T00:17:33.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.018+0000 7f7f900ec700 1 -- 172.21.15.59:0/3745845972 >> 172.21.15.59:0/3745845972 conn(0x7f7f880724e0 msgr2=0x7f7f880d34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:33.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.018+0000 7f7f900ec700 1 -- 172.21.15.59:0/3745845972 shutdown_connections 2023-09-21T00:17:33.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.018+0000 7f7f900ec700 1 -- 172.21.15.59:0/3745845972 wait complete. 2023-09-21T00:17:33.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.021+0000 7f9c3effd700 1 -- 172.21.15.59:0/839681692 <== osd.5 v2:172.21.15.83:6816/156730565 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9c44004040 con 0x7f9c30074510 2023-09-21T00:17:33.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.021+0000 7f9c5499e700 1 -- 172.21.15.59:0/839681692 >> [v2:172.21.15.83:6816/156730565,v1:172.21.15.83:6817/156730565] conn(0x7f9c30074510 msgr2=0x7f9c30076950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.021+0000 7f9c5499e700 1 --2- 172.21.15.59:0/839681692 >> [v2:172.21.15.83:6816/156730565,v1:172.21.15.83:6817/156730565] conn(0x7f9c30074510 0x7f9c30076950 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.022+0000 7f9c5499e700 1 -- 172.21.15.59:0/839681692 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f9c3006aed0 msgr2=0x7f9c3006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.022+0000 7f9c5499e700 1 --2- 172.21.15.59:0/839681692 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f9c3006aed0 0x7f9c3006d390 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9c500ce0e0 tx=0x7f9c4800b040 comp rx=0 tx=0).stop 2023-09-21T00:17:33.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.022+0000 7f9c5499e700 1 -- 172.21.15.59:0/839681692 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c500b10d0 msgr2=0x7f9c5013ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.022+0000 7f9c5499e700 1 --2- 172.21.15.59:0/839681692 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c500b10d0 0x7f9c5013ecb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9c4000c3c0 tx=0x7f9c4000c6d0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.022+0000 7f9c4ed9d700 1 -- 172.21.15.59:0/839681692 reap_dead start 2023-09-21T00:17:33.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.022+0000 7f9c5499e700 1 -- 172.21.15.59:0/839681692 shutdown_connections 2023-09-21T00:17:33.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.022+0000 7f9c5499e700 1 -- 172.21.15.59:0/839681692 >> 172.21.15.59:0/839681692 conn(0x7f9c5006de70 msgr2=0x7f9c5006d050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:33.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.023+0000 7f9c5499e700 1 -- 172.21.15.59:0/839681692 shutdown_connections 2023-09-21T00:17:33.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.023+0000 7f9c5499e700 1 -- 172.21.15.59:0/839681692 wait complete. 2023-09-21T00:17:33.118 INFO:teuthology.orchestra.run.smithi059.stdout:55834574859 2023-09-21T00:17:33.118 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-09-21T00:17:33.120 INFO:teuthology.orchestra.run.smithi059.stdout:55834574858 2023-09-21T00:17:33.120 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-21T00:17:33.121 INFO:teuthology.orchestra.run.smithi059.stdout:55834574859 2023-09-21T00:17:33.122 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-21T00:17:33.123 INFO:teuthology.orchestra.run.smithi059.stdout:55834574860 2023-09-21T00:17:33.123 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-09-21T00:17:33.125 INFO:teuthology.orchestra.run.smithi059.stdout:55834574857 2023-09-21T00:17:33.125 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-09-21T00:17:33.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.367+0000 7fac9f8e0700 1 Processor -- start 2023-09-21T00:17:33.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.367+0000 7f0adb8b4700 1 Processor -- start 2023-09-21T00:17:33.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.368+0000 7f0adb8b4700 1 -- start start 2023-09-21T00:17:33.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.369+0000 7f0adb8b4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ad414b3c0 0x7f0ad40720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.369+0000 7f0adb8b4700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0ad40ce690 0x7f0ad406a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.369+0000 7f0adb8b4700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ad406b110 con 0x7f0ad406acc0 2023-09-21T00:17:33.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.369+0000 7f0adb8b4700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ad4072c70 con 0x7f0ad40ce690 2023-09-21T00:17:33.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.369+0000 7f0adb8b4700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad4072990 con 0x7f0ad414b3c0 2023-09-21T00:17:33.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.369+0000 7f0ad8e4f700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0ad40ce690 0x7f0ad406a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.369+0000 7f0ad8e4f700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0ad40ce690 0x7f0ad406a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.59:37712/0 (socket says 172.21.15.59:37712) 2023-09-21T00:17:33.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.369+0000 7f0ad8e4f700 1 -- 172.21.15.59:0/4182763444 learned_addr learned my addr 172.21.15.59:0/4182763444 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:33.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.367+0000 7fac9f8e0700 1 -- start start 2023-09-21T00:17:33.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.369+0000 7fac9f8e0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac98070cb0 0x7fac9815a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.369+0000 7fac9f8e0700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fac980c9e20 0x7fac98068590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.369+0000 7fac9f8e0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fac980ca2a0 0x7fac980cc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.369+0000 7fac9f8e0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac9815aef0 con 0x7fac980ca2a0 2023-09-21T00:17:33.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.369+0000 7fac9f8e0700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac9806d5b0 con 0x7fac980c9e20 2023-09-21T00:17:33.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.369+0000 7fac9f8e0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac980b2380 con 0x7fac98070cb0 2023-09-21T00:17:33.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.369+0000 7fac9de7d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fac980ca2a0 0x7fac980cc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.369+0000 7fac9de7d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fac980ca2a0 0x7fac980cc1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51598/0 (socket says 172.21.15.59:51598) 2023-09-21T00:17:33.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.369+0000 7fac9de7d700 1 -- 172.21.15.59:0/505359308 learned_addr learned my addr 172.21.15.59:0/505359308 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:33.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.370+0000 7fac9ce7b700 1 --2- 172.21.15.59:0/505359308 >> v2:172.21.15.83:3300/0 conn(0x7fac980c9e20 0x7fac98068590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.370+0000 7fac9de7d700 1 -- 172.21.15.59:0/505359308 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac98070cb0 msgr2=0x7fac9815a9b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-21T00:17:33.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.370+0000 7fac9de7d700 1 --2- 172.21.15.59:0/505359308 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac98070cb0 0x7fac9815a9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.370+0000 7fac9de7d700 1 -- 172.21.15.59:0/505359308 >> v2:172.21.15.83:3300/0 conn(0x7fac980c9e20 msgr2=0x7fac98068590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:33.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.370+0000 7fac9de7d700 1 --2- 172.21.15.59:0/505359308 >> v2:172.21.15.83:3300/0 conn(0x7fac980c9e20 0x7fac98068590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.370+0000 7fac9de7d700 1 -- 172.21.15.59:0/505359308 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac98071190 con 0x7fac980ca2a0 2023-09-21T00:17:33.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.370+0000 7fdf93abf700 1 Processor -- start 2023-09-21T00:17:33.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.370+0000 7f0ad9650700 1 --2- 172.21.15.59:0/4182763444 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ad414b3c0 0x7f0ad40720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.370+0000 7f0acbfff700 1 -- 172.21.15.59:0/4182763444 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3997723409 0 0) 0x7f0acc001490 con 0x7f0ad406acc0 2023-09-21T00:17:33.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.370+0000 7f0acbfff700 1 -- 172.21.15.59:0/4182763444 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ac00035b0 con 0x7f0ad406acc0 2023-09-21T00:17:33.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.370+0000 7f0acbfff700 1 -- 172.21.15.59:0/4182763444 <== mon.1 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 590795959 0 0) 0x7f0ac00035b0 con 0x7f0ad406acc0 2023-09-21T00:17:33.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.370+0000 7f0ad9650700 1 -- 172.21.15.59:0/4182763444 >> v2:172.21.15.83:3300/0 conn(0x7f0ad40ce690 msgr2=0x7f0ad406a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:33.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.370+0000 7f0ad9650700 1 --2- 172.21.15.59:0/4182763444 >> v2:172.21.15.83:3300/0 conn(0x7f0ad40ce690 0x7f0ad406a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.370+0000 7f0ad9650700 1 -- 172.21.15.59:0/4182763444 >> v1:172.21.15.83:6789/0 conn(0x7f0ad406acc0 legacy=0x7f0ad40cfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.370+0000 7f0ad9650700 1 -- 172.21.15.59:0/4182763444 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad40ca8e0 con 0x7f0ad414b3c0 2023-09-21T00:17:33.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.370+0000 7f0ad9650700 1 --2- 172.21.15.59:0/4182763444 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ad414b3c0 0x7f0ad40720d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0ac4009840 tx=0x7f0ac4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e827e8e787bd13a server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.371+0000 7fac9de7d700 1 --2- 172.21.15.59:0/505359308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac980ca2a0 0x7fac980cc1f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fac9806b430 tx=0x7fac9000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dba6b8c9cedb4e9 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.371+0000 7fac8ffff700 1 -- 172.21.15.59:0/505359308 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9000e070 con 0x7fac980ca2a0 2023-09-21T00:17:33.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.371+0000 7fac8ffff700 1 -- 172.21.15.59:0/505359308 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac9000b980 con 0x7fac980ca2a0 2023-09-21T00:17:33.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.371+0000 7fac8ffff700 1 -- 172.21.15.59:0/505359308 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9000bd30 con 0x7fac980ca2a0 2023-09-21T00:17:33.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.370+0000 7fdf93abf700 1 -- start start 2023-09-21T00:17:33.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.371+0000 7fdf93abf700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdf8c1596f0 0x7fdf8c071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.371+0000 7fdf93abf700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fdf8c070590 0x7fdf8c0cc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.371+0000 7fdf93abf700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf8c0724d0 con 0x7fdf8c0cef00 2023-09-21T00:17:33.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.371+0000 7fdf93abf700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf8c0cc820 con 0x7fdf8c070590 2023-09-21T00:17:33.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.371+0000 7fdf93abf700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c0727b0 con 0x7fdf8c1596f0 2023-09-21T00:17:33.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.371+0000 7fdf9105a700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fdf8c070590 0x7fdf8c0cc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.371+0000 7fdf9105a700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fdf8c070590 0x7fdf8c0cc2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.59:37720/0 (socket says 172.21.15.59:37720) 2023-09-21T00:17:33.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.371+0000 7fdf9105a700 1 -- 172.21.15.59:0/658990818 learned_addr learned my addr 172.21.15.59:0/658990818 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:33.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.372+0000 7fdf9185b700 1 --2- 172.21.15.59:0/658990818 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdf8c1596f0 0x7fdf8c071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.372+0000 7fac9f8e0700 1 -- 172.21.15.59:0/505359308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac980ca2a0 msgr2=0x7fac980cc1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.372+0000 7fac9f8e0700 1 --2- 172.21.15.59:0/505359308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac980ca2a0 0x7fac980cc1f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fac9806b430 tx=0x7fac9000b330 comp rx=0 tx=0).stop 2023-09-21T00:17:33.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.372+0000 7f0acbfff700 1 -- 172.21.15.59:0/4182763444 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0acc001b80 con 0x7f0ad414b3c0 2023-09-21T00:17:33.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.372+0000 7fdf9105a700 1 -- 172.21.15.59:0/658990818 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdf8c1596f0 msgr2=0x7fdf8c071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:33.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.372+0000 7fdf9105a700 1 --2- 172.21.15.59:0/658990818 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdf8c1596f0 0x7fdf8c071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.372+0000 7fdf9105a700 1 -- 172.21.15.59:0/658990818 >> v1:172.21.15.83:6789/0 conn(0x7fdf8c0cef00 legacy=0x7fdf8c0b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.372+0000 7fdf9105a700 1 -- 172.21.15.59:0/658990818 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf8c0cb800 con 0x7fdf8c070590 2023-09-21T00:17:33.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.372+0000 7f0acbfff700 1 -- 172.21.15.59:0/4182763444 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac4004030 con 0x7f0ad414b3c0 2023-09-21T00:17:33.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.372+0000 7f0acbfff700 1 -- 172.21.15.59:0/4182763444 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac40043c0 con 0x7f0ad414b3c0 2023-09-21T00:17:33.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.372+0000 7fdf9105a700 1 --2- 172.21.15.59:0/658990818 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdf8c070590 0x7fdf8c0cc2e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c009210 tx=0x7fdf7c009520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a62894a9cbd06d1f server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.372+0000 7f7cfef36700 1 Processor -- start 2023-09-21T00:17:33.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.372+0000 7fdf90859700 1 -- 172.21.15.59:0/658990818 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c00f940 con 0x7fdf8c070590 2023-09-21T00:17:33.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.372+0000 7fdf90859700 1 -- 172.21.15.59:0/658990818 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf7c00faa0 con 0x7fdf8c070590 2023-09-21T00:17:33.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.372+0000 7fdf90859700 1 -- 172.21.15.59:0/658990818 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c00fe30 con 0x7fdf8c070590 2023-09-21T00:17:33.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.373+0000 7f0adb8b4700 1 -- 172.21.15.59:0/4182763444 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ad414b3c0 msgr2=0x7f0ad40720d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.373+0000 7f0adb8b4700 1 --2- 172.21.15.59:0/4182763444 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ad414b3c0 0x7f0ad40720d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0ac4009840 tx=0x7f0ac4009b50 comp rx=0 tx=0).stop 2023-09-21T00:17:33.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.373+0000 7fac9f8e0700 1 -- 172.21.15.59:0/505359308 shutdown_connections 2023-09-21T00:17:33.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.373+0000 7fac9f8e0700 1 --2- 172.21.15.59:0/505359308 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac98070cb0 0x7fac9815a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.373+0000 7fac9f8e0700 1 --2- 172.21.15.59:0/505359308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac980ca2a0 0x7fac980cc1f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.373+0000 7fac9f8e0700 1 --2- 172.21.15.59:0/505359308 >> v2:172.21.15.83:3300/0 conn(0x7fac980c9e20 0x7fac98068590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.373+0000 7fac9f8e0700 1 -- 172.21.15.59:0/505359308 >> 172.21.15.59:0/505359308 conn(0x7fac9806a780 msgr2=0x7fac9806ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:33.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.373+0000 7f0adb8b4700 1 -- 172.21.15.59:0/4182763444 shutdown_connections 2023-09-21T00:17:33.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.373+0000 7f0adb8b4700 1 --2- 172.21.15.59:0/4182763444 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ad414b3c0 0x7f0ad40720d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.373+0000 7f0adb8b4700 1 --2- 172.21.15.59:0/4182763444 >> v2:172.21.15.83:3300/0 conn(0x7f0ad40ce690 0x7f0ad406a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.373+0000 7f0adb8b4700 1 -- 172.21.15.59:0/4182763444 >> 172.21.15.59:0/4182763444 conn(0x7f0ad406d920 msgr2=0x7f0ad406dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:33.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.373+0000 7f0adb8b4700 1 -- 172.21.15.59:0/4182763444 shutdown_connections 2023-09-21T00:17:33.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.373+0000 7f0adb8b4700 1 -- 172.21.15.59:0/4182763444 wait complete. 2023-09-21T00:17:33.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.373+0000 7f7cfef36700 1 -- start start 2023-09-21T00:17:33.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.373+0000 7fdf93abf700 1 -- 172.21.15.59:0/658990818 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdf8c070590 msgr2=0x7fdf8c0cc2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.373+0000 7fdf93abf700 1 --2- 172.21.15.59:0/658990818 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdf8c070590 0x7fdf8c0cc2e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c009210 tx=0x7fdf7c009520 comp rx=0 tx=0).stop 2023-09-21T00:17:33.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.374+0000 7fdf93abf700 1 -- 172.21.15.59:0/658990818 shutdown_connections 2023-09-21T00:17:33.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.374+0000 7fdf93abf700 1 --2- 172.21.15.59:0/658990818 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdf8c1596f0 0x7fdf8c071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.374+0000 7fdf93abf700 1 --2- 172.21.15.59:0/658990818 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdf8c070590 0x7fdf8c0cc2e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.374+0000 7fdf93abf700 1 -- 172.21.15.59:0/658990818 >> 172.21.15.59:0/658990818 conn(0x7fdf8c06c7c0 msgr2=0x7fdf8c06cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:33.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.374+0000 7fdf93abf700 1 -- 172.21.15.59:0/658990818 shutdown_connections 2023-09-21T00:17:33.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.374+0000 7fdf93abf700 1 -- 172.21.15.59:0/658990818 wait complete. 2023-09-21T00:17:33.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.374+0000 7f7cfef36700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7cf80cf610 0x7f7cf8071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.374+0000 7f7cfef36700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7cf8070590 0x7f7cf80cc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.374+0000 7f7cfef36700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cf80724d0 con 0x7f7cf81596f0 2023-09-21T00:17:33.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.374+0000 7f7cfef36700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cf80cc820 con 0x7f7cf8070590 2023-09-21T00:17:33.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.374+0000 7f7cfef36700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cf80727b0 con 0x7f7cf80cf610 2023-09-21T00:17:33.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.374+0000 7f7cfccd2700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7cf81596f0 0x7f7cf80cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57176/0 (socket says 172.21.15.59:57176) 2023-09-21T00:17:33.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.374+0000 7f7cfccd2700 1 -- 172.21.15.59:0/2642853012 learned_addr learned my addr 172.21.15.59:0/2642853012 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:33.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.374+0000 7f7cf7fff700 1 --2- 172.21.15.59:0/2642853012 >> v2:172.21.15.83:3300/0 conn(0x7f7cf80cf610 0x7f7cf8071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.374+0000 7f7cfd4d3700 1 --2- 172.21.15.59:0/2642853012 >> v2:172.21.15.59:3300/0 conn(0x7f7cf8070590 0x7f7cf80cc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.375+0000 7f9a8bbb6700 1 Processor -- start 2023-09-21T00:17:33.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.375+0000 7f7cf77fe700 1 -- 172.21.15.59:0/2642853012 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4233248050 0 0) 0x7f7cf80724d0 con 0x7f7cf81596f0 2023-09-21T00:17:33.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.375+0000 7f7cf77fe700 1 -- 172.21.15.59:0/2642853012 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ce00034d0 con 0x7f7cf81596f0 2023-09-21T00:17:33.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.375+0000 7f7cf7fff700 1 -- 172.21.15.59:0/2642853012 >> v2:172.21.15.59:3300/0 conn(0x7f7cf8070590 msgr2=0x7f7cf80cc2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:33.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.375+0000 7f7cf7fff700 1 --2- 172.21.15.59:0/2642853012 >> v2:172.21.15.59:3300/0 conn(0x7f7cf8070590 0x7f7cf80cc2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.375+0000 7f7cf7fff700 1 -- 172.21.15.59:0/2642853012 >> v1:172.21.15.59:6789/0 conn(0x7f7cf81596f0 legacy=0x7f7cf80cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.375+0000 7f7cf7fff700 1 -- 172.21.15.59:0/2642853012 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf80cb800 con 0x7f7cf80cf610 2023-09-21T00:17:33.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.375+0000 7f0adb8b4700 1 Processor -- start 2023-09-21T00:17:33.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.375+0000 7f0adb8b4700 1 -- start start 2023-09-21T00:17:33.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.375+0000 7f9a8bbb6700 1 -- start start 2023-09-21T00:17:33.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.376+0000 7f9a8bbb6700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9a8415d550 0x7f9a840b8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.376+0000 7f9a8bbb6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9a840d17c0 0x7f9a840b4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.376+0000 7fdf93abf700 1 Processor -- start 2023-09-21T00:17:33.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.376+0000 7fdf93abf700 1 -- start start 2023-09-21T00:17:33.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.375+0000 7f7cf7fff700 1 --2- 172.21.15.59:0/2642853012 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7cf80cf610 0x7f7cf8071e80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7cf80ccd40 tx=0x7f7cf000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f531105cfb921f86 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.375+0000 7f7cf77fe700 1 -- 172.21.15.59:0/2642853012 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf000bce0 con 0x7f7cf80cf610 2023-09-21T00:17:33.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.375+0000 7f7cf77fe700 1 -- 172.21.15.59:0/2642853012 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf000be40 con 0x7f7cf80cf610 2023-09-21T00:17:33.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.375+0000 7f7cf77fe700 1 -- 172.21.15.59:0/2642853012 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf0003c60 con 0x7f7cf80cf610 2023-09-21T00:17:33.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.376+0000 7f7cfef36700 1 -- 172.21.15.59:0/2642853012 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7cf80cf610 msgr2=0x7f7cf8071e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.376+0000 7f7cfef36700 1 --2- 172.21.15.59:0/2642853012 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7cf80cf610 0x7f7cf8071e80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7cf80ccd40 tx=0x7f7cf000b330 comp rx=0 tx=0).stop 2023-09-21T00:17:33.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.376+0000 7f7cfef36700 1 -- 172.21.15.59:0/2642853012 shutdown_connections 2023-09-21T00:17:33.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.376+0000 7f7cfef36700 1 --2- 172.21.15.59:0/2642853012 >> v2:172.21.15.59:3300/0 conn(0x7f7cf8070590 0x7f7cf80cc2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.376+0000 7f7cfef36700 1 --2- 172.21.15.59:0/2642853012 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7cf80cf610 0x7f7cf8071e80 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7cf80ccd40 tx=0x7f7cf000b330 comp rx=0 tx=0).stop 2023-09-21T00:17:33.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.376+0000 7f7cfef36700 1 -- 172.21.15.59:0/2642853012 >> 172.21.15.59:0/2642853012 conn(0x7f7cf806c7c0 msgr2=0x7f7cf806cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:33.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.376+0000 7f9a8bbb6700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a8415d930 con 0x7f9a840b53b0 2023-09-21T00:17:33.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.376+0000 7f9a8bbb6700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a840b5840 con 0x7f9a8415d550 2023-09-21T00:17:33.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.376+0000 7f9a8bbb6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a840d1f30 con 0x7f9a840d17c0 2023-09-21T00:17:33.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.376+0000 7f9a89952700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9a8415d550 0x7f9a840b8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.376+0000 7f9a89151700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9a840d17c0 0x7f9a840b4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.376+0000 7f9a8a153700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f9a840b53b0 0x7f9a8406b6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.59:47684/0 (socket says 172.21.15.59:47684) 2023-09-21T00:17:33.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.376+0000 7f9a8a153700 1 -- 172.21.15.59:0/207264107 learned_addr learned my addr 172.21.15.59:0/207264107 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:33.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.376+0000 7f0adb8b4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ad406acc0 0x7f0ad4135f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.376+0000 7f0adb8b4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ad40ce690 0x7f0ad4132880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.376+0000 7f0adb8b4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ad414b3c0 0x7f0ad4132dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.376+0000 7f0adb8b4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad41364d0 con 0x7f0ad414b3c0 2023-09-21T00:17:33.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.376+0000 7f0adb8b4700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad414a970 con 0x7f0ad40ce690 2023-09-21T00:17:33.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.376+0000 7f0adb8b4700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad40c5100 con 0x7f0ad406acc0 2023-09-21T00:17:33.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.377+0000 7f7cfef36700 1 -- 172.21.15.59:0/2642853012 shutdown_connections 2023-09-21T00:17:33.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.377+0000 7f0ad8e4f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ad40ce690 0x7f0ad4132880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.377+0000 7f0ad8e4f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ad40ce690 0x7f0ad4132880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.59:37736/0 (socket says 172.21.15.59:37736) 2023-09-21T00:17:33.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.377+0000 7f0ad8e4f700 1 -- 172.21.15.59:0/982620402 learned_addr learned my addr 172.21.15.59:0/982620402 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:33.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.377+0000 7f7cfef36700 1 -- 172.21.15.59:0/2642853012 wait complete. 2023-09-21T00:17:33.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.377+0000 7f9a89952700 1 -- 172.21.15.59:0/207264107 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9a840d17c0 msgr2=0x7f9a840b4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:33.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.377+0000 7f9a89952700 1 --2- 172.21.15.59:0/207264107 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9a840d17c0 0x7f9a840b4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.377+0000 7f9a89952700 1 -- 172.21.15.59:0/207264107 >> v1:172.21.15.83:6789/0 conn(0x7f9a840b53b0 legacy=0x7f9a8406b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.377+0000 7f9a89952700 1 -- 172.21.15.59:0/207264107 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a840d2210 con 0x7f9a8415d550 2023-09-21T00:17:33.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.377+0000 7fdf93abf700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdf8c070590 0x7fdf8c151900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.377+0000 7fdf93abf700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdf8c0cef00 0x7fdf8c154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.377+0000 7fdf93abf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf8c1596f0 0x7fdf8c1e44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.377+0000 7fdf93abf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c156b60 con 0x7fdf8c1596f0 2023-09-21T00:17:33.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.377+0000 7fdf93abf700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c156e40 con 0x7fdf8c070590 2023-09-21T00:17:33.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.377+0000 7fdf93abf700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c157120 con 0x7fdf8c0cef00 2023-09-21T00:17:33.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.377+0000 7fdf9105a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdf8c0cef00 0x7fdf8c154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.377+0000 7fdf9105a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdf8c0cef00 0x7fdf8c154ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.59:52242/0 (socket says 172.21.15.59:52242) 2023-09-21T00:17:33.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.377+0000 7fdf9185b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdf8c070590 0x7fdf8c151900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.377+0000 7fdf9105a700 1 -- 172.21.15.59:0/3297652954 learned_addr learned my addr 172.21.15.59:0/3297652954 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:33.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.377+0000 7fdf9205c700 1 --2- 172.21.15.59:0/3297652954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf8c1596f0 0x7fdf8c1e44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.378+0000 7fdf9185b700 1 -- 172.21.15.59:0/3297652954 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdf8c0cef00 msgr2=0x7fdf8c154ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.378+0000 7fdf9185b700 1 --2- 172.21.15.59:0/3297652954 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdf8c0cef00 0x7fdf8c154ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.378+0000 7fdf9185b700 1 -- 172.21.15.59:0/3297652954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf8c1596f0 msgr2=0x7fdf8c1e44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.378+0000 7fdf9185b700 1 --2- 172.21.15.59:0/3297652954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf8c1596f0 0x7fdf8c1e44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.378+0000 7fdf9185b700 1 -- 172.21.15.59:0/3297652954 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf7c009de0 con 0x7fdf8c070590 2023-09-21T00:17:33.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.378+0000 7fdf9185b700 1 --2- 172.21.15.59:0/3297652954 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdf8c070590 0x7fdf8c151900 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdf8800e870 tx=0x7fdf8800eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.379+0000 7f7cfef36700 1 Processor -- start 2023-09-21T00:17:33.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.377+0000 7f0ad9650700 1 --2- 172.21.15.59:0/982620402 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ad406acc0 0x7f0ad4135f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.377+0000 7f0ad8e4f700 1 -- 172.21.15.59:0/982620402 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ad406acc0 msgr2=0x7f0ad4135f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.377+0000 7f0ad8e4f700 1 --2- 172.21.15.59:0/982620402 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ad406acc0 0x7f0ad4135f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.377+0000 7f0ad8e4f700 1 -- 172.21.15.59:0/982620402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ad414b3c0 msgr2=0x7f0ad4132dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.377+0000 7f0ad8e4f700 1 --2- 172.21.15.59:0/982620402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ad414b3c0 0x7f0ad4132dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.377+0000 7f0ad8e4f700 1 -- 172.21.15.59:0/982620402 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac40094a0 con 0x7f0ad40ce690 2023-09-21T00:17:33.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.377+0000 7f0ad8e4f700 1 --2- 172.21.15.59:0/982620402 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ad40ce690 0x7f0ad4132880 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0ad000e8c0 tx=0x7f0ad000ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.378+0000 7f0ac9ffb700 1 -- 172.21.15.59:0/982620402 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad000eec0 con 0x7f0ad40ce690 2023-09-21T00:17:33.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.378+0000 7f0ac9ffb700 1 -- 172.21.15.59:0/982620402 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad000c850 con 0x7f0ad40ce690 2023-09-21T00:17:33.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.378+0000 7f0ac9ffb700 1 -- 172.21.15.59:0/982620402 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad000cbc0 con 0x7f0ad40ce690 2023-09-21T00:17:33.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.379+0000 7fdf827fc700 1 -- 172.21.15.59:0/3297652954 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf88013680 con 0x7fdf8c070590 2023-09-21T00:17:33.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.379+0000 7fdf827fc700 1 -- 172.21.15.59:0/3297652954 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf880137e0 con 0x7fdf8c070590 2023-09-21T00:17:33.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.379+0000 7fdf827fc700 1 -- 172.21.15.59:0/3297652954 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf88013b90 con 0x7fdf8c070590 2023-09-21T00:17:33.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.379+0000 7fdf93abf700 1 -- 172.21.15.59:0/3297652954 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf8c157400 con 0x7fdf8c070590 2023-09-21T00:17:33.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.379+0000 7fdf93abf700 1 -- 172.21.15.59:0/3297652954 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf8c157c00 con 0x7fdf8c070590 2023-09-21T00:17:33.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.380+0000 7f9a89952700 1 --2- 172.21.15.59:0/207264107 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a8415d550 0x7f9a840b8f80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9a80009840 tx=0x7f9a80009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=914bf645defd62d1 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.380+0000 7f7cfef36700 1 -- start start 2023-09-21T00:17:33.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.379+0000 7f0adb8b4700 1 -- 172.21.15.59:0/982620402 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ad4137b40 con 0x7f0ad40ce690 2023-09-21T00:17:33.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.379+0000 7f0adb8b4700 1 -- 172.21.15.59:0/982620402 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ad41386f0 con 0x7f0ad40ce690 2023-09-21T00:17:33.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.380+0000 7f0adb8b4700 1 -- 172.21.15.59:0/982620402 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ad40c5300 con 0x7f0ad40ce690 2023-09-21T00:17:33.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.380+0000 7fac9f8e0700 1 -- 172.21.15.59:0/505359308 shutdown_connections 2023-09-21T00:17:33.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.380+0000 7fdf93abf700 1 -- 172.21.15.59:0/3297652954 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf8c157920 con 0x7fdf8c070590 2023-09-21T00:17:33.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.381+0000 7f7cfef36700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cf8070590 0x7f7cf8203690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.381+0000 7f7cfef36700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7cf81596f0 0x7f7cf8152c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.381+0000 7f7cfef36700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7cf8153180 0x7f7cf81f98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.381+0000 7f7cfef36700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf8201120 con 0x7f7cf8070590 2023-09-21T00:17:33.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.381+0000 7f7cfef36700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf82013c0 con 0x7f7cf81596f0 2023-09-21T00:17:33.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.381+0000 7f7cfef36700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf82016a0 con 0x7f7cf8153180 2023-09-21T00:17:33.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.382+0000 7f7cfd4d3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7cf8153180 0x7f7cf81f98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.382+0000 7f7cfd4d3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7cf8153180 0x7f7cf81f98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.59:52248/0 (socket says 172.21.15.59:52248) 2023-09-21T00:17:33.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.382+0000 7f7cfd4d3700 1 -- 172.21.15.59:0/193962437 learned_addr learned my addr 172.21.15.59:0/193962437 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:33.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.382+0000 7f7cf7fff700 1 --2- 172.21.15.59:0/193962437 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7cf81596f0 0x7f7cf8152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.382+0000 7f9a88950700 1 -- 172.21.15.59:0/207264107 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a80011830 con 0x7f9a8415d550 2023-09-21T00:17:33.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.382+0000 7f9a88950700 1 -- 172.21.15.59:0/207264107 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a80011990 con 0x7f9a8415d550 2023-09-21T00:17:33.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.382+0000 7f9a88950700 1 -- 172.21.15.59:0/207264107 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a80011d20 con 0x7f9a8415d550 2023-09-21T00:17:33.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.382+0000 7f7cfd4d3700 1 -- 172.21.15.59:0/193962437 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7cf81596f0 msgr2=0x7f7cf8152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.382+0000 7f7cfd4d3700 1 --2- 172.21.15.59:0/193962437 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7cf81596f0 0x7f7cf8152c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.382+0000 7f7cfd4d3700 1 -- 172.21.15.59:0/193962437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cf8070590 msgr2=0x7f7cf8203690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.382+0000 7f7cfd4d3700 1 --2- 172.21.15.59:0/193962437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cf8070590 0x7f7cf8203690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.382+0000 7f7cfd4d3700 1 -- 172.21.15.59:0/193962437 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf0009a70 con 0x7f7cf8153180 2023-09-21T00:17:33.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.382+0000 7fdf827fc700 1 -- 172.21.15.59:0/3297652954 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fdf88013cf0 con 0x7fdf8c070590 2023-09-21T00:17:33.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.382+0000 7f0ac9ffb700 1 -- 172.21.15.59:0/982620402 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f0ad000cd20 con 0x7f0ad40ce690 2023-09-21T00:17:33.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.382+0000 7f0ac9ffb700 1 --2- 172.21.15.59:0/982620402 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f0ab806ae00 0x7f0ab806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.382+0000 7f0ac9ffb700 1 -- 172.21.15.59:0/982620402 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0ad0089ca0 con 0x7f0ad40ce690 2023-09-21T00:17:33.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.382+0000 7f7cfd4d3700 1 --2- 172.21.15.59:0/193962437 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7cf8153180 0x7f7cf81f98f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7ce800e7f0 tx=0x7f7ce800ebb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.383+0000 7f9a8bbb6700 1 -- 172.21.15.59:0/207264107 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a8415d550 msgr2=0x7f9a840b8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.383+0000 7f9a8bbb6700 1 --2- 172.21.15.59:0/207264107 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a8415d550 0x7f9a840b8f80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9a80009840 tx=0x7f9a80009b50 comp rx=0 tx=0).stop 2023-09-21T00:17:33.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.383+0000 7f0ad9650700 1 --2- 172.21.15.59:0/982620402 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f0ab806ae00 0x7f0ab806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.383+0000 7fdf827fc700 1 --2- 172.21.15.59:0/3297652954 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fdf7006ae50 0x7fdf7006d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.383+0000 7fdf827fc700 1 -- 172.21.15.59:0/3297652954 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdf88089c80 con 0x7fdf8c070590 2023-09-21T00:17:33.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.383+0000 7f7cf57fa700 1 -- 172.21.15.59:0/193962437 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce8013680 con 0x7f7cf8153180 2023-09-21T00:17:33.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.383+0000 7f7cf57fa700 1 -- 172.21.15.59:0/193962437 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce80137e0 con 0x7f7cf8153180 2023-09-21T00:17:33.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.383+0000 7f7cf57fa700 1 -- 172.21.15.59:0/193962437 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce8013b90 con 0x7f7cf8153180 2023-09-21T00:17:33.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.383+0000 7f7cfef36700 1 -- 172.21.15.59:0/193962437 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cf8201980 con 0x7f7cf8153180 2023-09-21T00:17:33.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.383+0000 7f7cfef36700 1 -- 172.21.15.59:0/193962437 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cf81fda70 con 0x7f7cf8153180 2023-09-21T00:17:33.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.383+0000 7f0ad9650700 1 --2- 172.21.15.59:0/982620402 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f0ab806ae00 0x7f0ab806d2c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0ac40090b0 tx=0x7f0ac4013040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.384+0000 7f9a8bbb6700 1 -- 172.21.15.59:0/207264107 shutdown_connections 2023-09-21T00:17:33.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.384+0000 7f9a8bbb6700 1 --2- 172.21.15.59:0/207264107 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a8415d550 0x7f9a840b8f80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.384+0000 7f9a8bbb6700 1 --2- 172.21.15.59:0/207264107 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9a840d17c0 0x7f9a840b4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.384+0000 7f9a8bbb6700 1 -- 172.21.15.59:0/207264107 >> 172.21.15.59:0/207264107 conn(0x7f9a840724e0 msgr2=0x7f9a840cfe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:33.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.384+0000 7fdf9105a700 1 --2- 172.21.15.59:0/3297652954 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fdf7006ae50 0x7fdf7006d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.381+0000 7fac9f8e0700 1 -- 172.21.15.59:0/505359308 wait complete. 2023-09-21T00:17:33.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.382+0000 7fac9f8e0700 1 Processor -- start 2023-09-21T00:17:33.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.384+0000 7fac9f8e0700 1 -- start start 2023-09-21T00:17:33.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.385+0000 7fdf9105a700 1 --2- 172.21.15.59:0/3297652954 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fdf7006ae50 0x7fdf7006d310 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c1f6900 tx=0x7fdf7c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.385+0000 7f7cfef36700 1 -- 172.21.15.59:0/193962437 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cf8067e50 con 0x7f7cf8153180 2023-09-21T00:17:33.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.385+0000 7f7cf57fa700 1 -- 172.21.15.59:0/193962437 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f7ce8013cf0 con 0x7f7cf8153180 2023-09-21T00:17:33.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.386+0000 7f57e3da4700 1 Processor -- start 2023-09-21T00:17:33.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.386+0000 7f55504ee700 1 Processor -- start 2023-09-21T00:17:33.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.386+0000 7f55504ee700 1 -- start start 2023-09-21T00:17:33.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.386+0000 7f57e3da4700 1 -- start start 2023-09-21T00:17:33.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.386+0000 7f7cf57fa700 1 --2- 172.21.15.59:0/193962437 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f7ce406ae00 0x7f7ce406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.386+0000 7f7cf57fa700 1 -- 172.21.15.59:0/193962437 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7ce8089a60 con 0x7f7cf8153180 2023-09-21T00:17:33.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.386+0000 7f7cfccd2700 1 --2- 172.21.15.59:0/193962437 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f7ce406ae00 0x7f7ce406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.387+0000 7f9a8bbb6700 1 -- 172.21.15.59:0/207264107 shutdown_connections 2023-09-21T00:17:33.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.387+0000 7f9a8bbb6700 1 -- 172.21.15.59:0/207264107 wait complete. 2023-09-21T00:17:33.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.387+0000 7f7cfccd2700 1 --2- 172.21.15.59:0/193962437 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f7ce406ae00 0x7f7ce406d2c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7cec000f60 tx=0x7f7cec007b00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.387+0000 7f55504ee700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5548154030 0x7f55480cc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.387+0000 7f55504ee700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f55480b2f20 0x7f55480cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.387+0000 7f55504ee700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55480b3580 con 0x7f55480cc770 2023-09-21T00:17:33.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.387+0000 7f55504ee700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55480ccc20 con 0x7f5548154030 2023-09-21T00:17:33.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.387+0000 7f55504ee700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55480b3390 con 0x7f55480b2f20 2023-09-21T00:17:33.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.387+0000 7f57e3da4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f57dc1619e0 0x7f57dc0d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.387+0000 7f57e3da4700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f57dc0b6240 0x7f57dc0b66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.387+0000 7f57e3da4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f57dc0b1fe0 0x7f57dc0b2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.387+0000 7fdf827fc700 1 -- 172.21.15.59:0/3297652954 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fdf88054c20 con 0x7fdf8c070590 2023-09-21T00:17:33.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.387+0000 7f57e3da4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57dc0b6c00 con 0x7f57dc0b1fe0 2023-09-21T00:17:33.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.387+0000 7f57e3da4700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57dc0b2ca0 con 0x7f57dc0b6240 2023-09-21T00:17:33.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.387+0000 7f57e3da4700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc161dc0 con 0x7f57dc1619e0 2023-09-21T00:17:33.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.387+0000 7f554ea8b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f55480b2f20 0x7f55480cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.387+0000 7f554e28a700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5548154030 0x7f55480cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.387+0000 7f554ea8b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f55480b2f20 0x7f55480cdc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.59:52270/0 (socket says 172.21.15.59:52270) 2023-09-21T00:17:33.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.387+0000 7f554e28a700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5548154030 0x7f55480cc230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.59:37768/0 (socket says 172.21.15.59:37768) 2023-09-21T00:17:33.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.387+0000 7f554ea8b700 1 -- 172.21.15.59:0/77792447 learned_addr learned my addr 172.21.15.59:0/77792447 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:33.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.387+0000 7f57e133f700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f57dc0b6240 0x7f57dc0b66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.387+0000 7f57e133f700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f57dc0b6240 0x7f57dc0b66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.59:37772/0 (socket says 172.21.15.59:37772) 2023-09-21T00:17:33.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.387+0000 7f57e133f700 1 -- 172.21.15.59:0/3146161923 learned_addr learned my addr 172.21.15.59:0/3146161923 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:33.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.386+0000 7fac9f8e0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac98070cb0 0x7fac98157b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.386+0000 7fac9f8e0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac980c9e20 0x7fac981580c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.386+0000 7fac9f8e0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac980ca2a0 0x7fac98158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.386+0000 7fac9f8e0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac980b3f90 con 0x7fac980ca2a0 2023-09-21T00:17:33.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.386+0000 7fac9f8e0700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac981419d0 con 0x7fac98070cb0 2023-09-21T00:17:33.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.386+0000 7fac9f8e0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac9813feb0 con 0x7fac980c9e20 2023-09-21T00:17:33.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.386+0000 7fac9d67c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac98070cb0 0x7fac98157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.388+0000 7f57e1b40700 1 --2- 172.21.15.59:0/3146161923 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f57dc1619e0 0x7f57dc0d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.386+0000 7fac9d67c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac98070cb0 0x7fac98157b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.59:37758/0 (socket says 172.21.15.59:37758) 2023-09-21T00:17:33.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.386+0000 7fac9d67c700 1 -- 172.21.15.59:0/407046531 learned_addr learned my addr 172.21.15.59:0/407046531 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:33.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.386+0000 7fac9ce7b700 1 --2- 172.21.15.59:0/407046531 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac980c9e20 0x7fac981580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.386+0000 7fac9d67c700 1 -- 172.21.15.59:0/407046531 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac980c9e20 msgr2=0x7fac981580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.386+0000 7fac9d67c700 1 --2- 172.21.15.59:0/407046531 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac980c9e20 0x7fac981580c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.386+0000 7fac9d67c700 1 -- 172.21.15.59:0/407046531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac980ca2a0 msgr2=0x7fac98158600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.386+0000 7fac9d67c700 1 --2- 172.21.15.59:0/407046531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac980ca2a0 0x7fac98158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.386+0000 7fac9d67c700 1 -- 172.21.15.59:0/407046531 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac90009b30 con 0x7fac98070cb0 2023-09-21T00:17:33.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.387+0000 7fac9d67c700 1 --2- 172.21.15.59:0/407046531 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac98070cb0 0x7fac98157b80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fac8801c480 tx=0x7fac8801c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.388+0000 7f554ea8b700 1 -- 172.21.15.59:0/77792447 >> v2:172.21.15.83:3300/0 conn(0x7f5548154030 msgr2=0x7f55480cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:33.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.388+0000 7f554ea8b700 1 --2- 172.21.15.59:0/77792447 >> v2:172.21.15.83:3300/0 conn(0x7f5548154030 0x7f55480cc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.388+0000 7f554ea8b700 1 -- 172.21.15.59:0/77792447 >> v1:172.21.15.59:6789/0 conn(0x7f55480cc770 legacy=0x7f55480b2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:33.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.388+0000 7f554ea8b700 1 -- 172.21.15.59:0/77792447 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5548070e20 con 0x7f55480b2f20 2023-09-21T00:17:33.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.388+0000 7f57e133f700 1 -- 172.21.15.59:0/3146161923 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f57dc1619e0 msgr2=0x7f57dc0d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:33.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.388+0000 7f57e133f700 1 --2- 172.21.15.59:0/3146161923 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f57dc1619e0 0x7f57dc0d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.388+0000 7f57e133f700 1 -- 172.21.15.59:0/3146161923 >> v2:172.21.15.59:3300/0 conn(0x7f57dc0b1fe0 msgr2=0x7f57dc0b2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:33.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.388+0000 7f57e133f700 1 --2- 172.21.15.59:0/3146161923 >> v2:172.21.15.59:3300/0 conn(0x7f57dc0b1fe0 0x7f57dc0b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.388+0000 7f57e133f700 1 -- 172.21.15.59:0/3146161923 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57dc0cddc0 con 0x7f57dc0b6240 2023-09-21T00:17:33.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.388+0000 7f554ea8b700 1 --2- 172.21.15.59:0/77792447 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f55480b2f20 0x7f55480cdc50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5540009e50 tx=0x7f554000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebd131fdb710efcd server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.388+0000 7f57e133f700 1 --2- 172.21.15.59:0/3146161923 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57dc0b6240 0x7f57dc0b66c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f57dc08c560 tx=0x7f57d8009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80c99f5de6d7392c server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.388+0000 7f68e53b4700 1 Processor -- start 2023-09-21T00:17:33.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.388+0000 7f68e53b4700 1 -- start start 2023-09-21T00:17:33.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.389+0000 7f9a8bbb6700 1 Processor -- start 2023-09-21T00:17:33.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.389+0000 7f9a8bbb6700 1 -- start start 2023-09-21T00:17:33.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.390+0000 7f9a8bbb6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9a840b53b0 0x7f9a84070170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.390+0000 7f9a8bbb6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a840d17c0 0x7f9a841feb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.390+0000 7f68e53b4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f68e008a2a0 0x7f68e008a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.390+0000 7f9a8bbb6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a8415d550 0x7f9a840c8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.390+0000 7f9a8bbb6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a84071660 con 0x7f9a8415d550 2023-09-21T00:17:33.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.390+0000 7f9a8bbb6700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8406ecd0 con 0x7f9a840d17c0 2023-09-21T00:17:33.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.390+0000 7f9a8bbb6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a840709e0 con 0x7f9a840b53b0 2023-09-21T00:17:33.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.390+0000 7f68e53b4700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f68e00721e0 0x7f68e00ce2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.390+0000 7f68e53b4700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68e008abc0 con 0x7f68e00b3140 2023-09-21T00:17:33.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.390+0000 7f68e53b4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68e00b2450 con 0x7f68e008a2a0 2023-09-21T00:17:33.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.390+0000 7f68e53b4700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68e016a780 con 0x7f68e00721e0 2023-09-21T00:17:33.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.390+0000 7f68deffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f68e008a2a0 0x7f68e008a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.390+0000 7f68deffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f68e008a2a0 0x7f68e008a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51664/0 (socket says 172.21.15.59:51664) 2023-09-21T00:17:33.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.390+0000 7f68deffd700 1 -- 172.21.15.59:0/221033897 learned_addr learned my addr 172.21.15.59:0/221033897 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:33.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.390+0000 7f9a89952700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9a840b53b0 0x7f9a84070170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.390+0000 7f9a89952700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9a840b53b0 0x7f9a84070170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.59:52278/0 (socket says 172.21.15.59:52278) 2023-09-21T00:17:33.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.390+0000 7f9a89952700 1 -- 172.21.15.59:0/3325921623 learned_addr learned my addr 172.21.15.59:0/3325921623 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:33.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.390+0000 7f9a89151700 1 --2- 172.21.15.59:0/3325921623 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a840d17c0 0x7f9a841feb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.390+0000 7f9a8a153700 1 --2- 172.21.15.59:0/3325921623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a8415d550 0x7f9a840c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.390+0000 7f68deffd700 1 -- 172.21.15.59:0/221033897 >> v2:172.21.15.83:3300/0 conn(0x7f68e00721e0 msgr2=0x7f68e00ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:33.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.390+0000 7f68deffd700 1 --2- 172.21.15.59:0/221033897 >> v2:172.21.15.83:3300/0 conn(0x7f68e00721e0 0x7f68e00ce2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.390+0000 7f68deffd700 1 -- 172.21.15.59:0/221033897 >> v1:172.21.15.83:6789/0 conn(0x7f68e00b3140 legacy=0x7f68e0071ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.390+0000 7f68deffd700 1 -- 172.21.15.59:0/221033897 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e0072690 con 0x7f68e008a2a0 2023-09-21T00:17:33.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.390+0000 7f68deffd700 1 --2- 172.21.15.59:0/221033897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68e008a2a0 0x7f68e008a680 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f68e0071050 tx=0x7f68d000d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7646d6cc70667e2e server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.390+0000 7f9a89952700 1 -- 172.21.15.59:0/3325921623 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a840d17c0 msgr2=0x7f9a841feb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.390+0000 7f9a89952700 1 --2- 172.21.15.59:0/3325921623 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a840d17c0 0x7f9a841feb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.390+0000 7f9a89952700 1 -- 172.21.15.59:0/3325921623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a8415d550 msgr2=0x7f9a840c8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.390+0000 7f9a89952700 1 --2- 172.21.15.59:0/3325921623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a8415d550 0x7f9a840c8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.390+0000 7f9a89952700 1 -- 172.21.15.59:0/3325921623 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a800094a0 con 0x7f9a840b53b0 2023-09-21T00:17:33.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.391+0000 7f9a89952700 1 --2- 172.21.15.59:0/3325921623 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9a840b53b0 0x7f9a84070170 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9a80009fd0 tx=0x7f9a80004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.391+0000 7f68ddffb700 1 -- 172.21.15.59:0/221033897 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d0010070 con 0x7f68e008a2a0 2023-09-21T00:17:33.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.391+0000 7f68ddffb700 1 -- 172.21.15.59:0/221033897 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d000da80 con 0x7f68e008a2a0 2023-09-21T00:17:33.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.391+0000 7f68ddffb700 1 -- 172.21.15.59:0/221033897 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d000ddf0 con 0x7f68e008a2a0 2023-09-21T00:17:33.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.391+0000 7f68e53b4700 1 -- 172.21.15.59:0/221033897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68e008a2a0 msgr2=0x7f68e008a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.391+0000 7f68e53b4700 1 --2- 172.21.15.59:0/221033897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68e008a2a0 0x7f68e008a680 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f68e0071050 tx=0x7f68d000d330 comp rx=0 tx=0).stop 2023-09-21T00:17:33.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.391+0000 7f68e53b4700 1 -- 172.21.15.59:0/221033897 shutdown_connections 2023-09-21T00:17:33.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.391+0000 7f68e53b4700 1 --2- 172.21.15.59:0/221033897 >> v2:172.21.15.83:3300/0 conn(0x7f68e00721e0 0x7f68e00ce2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.391+0000 7f68e53b4700 1 --2- 172.21.15.59:0/221033897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68e008a2a0 0x7f68e008a680 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.391+0000 7f68e53b4700 1 -- 172.21.15.59:0/221033897 >> 172.21.15.59:0/221033897 conn(0x7f68e006c7c0 msgr2=0x7f68e006cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:33.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.391+0000 7f68e53b4700 1 -- 172.21.15.59:0/221033897 shutdown_connections 2023-09-21T00:17:33.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.391+0000 7f68e53b4700 1 -- 172.21.15.59:0/221033897 wait complete. 2023-09-21T00:17:33.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.393+0000 7f68e53b4700 1 Processor -- start 2023-09-21T00:17:33.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.393+0000 7f68e53b4700 1 -- start start 2023-09-21T00:17:33.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.394+0000 7f68e53b4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68e00721e0 0x7f68e015e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.394+0000 7f68e53b4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f68e008a2a0 0x7f68e0162a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.394+0000 7f68e53b4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68e00b3140 0x7f68e015dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.394+0000 7f68e53b4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e0162fb0 con 0x7f68e00b3140 2023-09-21T00:17:33.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.394+0000 7f68e53b4700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e01609c0 con 0x7f68e00721e0 2023-09-21T00:17:33.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.394+0000 7f68e53b4700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68e01631c0 con 0x7f68e008a2a0 2023-09-21T00:17:33.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.394+0000 7f68df7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68e00b3140 0x7f68e015dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.394+0000 7f68df7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68e00b3140 0x7f68e015dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51678/0 (socket says 172.21.15.59:51678) 2023-09-21T00:17:33.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.394+0000 7f68df7fe700 1 -- 172.21.15.59:0/3764886452 learned_addr learned my addr 172.21.15.59:0/3764886452 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:33.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.394+0000 7f68deffd700 1 --2- 172.21.15.59:0/3764886452 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68e00721e0 0x7f68e015e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.394+0000 7f68de7fc700 1 --2- 172.21.15.59:0/3764886452 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f68e008a2a0 0x7f68e0162a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.395+0000 7f68df7fe700 1 -- 172.21.15.59:0/3764886452 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f68e008a2a0 msgr2=0x7f68e0162a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.395+0000 7f68df7fe700 1 --2- 172.21.15.59:0/3764886452 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f68e008a2a0 0x7f68e0162a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.395+0000 7f68df7fe700 1 -- 172.21.15.59:0/3764886452 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68e00721e0 msgr2=0x7f68e015e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.395+0000 7f68df7fe700 1 --2- 172.21.15.59:0/3764886452 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68e00721e0 0x7f68e015e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.395+0000 7f68df7fe700 1 -- 172.21.15.59:0/3764886452 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d00085d0 con 0x7f68e00b3140 2023-09-21T00:17:33.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.395+0000 7f68deffd700 1 --2- 172.21.15.59:0/3764886452 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68e00721e0 0x7f68e015e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T00:17:33.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.395+0000 7f68df7fe700 1 --2- 172.21.15.59:0/3764886452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68e00b3140 0x7f68e015dfa0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f68d800b970 tx=0x7f68d800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.395+0000 7f9a7a7fc700 1 -- 172.21.15.59:0/3325921623 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a800036a0 con 0x7f9a840b53b0 2023-09-21T00:17:33.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.395+0000 7f9a8bbb6700 1 -- 172.21.15.59:0/3325921623 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a84070cc0 con 0x7f9a840b53b0 2023-09-21T00:17:33.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.395+0000 7f554d288700 1 -- 172.21.15.59:0/77792447 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554000e070 con 0x7f55480b2f20 2023-09-21T00:17:33.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.395+0000 7f9a8bbb6700 1 -- 172.21.15.59:0/3325921623 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a84071280 con 0x7f9a840b53b0 2023-09-21T00:17:33.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.396+0000 7f0ac9ffb700 1 -- 172.21.15.59:0/982620402 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f0ad40c5300 con 0x7f0ad40ce690 2023-09-21T00:17:33.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.396+0000 7f7cf57fa700 1 -- 172.21.15.59:0/193962437 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f7ce8054920 con 0x7f7cf8153180 2023-09-21T00:17:33.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.396+0000 7fac8dffb700 1 -- 172.21.15.59:0/407046531 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac88022640 con 0x7fac98070cb0 2023-09-21T00:17:33.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.397+0000 7fac8dffb700 1 -- 172.21.15.59:0/407046531 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac880227c0 con 0x7fac98070cb0 2023-09-21T00:17:33.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.397+0000 7fac8dffb700 1 -- 172.21.15.59:0/407046531 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac88022b70 con 0x7fac98070cb0 2023-09-21T00:17:33.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.397+0000 7fac9f8e0700 1 -- 172.21.15.59:0/407046531 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac980b3380 con 0x7fac98070cb0 2023-09-21T00:17:33.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.397+0000 7fac9f8e0700 1 -- 172.21.15.59:0/407046531 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac980b3940 con 0x7fac98070cb0 2023-09-21T00:17:33.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.395+0000 7f554d288700 1 -- 172.21.15.59:0/77792447 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5540003a20 con 0x7f55480b2f20 2023-09-21T00:17:33.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.395+0000 7f554d288700 1 -- 172.21.15.59:0/77792447 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5540003dd0 con 0x7f55480b2f20 2023-09-21T00:17:33.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.396+0000 7f55504ee700 1 -- 172.21.15.59:0/77792447 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f55480b2f20 msgr2=0x7f55480cdc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.396+0000 7f55504ee700 1 --2- 172.21.15.59:0/77792447 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f55480b2f20 0x7f55480cdc50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5540009e50 tx=0x7f554000b330 comp rx=0 tx=0).stop 2023-09-21T00:17:33.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.398+0000 7f55504ee700 1 -- 172.21.15.59:0/77792447 shutdown_connections 2023-09-21T00:17:33.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.398+0000 7f55504ee700 1 --2- 172.21.15.59:0/77792447 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f55480b2f20 0x7f55480cdc50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.398+0000 7f55504ee700 1 --2- 172.21.15.59:0/77792447 >> v2:172.21.15.83:3300/0 conn(0x7f5548154030 0x7f55480cc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.398+0000 7f55504ee700 1 -- 172.21.15.59:0/77792447 >> 172.21.15.59:0/77792447 conn(0x7f55480b1430 msgr2=0x7f55480b1840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:33.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.395+0000 7f9a7a7fc700 1 -- 172.21.15.59:0/3325921623 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a8001e070 con 0x7f9a840b53b0 2023-09-21T00:17:33.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.396+0000 7f9a7a7fc700 1 -- 172.21.15.59:0/3325921623 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a80003a40 con 0x7f9a840b53b0 2023-09-21T00:17:33.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.397+0000 7f9a8bbb6700 1 -- 172.21.15.59:0/3325921623 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a6c0052f0 con 0x7f9a840b53b0 2023-09-21T00:17:33.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.397+0000 7f9a7a7fc700 1 -- 172.21.15.59:0/3325921623 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f9a80003ba0 con 0x7f9a840b53b0 2023-09-21T00:17:33.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.398+0000 7f9a7a7fc700 1 --2- 172.21.15.59:0/3325921623 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f9a6806ae00 0x7f9a6806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.398+0000 7f9a7a7fc700 1 -- 172.21.15.59:0/3325921623 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9a8008a840 con 0x7f9a840b53b0 2023-09-21T00:17:33.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.398+0000 7f9a89151700 1 --2- 172.21.15.59:0/3325921623 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f9a6806ae00 0x7f9a6806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.398+0000 7f55504ee700 1 -- 172.21.15.59:0/77792447 shutdown_connections 2023-09-21T00:17:33.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.395+0000 7f68c77fe700 1 -- 172.21.15.59:0/3764886452 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d800d860 con 0x7f68e00b3140 2023-09-21T00:17:33.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.395+0000 7f68c77fe700 1 -- 172.21.15.59:0/3764886452 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d800d9e0 con 0x7f68e00b3140 2023-09-21T00:17:33.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.395+0000 7f68c77fe700 1 -- 172.21.15.59:0/3764886452 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d800dd90 con 0x7f68e00b3140 2023-09-21T00:17:33.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.395+0000 7f68e53b4700 1 -- 172.21.15.59:0/3764886452 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68e015e4e0 con 0x7f68e00b3140 2023-09-21T00:17:33.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.396+0000 7f68e53b4700 1 -- 172.21.15.59:0/3764886452 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68e0160ed0 con 0x7f68e00b3140 2023-09-21T00:17:33.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.398+0000 7f68e53b4700 1 -- 172.21.15.59:0/3764886452 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68e00b2620 con 0x7f68e00b3140 2023-09-21T00:17:33.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.399+0000 7f9a89151700 1 --2- 172.21.15.59:0/3325921623 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f9a6806ae00 0x7f9a6806d2c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9a841edbb0 tx=0x7f9a7c00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.399+0000 7f57e0b3e700 1 -- 172.21.15.59:0/3146161923 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d8011830 con 0x7f57dc0b6240 2023-09-21T00:17:33.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.399+0000 7f57e0b3e700 1 -- 172.21.15.59:0/3146161923 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d8011990 con 0x7f57dc0b6240 2023-09-21T00:17:33.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.399+0000 7f57e0b3e700 1 -- 172.21.15.59:0/3146161923 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d8011d20 con 0x7f57dc0b6240 2023-09-21T00:17:33.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.400+0000 7fac9f8e0700 1 -- 172.21.15.59:0/407046531 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac98067e50 con 0x7fac98070cb0 2023-09-21T00:17:33.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.400+0000 7f57e3da4700 1 -- 172.21.15.59:0/3146161923 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57dc0b6240 msgr2=0x7f57dc0b66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.400+0000 7f57e3da4700 1 --2- 172.21.15.59:0/3146161923 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57dc0b6240 0x7f57dc0b66c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f57dc08c560 tx=0x7f57d8009bd0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.400+0000 7f57e3da4700 1 -- 172.21.15.59:0/3146161923 shutdown_connections 2023-09-21T00:17:33.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.400+0000 7f57e3da4700 1 --2- 172.21.15.59:0/3146161923 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f57dc1619e0 0x7f57dc0d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.400+0000 7f57e3da4700 1 --2- 172.21.15.59:0/3146161923 >> v2:172.21.15.59:3300/0 conn(0x7f57dc0b1fe0 0x7f57dc0b2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.400+0000 7f57e3da4700 1 --2- 172.21.15.59:0/3146161923 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57dc0b6240 0x7f57dc0b66c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.400+0000 7f57e3da4700 1 -- 172.21.15.59:0/3146161923 >> 172.21.15.59:0/3146161923 conn(0x7f57dc0b4ee0 msgr2=0x7f57dc0b52f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:33.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.398+0000 7f55504ee700 1 -- 172.21.15.59:0/77792447 wait complete. 2023-09-21T00:17:33.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.400+0000 7f55504ee700 1 Processor -- start 2023-09-21T00:17:33.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.400+0000 7f55504ee700 1 -- start start 2023-09-21T00:17:33.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.401+0000 7f55504ee700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55480b2f20 0x7f554813e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.401+0000 7f55504ee700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f55480cc770 0x7f554815a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.401+0000 7f55504ee700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5548154030 0x7f5548152f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.401+0000 7f55504ee700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554815e1f0 con 0x7f5548154030 2023-09-21T00:17:33.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.401+0000 7f55504ee700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554815e610 con 0x7f55480b2f20 2023-09-21T00:17:33.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.401+0000 7f55504ee700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f554815d570 con 0x7f55480cc770 2023-09-21T00:17:33.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.402+0000 7f554e28a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55480b2f20 0x7f554813e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.402+0000 7f554e28a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55480b2f20 0x7f554813e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.59:37800/0 (socket says 172.21.15.59:37800) 2023-09-21T00:17:33.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.402+0000 7f554e28a700 1 -- 172.21.15.59:0/958085041 learned_addr learned my addr 172.21.15.59:0/958085041 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:33.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.402+0000 7f554ea8b700 1 --2- 172.21.15.59:0/958085041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5548154030 0x7f5548152f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.402+0000 7f554da89700 1 --2- 172.21.15.59:0/958085041 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f55480cc770 0x7f554815a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.402+0000 7f554ea8b700 1 -- 172.21.15.59:0/958085041 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f55480cc770 msgr2=0x7f554815a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.402+0000 7f554ea8b700 1 --2- 172.21.15.59:0/958085041 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f55480cc770 0x7f554815a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.402+0000 7f554ea8b700 1 -- 172.21.15.59:0/958085041 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55480b2f20 msgr2=0x7f554813e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.402+0000 7f554ea8b700 1 --2- 172.21.15.59:0/958085041 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55480b2f20 0x7f554813e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.402+0000 7f554ea8b700 1 -- 172.21.15.59:0/958085041 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5540009b30 con 0x7f5548154030 2023-09-21T00:17:33.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.401+0000 7fac8dffb700 1 -- 172.21.15.59:0/407046531 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fac88022cd0 con 0x7fac98070cb0 2023-09-21T00:17:33.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.402+0000 7fac8dffb700 1 --2- 172.21.15.59:0/407046531 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fac7c06aea0 0x7fac7c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.402+0000 7fac8dffb700 1 -- 172.21.15.59:0/407046531 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fac8809a4e0 con 0x7fac98070cb0 2023-09-21T00:17:33.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.402+0000 7f554ea8b700 1 --2- 172.21.15.59:0/958085041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5548154030 0x7f5548152f30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5540014000 tx=0x7f5540004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.402+0000 7fac9ce7b700 1 --2- 172.21.15.59:0/407046531 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fac7c06aea0 0x7fac7c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.399+0000 7f68c77fe700 1 -- 172.21.15.59:0/3764886452 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f68d80203f0 con 0x7f68e00b3140 2023-09-21T00:17:33.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.400+0000 7f68c77fe700 1 --2- 172.21.15.59:0/3764886452 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f68cc06ae50 0x7f68cc06d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.400+0000 7f68c77fe700 1 -- 172.21.15.59:0/3764886452 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f68d8089b80 con 0x7f68e00b3140 2023-09-21T00:17:33.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.400+0000 7f68deffd700 1 --2- 172.21.15.59:0/3764886452 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f68cc06ae50 0x7f68cc06d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.401+0000 7f68deffd700 1 --2- 172.21.15.59:0/3764886452 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f68cc06ae50 0x7f68cc06d310 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f68d00089b0 tx=0x7f68d0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.403+0000 7f57e3da4700 1 -- 172.21.15.59:0/3146161923 shutdown_connections 2023-09-21T00:17:33.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.403+0000 7f57e3da4700 1 -- 172.21.15.59:0/3146161923 wait complete. 2023-09-21T00:17:33.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.403+0000 7fac9ce7b700 1 --2- 172.21.15.59:0/407046531 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fac7c06aea0 0x7fac7c06d360 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fac98159c90 tx=0x7fac94008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.405+0000 7f57e3da4700 1 Processor -- start 2023-09-21T00:17:33.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.405+0000 7f57e3da4700 1 -- start start 2023-09-21T00:17:33.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.406+0000 7f57e3da4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57dc0b1fe0 0x7f57dc1543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.406+0000 7f57e3da4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57dc0b6240 0x7f57dc0ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.406+0000 7f57e3da4700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f57dc1619e0 0x7f57dc1f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.406+0000 7f57e3da4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc164e90 con 0x7f57dc0b1fe0 2023-09-21T00:17:33.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.406+0000 7f57e3da4700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc164680 con 0x7f57dc0b6240 2023-09-21T00:17:33.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.406+0000 7f57e3da4700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc0ca4c0 con 0x7f57dc1619e0 2023-09-21T00:17:33.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.406+0000 7f553effd700 1 -- 172.21.15.59:0/958085041 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5540004440 con 0x7f5548154030 2023-09-21T00:17:33.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.406+0000 7f553effd700 1 -- 172.21.15.59:0/958085041 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55400045c0 con 0x7f5548154030 2023-09-21T00:17:33.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.406+0000 7f553effd700 1 -- 172.21.15.59:0/958085041 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5540004970 con 0x7f5548154030 2023-09-21T00:17:33.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.407+0000 7f68c77fe700 1 -- 172.21.15.59:0/3764886452 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f68d8054b20 con 0x7f68e00b3140 2023-09-21T00:17:33.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.407+0000 7f9a7a7fc700 1 -- 172.21.15.59:0/3325921623 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f9a80055620 con 0x7f9a840b53b0 2023-09-21T00:17:33.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.406+0000 7f57e2341700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f57dc1619e0 0x7f57dc1f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.406+0000 7f57e2341700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f57dc1619e0 0x7f57dc1f6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.59:52312/0 (socket says 172.21.15.59:52312) 2023-09-21T00:17:33.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.406+0000 7f57e2341700 1 -- 172.21.15.59:0/79454553 learned_addr learned my addr 172.21.15.59:0/79454553 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:33.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.406+0000 7f57e1b40700 1 --2- 172.21.15.59:0/79454553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57dc0b1fe0 0x7f57dc1543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.407+0000 7f57e133f700 1 --2- 172.21.15.59:0/79454553 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57dc0b6240 0x7f57dc0ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.407+0000 7f57e133f700 1 -- 172.21.15.59:0/79454553 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f57dc1619e0 msgr2=0x7f57dc1f6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.407+0000 7f57e133f700 1 --2- 172.21.15.59:0/79454553 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f57dc1619e0 0x7f57dc1f6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.407+0000 7f57e133f700 1 -- 172.21.15.59:0/79454553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57dc0b1fe0 msgr2=0x7f57dc1543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.407+0000 7f57e133f700 1 --2- 172.21.15.59:0/79454553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57dc0b1fe0 0x7f57dc1543e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.407+0000 7f57e133f700 1 -- 172.21.15.59:0/79454553 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d8009550 con 0x7f57dc0b6240 2023-09-21T00:17:33.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.407+0000 7f57e1b40700 1 --2- 172.21.15.59:0/79454553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57dc0b1fe0 0x7f57dc1543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T00:17:33.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.407+0000 7f55504ee700 1 -- 172.21.15.59:0/958085041 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f554815d850 con 0x7f5548154030 2023-09-21T00:17:33.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.407+0000 7f55504ee700 1 -- 172.21.15.59:0/958085041 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f554815de10 con 0x7f5548154030 2023-09-21T00:17:33.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.409+0000 7f553effd700 1 -- 172.21.15.59:0/958085041 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f5540019070 con 0x7f5548154030 2023-09-21T00:17:33.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.410+0000 7f553effd700 1 --2- 172.21.15.59:0/958085041 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f552c06ae00 0x7f552c06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.410+0000 7f553effd700 1 -- 172.21.15.59:0/958085041 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f554008a710 con 0x7f5548154030 2023-09-21T00:17:33.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.410+0000 7fac8dffb700 1 -- 172.21.15.59:0/407046531 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fac88065440 con 0x7fac98070cb0 2023-09-21T00:17:33.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.410+0000 7f554e28a700 1 --2- 172.21.15.59:0/958085041 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f552c06ae00 0x7f552c06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.410+0000 7f554e28a700 1 --2- 172.21.15.59:0/958085041 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f552c06ae00 0x7f552c06d2c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f55480b10a0 tx=0x7f5544008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.411+0000 7f57e133f700 1 --2- 172.21.15.59:0/79454553 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57dc0b6240 0x7f57dc0ccf30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f57d8016000 tx=0x7f57d8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.411+0000 7f55504ee700 1 -- 172.21.15.59:0/958085041 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55480716a0 con 0x7f5548154030 2023-09-21T00:17:33.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.411+0000 7f57ce7fc700 1 -- 172.21.15.59:0/79454553 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d8004510 con 0x7f57dc0b6240 2023-09-21T00:17:33.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.411+0000 7f57ce7fc700 1 -- 172.21.15.59:0/79454553 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d80036a0 con 0x7f57dc0b6240 2023-09-21T00:17:33.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.411+0000 7f57e3da4700 1 -- 172.21.15.59:0/79454553 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57dc0ca7a0 con 0x7f57dc0b6240 2023-09-21T00:17:33.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.411+0000 7f57e3da4700 1 -- 172.21.15.59:0/79454553 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57dc164bb0 con 0x7f57dc0b6240 2023-09-21T00:17:33.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.411+0000 7f57ce7fc700 1 -- 172.21.15.59:0/79454553 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d8003a90 con 0x7f57dc0b6240 2023-09-21T00:17:33.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.414+0000 7f57ce7fc700 1 -- 172.21.15.59:0/79454553 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f57d8003bf0 con 0x7f57dc0b6240 2023-09-21T00:17:33.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.414+0000 7f57ce7fc700 1 --2- 172.21.15.59:0/79454553 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f57c006ae00 0x7f57c006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:33.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.414+0000 7f57ce7fc700 1 -- 172.21.15.59:0/79454553 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f57d808a990 con 0x7f57dc0b6240 2023-09-21T00:17:33.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.415+0000 7f57e1b40700 1 --2- 172.21.15.59:0/79454553 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f57c006ae00 0x7f57c006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:33.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.415+0000 7f57e1b40700 1 --2- 172.21.15.59:0/79454553 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f57c006ae00 0x7f57c006d2c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f57d0009fd0 tx=0x7f57d0009210 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:33.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.419+0000 7f57e3da4700 1 -- 172.21.15.59:0/79454553 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57c40052f0 con 0x7f57dc0b6240 2023-09-21T00:17:33.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.420+0000 7f553effd700 1 -- 172.21.15.59:0/958085041 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f55480716a0 con 0x7f5548154030 2023-09-21T00:17:33.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.424+0000 7f57ce7fc700 1 -- 172.21.15.59:0/79454553 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f57d8055850 con 0x7f57dc0b6240 2023-09-21T00:17:33.808 INFO:teuthology.orchestra.run.smithi059.stdout:55834574858 2023-09-21T00:17:33.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.796+0000 7fdf93abf700 1 -- 172.21.15.59:0/3297652954 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdf8c156f80 con 0x7fdf8c070590 2023-09-21T00:17:33.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.797+0000 7fdf827fc700 1 -- 172.21.15.59:0/3297652954 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdf8c156f80 con 0x7fdf8c070590 2023-09-21T00:17:33.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.811+0000 7f9a8bbb6700 1 -- 172.21.15.59:0/3325921623 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f9a6c0055a0 con 0x7f9a840b53b0 2023-09-21T00:17:33.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.812+0000 7fdf93abf700 1 -- 172.21.15.59:0/3297652954 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fdf7006ae50 msgr2=0x7fdf7006d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.812+0000 7fdf93abf700 1 --2- 172.21.15.59:0/3297652954 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fdf7006ae50 0x7fdf7006d310 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c1f6900 tx=0x7fdf7c008030 comp rx=0 tx=0).stop 2023-09-21T00:17:33.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.812+0000 7fdf93abf700 1 -- 172.21.15.59:0/3297652954 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdf8c070590 msgr2=0x7fdf8c151900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.812+0000 7fdf93abf700 1 --2- 172.21.15.59:0/3297652954 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdf8c070590 0x7fdf8c151900 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdf8800e870 tx=0x7fdf8800eb80 comp rx=0 tx=0).stop 2023-09-21T00:17:33.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.812+0000 7fdf93abf700 1 -- 172.21.15.59:0/3297652954 shutdown_connections 2023-09-21T00:17:33.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.812+0000 7fdf93abf700 1 --2- 172.21.15.59:0/3297652954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf8c1596f0 0x7fdf8c1e44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.812+0000 7fdf93abf700 1 --2- 172.21.15.59:0/3297652954 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdf8c070590 0x7fdf8c151900 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.812+0000 7fdf93abf700 1 --2- 172.21.15.59:0/3297652954 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fdf7006ae50 0x7fdf7006d310 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.812+0000 7fdf93abf700 1 --2- 172.21.15.59:0/3297652954 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdf8c0cef00 0x7fdf8c154ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.812+0000 7fdf93abf700 1 -- 172.21.15.59:0/3297652954 >> 172.21.15.59:0/3297652954 conn(0x7fdf8c06c7c0 msgr2=0x7fdf8c0cce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:33.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.812+0000 7fdf93abf700 1 -- 172.21.15.59:0/3297652954 shutdown_connections 2023-09-21T00:17:33.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.812+0000 7fdf93abf700 1 -- 172.21.15.59:0/3297652954 wait complete. 2023-09-21T00:17:33.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.812+0000 7f9a7a7fc700 1 -- 172.21.15.59:0/3325921623 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9a80058c40 con 0x7f9a840b53b0 2023-09-21T00:17:33.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.815+0000 7f0adb8b4700 1 -- 172.21.15.59:0/982620402 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0ad40c52c0 con 0x7f0ad40ce690 2023-09-21T00:17:33.817 INFO:teuthology.orchestra.run.smithi059.stdout:55834574858 2023-09-21T00:17:33.818 INFO:teuthology.orchestra.run.smithi059.stdout:55834574859 2023-09-21T00:17:33.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.815+0000 7f7cfef36700 1 -- 172.21.15.59:0/193962437 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f7cf806e260 con 0x7f7cf8153180 2023-09-21T00:17:33.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.816+0000 7f7cf57fa700 1 -- 172.21.15.59:0/193962437 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7ce8021090 con 0x7f7cf8153180 2023-09-21T00:17:33.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.817+0000 7f9a8bbb6700 1 -- 172.21.15.59:0/3325921623 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f9a6806ae00 msgr2=0x7f9a6806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.817+0000 7f9a8bbb6700 1 --2- 172.21.15.59:0/3325921623 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f9a6806ae00 0x7f9a6806d2c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9a841edbb0 tx=0x7f9a7c00b040 comp rx=0 tx=0).stop 2023-09-21T00:17:33.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.817+0000 7f9a8bbb6700 1 -- 172.21.15.59:0/3325921623 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9a840b53b0 msgr2=0x7f9a84070170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.817+0000 7f9a8bbb6700 1 --2- 172.21.15.59:0/3325921623 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9a840b53b0 0x7f9a84070170 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9a80009fd0 tx=0x7f9a80004750 comp rx=0 tx=0).stop 2023-09-21T00:17:33.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.817+0000 7f0ac9ffb700 1 -- 172.21.15.59:0/982620402 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0ad0021020 con 0x7f0ad40ce690 2023-09-21T00:17:33.821 INFO:teuthology.orchestra.run.smithi059.stdout:55834574857 2023-09-21T00:17:33.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.820+0000 7f0adb8b4700 1 -- 172.21.15.59:0/982620402 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f0ab806ae00 msgr2=0x7f0ab806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.820+0000 7f0adb8b4700 1 --2- 172.21.15.59:0/982620402 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f0ab806ae00 0x7f0ab806d2c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0ac40090b0 tx=0x7f0ac4013040 comp rx=0 tx=0).stop 2023-09-21T00:17:33.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.820+0000 7f0adb8b4700 1 -- 172.21.15.59:0/982620402 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ad40ce690 msgr2=0x7f0ad4132880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.820+0000 7f0adb8b4700 1 --2- 172.21.15.59:0/982620402 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ad40ce690 0x7f0ad4132880 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0ad000e8c0 tx=0x7f0ad000ec80 comp rx=0 tx=0).stop 2023-09-21T00:17:33.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.820+0000 7f0adb8b4700 1 -- 172.21.15.59:0/982620402 shutdown_connections 2023-09-21T00:17:33.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.820+0000 7f0adb8b4700 1 --2- 172.21.15.59:0/982620402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ad414b3c0 0x7f0ad4132dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.820+0000 7f0adb8b4700 1 --2- 172.21.15.59:0/982620402 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f0ab806ae00 0x7f0ab806d2c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.820+0000 7f0adb8b4700 1 --2- 172.21.15.59:0/982620402 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ad406acc0 0x7f0ad4135f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.820+0000 7f0adb8b4700 1 --2- 172.21.15.59:0/982620402 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ad40ce690 0x7f0ad4132880 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.820+0000 7f0adb8b4700 1 -- 172.21.15.59:0/982620402 >> 172.21.15.59:0/982620402 conn(0x7f0ad406d920 msgr2=0x7f0ad40cfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:33.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.820+0000 7f0adb8b4700 1 -- 172.21.15.59:0/982620402 shutdown_connections 2023-09-21T00:17:33.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.820+0000 7f0adb8b4700 1 -- 172.21.15.59:0/982620402 wait complete. 2023-09-21T00:17:33.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.824+0000 7f9a8bbb6700 1 -- 172.21.15.59:0/3325921623 shutdown_connections 2023-09-21T00:17:33.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.824+0000 7f9a8bbb6700 1 --2- 172.21.15.59:0/3325921623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a8415d550 0x7f9a840c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.824+0000 7f9a8bbb6700 1 --2- 172.21.15.59:0/3325921623 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f9a6806ae00 0x7f9a6806d2c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.824+0000 7f9a8bbb6700 1 --2- 172.21.15.59:0/3325921623 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9a840b53b0 0x7f9a84070170 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.824+0000 7f9a8bbb6700 1 --2- 172.21.15.59:0/3325921623 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a840d17c0 0x7f9a841feb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.824+0000 7f9a8bbb6700 1 -- 172.21.15.59:0/3325921623 >> 172.21.15.59:0/3325921623 conn(0x7f9a840724e0 msgr2=0x7f9a840d33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:33.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.824+0000 7f9a8bbb6700 1 -- 172.21.15.59:0/3325921623 shutdown_connections 2023-09-21T00:17:33.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.824+0000 7f7cfef36700 1 -- 172.21.15.59:0/193962437 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f7ce406ae00 msgr2=0x7f7ce406d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.824+0000 7f7cfef36700 1 --2- 172.21.15.59:0/193962437 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f7ce406ae00 0x7f7ce406d2c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7cec000f60 tx=0x7f7cec007b00 comp rx=0 tx=0).stop 2023-09-21T00:17:33.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.824+0000 7f7cfef36700 1 -- 172.21.15.59:0/193962437 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7cf8153180 msgr2=0x7f7cf81f98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.824+0000 7f7cfef36700 1 --2- 172.21.15.59:0/193962437 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7cf8153180 0x7f7cf81f98f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7ce800e7f0 tx=0x7f7ce800ebb0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.824+0000 7f7cfef36700 1 -- 172.21.15.59:0/193962437 shutdown_connections 2023-09-21T00:17:33.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.824+0000 7f7cfef36700 1 --2- 172.21.15.59:0/193962437 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f7ce406ae00 0x7f7ce406d2c0 secure :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7cec000f60 tx=0x7f7cec007b00 comp rx=0 tx=0).stop 2023-09-21T00:17:33.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.824+0000 7f7cfef36700 1 --2- 172.21.15.59:0/193962437 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7cf8153180 0x7f7cf81f98f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.824+0000 7f7cfef36700 1 --2- 172.21.15.59:0/193962437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cf8070590 0x7f7cf8203690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.824+0000 7f7cfef36700 1 --2- 172.21.15.59:0/193962437 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7cf81596f0 0x7f7cf8152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.824+0000 7f7cfef36700 1 -- 172.21.15.59:0/193962437 >> 172.21.15.59:0/193962437 conn(0x7f7cf806c7c0 msgr2=0x7f7cf80b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:33.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.825+0000 7f7cfef36700 1 -- 172.21.15.59:0/193962437 shutdown_connections 2023-09-21T00:17:33.835 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.2 2023-09-21T00:17:33.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.829+0000 7f9a8bbb6700 1 -- 172.21.15.59:0/3325921623 wait complete. 2023-09-21T00:17:33.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.831+0000 7f68e53b4700 1 -- 172.21.15.59:0/3764886452 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f68e0067e50 con 0x7f68e00b3140 2023-09-21T00:17:33.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.831+0000 7f68c77fe700 1 -- 172.21.15.59:0/3764886452 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f68d8058140 con 0x7f68e00b3140 2023-09-21T00:17:33.837 INFO:teuthology.orchestra.run.smithi059.stdout:55834574859 2023-09-21T00:17:33.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.832+0000 7f7cfef36700 1 -- 172.21.15.59:0/193962437 wait complete. 2023-09-21T00:17:33.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.834+0000 7f68e53b4700 1 -- 172.21.15.59:0/3764886452 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f68cc06ae50 msgr2=0x7f68cc06d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.834+0000 7f68e53b4700 1 --2- 172.21.15.59:0/3764886452 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f68cc06ae50 0x7f68cc06d310 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f68d00089b0 tx=0x7f68d0008040 comp rx=0 tx=0).stop 2023-09-21T00:17:33.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.834+0000 7f68e53b4700 1 -- 172.21.15.59:0/3764886452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68e00b3140 msgr2=0x7f68e015dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.834+0000 7f68e53b4700 1 --2- 172.21.15.59:0/3764886452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68e00b3140 0x7f68e015dfa0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f68d800b970 tx=0x7f68d800bc80 comp rx=0 tx=0).stop 2023-09-21T00:17:33.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.834+0000 7f68e53b4700 1 -- 172.21.15.59:0/3764886452 shutdown_connections 2023-09-21T00:17:33.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.834+0000 7f68e53b4700 1 --2- 172.21.15.59:0/3764886452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68e00b3140 0x7f68e015dfa0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.834+0000 7f68e53b4700 1 --2- 172.21.15.59:0/3764886452 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68e00721e0 0x7f68e015e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.834+0000 7f68e53b4700 1 --2- 172.21.15.59:0/3764886452 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f68cc06ae50 0x7f68cc06d310 secure :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f68d00089b0 tx=0x7f68d0008040 comp rx=0 tx=0).stop 2023-09-21T00:17:33.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.834+0000 7f68e53b4700 1 --2- 172.21.15.59:0/3764886452 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f68e008a2a0 0x7f68e0162a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.834+0000 7f68e53b4700 1 -- 172.21.15.59:0/3764886452 >> 172.21.15.59:0/3764886452 conn(0x7f68e006c7c0 msgr2=0x7f68e00cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:33.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.837+0000 7f55504ee700 1 -- 172.21.15.59:0/958085041 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f554815dfa0 con 0x7f5548154030 2023-09-21T00:17:33.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.837+0000 7f553effd700 1 -- 172.21.15.59:0/958085041 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f554815dfa0 con 0x7f5548154030 2023-09-21T00:17:33.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.837+0000 7f68e53b4700 1 -- 172.21.15.59:0/3764886452 shutdown_connections 2023-09-21T00:17:33.842 INFO:teuthology.orchestra.run.smithi059.stdout:55834574857 2023-09-21T00:17:33.843 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.0 2023-09-21T00:17:33.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.839+0000 7f68e53b4700 1 -- 172.21.15.59:0/3764886452 wait complete. 2023-09-21T00:17:33.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.840+0000 7f55504ee700 1 -- 172.21.15.59:0/958085041 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f552c06ae00 msgr2=0x7f552c06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.840+0000 7f55504ee700 1 --2- 172.21.15.59:0/958085041 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f552c06ae00 0x7f552c06d2c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f55480b10a0 tx=0x7f5544008040 comp rx=0 tx=0).stop 2023-09-21T00:17:33.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.840+0000 7f55504ee700 1 -- 172.21.15.59:0/958085041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5548154030 msgr2=0x7f5548152f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.840+0000 7f55504ee700 1 --2- 172.21.15.59:0/958085041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5548154030 0x7f5548152f30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5540014000 tx=0x7f5540004ad0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.840+0000 7f55504ee700 1 -- 172.21.15.59:0/958085041 shutdown_connections 2023-09-21T00:17:33.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.840+0000 7f55504ee700 1 --2- 172.21.15.59:0/958085041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5548154030 0x7f5548152f30 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.840+0000 7f55504ee700 1 --2- 172.21.15.59:0/958085041 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55480b2f20 0x7f554813e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.840+0000 7f55504ee700 1 --2- 172.21.15.59:0/958085041 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f552c06ae00 0x7f552c06d2c0 secure :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f55480b10a0 tx=0x7f5544008040 comp rx=0 tx=0).stop 2023-09-21T00:17:33.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.840+0000 7f55504ee700 1 --2- 172.21.15.59:0/958085041 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f55480cc770 0x7f554815a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.840+0000 7f55504ee700 1 -- 172.21.15.59:0/958085041 >> 172.21.15.59:0/958085041 conn(0x7f55480b1430 msgr2=0x7f55480b2450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:33.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.840+0000 7f55504ee700 1 -- 172.21.15.59:0/958085041 shutdown_connections 2023-09-21T00:17:33.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.840+0000 7fac9f8e0700 1 -- 172.21.15.59:0/407046531 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fac9806d390 con 0x7fac98070cb0 2023-09-21T00:17:33.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.840+0000 7f55504ee700 1 -- 172.21.15.59:0/958085041 wait complete. 2023-09-21T00:17:33.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.841+0000 7fac8dffb700 1 -- 172.21.15.59:0/407046531 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fac88068a60 con 0x7fac98070cb0 2023-09-21T00:17:33.848 INFO:teuthology.orchestra.run.smithi059.stdout:55834574858 2023-09-21T00:17:33.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.843+0000 7fac9f8e0700 1 -- 172.21.15.59:0/407046531 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fac7c06aea0 msgr2=0x7fac7c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.843+0000 7fac9f8e0700 1 --2- 172.21.15.59:0/407046531 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fac7c06aea0 0x7fac7c06d360 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fac98159c90 tx=0x7fac94008040 comp rx=0 tx=0).stop 2023-09-21T00:17:33.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.843+0000 7fac9f8e0700 1 -- 172.21.15.59:0/407046531 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac98070cb0 msgr2=0x7fac98157b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.844+0000 7fac9f8e0700 1 --2- 172.21.15.59:0/407046531 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac98070cb0 0x7fac98157b80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fac8801c480 tx=0x7fac8801c790 comp rx=0 tx=0).stop 2023-09-21T00:17:33.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.844+0000 7fac9f8e0700 1 -- 172.21.15.59:0/407046531 shutdown_connections 2023-09-21T00:17:33.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.844+0000 7fac9f8e0700 1 --2- 172.21.15.59:0/407046531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac980ca2a0 0x7fac98158600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.844+0000 7fac9f8e0700 1 --2- 172.21.15.59:0/407046531 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac98070cb0 0x7fac98157b80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.844+0000 7fac9f8e0700 1 --2- 172.21.15.59:0/407046531 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fac7c06aea0 0x7fac7c06d360 secure :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fac98159c90 tx=0x7fac94008040 comp rx=0 tx=0).stop 2023-09-21T00:17:33.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.844+0000 7fac9f8e0700 1 --2- 172.21.15.59:0/407046531 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fac980c9e20 0x7fac981580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.844+0000 7fac9f8e0700 1 -- 172.21.15.59:0/407046531 >> 172.21.15.59:0/407046531 conn(0x7fac9806a780 msgr2=0x7fac9806d940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:33.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.844+0000 7f57e3da4700 1 -- 172.21.15.59:0/79454553 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f57c4005870 con 0x7f57dc0b6240 2023-09-21T00:17:33.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.844+0000 7fac9f8e0700 1 -- 172.21.15.59:0/407046531 shutdown_connections 2023-09-21T00:17:33.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.844+0000 7fac9f8e0700 1 -- 172.21.15.59:0/407046531 wait complete. 2023-09-21T00:17:33.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.844+0000 7f57ce7fc700 1 -- 172.21.15.59:0/79454553 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f57d8015070 con 0x7f57dc0b6240 2023-09-21T00:17:33.854 INFO:teuthology.orchestra.run.smithi059.stdout:55834574856 2023-09-21T00:17:33.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.847+0000 7f57e3da4700 1 -- 172.21.15.59:0/79454553 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f57c006ae00 msgr2=0x7f57c006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.847+0000 7f57e3da4700 1 --2- 172.21.15.59:0/79454553 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f57c006ae00 0x7f57c006d2c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f57d0009fd0 tx=0x7f57d0009210 comp rx=0 tx=0).stop 2023-09-21T00:17:33.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.847+0000 7f57e3da4700 1 -- 172.21.15.59:0/79454553 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57dc0b6240 msgr2=0x7f57dc0ccf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:33.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.847+0000 7f57e3da4700 1 --2- 172.21.15.59:0/79454553 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57dc0b6240 0x7f57dc0ccf30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f57d8016000 tx=0x7f57d8004750 comp rx=0 tx=0).stop 2023-09-21T00:17:33.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.848+0000 7f57e3da4700 1 -- 172.21.15.59:0/79454553 shutdown_connections 2023-09-21T00:17:33.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.848+0000 7f57e3da4700 1 --2- 172.21.15.59:0/79454553 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f57c006ae00 0x7f57c006d2c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.848+0000 7f57e3da4700 1 --2- 172.21.15.59:0/79454553 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f57dc1619e0 0x7f57dc1f6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.848+0000 7f57e3da4700 1 --2- 172.21.15.59:0/79454553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57dc0b1fe0 0x7f57dc1543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.848+0000 7f57e3da4700 1 --2- 172.21.15.59:0/79454553 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57dc0b6240 0x7f57dc0ccf30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:33.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.848+0000 7f57e3da4700 1 -- 172.21.15.59:0/79454553 >> 172.21.15.59:0/79454553 conn(0x7f57dc0b4ee0 msgr2=0x7f57dc15b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:33.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.848+0000 7f57e3da4700 1 -- 172.21.15.59:0/79454553 shutdown_connections 2023-09-21T00:17:33.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:33.848+0000 7f57e3da4700 1 -- 172.21.15.59:0/79454553 wait complete. 2023-09-21T00:17:33.858 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.6 2023-09-21T00:17:33.861 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.5 2023-09-21T00:17:33.864 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.4 2023-09-21T00:17:33.868 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.1 2023-09-21T00:17:33.869 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.7 2023-09-21T00:17:33.869 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.3 2023-09-21T00:17:34.836 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-21T00:17:34.844 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-21T00:17:34.859 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-09-21T00:17:34.862 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-09-21T00:17:34.865 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-09-21T00:17:34.869 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-21T00:17:34.870 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-09-21T00:17:34.870 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-21T00:17:35.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.056+0000 7f07c350c700 1 Processor -- start 2023-09-21T00:17:35.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.056+0000 7f07c350c700 1 -- start start 2023-09-21T00:17:35.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.058+0000 7f07c350c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f07bc0cf610 0x7f07bc071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.058+0000 7f07c350c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f07bc070590 0x7f07bc0cc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.058+0000 7f07c350c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07bc0724d0 con 0x7f07bc1596f0 2023-09-21T00:17:35.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.058+0000 7f07c350c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07bc0cc820 con 0x7f07bc0cf610 2023-09-21T00:17:35.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.058+0000 7f07c350c700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07bc0727b0 con 0x7f07bc070590 2023-09-21T00:17:35.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.059+0000 7f07c12a8700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f07bc1596f0 0x7f07bc0cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57270/0 (socket says 172.21.15.59:57270) 2023-09-21T00:17:35.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.059+0000 7f07c12a8700 1 -- 172.21.15.59:0/838303094 learned_addr learned my addr 172.21.15.59:0/838303094 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:35.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.059+0000 7f07c0aa7700 1 --2- 172.21.15.59:0/838303094 >> v2:172.21.15.59:3300/0 conn(0x7f07bc0cf610 0x7f07bc071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:35.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.060+0000 7f07c0aa7700 1 -- 172.21.15.59:0/838303094 >> v2:172.21.15.83:3300/0 conn(0x7f07bc070590 msgr2=0x7f07bc0cc2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:35.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.060+0000 7f07c0aa7700 1 --2- 172.21.15.59:0/838303094 >> v2:172.21.15.83:3300/0 conn(0x7f07bc070590 0x7f07bc0cc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.060+0000 7f07c0aa7700 1 -- 172.21.15.59:0/838303094 >> v1:172.21.15.59:6789/0 conn(0x7f07bc1596f0 legacy=0x7f07bc0cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.060+0000 7f07c0aa7700 1 -- 172.21.15.59:0/838303094 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07bc0cb800 con 0x7f07bc0cf610 2023-09-21T00:17:35.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.060+0000 7f07c0aa7700 1 --2- 172.21.15.59:0/838303094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07bc0cf610 0x7f07bc071e80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f07bc15e220 tx=0x7f07b800bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b08ad8ca1514caab server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:35.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.063+0000 7f07b3fff700 1 -- 172.21.15.59:0/838303094 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b800dd20 con 0x7f07bc0cf610 2023-09-21T00:17:35.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.063+0000 7f07b3fff700 1 -- 172.21.15.59:0/838303094 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b800de80 con 0x7f07bc0cf610 2023-09-21T00:17:35.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.063+0000 7f07b3fff700 1 -- 172.21.15.59:0/838303094 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b8006d30 con 0x7f07bc0cf610 2023-09-21T00:17:35.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.064+0000 7f07c350c700 1 -- 172.21.15.59:0/838303094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07bc0cf610 msgr2=0x7f07bc071e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.064+0000 7f07c350c700 1 --2- 172.21.15.59:0/838303094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07bc0cf610 0x7f07bc071e80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f07bc15e220 tx=0x7f07b800bdb0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.064+0000 7f07c350c700 1 -- 172.21.15.59:0/838303094 shutdown_connections 2023-09-21T00:17:35.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.064+0000 7f07c350c700 1 --2- 172.21.15.59:0/838303094 >> v2:172.21.15.83:3300/0 conn(0x7f07bc070590 0x7f07bc0cc2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.064+0000 7f07c350c700 1 --2- 172.21.15.59:0/838303094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07bc0cf610 0x7f07bc071e80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.064+0000 7f07c350c700 1 -- 172.21.15.59:0/838303094 >> 172.21.15.59:0/838303094 conn(0x7f07bc06c7c0 msgr2=0x7f07bc06cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:35.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.065+0000 7f07c350c700 1 -- 172.21.15.59:0/838303094 shutdown_connections 2023-09-21T00:17:35.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.065+0000 7f07c350c700 1 -- 172.21.15.59:0/838303094 wait complete. 2023-09-21T00:17:35.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.067+0000 7f07c350c700 1 Processor -- start 2023-09-21T00:17:35.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.067+0000 7f07c350c700 1 -- start start 2023-09-21T00:17:35.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.068+0000 7f07c350c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07bc070590 0x7f07bc0afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.068+0000 7f07c350c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07bc0cf610 0x7f07bc0b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.068+0000 7f07c350c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f07bc1596f0 0x7f07bc14a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.068+0000 7f07c350c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07bc14b570 con 0x7f07bc070590 2023-09-21T00:17:35.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.068+0000 7f07c350c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07bc148500 con 0x7f07bc0cf610 2023-09-21T00:17:35.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.068+0000 7f07c350c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07bc14b290 con 0x7f07bc1596f0 2023-09-21T00:17:35.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.069+0000 7f07c12a8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07bc070590 0x7f07bc0afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:35.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.069+0000 7f07c12a8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07bc070590 0x7f07bc0afbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51708/0 (socket says 172.21.15.59:51708) 2023-09-21T00:17:35.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.069+0000 7f07c12a8700 1 -- 172.21.15.59:0/321534078 learned_addr learned my addr 172.21.15.59:0/321534078 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:35.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.069+0000 7f07c12a8700 1 -- 172.21.15.59:0/321534078 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f07bc1596f0 msgr2=0x7f07bc14a6b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-21T00:17:35.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.069+0000 7f07c12a8700 1 --2- 172.21.15.59:0/321534078 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f07bc1596f0 0x7f07bc14a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.069+0000 7f07c12a8700 1 -- 172.21.15.59:0/321534078 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07bc0cf610 msgr2=0x7f07bc0b00f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-21T00:17:35.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.069+0000 7f07c12a8700 1 --2- 172.21.15.59:0/321534078 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07bc0cf610 0x7f07bc0b00f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.069+0000 7f07c12a8700 1 -- 172.21.15.59:0/321534078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b800b730 con 0x7f07bc070590 2023-09-21T00:17:35.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.070+0000 7f07c12a8700 1 --2- 172.21.15.59:0/321534078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07bc070590 0x7f07bc0afbb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f07b400c890 tx=0x7f07b400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:35.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.070+0000 7f07b1ffb700 1 -- 172.21.15.59:0/321534078 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b400a9e0 con 0x7f07bc070590 2023-09-21T00:17:35.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.070+0000 7f07b1ffb700 1 -- 172.21.15.59:0/321534078 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b400ce90 con 0x7f07bc070590 2023-09-21T00:17:35.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.070+0000 7f07b1ffb700 1 -- 172.21.15.59:0/321534078 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b400ad40 con 0x7f07bc070590 2023-09-21T00:17:35.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.071+0000 7f07c350c700 1 -- 172.21.15.59:0/321534078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07bc155b30 con 0x7f07bc070590 2023-09-21T00:17:35.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.071+0000 7f07c350c700 1 -- 172.21.15.59:0/321534078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07bc1560f0 con 0x7f07bc070590 2023-09-21T00:17:35.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.074+0000 7f07c350c700 1 -- 172.21.15.59:0/321534078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07a0005320 con 0x7f07bc070590 2023-09-21T00:17:35.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.075+0000 7f07b1ffb700 1 -- 172.21.15.59:0/321534078 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f07b4012420 con 0x7f07bc070590 2023-09-21T00:17:35.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.075+0000 7f07b1ffb700 1 --2- 172.21.15.59:0/321534078 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f07a806afd0 0x7f07a806d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.075+0000 7f07b1ffb700 1 -- 172.21.15.59:0/321534078 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f07b40897e0 con 0x7f07bc070590 2023-09-21T00:17:35.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.076+0000 7f07c0aa7700 1 --2- 172.21.15.59:0/321534078 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f07a806afd0 0x7f07a806d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:35.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.085+0000 7f07b1ffb700 1 -- 172.21.15.59:0/321534078 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f07b4054700 con 0x7f07bc070590 2023-09-21T00:17:35.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.088+0000 7f07c0aa7700 1 --2- 172.21.15.59:0/321534078 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f07a806afd0 0x7f07a806d490 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f07bc150e10 tx=0x7f07b8012000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:35.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.112+0000 7fd332ff7700 1 Processor -- start 2023-09-21T00:17:35.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.112+0000 7fd332ff7700 1 -- start start 2023-09-21T00:17:35.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.113+0000 7fd332ff7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd32c072230 0x7fd32c0b3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.113+0000 7fd332ff7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd32c072610 0x7fd32c0b3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.113+0000 7fd332ff7700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd32c0b4360 con 0x7fd32c0b0b90 2023-09-21T00:17:35.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.113+0000 7fd332ff7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd32c166640 con 0x7fd32c072610 2023-09-21T00:17:35.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.113+0000 7fd332ff7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd32c162150 con 0x7fd32c072230 2023-09-21T00:17:35.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.114+0000 7fd331594700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fd32c0b0b90 0x7fd32c0cce70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.59:47786/0 (socket says 172.21.15.59:47786) 2023-09-21T00:17:35.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.114+0000 7fd331594700 1 -- 172.21.15.59:0/3054272176 learned_addr learned my addr 172.21.15.59:0/3054272176 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:35.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.114+0000 7fd330d93700 1 --2- 172.21.15.59:0/3054272176 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd32c072230 0x7fd32c0b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:35.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.114+0000 7f63b597b700 1 Processor -- start 2023-09-21T00:17:35.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.114+0000 7fd32b7fe700 1 -- 172.21.15.59:0/3054272176 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2588673136 0 0) 0x7fd32c0b4360 con 0x7fd32c0b0b90 2023-09-21T00:17:35.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.114+0000 7fd32b7fe700 1 -- 172.21.15.59:0/3054272176 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3140035b0 con 0x7fd32c0b0b90 2023-09-21T00:17:35.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.115+0000 7fd330d93700 1 -- 172.21.15.59:0/3054272176 >> v2:172.21.15.59:3300/0 conn(0x7fd32c072610 msgr2=0x7fd32c0b3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:35.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.115+0000 7fd330d93700 1 --2- 172.21.15.59:0/3054272176 >> v2:172.21.15.59:3300/0 conn(0x7fd32c072610 0x7fd32c0b3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.115+0000 7fd330d93700 1 -- 172.21.15.59:0/3054272176 >> v1:172.21.15.83:6789/0 conn(0x7fd32c0b0b90 legacy=0x7fd32c0cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.115+0000 7fd330d93700 1 -- 172.21.15.59:0/3054272176 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd32c162430 con 0x7fd32c072230 2023-09-21T00:17:35.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.115+0000 7fd330d93700 1 --2- 172.21.15.59:0/3054272176 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd32c072230 0x7fd32c0b3810 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd31c009840 tx=0x7fd31c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e678b5e963fe8ee4 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:35.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.115+0000 7fd32b7fe700 1 -- 172.21.15.59:0/3054272176 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31c011830 con 0x7fd32c072230 2023-09-21T00:17:35.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.115+0000 7fd32b7fe700 1 -- 172.21.15.59:0/3054272176 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31c011990 con 0x7fd32c072230 2023-09-21T00:17:35.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.115+0000 7fd32b7fe700 1 -- 172.21.15.59:0/3054272176 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31c011d20 con 0x7fd32c072230 2023-09-21T00:17:35.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.114+0000 7f63b597b700 1 -- start start 2023-09-21T00:17:35.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.116+0000 7f63b597b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f63b015b790 0x7f63b00d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.116+0000 7f63b597b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63b00cc940 con 0x7f63b00b0150 2023-09-21T00:17:35.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.116+0000 7f63b597b700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63b00cf260 con 0x7f63b00cdb20 2023-09-21T00:17:35.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.116+0000 7f63b597b700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63b00d0560 con 0x7f63b015b790 2023-09-21T00:17:35.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.116+0000 7f63af7fe700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f63b00cdb20 0x7f63b00ccdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.59:47796/0 (socket says 172.21.15.59:47796) 2023-09-21T00:17:35.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.116+0000 7efd70dad700 1 Processor -- start 2023-09-21T00:17:35.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.116+0000 7f63af7fe700 1 -- 172.21.15.59:0/2874756742 learned_addr learned my addr 172.21.15.59:0/2874756742 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:35.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.116+0000 7f63aeffd700 1 --2- 172.21.15.59:0/2874756742 >> v2:172.21.15.83:3300/0 conn(0x7f63b015b790 0x7f63b00d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:35.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.116+0000 7fd332ff7700 1 -- 172.21.15.59:0/3054272176 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd32c072230 msgr2=0x7fd32c0b3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.116+0000 7fd332ff7700 1 --2- 172.21.15.59:0/3054272176 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd32c072230 0x7fd32c0b3810 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd31c009840 tx=0x7fd31c009b50 comp rx=0 tx=0).stop 2023-09-21T00:17:35.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.117+0000 7efd70dad700 1 -- start start 2023-09-21T00:17:35.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.117+0000 7f63aeffd700 1 -- 172.21.15.59:0/2874756742 >> v1:172.21.15.83:6789/0 conn(0x7f63b00cdb20 legacy=0x7f63b00ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.117+0000 7f63aeffd700 1 -- 172.21.15.59:0/2874756742 >> v1:172.21.15.59:6789/0 conn(0x7f63b00b0150 legacy=0x7f63b00add00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:35.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.117+0000 7f63aeffd700 1 -- 172.21.15.59:0/2874756742 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b00cc2f0 con 0x7f63b015b790 2023-09-21T00:17:35.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.117+0000 7f63aeffd700 1 --2- 172.21.15.59:0/2874756742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63b015b790 0x7f63b00d0020 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f63a00097a0 tx=0x7f63a0009ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15f77824fc0401e1 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:35.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.117+0000 7fd332ff7700 1 -- 172.21.15.59:0/3054272176 shutdown_connections 2023-09-21T00:17:35.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.117+0000 7fd332ff7700 1 --2- 172.21.15.59:0/3054272176 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd32c072230 0x7fd32c0b3810 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.117+0000 7fd332ff7700 1 --2- 172.21.15.59:0/3054272176 >> v2:172.21.15.59:3300/0 conn(0x7fd32c072610 0x7fd32c0b3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.117+0000 7fd332ff7700 1 -- 172.21.15.59:0/3054272176 >> 172.21.15.59:0/3054272176 conn(0x7fd32c06de70 msgr2=0x7fd32c06a780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:35.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.114+0000 7fa61a10c700 1 Processor -- start 2023-09-21T00:17:35.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.114+0000 7fa61a10c700 1 -- start start 2023-09-21T00:17:35.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.116+0000 7fa61a10c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa61416a540 0x7fa6140cf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.116+0000 7fa61a10c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa6140cf680 0x7fa6140b1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.116+0000 7fa61a10c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa61406e5e0 con 0x7fa6140b2440 2023-09-21T00:17:35.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.116+0000 7fa61a10c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6140ce380 con 0x7fa61416a540 2023-09-21T00:17:35.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.116+0000 7fa61a10c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6140ce660 con 0x7fa6140cf680 2023-09-21T00:17:35.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.116+0000 7fa612ffd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa6140cf680 0x7fa6140b1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:35.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.116+0000 7fa612ffd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa6140cf680 0x7fa6140b1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.59:52340/0 (socket says 172.21.15.59:52340) 2023-09-21T00:17:35.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.116+0000 7fa612ffd700 1 -- 172.21.15.59:0/2343611762 learned_addr learned my addr 172.21.15.59:0/2343611762 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:35.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.118+0000 7f63adffb700 1 -- 172.21.15.59:0/2874756742 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a0005e30 con 0x7f63b015b790 2023-09-21T00:17:35.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.118+0000 7f63adffb700 1 -- 172.21.15.59:0/2874756742 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a0004030 con 0x7f63b015b790 2023-09-21T00:17:35.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.118+0000 7f63adffb700 1 -- 172.21.15.59:0/2874756742 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a00043c0 con 0x7f63b015b790 2023-09-21T00:17:35.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.118+0000 7efd70dad700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efd6c0cc270 0x7efd6c0cc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.118+0000 7efd70dad700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd6c15f9e0 0x7efd6c06eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.118+0000 7efd70dad700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd6c0cd780 con 0x7efd6c06ce80 2023-09-21T00:17:35.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.118+0000 7efd70dad700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd6c15ff90 con 0x7efd6c0cc270 2023-09-21T00:17:35.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.118+0000 7efd70dad700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c0ccb90 con 0x7efd6c15f9e0 2023-09-21T00:17:35.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.118+0000 7efd69d9b700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7efd6c06ce80 0x7efd6c06e7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.59:47804/0 (socket says 172.21.15.59:47804) 2023-09-21T00:17:35.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.118+0000 7efd69d9b700 1 -- 172.21.15.59:0/4208270033 learned_addr learned my addr 172.21.15.59:0/4208270033 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:35.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.118+0000 7efd6a59c700 1 --2- 172.21.15.59:0/4208270033 >> v2:172.21.15.59:3300/0 conn(0x7efd6c0cc270 0x7efd6c0cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:35.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.119+0000 7efd6ad9d700 1 --2- 172.21.15.59:0/4208270033 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd6c15f9e0 0x7efd6c06eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:35.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.118+0000 7fa612ffd700 1 -- 172.21.15.59:0/2343611762 >> v2:172.21.15.59:3300/0 conn(0x7fa61416a540 msgr2=0x7fa6140cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:35.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.118+0000 7fa612ffd700 1 --2- 172.21.15.59:0/2343611762 >> v2:172.21.15.59:3300/0 conn(0x7fa61416a540 0x7fa6140cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.118+0000 7fa612ffd700 1 -- 172.21.15.59:0/2343611762 >> v1:172.21.15.59:6789/0 conn(0x7fa6140b2440 legacy=0x7fa61408a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:35.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.118+0000 7fa612ffd700 1 -- 172.21.15.59:0/2343611762 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6140ce940 con 0x7fa6140cf680 2023-09-21T00:17:35.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.118+0000 7fa612ffd700 1 --2- 172.21.15.59:0/2343611762 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa6140cf680 0x7fa6140b1f00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa608007460 tx=0x7fa6080077f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7defb4cc110dba6 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:35.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.118+0000 7fa6127fc700 1 -- 172.21.15.59:0/2343611762 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60800bae0 con 0x7fa6140cf680 2023-09-21T00:17:35.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.118+0000 7fa6127fc700 1 -- 172.21.15.59:0/2343611762 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa60800bc40 con 0x7fa6140cf680 2023-09-21T00:17:35.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.118+0000 7fa6127fc700 1 -- 172.21.15.59:0/2343611762 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa608018480 con 0x7fa6140cf680 2023-09-21T00:17:35.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.119+0000 7f63b597b700 1 -- 172.21.15.59:0/2874756742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63b015b790 msgr2=0x7f63b00d0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.119+0000 7f63b597b700 1 --2- 172.21.15.59:0/2874756742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63b015b790 0x7f63b00d0020 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f63a00097a0 tx=0x7f63a0009ab0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.119+0000 7efd6a59c700 1 -- 172.21.15.59:0/4208270033 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd6c15f9e0 msgr2=0x7efd6c06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:35.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.119+0000 7efd6a59c700 1 --2- 172.21.15.59:0/4208270033 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd6c15f9e0 0x7efd6c06eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.119+0000 7efd6a59c700 1 -- 172.21.15.59:0/4208270033 >> v1:172.21.15.83:6789/0 conn(0x7efd6c06ce80 legacy=0x7efd6c06e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.119+0000 7efd6a59c700 1 -- 172.21.15.59:0/4208270033 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd6c15c980 con 0x7efd6c0cc270 2023-09-21T00:17:35.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.119+0000 7efd6ad9d700 1 --2- 172.21.15.59:0/4208270033 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd6c15f9e0 0x7efd6c06eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T00:17:35.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.118+0000 7fd332ff7700 1 -- 172.21.15.59:0/3054272176 shutdown_connections 2023-09-21T00:17:35.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.119+0000 7efd6a59c700 1 --2- 172.21.15.59:0/4208270033 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd6c0cc270 0x7efd6c0cc650 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7efd5c009840 tx=0x7efd5c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b541840eebab0a9 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:35.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.119+0000 7fa61a10c700 1 -- 172.21.15.59:0/2343611762 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa6140cf680 msgr2=0x7fa6140b1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.119+0000 7fa61a10c700 1 --2- 172.21.15.59:0/2343611762 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa6140cf680 0x7fa6140b1f00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa608007460 tx=0x7fa6080077f0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.119+0000 7fa61a10c700 1 -- 172.21.15.59:0/2343611762 shutdown_connections 2023-09-21T00:17:35.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.119+0000 7fa61a10c700 1 --2- 172.21.15.59:0/2343611762 >> v2:172.21.15.59:3300/0 conn(0x7fa61416a540 0x7fa6140cf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.119+0000 7fa61a10c700 1 --2- 172.21.15.59:0/2343611762 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa6140cf680 0x7fa6140b1f00 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.119+0000 7fa61a10c700 1 -- 172.21.15.59:0/2343611762 >> 172.21.15.59:0/2343611762 conn(0x7fa61406c7c0 msgr2=0x7fa61406cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:35.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.119+0000 7efd6959a700 1 -- 172.21.15.59:0/4208270033 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5c011830 con 0x7efd6c0cc270 2023-09-21T00:17:35.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.119+0000 7f63b597b700 1 -- 172.21.15.59:0/2874756742 shutdown_connections 2023-09-21T00:17:35.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.119+0000 7f63b597b700 1 --2- 172.21.15.59:0/2874756742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63b015b790 0x7f63b00d0020 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.119+0000 7f63b597b700 1 -- 172.21.15.59:0/2874756742 >> 172.21.15.59:0/2874756742 conn(0x7f63b00d1130 msgr2=0x7f63b00d1540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:35.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.120+0000 7efd6959a700 1 -- 172.21.15.59:0/4208270033 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5c011990 con 0x7efd6c0cc270 2023-09-21T00:17:35.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.120+0000 7efd6959a700 1 -- 172.21.15.59:0/4208270033 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5c011d20 con 0x7efd6c0cc270 2023-09-21T00:17:35.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.120+0000 7efd70dad700 1 -- 172.21.15.59:0/4208270033 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd6c0cc270 msgr2=0x7efd6c0cc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.120+0000 7efd70dad700 1 --2- 172.21.15.59:0/4208270033 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd6c0cc270 0x7efd6c0cc650 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7efd5c009840 tx=0x7efd5c009b50 comp rx=0 tx=0).stop 2023-09-21T00:17:35.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.120+0000 7fdbd38c2700 1 Processor -- start 2023-09-21T00:17:35.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.120+0000 7fa61a10c700 1 -- 172.21.15.59:0/2343611762 shutdown_connections 2023-09-21T00:17:35.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.120+0000 7fa61a10c700 1 -- 172.21.15.59:0/2343611762 wait complete. 2023-09-21T00:17:35.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.121+0000 7fa61a10c700 1 Processor -- start 2023-09-21T00:17:35.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.119+0000 7fd332ff7700 1 -- 172.21.15.59:0/3054272176 wait complete. 2023-09-21T00:17:35.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.121+0000 7fd332ff7700 1 Processor -- start 2023-09-21T00:17:35.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.121+0000 7fd332ff7700 1 -- start start 2023-09-21T00:17:35.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.121+0000 7fa61a10c700 1 -- start start 2023-09-21T00:17:35.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.122+0000 7efd70dad700 1 -- 172.21.15.59:0/4208270033 shutdown_connections 2023-09-21T00:17:35.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.122+0000 7efd70dad700 1 --2- 172.21.15.59:0/4208270033 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd6c15f9e0 0x7efd6c06eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.122+0000 7efd70dad700 1 --2- 172.21.15.59:0/4208270033 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd6c0cc270 0x7efd6c0cc650 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.122+0000 7efd70dad700 1 -- 172.21.15.59:0/4208270033 >> 172.21.15.59:0/4208270033 conn(0x7efd6c0b1430 msgr2=0x7efd6c0b1840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:35.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.122+0000 7f63b597b700 1 -- 172.21.15.59:0/2874756742 shutdown_connections 2023-09-21T00:17:35.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.121+0000 7fdbd38c2700 1 -- start start 2023-09-21T00:17:35.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.122+0000 7fdbd38c2700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fdbcc1619e0 0x7fdbcc0d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.122+0000 7fdbd38c2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdbcc0b26f0 0x7fdbcc0b66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.122+0000 7fdbd38c2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbcc0b2ca0 con 0x7fdbcc0b6240 2023-09-21T00:17:35.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.122+0000 7fdbd38c2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbcc0b6c00 con 0x7fdbcc0b26f0 2023-09-21T00:17:35.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.122+0000 7fdbd38c2700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbcc161dc0 con 0x7fdbcc1619e0 2023-09-21T00:17:35.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.122+0000 7fdbd0e5d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fdbcc0b6240 0x7fdbcc0b1fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57310/0 (socket says 172.21.15.59:57310) 2023-09-21T00:17:35.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.122+0000 7fdbd0e5d700 1 -- 172.21.15.59:0/4045278428 learned_addr learned my addr 172.21.15.59:0/4045278428 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:35.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.122+0000 7fdbd165e700 1 --2- 172.21.15.59:0/4045278428 >> v2:172.21.15.83:3300/0 conn(0x7fdbcc1619e0 0x7fdbcc0d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:35.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.122+0000 7fd332ff7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd32c072230 0x7fd32c154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.122+0000 7fd332ff7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd32c072610 0x7fd32c153eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.122+0000 7fd332ff7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd32c0b0b90 0x7fd32c1640f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.122+0000 7fd332ff7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32c163c60 con 0x7fd32c0b0b90 2023-09-21T00:17:35.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.122+0000 7fd332ff7700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32c1651e0 con 0x7fd32c072610 2023-09-21T00:17:35.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.122+0000 7fd332ff7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd32c1654c0 con 0x7fd32c072230 2023-09-21T00:17:35.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.122+0000 7fdbd1e5f700 1 --2- 172.21.15.59:0/4045278428 >> v2:172.21.15.59:3300/0 conn(0x7fdbcc0b26f0 0x7fdbcc0b66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:35.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.122+0000 7fdbd165e700 1 -- 172.21.15.59:0/4045278428 >> v2:172.21.15.59:3300/0 conn(0x7fdbcc0b26f0 msgr2=0x7fdbcc0b66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:35.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.122+0000 7fdbd165e700 1 --2- 172.21.15.59:0/4045278428 >> v2:172.21.15.59:3300/0 conn(0x7fdbcc0b26f0 0x7fdbcc0b66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.122+0000 7fdbd165e700 1 -- 172.21.15.59:0/4045278428 >> v1:172.21.15.59:6789/0 conn(0x7fdbcc0b6240 legacy=0x7fdbcc0b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.123+0000 7fdbd165e700 1 -- 172.21.15.59:0/4045278428 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbcc0cddc0 con 0x7fdbcc1619e0 2023-09-21T00:17:35.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.123+0000 7efd70dad700 1 -- 172.21.15.59:0/4208270033 shutdown_connections 2023-09-21T00:17:35.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.123+0000 7fdbd1e5f700 1 --2- 172.21.15.59:0/4045278428 >> v2:172.21.15.59:3300/0 conn(0x7fdbcc0b26f0 0x7fdbcc0b66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:17:35.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.122+0000 7fa61a10c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6140b2440 0x7fa614159770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.123+0000 7fa61a10c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa6140cf680 0x7fa614165e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.123+0000 7fa61a10c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6140b17f0 0x7fa6141663a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.123+0000 7fa61a10c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6140b0570 con 0x7fa6140b17f0 2023-09-21T00:17:35.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.123+0000 7fa61a10c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6140b1360 con 0x7fa6140b2440 2023-09-21T00:17:35.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.123+0000 7fa61a10c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6140b0750 con 0x7fa6140cf680 2023-09-21T00:17:35.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.123+0000 7fa6137fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6140b2440 0x7fa614159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:35.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.123+0000 7fd32bfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd32c072610 0x7fd32c153eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:35.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.123+0000 7fa6137fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6140b2440 0x7fa614159770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.59:37870/0 (socket says 172.21.15.59:37870) 2023-09-21T00:17:35.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.123+0000 7fa6137fe700 1 -- 172.21.15.59:0/2656098560 learned_addr learned my addr 172.21.15.59:0/2656098560 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:35.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.123+0000 7fd330d93700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd32c072230 0x7fd32c154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:35.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.123+0000 7fd331594700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd32c0b0b90 0x7fd32c1640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:35.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.123+0000 7fd331594700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd32c0b0b90 0x7fd32c1640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51750/0 (socket says 172.21.15.59:51750) 2023-09-21T00:17:35.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.123+0000 7fd331594700 1 -- 172.21.15.59:0/2901227356 learned_addr learned my addr 172.21.15.59:0/2901227356 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:35.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.123+0000 7fa613fff700 1 --2- 172.21.15.59:0/2656098560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6140b17f0 0x7fa6141663a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:35.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.123+0000 7fa6137fe700 1 -- 172.21.15.59:0/2656098560 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa6140cf680 msgr2=0x7fa614165e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.123+0000 7fa6137fe700 1 --2- 172.21.15.59:0/2656098560 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa6140cf680 0x7fa614165e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.123+0000 7fa6137fe700 1 -- 172.21.15.59:0/2656098560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6140b17f0 msgr2=0x7fa6141663a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.123+0000 7fa6137fe700 1 --2- 172.21.15.59:0/2656098560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6140b17f0 0x7fa6141663a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.123+0000 7fa6137fe700 1 -- 172.21.15.59:0/2656098560 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60800b190 con 0x7fa6140b2440 2023-09-21T00:17:35.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.124+0000 7fd330d93700 1 -- 172.21.15.59:0/2901227356 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd32c072610 msgr2=0x7fd32c153eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.124+0000 7fd330d93700 1 --2- 172.21.15.59:0/2901227356 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd32c072610 0x7fd32c153eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.124+0000 7fd330d93700 1 -- 172.21.15.59:0/2901227356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd32c0b0b90 msgr2=0x7fd32c1640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.124+0000 7fd330d93700 1 --2- 172.21.15.59:0/2901227356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd32c0b0b90 0x7fd32c1640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.124+0000 7fd330d93700 1 -- 172.21.15.59:0/2901227356 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd31c0094a0 con 0x7fd32c072230 2023-09-21T00:17:35.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.124+0000 7f63b597b700 1 -- 172.21.15.59:0/2874756742 wait complete. 2023-09-21T00:17:35.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.126+0000 7f63b597b700 1 Processor -- start 2023-09-21T00:17:35.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.123+0000 7efd70dad700 1 -- 172.21.15.59:0/4208270033 wait complete. 2023-09-21T00:17:35.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.125+0000 7efd70dad700 1 Processor -- start 2023-09-21T00:17:35.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.125+0000 7fdbd165e700 1 --2- 172.21.15.59:0/4045278428 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdbcc1619e0 0x7fdbcc0d0fc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc06b240 tx=0x7fdbbc009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9a5fdf3faf1ffbd server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:35.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.126+0000 7fdbc3fff700 1 -- 172.21.15.59:0/4045278428 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc004230 con 0x7fdbcc1619e0 2023-09-21T00:17:35.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.126+0000 7fdbc3fff700 1 -- 172.21.15.59:0/4045278428 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbbc004390 con 0x7fdbcc1619e0 2023-09-21T00:17:35.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.126+0000 7fdbc3fff700 1 -- 172.21.15.59:0/4045278428 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc0036a0 con 0x7fdbcc1619e0 2023-09-21T00:17:35.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.124+0000 7fa6137fe700 1 --2- 172.21.15.59:0/2656098560 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6140b2440 0x7fa614159770 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa60400b4a0 tx=0x7fa60400b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:35.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.124+0000 7fa5fbfff700 1 -- 172.21.15.59:0/2656098560 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa604011830 con 0x7fa6140b2440 2023-09-21T00:17:35.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.124+0000 7fa5fbfff700 1 -- 172.21.15.59:0/2656098560 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa604011990 con 0x7fa6140b2440 2023-09-21T00:17:35.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.124+0000 7fa5fbfff700 1 -- 172.21.15.59:0/2656098560 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa604011d40 con 0x7fa6140b2440 2023-09-21T00:17:35.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.124+0000 7fa61a10c700 1 -- 172.21.15.59:0/2656098560 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6140b0a30 con 0x7fa6140b2440 2023-09-21T00:17:35.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.124+0000 7fa61a10c700 1 -- 172.21.15.59:0/2656098560 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6140b0ff0 con 0x7fa6140b2440 2023-09-21T00:17:35.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.124+0000 7fd330d93700 1 --2- 172.21.15.59:0/2901227356 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd32c072230 0x7fd32c154b40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd31c016000 tx=0x7fd31c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:35.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.124+0000 7fd3297fa700 1 -- 172.21.15.59:0/2901227356 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31c004590 con 0x7fd32c072230 2023-09-21T00:17:35.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.124+0000 7fd3297fa700 1 -- 172.21.15.59:0/2901227356 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31c01f070 con 0x7fd32c072230 2023-09-21T00:17:35.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.124+0000 7fd3297fa700 1 -- 172.21.15.59:0/2901227356 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31c0038e0 con 0x7fd32c072230 2023-09-21T00:17:35.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.125+0000 7efd70dad700 1 -- start start 2023-09-21T00:17:35.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.126+0000 7efd70dad700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd6c06ce80 0x7efd6c159d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.126+0000 7efd70dad700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd6c0cc270 0x7efd6c0a93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.126+0000 7efd70dad700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd6c15f9e0 0x7efd6c070e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.126+0000 7efd70dad700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c0ab890 con 0x7efd6c0cc270 2023-09-21T00:17:35.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.126+0000 7efd70dad700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c0a85f0 con 0x7efd6c15f9e0 2023-09-21T00:17:35.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.126+0000 7efd70dad700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c0a88d0 con 0x7efd6c06ce80 2023-09-21T00:17:35.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.126+0000 7efd6ad9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd6c15f9e0 0x7efd6c070e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:35.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.126+0000 7efd6a59c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd6c06ce80 0x7efd6c159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:35.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.126+0000 7efd6a59c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd6c06ce80 0x7efd6c159d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.59:52376/0 (socket says 172.21.15.59:52376) 2023-09-21T00:17:35.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.126+0000 7efd6a59c700 1 -- 172.21.15.59:0/2317098268 learned_addr learned my addr 172.21.15.59:0/2317098268 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:35.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.126+0000 7efd6ad9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd6c15f9e0 0x7efd6c070e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.59:37878/0 (socket says 172.21.15.59:37878) 2023-09-21T00:17:35.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.127+0000 7efd6a59c700 1 -- 172.21.15.59:0/2317098268 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd6c15f9e0 msgr2=0x7efd6c070e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.127+0000 7efd6a59c700 1 --2- 172.21.15.59:0/2317098268 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd6c15f9e0 0x7efd6c070e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.127+0000 7efd6a59c700 1 -- 172.21.15.59:0/2317098268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd6c0cc270 msgr2=0x7efd6c0a93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.127+0000 7efd6a59c700 1 --2- 172.21.15.59:0/2317098268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd6c0cc270 0x7efd6c0a93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.127+0000 7efd6a59c700 1 -- 172.21.15.59:0/2317098268 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd64009a70 con 0x7efd6c06ce80 2023-09-21T00:17:35.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.127+0000 7efd6a59c700 1 --2- 172.21.15.59:0/2317098268 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd6c06ce80 0x7efd6c159d70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efd5c009fd0 tx=0x7efd5c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:35.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.126+0000 7fa5fbfff700 1 -- 172.21.15.59:0/2656098560 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fa60401a400 con 0x7fa6140b2440 2023-09-21T00:17:35.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.127+0000 7fa5fbfff700 1 --2- 172.21.15.59:0/2656098560 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa60006ae50 0x7fa60006d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.127+0000 7fa5fbfff700 1 -- 172.21.15.59:0/2656098560 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa6040897a0 con 0x7fa6140b2440 2023-09-21T00:17:35.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.127+0000 7efd5affd700 1 -- 172.21.15.59:0/2317098268 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5c0036a0 con 0x7efd6c06ce80 2023-09-21T00:17:35.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.127+0000 7efd5affd700 1 -- 172.21.15.59:0/2317098268 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5c01e070 con 0x7efd6c06ce80 2023-09-21T00:17:35.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.127+0000 7efd5affd700 1 -- 172.21.15.59:0/2317098268 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5c003a60 con 0x7efd6c06ce80 2023-09-21T00:17:35.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.126+0000 7f63b597b700 1 -- start start 2023-09-21T00:17:35.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.127+0000 7f63b597b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f63b00b0150 0x7f63b01ffbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.127+0000 7f63b597b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63b00cdb20 0x7f63b01506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.127+0000 7f63b597b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63b014ab00 0x7f63b00ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.127+0000 7f63b597b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b014a530 con 0x7f63b014ab00 2023-09-21T00:17:35.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.127+0000 7f63b597b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b014c930 con 0x7f63b00cdb20 2023-09-21T00:17:35.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.127+0000 7f63b597b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b014bbd0 con 0x7f63b00b0150 2023-09-21T00:17:35.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.128+0000 7f63ae7fc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63b00cdb20 0x7f63b01506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:35.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.128+0000 7f63af7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63b014ab00 0x7f63b00ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:35.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.127+0000 7fd332ff7700 1 -- 172.21.15.59:0/2901227356 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd32c1f7e60 con 0x7fd32c072230 2023-09-21T00:17:35.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.127+0000 7fd332ff7700 1 -- 172.21.15.59:0/2901227356 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd32c1657a0 con 0x7fd32c072230 2023-09-21T00:17:35.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.128+0000 7f63ae7fc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63b00cdb20 0x7f63b01506d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.59:37882/0 (socket says 172.21.15.59:37882) 2023-09-21T00:17:35.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.128+0000 7f63ae7fc700 1 -- 172.21.15.59:0/3731515003 learned_addr learned my addr 172.21.15.59:0/3731515003 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:35.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.128+0000 7f63ae7fc700 1 -- 172.21.15.59:0/3731515003 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f63b00b0150 msgr2=0x7f63b01ffbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.128+0000 7f63ae7fc700 1 --2- 172.21.15.59:0/3731515003 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f63b00b0150 0x7f63b01ffbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.128+0000 7f63ae7fc700 1 -- 172.21.15.59:0/3731515003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63b014ab00 msgr2=0x7f63b00ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.128+0000 7f63ae7fc700 1 --2- 172.21.15.59:0/3731515003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63b014ab00 0x7f63b00ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.128+0000 7f63ae7fc700 1 -- 172.21.15.59:0/3731515003 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a0009430 con 0x7f63b00cdb20 2023-09-21T00:17:35.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.128+0000 7f63ae7fc700 1 --2- 172.21.15.59:0/3731515003 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63b00cdb20 0x7f63b01506d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f63a400c4a0 tx=0x7f63a400c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:35.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.127+0000 7fdbd38c2700 1 -- 172.21.15.59:0/4045278428 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdbcc1619e0 msgr2=0x7fdbcc0d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.127+0000 7fdbd38c2700 1 --2- 172.21.15.59:0/4045278428 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdbcc1619e0 0x7fdbcc0d0fc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc06b240 tx=0x7fdbbc009b20 comp rx=0 tx=0).stop 2023-09-21T00:17:35.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.127+0000 7fdbd38c2700 1 -- 172.21.15.59:0/4045278428 shutdown_connections 2023-09-21T00:17:35.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.127+0000 7fdbd38c2700 1 --2- 172.21.15.59:0/4045278428 >> v2:172.21.15.59:3300/0 conn(0x7fdbcc0b26f0 0x7fdbcc0b66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.127+0000 7fdbd38c2700 1 --2- 172.21.15.59:0/4045278428 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdbcc1619e0 0x7fdbcc0d0fc0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.127+0000 7fdbd38c2700 1 -- 172.21.15.59:0/4045278428 >> 172.21.15.59:0/4045278428 conn(0x7fdbcc0b4ee0 msgr2=0x7fdbcc0b52f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:35.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.128+0000 7efd70dad700 1 -- 172.21.15.59:0/2317098268 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd5c0094a0 con 0x7efd6c06ce80 2023-09-21T00:17:35.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.128+0000 7efd70dad700 1 -- 172.21.15.59:0/2317098268 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd6c0a8e90 con 0x7efd6c06ce80 2023-09-21T00:17:35.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.128+0000 7f6397fff700 1 -- 172.21.15.59:0/3731515003 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a40054e0 con 0x7f63b00cdb20 2023-09-21T00:17:35.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.129+0000 7f6397fff700 1 -- 172.21.15.59:0/3731515003 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a4003680 con 0x7f63b00cdb20 2023-09-21T00:17:35.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.129+0000 7f6397fff700 1 -- 172.21.15.59:0/3731515003 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a4003a30 con 0x7f63b00cdb20 2023-09-21T00:17:35.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.128+0000 7fd332ff7700 1 -- 172.21.15.59:0/2901227356 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd32c163f60 con 0x7fd32c072230 2023-09-21T00:17:35.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.129+0000 7fd3297fa700 1 -- 172.21.15.59:0/2901227356 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fd31c003a40 con 0x7fd32c072230 2023-09-21T00:17:35.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.129+0000 7f63b597b700 1 -- 172.21.15.59:0/3731515003 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63b014b050 con 0x7f63b00cdb20 2023-09-21T00:17:35.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.129+0000 7f63b597b700 1 -- 172.21.15.59:0/3731515003 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63b014b610 con 0x7f63b00cdb20 2023-09-21T00:17:35.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.129+0000 7fd3297fa700 1 --2- 172.21.15.59:0/2901227356 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd31806ae00 0x7fd31806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.130+0000 7fd3297fa700 1 -- 172.21.15.59:0/2901227356 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd31c021070 con 0x7fd32c072230 2023-09-21T00:17:35.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.130+0000 7f63b597b700 1 -- 172.21.15.59:0/3731515003 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63b014caa0 con 0x7f63b00cdb20 2023-09-21T00:17:35.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.130+0000 7efd5affd700 1 -- 172.21.15.59:0/2317098268 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7efd5c003bc0 con 0x7efd6c06ce80 2023-09-21T00:17:35.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.131+0000 7efd70dad700 1 -- 172.21.15.59:0/2317098268 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd6c0cf680 con 0x7efd6c06ce80 2023-09-21T00:17:35.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.131+0000 7f6397fff700 1 -- 172.21.15.59:0/3731515003 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f63a4003b90 con 0x7f63b00cdb20 2023-09-21T00:17:35.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.131+0000 7efd5affd700 1 --2- 172.21.15.59:0/2317098268 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7efd4c06ae20 0x7efd4c06d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.131+0000 7efd5affd700 1 -- 172.21.15.59:0/2317098268 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efd5c08a750 con 0x7efd6c06ce80 2023-09-21T00:17:35.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.131+0000 7efd69d9b700 1 --2- 172.21.15.59:0/2317098268 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7efd4c06ae20 0x7efd4c06d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:35.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.131+0000 7f6397fff700 1 --2- 172.21.15.59:0/3731515003 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f639806afb0 0x7f639806d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.131+0000 7f6397fff700 1 -- 172.21.15.59:0/3731515003 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f63a4088c60 con 0x7f63b00cdb20 2023-09-21T00:17:35.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.131+0000 7fdbd38c2700 1 -- 172.21.15.59:0/4045278428 shutdown_connections 2023-09-21T00:17:35.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.131+0000 7fdbd38c2700 1 -- 172.21.15.59:0/4045278428 wait complete. 2023-09-21T00:17:35.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.132+0000 7fa61a10c700 1 -- 172.21.15.59:0/2656098560 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5f40052f0 con 0x7fa6140b2440 2023-09-21T00:17:35.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.132+0000 7f760bf72700 1 Processor -- start 2023-09-21T00:17:35.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.133+0000 7f760bf72700 1 -- start start 2023-09-21T00:17:35.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.133+0000 7efd69d9b700 1 --2- 172.21.15.59:0/2317098268 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7efd4c06ae20 0x7efd4c06d2e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7efd6c1f5790 tx=0x7efd60007ad0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:35.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.133+0000 7fdbd38c2700 1 Processor -- start 2023-09-21T00:17:35.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.133+0000 7fdbd38c2700 1 -- start start 2023-09-21T00:17:35.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.133+0000 7f760bf72700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f76040d2e80 0x7f76040b4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.133+0000 7f760bf72700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f76040b8d80 0x7f76040b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.133+0000 7f760bf72700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76040d1de0 con 0x7f760415d4c0 2023-09-21T00:17:35.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.133+0000 7f760bf72700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76040d1bf0 con 0x7f76040b8d80 2023-09-21T00:17:35.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.133+0000 7f760bf72700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76040b7530 con 0x7f76040d2e80 2023-09-21T00:17:35.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.134+0000 7f7609d0e700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f760415d4c0 0x7f76040d14e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57340/0 (socket says 172.21.15.59:57340) 2023-09-21T00:17:35.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.134+0000 7f7609d0e700 1 -- 172.21.15.59:0/3796393290 learned_addr learned my addr 172.21.15.59:0/3796393290 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:35.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.134+0000 7f760a50f700 1 --2- 172.21.15.59:0/3796393290 >> v2:172.21.15.83:3300/0 conn(0x7f76040b8d80 0x7f76040b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:35.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.134+0000 7f760950d700 1 --2- 172.21.15.59:0/3796393290 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f76040d2e80 0x7f76040b4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:35.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.134+0000 7fdbd38c2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdbcc0b26f0 0x7fdbcc0ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.134+0000 7fdbd38c2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbcc0b6240 0x7fdbcc157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.134+0000 7fdbd38c2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdbcc1619e0 0x7fdbcc0c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.134+0000 7fdbd38c2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbcc143860 con 0x7fdbcc0b6240 2023-09-21T00:17:35.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.134+0000 7fdbd38c2700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbcc0cc500 con 0x7fdbcc0b26f0 2023-09-21T00:17:35.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.134+0000 7fdbd38c2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbcc143a70 con 0x7fdbcc1619e0 2023-09-21T00:17:35.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.134+0000 7fdbd165e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdbcc0b26f0 0x7fdbcc0ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:35.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.134+0000 7fdbd165e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdbcc0b26f0 0x7fdbcc0ccab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.59:37894/0 (socket says 172.21.15.59:37894) 2023-09-21T00:17:35.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.134+0000 7fdbd165e700 1 -- 172.21.15.59:0/4107524081 learned_addr learned my addr 172.21.15.59:0/4107524081 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:35.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.134+0000 7fdbd0e5d700 1 --2- 172.21.15.59:0/4107524081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbcc0b6240 0x7fdbcc157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:35.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.134+0000 7fd32bfff700 1 --2- 172.21.15.59:0/2901227356 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd31806ae00 0x7fd31806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:35.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.134+0000 7f760a50f700 1 -- 172.21.15.59:0/3796393290 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f76040d2e80 msgr2=0x7f76040b4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:35.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.134+0000 7f760a50f700 1 --2- 172.21.15.59:0/3796393290 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f76040d2e80 0x7f76040b4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.134+0000 7f760a50f700 1 -- 172.21.15.59:0/3796393290 >> v1:172.21.15.59:6789/0 conn(0x7f760415d4c0 legacy=0x7f76040d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.134+0000 7fd3297fa700 1 -- 172.21.15.59:0/2901227356 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fd31c08e030 con 0x7fd32c072230 2023-09-21T00:17:35.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.134+0000 7f760a50f700 1 -- 172.21.15.59:0/3796393290 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76040d20c0 con 0x7f76040b8d80 2023-09-21T00:17:35.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.134+0000 7f7608d0c700 1 -- 172.21.15.59:0/3796393290 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1183964429 0 0) 0x7f76040d1de0 con 0x7f760415d4c0 2023-09-21T00:17:35.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.134+0000 7fdbd1e5f700 1 --2- 172.21.15.59:0/4107524081 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdbcc1619e0 0x7fdbcc0c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:35.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.134+0000 7fdbd165e700 1 -- 172.21.15.59:0/4107524081 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdbcc1619e0 msgr2=0x7fdbcc0c69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.134+0000 7fdbd165e700 1 --2- 172.21.15.59:0/4107524081 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdbcc1619e0 0x7fdbcc0c69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.134+0000 7fdbd165e700 1 -- 172.21.15.59:0/4107524081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbcc0b6240 msgr2=0x7fdbcc157a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.134+0000 7fdbd165e700 1 --2- 172.21.15.59:0/4107524081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbcc0b6240 0x7fdbcc157a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.134+0000 7fdbd165e700 1 -- 172.21.15.59:0/4107524081 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbbc0094a0 con 0x7fdbcc0b26f0 2023-09-21T00:17:35.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.135+0000 7f760a50f700 1 --2- 172.21.15.59:0/3796393290 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76040b8d80 0x7f76040b53b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f75fc009d90 tx=0x7f75fc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e21d45da574f4bd server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:35.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.135+0000 7fdbd165e700 1 --2- 172.21.15.59:0/4107524081 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdbcc0b26f0 0x7fdbcc0ccab0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc0090b0 tx=0x7fdbbc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:35.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.135+0000 7fd32bfff700 1 --2- 172.21.15.59:0/2901227356 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd31806ae00 0x7fd31806d2c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd320006fd0 tx=0x7fd320008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:35.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.137+0000 7f6397fff700 1 -- 172.21.15.59:0/3731515003 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f63a4053b70 con 0x7f63b00cdb20 2023-09-21T00:17:35.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.139+0000 7efd5affd700 1 -- 172.21.15.59:0/2317098268 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7efd5c0555f0 con 0x7efd6c06ce80 2023-09-21T00:17:35.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.140+0000 7f63aeffd700 1 --2- 172.21.15.59:0/3731515003 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f639806afb0 0x7f639806d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:35.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.140+0000 7fa612ffd700 1 --2- 172.21.15.59:0/2656098560 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa60006ae50 0x7fa60006d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:35.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.140+0000 7f63aeffd700 1 --2- 172.21.15.59:0/3731515003 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f639806afb0 0x7f639806d470 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f63a0000c00 tx=0x7f63a0010000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:35.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.142+0000 7fdbc1ffb700 1 -- 172.21.15.59:0/4107524081 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc011630 con 0x7fdbcc0b26f0 2023-09-21T00:17:35.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.142+0000 7fdbc1ffb700 1 -- 172.21.15.59:0/4107524081 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbbc01f070 con 0x7fdbcc0b26f0 2023-09-21T00:17:35.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.142+0000 7fa5fbfff700 1 -- 172.21.15.59:0/2656098560 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fa604054660 con 0x7fa6140b2440 2023-09-21T00:17:35.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.142+0000 7fdbc1ffb700 1 -- 172.21.15.59:0/4107524081 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc0119d0 con 0x7fdbcc0b26f0 2023-09-21T00:17:35.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.144+0000 7fdbd38c2700 1 -- 172.21.15.59:0/4107524081 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbcc143d50 con 0x7fdbcc0b26f0 2023-09-21T00:17:35.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.144+0000 7fdbd38c2700 1 -- 172.21.15.59:0/4107524081 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbcc157f60 con 0x7fdbcc0b26f0 2023-09-21T00:17:35.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.142+0000 7f7608d0c700 1 -- 172.21.15.59:0/3796393290 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc00e070 con 0x7f76040b8d80 2023-09-21T00:17:35.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.143+0000 7f7608d0c700 1 -- 172.21.15.59:0/3796393290 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75fc00bb20 con 0x7f76040b8d80 2023-09-21T00:17:35.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.143+0000 7f7608d0c700 1 -- 172.21.15.59:0/3796393290 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc012430 con 0x7f76040b8d80 2023-09-21T00:17:35.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.143+0000 7f760bf72700 1 -- 172.21.15.59:0/3796393290 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76040b8d80 msgr2=0x7f76040b53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.144+0000 7f760bf72700 1 --2- 172.21.15.59:0/3796393290 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76040b8d80 0x7f76040b53b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f75fc009d90 tx=0x7f75fc00b330 comp rx=0 tx=0).stop 2023-09-21T00:17:35.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.145+0000 7fc513fc7700 1 Processor -- start 2023-09-21T00:17:35.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.145+0000 7f760bf72700 1 -- 172.21.15.59:0/3796393290 shutdown_connections 2023-09-21T00:17:35.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.145+0000 7f760bf72700 1 --2- 172.21.15.59:0/3796393290 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76040b8d80 0x7f76040b53b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.145+0000 7f760bf72700 1 --2- 172.21.15.59:0/3796393290 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f76040d2e80 0x7f76040b4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.145+0000 7f760bf72700 1 -- 172.21.15.59:0/3796393290 >> 172.21.15.59:0/3796393290 conn(0x7f76040724e0 msgr2=0x7f76040cfe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:35.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.145+0000 7fc513fc7700 1 -- start start 2023-09-21T00:17:35.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.147+0000 7f760bf72700 1 -- 172.21.15.59:0/3796393290 shutdown_connections 2023-09-21T00:17:35.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.147+0000 7f760bf72700 1 -- 172.21.15.59:0/3796393290 wait complete. 2023-09-21T00:17:35.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.147+0000 7fc513fc7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc50c15e800 0x7fc50c0b0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.147+0000 7fc513fc7700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc50c0b10d0 0x7fc50c0cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.147+0000 7fc513fc7700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc50c0cc380 con 0x7fc50c0b3990 2023-09-21T00:17:35.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.147+0000 7fc513fc7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc50c0b1540 con 0x7fc50c15e800 2023-09-21T00:17:35.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.147+0000 7fc513fc7700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc50c0b3d70 con 0x7fc50c0b10d0 2023-09-21T00:17:35.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.149+0000 7fc512564700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc50c0b10d0 0x7fc50c0cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:35.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.149+0000 7fc512564700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc50c0b10d0 0x7fc50c0cef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.59:37906/0 (socket says 172.21.15.59:37906) 2023-09-21T00:17:35.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.149+0000 7fc512564700 1 -- 172.21.15.59:0/2193287495 learned_addr learned my addr 172.21.15.59:0/2193287495 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:35.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.149+0000 7f760bf72700 1 Processor -- start 2023-09-21T00:17:35.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.149+0000 7f760bf72700 1 -- start start 2023-09-21T00:17:35.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.150+0000 7f760bf72700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76040b8d80 0x7f76040c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.150+0000 7f760bf72700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76040d2e80 0x7f7604157d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.151+0000 7f760bf72700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f760415d4c0 0x7f760406be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.151+0000 7f760bf72700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76040c9850 con 0x7f76040d2e80 2023-09-21T00:17:35.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.151+0000 7f760bf72700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76040cabb0 con 0x7f76040b8d80 2023-09-21T00:17:35.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.151+0000 7f760bf72700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76040c88f0 con 0x7f760415d4c0 2023-09-21T00:17:35.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.149+0000 7fc512564700 1 -- 172.21.15.59:0/2193287495 >> v2:172.21.15.59:3300/0 conn(0x7fc50c15e800 msgr2=0x7fc50c0b0b90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-21T00:17:35.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.149+0000 7fc512564700 1 --2- 172.21.15.59:0/2193287495 >> v2:172.21.15.59:3300/0 conn(0x7fc50c15e800 0x7fc50c0b0b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.149+0000 7fc512564700 1 -- 172.21.15.59:0/2193287495 >> v1:172.21.15.83:6789/0 conn(0x7fc50c0b3990 legacy=0x7fc50c15a190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-21T00:17:35.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.149+0000 7fc512564700 1 -- 172.21.15.59:0/2193287495 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc50c0cc810 con 0x7fc50c0b10d0 2023-09-21T00:17:35.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.151+0000 7f7609d0e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76040b8d80 0x7f76040c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:35.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.151+0000 7f7609d0e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76040b8d80 0x7f76040c8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.59:37908/0 (socket says 172.21.15.59:37908) 2023-09-21T00:17:35.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.151+0000 7f7609d0e700 1 -- 172.21.15.59:0/2547273123 learned_addr learned my addr 172.21.15.59:0/2547273123 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:35.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.151+0000 7f760a50f700 1 --2- 172.21.15.59:0/2547273123 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f760415d4c0 0x7f760406be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:35.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.151+0000 7fc512564700 1 --2- 172.21.15.59:0/2193287495 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc50c0b10d0 0x7fc50c0cef10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc50c0b4550 tx=0x7fc50400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eeb50f37a7239388 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:35.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.152+0000 7f760a50f700 1 -- 172.21.15.59:0/2547273123 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76040b8d80 msgr2=0x7f76040c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.152+0000 7f760a50f700 1 --2- 172.21.15.59:0/2547273123 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76040b8d80 0x7f76040c8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.152+0000 7f760a50f700 1 -- 172.21.15.59:0/2547273123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76040d2e80 msgr2=0x7f7604157d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.152+0000 7f760a50f700 1 --2- 172.21.15.59:0/2547273123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76040d2e80 0x7f7604157d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.152+0000 7f760a50f700 1 -- 172.21.15.59:0/2547273123 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75fc009a70 con 0x7f760415d4c0 2023-09-21T00:17:35.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.152+0000 7f760a50f700 1 --2- 172.21.15.59:0/2547273123 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f760415d4c0 0x7f760406be10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f75fc016000 tx=0x7f75fc004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:35.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.152+0000 7f75fa7fc700 1 -- 172.21.15.59:0/2547273123 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc0048e0 con 0x7f760415d4c0 2023-09-21T00:17:35.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.152+0000 7f75fa7fc700 1 -- 172.21.15.59:0/2547273123 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75fc020070 con 0x7f760415d4c0 2023-09-21T00:17:35.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.152+0000 7f75fa7fc700 1 -- 172.21.15.59:0/2547273123 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc0276c0 con 0x7f760415d4c0 2023-09-21T00:17:35.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.152+0000 7f760bf72700 1 -- 172.21.15.59:0/2547273123 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76041501d0 con 0x7f760415d4c0 2023-09-21T00:17:35.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.152+0000 7f760bf72700 1 -- 172.21.15.59:0/2547273123 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76040c9d10 con 0x7f760415d4c0 2023-09-21T00:17:35.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.154+0000 7f760bf72700 1 -- 172.21.15.59:0/2547273123 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7604067e50 con 0x7f760415d4c0 2023-09-21T00:17:35.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.146+0000 7fa612ffd700 1 --2- 172.21.15.59:0/2656098560 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa60006ae50 0x7fa60006d310 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa6140cfae0 tx=0x7fa608012000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:35.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.154+0000 7f75fa7fc700 1 -- 172.21.15.59:0/2547273123 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f75fc012430 con 0x7f760415d4c0 2023-09-21T00:17:35.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.155+0000 7f75fa7fc700 1 --2- 172.21.15.59:0/2547273123 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f75f006af30 0x7f75f006d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.155+0000 7f75fa7fc700 1 -- 172.21.15.59:0/2547273123 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f75fc022070 con 0x7f760415d4c0 2023-09-21T00:17:35.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.155+0000 7f7609d0e700 1 --2- 172.21.15.59:0/2547273123 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f75f006af30 0x7f75f006d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:35.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.155+0000 7f7609d0e700 1 --2- 172.21.15.59:0/2547273123 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f75f006af30 0x7f75f006d3f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7600000f60 tx=0x7f7600007d50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:35.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.159+0000 7fdbd38c2700 1 -- 172.21.15.59:0/4107524081 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbcc067e50 con 0x7fdbcc0b26f0 2023-09-21T00:17:35.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.159+0000 7fc510d61700 1 -- 172.21.15.59:0/2193287495 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc50400e070 con 0x7fc50c0b10d0 2023-09-21T00:17:35.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.159+0000 7fc510d61700 1 -- 172.21.15.59:0/2193287495 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc504003a70 con 0x7fc50c0b10d0 2023-09-21T00:17:35.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.159+0000 7fc510d61700 1 -- 172.21.15.59:0/2193287495 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc504003e20 con 0x7fc50c0b10d0 2023-09-21T00:17:35.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.160+0000 7f75fa7fc700 1 -- 172.21.15.59:0/2547273123 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f75fc0562c0 con 0x7f760415d4c0 2023-09-21T00:17:35.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.161+0000 7fc513fc7700 1 -- 172.21.15.59:0/2193287495 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc50c0b10d0 msgr2=0x7fc50c0cef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.161+0000 7fc513fc7700 1 --2- 172.21.15.59:0/2193287495 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc50c0b10d0 0x7fc50c0cef10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc50c0b4550 tx=0x7fc50400b330 comp rx=0 tx=0).stop 2023-09-21T00:17:35.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.162+0000 7fc513fc7700 1 -- 172.21.15.59:0/2193287495 shutdown_connections 2023-09-21T00:17:35.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.162+0000 7fc513fc7700 1 --2- 172.21.15.59:0/2193287495 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc50c0b10d0 0x7fc50c0cef10 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.162+0000 7fc513fc7700 1 --2- 172.21.15.59:0/2193287495 >> v2:172.21.15.59:3300/0 conn(0x7fc50c15e800 0x7fc50c0b0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.162+0000 7fc513fc7700 1 -- 172.21.15.59:0/2193287495 >> 172.21.15.59:0/2193287495 conn(0x7fc50c06de70 msgr2=0x7fc50c06a780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:35.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.164+0000 7fc513fc7700 1 -- 172.21.15.59:0/2193287495 shutdown_connections 2023-09-21T00:17:35.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.164+0000 7fc513fc7700 1 -- 172.21.15.59:0/2193287495 wait complete. 2023-09-21T00:17:35.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.166+0000 7fc513fc7700 1 Processor -- start 2023-09-21T00:17:35.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.166+0000 7fdbc1ffb700 1 -- 172.21.15.59:0/4107524081 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fdbbc011b30 con 0x7fdbcc0b26f0 2023-09-21T00:17:35.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.166+0000 7fdbc1ffb700 1 --2- 172.21.15.59:0/4107524081 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fdbb006ae50 0x7fdbb006d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.167+0000 7fdbc1ffb700 1 -- 172.21.15.59:0/4107524081 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdbbc021070 con 0x7fdbcc0b26f0 2023-09-21T00:17:35.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.166+0000 7fc513fc7700 1 -- start start 2023-09-21T00:17:35.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.167+0000 7fc513fc7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc50c0b10d0 0x7fc50c0af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.167+0000 7fc513fc7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc50c162540 0x7fc50c171270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.167+0000 7fc513fc7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc50c1733e0 0x7fc50c173860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.167+0000 7fc513fc7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc50c1717b0 con 0x7fc50c1733e0 2023-09-21T00:17:35.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.167+0000 7fc513fc7700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc50c173da0 con 0x7fc50c162540 2023-09-21T00:17:35.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.167+0000 7fc513fc7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc50c1629c0 con 0x7fc50c0b10d0 2023-09-21T00:17:35.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.168+0000 7fc512564700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc50c1733e0 0x7fc50c173860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:35.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.168+0000 7fc511d63700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc50c0b10d0 0x7fc50c0af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:35.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.168+0000 7fc512564700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc50c1733e0 0x7fc50c173860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51806/0 (socket says 172.21.15.59:51806) 2023-09-21T00:17:35.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.168+0000 7fc512564700 1 -- 172.21.15.59:0/2226028032 learned_addr learned my addr 172.21.15.59:0/2226028032 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:35.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.168+0000 7fc512564700 1 -- 172.21.15.59:0/2226028032 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc50c0b10d0 msgr2=0x7fc50c0af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.168+0000 7fc512564700 1 --2- 172.21.15.59:0/2226028032 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc50c0b10d0 0x7fc50c0af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.168+0000 7fc512564700 1 -- 172.21.15.59:0/2226028032 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc50c162540 msgr2=0x7fc50c171270 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-21T00:17:35.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.168+0000 7fc512564700 1 --2- 172.21.15.59:0/2226028032 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc50c162540 0x7fc50c171270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.168+0000 7fc512564700 1 -- 172.21.15.59:0/2226028032 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc504009b30 con 0x7fc50c1733e0 2023-09-21T00:17:35.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.168+0000 7fc511d63700 1 --2- 172.21.15.59:0/2226028032 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc50c0b10d0 0x7fc50c0af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T00:17:35.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.169+0000 7fdbd0e5d700 1 --2- 172.21.15.59:0/4107524081 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fdbb006ae50 0x7fdbb006d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:35.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.169+0000 7fc512564700 1 --2- 172.21.15.59:0/2226028032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc50c1733e0 0x7fc50c173860 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc504009fd0 tx=0x7fc504004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:35.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.169+0000 7fc5027fc700 1 -- 172.21.15.59:0/2226028032 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc504004440 con 0x7fc50c1733e0 2023-09-21T00:17:35.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.169+0000 7fc5027fc700 1 -- 172.21.15.59:0/2226028032 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5040045a0 con 0x7fc50c1733e0 2023-09-21T00:17:35.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.169+0000 7fc5027fc700 1 -- 172.21.15.59:0/2226028032 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc504004950 con 0x7fc50c1733e0 2023-09-21T00:17:35.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.169+0000 7fc513fc7700 1 -- 172.21.15.59:0/2226028032 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc50c0afcd0 con 0x7fc50c1733e0 2023-09-21T00:17:35.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.169+0000 7fc513fc7700 1 -- 172.21.15.59:0/2226028032 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc50c13e250 con 0x7fc50c1733e0 2023-09-21T00:17:35.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.172+0000 7fc5027fc700 1 -- 172.21.15.59:0/2226028032 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fc504012430 con 0x7fc50c1733e0 2023-09-21T00:17:35.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.172+0000 7fc5027fc700 1 --2- 172.21.15.59:0/2226028032 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fc4f806afb0 0x7fc4f806d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.172+0000 7fc5027fc700 1 -- 172.21.15.59:0/2226028032 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc50408b190 con 0x7fc50c1733e0 2023-09-21T00:17:35.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.173+0000 7fc511d63700 1 --2- 172.21.15.59:0/2226028032 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fc4f806afb0 0x7fc4f806d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:35.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.173+0000 7fc511d63700 1 --2- 172.21.15.59:0/2226028032 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fc4f806afb0 0x7fc4f806d470 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc006fd0 tx=0x7fc4fc009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:35.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.176+0000 7fc513fc7700 1 -- 172.21.15.59:0/2226028032 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4f40052f0 con 0x7fc50c1733e0 2023-09-21T00:17:35.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.178+0000 7fdbc1ffb700 1 -- 172.21.15.59:0/4107524081 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fdbbc0567b0 con 0x7fdbcc0b26f0 2023-09-21T00:17:35.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.185+0000 7fdbd0e5d700 1 --2- 172.21.15.59:0/4107524081 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fdbb006ae50 0x7fdbb006d310 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4001f00 tx=0x7fdbc4001e90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:35.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.186+0000 7fc5027fc700 1 -- 172.21.15.59:0/2226028032 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fc504056200 con 0x7fc50c1733e0 2023-09-21T00:17:35.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.537+0000 7fd332ff7700 1 -- 172.21.15.59:0/2901227356 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fd32c067e50 con 0x7fd32c072230 2023-09-21T00:17:35.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.538+0000 7fd3297fa700 1 -- 172.21.15.59:0/2901227356 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd31c02b020 con 0x7fd32c072230 2023-09-21T00:17:35.540 INFO:teuthology.orchestra.run.smithi059.stdout:55834574860 2023-09-21T00:17:35.541 INFO:teuthology.orchestra.run.smithi059.stdout:55834574858 2023-09-21T00:17:35.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.540+0000 7f63b597b700 1 -- 172.21.15.59:0/3731515003 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f63b0067e50 con 0x7f63b00cdb20 2023-09-21T00:17:35.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.540+0000 7f6397fff700 1 -- 172.21.15.59:0/3731515003 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f63a4057190 con 0x7f63b00cdb20 2023-09-21T00:17:35.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.541+0000 7f07c350c700 1 -- 172.21.15.59:0/321534078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f07a0005190 con 0x7f07bc070590 2023-09-21T00:17:35.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.541+0000 7efd70dad700 1 -- 172.21.15.59:0/2317098268 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efd6c06bc30 con 0x7efd6c06ce80 2023-09-21T00:17:35.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.542+0000 7f07b1ffb700 1 -- 172.21.15.59:0/321534078 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f07b4057d20 con 0x7f07bc070590 2023-09-21T00:17:35.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.543+0000 7efd5affd700 1 -- 172.21.15.59:0/2317098268 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efd5c058c10 con 0x7efd6c06ce80 2023-09-21T00:17:35.547 INFO:teuthology.orchestra.run.smithi059.stdout:55834574859 2023-09-21T00:17:35.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.544+0000 7f63b597b700 1 -- 172.21.15.59:0/3731515003 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f639806afb0 msgr2=0x7f639806d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.544+0000 7f63b597b700 1 --2- 172.21.15.59:0/3731515003 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f639806afb0 0x7f639806d470 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f63a0000c00 tx=0x7f63a0010000 comp rx=0 tx=0).stop 2023-09-21T00:17:35.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.544+0000 7f63b597b700 1 -- 172.21.15.59:0/3731515003 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63b00cdb20 msgr2=0x7f63b01506d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.544+0000 7f63b597b700 1 --2- 172.21.15.59:0/3731515003 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63b00cdb20 0x7f63b01506d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f63a400c4a0 tx=0x7f63a400c7b0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.546+0000 7f63b597b700 1 -- 172.21.15.59:0/3731515003 shutdown_connections 2023-09-21T00:17:35.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.546+0000 7f63b597b700 1 --2- 172.21.15.59:0/3731515003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63b014ab00 0x7f63b00ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.546+0000 7f63b597b700 1 --2- 172.21.15.59:0/3731515003 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f639806afb0 0x7f639806d470 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.546+0000 7f63b597b700 1 --2- 172.21.15.59:0/3731515003 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f63b00b0150 0x7f63b01ffbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.546+0000 7f63b597b700 1 --2- 172.21.15.59:0/3731515003 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f63b00cdb20 0x7f63b01506d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.546+0000 7f63b597b700 1 -- 172.21.15.59:0/3731515003 >> 172.21.15.59:0/3731515003 conn(0x7f63b00d1130 msgr2=0x7f63b006e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:35.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.544+0000 7fd332ff7700 1 -- 172.21.15.59:0/2901227356 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd31806ae00 msgr2=0x7fd31806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.544+0000 7fd332ff7700 1 --2- 172.21.15.59:0/2901227356 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd31806ae00 0x7fd31806d2c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd320006fd0 tx=0x7fd320008040 comp rx=0 tx=0).stop 2023-09-21T00:17:35.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.544+0000 7fd332ff7700 1 -- 172.21.15.59:0/2901227356 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd32c072230 msgr2=0x7fd32c154b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.544+0000 7fd332ff7700 1 --2- 172.21.15.59:0/2901227356 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd32c072230 0x7fd32c154b40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd31c016000 tx=0x7fd31c004750 comp rx=0 tx=0).stop 2023-09-21T00:17:35.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.546+0000 7fd332ff7700 1 -- 172.21.15.59:0/2901227356 shutdown_connections 2023-09-21T00:17:35.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.546+0000 7fd332ff7700 1 --2- 172.21.15.59:0/2901227356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd32c0b0b90 0x7fd32c1640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.546+0000 7fd332ff7700 1 --2- 172.21.15.59:0/2901227356 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd31806ae00 0x7fd31806d2c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.546+0000 7fd332ff7700 1 --2- 172.21.15.59:0/2901227356 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd32c072230 0x7fd32c154b40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.546+0000 7fd332ff7700 1 --2- 172.21.15.59:0/2901227356 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd32c072610 0x7fd32c153eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.546+0000 7fd332ff7700 1 -- 172.21.15.59:0/2901227356 >> 172.21.15.59:0/2901227356 conn(0x7fd32c06de70 msgr2=0x7fd32c0b1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:35.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.546+0000 7fd332ff7700 1 -- 172.21.15.59:0/2901227356 shutdown_connections 2023-09-21T00:17:35.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.546+0000 7fd332ff7700 1 -- 172.21.15.59:0/2901227356 wait complete. 2023-09-21T00:17:35.552 INFO:teuthology.orchestra.run.smithi059.stdout:55834574860 2023-09-21T00:17:35.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.546+0000 7f63b597b700 1 -- 172.21.15.59:0/3731515003 shutdown_connections 2023-09-21T00:17:35.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.546+0000 7f63b597b700 1 -- 172.21.15.59:0/3731515003 wait complete. 2023-09-21T00:17:35.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.547+0000 7f07c350c700 1 -- 172.21.15.59:0/321534078 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f07a806afd0 msgr2=0x7f07a806d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.547+0000 7f07c350c700 1 --2- 172.21.15.59:0/321534078 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f07a806afd0 0x7f07a806d490 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f07bc150e10 tx=0x7f07b8012000 comp rx=0 tx=0).stop 2023-09-21T00:17:35.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.547+0000 7f07c350c700 1 -- 172.21.15.59:0/321534078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07bc070590 msgr2=0x7f07bc0afbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.547+0000 7f07c350c700 1 --2- 172.21.15.59:0/321534078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07bc070590 0x7f07bc0afbb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f07b400c890 tx=0x7f07b400cc50 comp rx=0 tx=0).stop 2023-09-21T00:17:35.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.548+0000 7efd70dad700 1 -- 172.21.15.59:0/2317098268 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7efd4c06ae20 msgr2=0x7efd4c06d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.548+0000 7efd70dad700 1 --2- 172.21.15.59:0/2317098268 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7efd4c06ae20 0x7efd4c06d2e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7efd6c1f5790 tx=0x7efd60007ad0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.548+0000 7efd70dad700 1 -- 172.21.15.59:0/2317098268 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd6c06ce80 msgr2=0x7efd6c159d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.548+0000 7efd70dad700 1 --2- 172.21.15.59:0/2317098268 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd6c06ce80 0x7efd6c159d70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efd5c009fd0 tx=0x7efd5c004750 comp rx=0 tx=0).stop 2023-09-21T00:17:35.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.549+0000 7f07c350c700 1 -- 172.21.15.59:0/321534078 shutdown_connections 2023-09-21T00:17:35.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.549+0000 7f07c350c700 1 --2- 172.21.15.59:0/321534078 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f07a806afd0 0x7f07a806d490 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.549+0000 7f07c350c700 1 --2- 172.21.15.59:0/321534078 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f07bc1596f0 0x7f07bc14a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.549+0000 7f07c350c700 1 --2- 172.21.15.59:0/321534078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07bc070590 0x7f07bc0afbb0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.549+0000 7f07c350c700 1 --2- 172.21.15.59:0/321534078 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07bc0cf610 0x7f07bc0b00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.549+0000 7f07c350c700 1 -- 172.21.15.59:0/321534078 >> 172.21.15.59:0/321534078 conn(0x7f07bc06c7c0 msgr2=0x7f07bc151990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:35.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.553+0000 7efd70dad700 1 -- 172.21.15.59:0/2317098268 shutdown_connections 2023-09-21T00:17:35.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.553+0000 7efd70dad700 1 --2- 172.21.15.59:0/2317098268 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd6c15f9e0 0x7efd6c070e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.553+0000 7efd70dad700 1 --2- 172.21.15.59:0/2317098268 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7efd4c06ae20 0x7efd4c06d2e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.553+0000 7efd70dad700 1 --2- 172.21.15.59:0/2317098268 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd6c06ce80 0x7efd6c159d70 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.553+0000 7efd70dad700 1 --2- 172.21.15.59:0/2317098268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd6c0cc270 0x7efd6c0a93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.553+0000 7efd70dad700 1 -- 172.21.15.59:0/2317098268 >> 172.21.15.59:0/2317098268 conn(0x7efd6c0b1430 msgr2=0x7efd6c0b1810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:35.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.553+0000 7efd70dad700 1 -- 172.21.15.59:0/2317098268 shutdown_connections 2023-09-21T00:17:35.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.553+0000 7efd70dad700 1 -- 172.21.15.59:0/2317098268 wait complete. 2023-09-21T00:17:35.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.557+0000 7f07c350c700 1 -- 172.21.15.59:0/321534078 shutdown_connections 2023-09-21T00:17:35.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.557+0000 7f07c350c700 1 -- 172.21.15.59:0/321534078 wait complete. 2023-09-21T00:17:35.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.565+0000 7f760bf72700 1 -- 172.21.15.59:0/2547273123 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f75ec0051a0 con 0x7f760415d4c0 2023-09-21T00:17:35.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.566+0000 7f75fa7fc700 1 -- 172.21.15.59:0/2547273123 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f75fc0598e0 con 0x7f760415d4c0 2023-09-21T00:17:35.568 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.5 2023-09-21T00:17:35.569 INFO:teuthology.orchestra.run.smithi059.stdout:55834574859 2023-09-21T00:17:35.569 DEBUG:teuthology.parallel:result is None 2023-09-21T00:17:35.570 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.0 2023-09-21T00:17:35.570 DEBUG:teuthology.parallel:result is None 2023-09-21T00:17:35.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.571+0000 7f760bf72700 1 -- 172.21.15.59:0/2547273123 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f75f006af30 msgr2=0x7f75f006d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.571+0000 7f760bf72700 1 --2- 172.21.15.59:0/2547273123 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f75f006af30 0x7f75f006d3f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7600000f60 tx=0x7f7600007d50 comp rx=0 tx=0).stop 2023-09-21T00:17:35.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.571+0000 7f760bf72700 1 -- 172.21.15.59:0/2547273123 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f760415d4c0 msgr2=0x7f760406be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.571+0000 7f760bf72700 1 --2- 172.21.15.59:0/2547273123 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f760415d4c0 0x7f760406be10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f75fc016000 tx=0x7f75fc004ad0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.571+0000 7f760bf72700 1 -- 172.21.15.59:0/2547273123 shutdown_connections 2023-09-21T00:17:35.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.571+0000 7f760bf72700 1 --2- 172.21.15.59:0/2547273123 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f75f006af30 0x7f75f006d3f0 secure :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7600000f60 tx=0x7f7600007d50 comp rx=0 tx=0).stop 2023-09-21T00:17:35.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.571+0000 7f760bf72700 1 --2- 172.21.15.59:0/2547273123 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f760415d4c0 0x7f760406be10 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.571+0000 7f760bf72700 1 --2- 172.21.15.59:0/2547273123 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f76040b8d80 0x7f76040c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.571+0000 7f760bf72700 1 --2- 172.21.15.59:0/2547273123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76040d2e80 0x7f7604157d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.571+0000 7f760bf72700 1 -- 172.21.15.59:0/2547273123 >> 172.21.15.59:0/2547273123 conn(0x7f76040724e0 msgr2=0x7f76040d39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:35.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.574+0000 7f760bf72700 1 -- 172.21.15.59:0/2547273123 shutdown_connections 2023-09-21T00:17:35.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.574+0000 7fdbd38c2700 1 -- 172.21.15.59:0/4107524081 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fdbcc0cd360 con 0x7fdbcc0b26f0 2023-09-21T00:17:35.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.574+0000 7fdbc1ffb700 1 -- 172.21.15.59:0/4107524081 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdbbc059dd0 con 0x7fdbcc0b26f0 2023-09-21T00:17:35.577 INFO:teuthology.orchestra.run.smithi059.stdout:55834574857 2023-09-21T00:17:35.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.577+0000 7f760bf72700 1 -- 172.21.15.59:0/2547273123 wait complete. 2023-09-21T00:17:35.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.577+0000 7fdbd38c2700 1 -- 172.21.15.59:0/4107524081 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fdbb006ae50 msgr2=0x7fdbb006d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.577+0000 7fdbd38c2700 1 --2- 172.21.15.59:0/4107524081 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fdbb006ae50 0x7fdbb006d310 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4001f00 tx=0x7fdbc4001e90 comp rx=0 tx=0).stop 2023-09-21T00:17:35.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.577+0000 7fdbd38c2700 1 -- 172.21.15.59:0/4107524081 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdbcc0b26f0 msgr2=0x7fdbcc0ccab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.577+0000 7fdbd38c2700 1 --2- 172.21.15.59:0/4107524081 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdbcc0b26f0 0x7fdbcc0ccab0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc0090b0 tx=0x7fdbbc004750 comp rx=0 tx=0).stop 2023-09-21T00:17:35.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.578+0000 7fdbd38c2700 1 -- 172.21.15.59:0/4107524081 shutdown_connections 2023-09-21T00:17:35.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.578+0000 7fdbd38c2700 1 --2- 172.21.15.59:0/4107524081 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fdbb006ae50 0x7fdbb006d310 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.578+0000 7fdbd38c2700 1 --2- 172.21.15.59:0/4107524081 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdbcc1619e0 0x7fdbcc0c69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.578+0000 7fdbd38c2700 1 --2- 172.21.15.59:0/4107524081 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdbcc0b26f0 0x7fdbcc0ccab0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.578+0000 7fdbd38c2700 1 --2- 172.21.15.59:0/4107524081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbcc0b6240 0x7fdbcc157a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.578+0000 7fdbd38c2700 1 -- 172.21.15.59:0/4107524081 >> 172.21.15.59:0/4107524081 conn(0x7fdbcc0b4ee0 msgr2=0x7fdbcc1628d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:35.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.578+0000 7fdbd38c2700 1 -- 172.21.15.59:0/4107524081 shutdown_connections 2023-09-21T00:17:35.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.578+0000 7fdbd38c2700 1 -- 172.21.15.59:0/4107524081 wait complete. 2023-09-21T00:17:35.582 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.2 2023-09-21T00:17:35.582 DEBUG:teuthology.parallel:result is None 2023-09-21T00:17:35.583 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.1 2023-09-21T00:17:35.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.580+0000 7fa61a10c700 1 -- 172.21.15.59:0/2656098560 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa5f4005870 con 0x7fa6140b2440 2023-09-21T00:17:35.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.580+0000 7fa5fbfff700 1 -- 172.21.15.59:0/2656098560 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa604015070 con 0x7fa6140b2440 2023-09-21T00:17:35.585 DEBUG:teuthology.parallel:result is None 2023-09-21T00:17:35.585 INFO:teuthology.orchestra.run.smithi059.stdout:55834574858 2023-09-21T00:17:35.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.583+0000 7fa61a10c700 1 -- 172.21.15.59:0/2656098560 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa60006ae50 msgr2=0x7fa60006d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.583+0000 7fa61a10c700 1 --2- 172.21.15.59:0/2656098560 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa60006ae50 0x7fa60006d310 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa6140cfae0 tx=0x7fa608012000 comp rx=0 tx=0).stop 2023-09-21T00:17:35.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.583+0000 7fa61a10c700 1 -- 172.21.15.59:0/2656098560 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6140b2440 msgr2=0x7fa614159770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.583+0000 7fa61a10c700 1 --2- 172.21.15.59:0/2656098560 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6140b2440 0x7fa614159770 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa60400b4a0 tx=0x7fa60400b860 comp rx=0 tx=0).stop 2023-09-21T00:17:35.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.584+0000 7fa61a10c700 1 -- 172.21.15.59:0/2656098560 shutdown_connections 2023-09-21T00:17:35.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.584+0000 7fa61a10c700 1 --2- 172.21.15.59:0/2656098560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6140b17f0 0x7fa6141663a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.584+0000 7fa61a10c700 1 --2- 172.21.15.59:0/2656098560 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6140b2440 0x7fa614159770 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.584+0000 7fa61a10c700 1 --2- 172.21.15.59:0/2656098560 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa60006ae50 0x7fa60006d310 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.584+0000 7fa61a10c700 1 --2- 172.21.15.59:0/2656098560 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa6140cf680 0x7fa614165e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.584+0000 7fa61a10c700 1 -- 172.21.15.59:0/2656098560 >> 172.21.15.59:0/2656098560 conn(0x7fa61406c7c0 msgr2=0x7fa6140cc170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:35.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.584+0000 7fa61a10c700 1 -- 172.21.15.59:0/2656098560 shutdown_connections 2023-09-21T00:17:35.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.584+0000 7fa61a10c700 1 -- 172.21.15.59:0/2656098560 wait complete. 2023-09-21T00:17:35.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.587+0000 7fc513fc7700 1 -- 172.21.15.59:0/2226028032 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fc4f4005870 con 0x7fc50c1733e0 2023-09-21T00:17:35.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.587+0000 7fc5027fc700 1 -- 172.21.15.59:0/2226028032 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc504017020 con 0x7fc50c1733e0 2023-09-21T00:17:35.590 INFO:teuthology.orchestra.run.smithi059.stdout:55834574859 2023-09-21T00:17:35.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.590+0000 7fc513fc7700 1 -- 172.21.15.59:0/2226028032 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fc4f806afb0 msgr2=0x7fc4f806d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.590+0000 7fc513fc7700 1 --2- 172.21.15.59:0/2226028032 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fc4f806afb0 0x7fc4f806d470 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc006fd0 tx=0x7fc4fc009190 comp rx=0 tx=0).stop 2023-09-21T00:17:35.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.590+0000 7fc513fc7700 1 -- 172.21.15.59:0/2226028032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc50c1733e0 msgr2=0x7fc50c173860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.590+0000 7fc513fc7700 1 --2- 172.21.15.59:0/2226028032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc50c1733e0 0x7fc50c173860 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc504009fd0 tx=0x7fc504004b20 comp rx=0 tx=0).stop 2023-09-21T00:17:35.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.590+0000 7fc513fc7700 1 -- 172.21.15.59:0/2226028032 shutdown_connections 2023-09-21T00:17:35.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.590+0000 7fc513fc7700 1 --2- 172.21.15.59:0/2226028032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc50c1733e0 0x7fc50c173860 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.590+0000 7fc513fc7700 1 --2- 172.21.15.59:0/2226028032 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fc4f806afb0 0x7fc4f806d470 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.590+0000 7fc513fc7700 1 --2- 172.21.15.59:0/2226028032 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc50c0b10d0 0x7fc50c0af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.590+0000 7fc513fc7700 1 --2- 172.21.15.59:0/2226028032 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc50c162540 0x7fc50c171270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.590+0000 7fc513fc7700 1 -- 172.21.15.59:0/2226028032 >> 172.21.15.59:0/2226028032 conn(0x7fc50c06de70 msgr2=0x7fc50c0cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:35.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.590+0000 7fc513fc7700 1 -- 172.21.15.59:0/2226028032 shutdown_connections 2023-09-21T00:17:35.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.590+0000 7fc513fc7700 1 -- 172.21.15.59:0/2226028032 wait complete. 2023-09-21T00:17:35.601 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.3 2023-09-21T00:17:35.602 DEBUG:teuthology.parallel:result is None 2023-09-21T00:17:35.602 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.4 2023-09-21T00:17:35.603 DEBUG:teuthology.parallel:result is None 2023-09-21T00:17:35.604 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.7 2023-09-21T00:17:35.604 DEBUG:teuthology.parallel:result is None 2023-09-21T00:17:35.605 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.6 2023-09-21T00:17:35.606 DEBUG:teuthology.parallel:result is None 2023-09-21T00:17:35.606 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-21T00:17:35.607 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-21T00:17:35.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.768+0000 7f2aaf581700 1 Processor -- start 2023-09-21T00:17:35.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.768+0000 7f2aaf581700 1 -- start start 2023-09-21T00:17:35.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.769+0000 7f2aaf581700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2aa80af230 0x7f2aa806a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.769+0000 7f2aaf581700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2aa806acc0 0x7f2aa80716e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.769+0000 7f2aaf581700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aa80b31b0 con 0x7f2aa815d730 2023-09-21T00:17:35.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.769+0000 7f2aaf581700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aa815db10 con 0x7f2aa806acc0 2023-09-21T00:17:35.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.769+0000 7f2aaf581700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aa806b150 con 0x7f2aa80af230 2023-09-21T00:17:35.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.769+0000 7f2aadb1e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2aa806acc0 0x7f2aa80716e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:35.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.769+0000 7f2aadb1e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2aa806acc0 0x7f2aa80716e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51814/0 (socket says 172.21.15.59:51814) 2023-09-21T00:17:35.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.769+0000 7f2aadb1e700 1 -- 172.21.15.59:0/3885846710 learned_addr learned my addr 172.21.15.59:0/3885846710 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:35.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.770+0000 7f2aacb1c700 1 --2- 172.21.15.59:0/3885846710 >> v2:172.21.15.83:3300/0 conn(0x7f2aa80af230 0x7f2aa806a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:35.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.770+0000 7f2aadb1e700 1 -- 172.21.15.59:0/3885846710 >> v2:172.21.15.83:3300/0 conn(0x7f2aa80af230 msgr2=0x7f2aa806a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:35.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.770+0000 7f2aadb1e700 1 --2- 172.21.15.59:0/3885846710 >> v2:172.21.15.83:3300/0 conn(0x7f2aa80af230 0x7f2aa806a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.770+0000 7f2aadb1e700 1 -- 172.21.15.59:0/3885846710 >> v1:172.21.15.83:6789/0 conn(0x7f2aa815d730 legacy=0x7f2aa8161b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.770+0000 7f2aadb1e700 1 -- 172.21.15.59:0/3885846710 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa80b3490 con 0x7f2aa806acc0 2023-09-21T00:17:35.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.770+0000 7f2aadb1e700 1 --2- 172.21.15.59:0/3885846710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2aa806acc0 0x7f2aa80716e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2aa806c820 tx=0x7f2aa000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5daa437c33c19e2a server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:35.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.770+0000 7f2a9ffff700 1 -- 172.21.15.59:0/3885846710 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa000e070 con 0x7f2aa806acc0 2023-09-21T00:17:35.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.770+0000 7f2a9ffff700 1 -- 172.21.15.59:0/3885846710 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa000b910 con 0x7f2aa806acc0 2023-09-21T00:17:35.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.770+0000 7f2a9ffff700 1 -- 172.21.15.59:0/3885846710 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa000bcc0 con 0x7f2aa806acc0 2023-09-21T00:17:35.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.771+0000 7f2aaf581700 1 -- 172.21.15.59:0/3885846710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2aa806acc0 msgr2=0x7f2aa80716e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.771+0000 7f2aaf581700 1 --2- 172.21.15.59:0/3885846710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2aa806acc0 0x7f2aa80716e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2aa806c820 tx=0x7f2aa000b330 comp rx=0 tx=0).stop 2023-09-21T00:17:35.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.771+0000 7f2aaf581700 1 -- 172.21.15.59:0/3885846710 shutdown_connections 2023-09-21T00:17:35.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.771+0000 7f2aaf581700 1 --2- 172.21.15.59:0/3885846710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2aa806acc0 0x7f2aa80716e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.771+0000 7f2aaf581700 1 --2- 172.21.15.59:0/3885846710 >> v2:172.21.15.83:3300/0 conn(0x7f2aa80af230 0x7f2aa806a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.771+0000 7f2aaf581700 1 -- 172.21.15.59:0/3885846710 >> 172.21.15.59:0/3885846710 conn(0x7f2aa80b1d80 msgr2=0x7f2aa80b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:35.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.771+0000 7f2aaf581700 1 -- 172.21.15.59:0/3885846710 shutdown_connections 2023-09-21T00:17:35.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.771+0000 7f2aaf581700 1 -- 172.21.15.59:0/3885846710 wait complete. 2023-09-21T00:17:35.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.772+0000 7f2aaf581700 1 Processor -- start 2023-09-21T00:17:35.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.772+0000 7f2aaf581700 1 -- start start 2023-09-21T00:17:35.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.773+0000 7f2aaf581700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2aa806acc0 0x7f2aa81f3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.773+0000 7f2aaf581700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2aa80af230 0x7f2aa81517e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.773+0000 7f2aaf581700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2aa815d730 0x7f2aa8157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.773+0000 7f2aaf581700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa81533b0 con 0x7f2aa806acc0 2023-09-21T00:17:35.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.773+0000 7f2aaf581700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa8153c50 con 0x7f2aa80af230 2023-09-21T00:17:35.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.773+0000 7f2aaf581700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa8152c60 con 0x7f2aa815d730 2023-09-21T00:17:35.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.773+0000 7f2aad31d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2aa806acc0 0x7f2aa81f3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:35.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.773+0000 7f2aad31d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2aa806acc0 0x7f2aa81f3610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51816/0 (socket says 172.21.15.59:51816) 2023-09-21T00:17:35.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.773+0000 7f2aad31d700 1 -- 172.21.15.59:0/92865533 learned_addr learned my addr 172.21.15.59:0/92865533 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:35.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.773+0000 7f2aacb1c700 1 --2- 172.21.15.59:0/92865533 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2aa80af230 0x7f2aa81517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:35.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.773+0000 7f2aadb1e700 1 --2- 172.21.15.59:0/92865533 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2aa815d730 0x7f2aa8157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:35.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.773+0000 7f2aad31d700 1 -- 172.21.15.59:0/92865533 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2aa815d730 msgr2=0x7f2aa8157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.773+0000 7f2aad31d700 1 --2- 172.21.15.59:0/92865533 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2aa815d730 0x7f2aa8157f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.773+0000 7f2aad31d700 1 -- 172.21.15.59:0/92865533 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2aa80af230 msgr2=0x7f2aa81517e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.773+0000 7f2aad31d700 1 --2- 172.21.15.59:0/92865533 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2aa80af230 0x7f2aa81517e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.773+0000 7f2aad31d700 1 -- 172.21.15.59:0/92865533 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa0009b30 con 0x7f2aa806acc0 2023-09-21T00:17:35.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.773+0000 7f2aacb1c700 1 --2- 172.21.15.59:0/92865533 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2aa80af230 0x7f2aa81517e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:17:35.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.773+0000 7f2aad31d700 1 --2- 172.21.15.59:0/92865533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2aa806acc0 0x7f2aa81f3610 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2aa400c480 tx=0x7f2aa400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:35.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.773+0000 7f2a9dffb700 1 -- 172.21.15.59:0/92865533 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa40052d0 con 0x7f2aa806acc0 2023-09-21T00:17:35.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.773+0000 7f2a9dffb700 1 -- 172.21.15.59:0/92865533 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa4005430 con 0x7f2aa806acc0 2023-09-21T00:17:35.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.773+0000 7f2aaf581700 1 -- 172.21.15.59:0/92865533 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aa8150d40 con 0x7f2aa806acc0 2023-09-21T00:17:35.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.773+0000 7f2a9dffb700 1 -- 172.21.15.59:0/92865533 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa40038c0 con 0x7f2aa806acc0 2023-09-21T00:17:35.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.774+0000 7f2aaf581700 1 -- 172.21.15.59:0/92865533 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aa8153870 con 0x7f2aa806acc0 2023-09-21T00:17:35.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.775+0000 7f2aaf581700 1 -- 172.21.15.59:0/92865533 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aa8067e50 con 0x7f2aa806acc0 2023-09-21T00:17:35.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.775+0000 7f2a9dffb700 1 -- 172.21.15.59:0/92865533 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f2aa4003a20 con 0x7f2aa806acc0 2023-09-21T00:17:35.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.775+0000 7f2a9dffb700 1 --2- 172.21.15.59:0/92865533 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f2a8c06ae30 0x7f2a8c06d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:35.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.775+0000 7f2a9dffb700 1 -- 172.21.15.59:0/92865533 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2aa4088c20 con 0x7f2aa806acc0 2023-09-21T00:17:35.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.776+0000 7f2aacb1c700 1 --2- 172.21.15.59:0/92865533 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f2a8c06ae30 0x7f2a8c06d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:35.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.776+0000 7f2aacb1c700 1 --2- 172.21.15.59:0/92865533 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f2a8c06ae30 0x7f2a8c06d2f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2aa815cf50 tx=0x7f2a98008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:35.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.780+0000 7f2a9dffb700 1 -- 172.21.15.59:0/92865533 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f2aa4053ae0 con 0x7f2aa806acc0 2023-09-21T00:17:35.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.975+0000 7f2aaf581700 1 -- 172.21.15.59:0/92865533 --> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2aa80b3a50 con 0x7f2a8c06ae30 2023-09-21T00:17:35.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.986+0000 7f2a9dffb700 1 -- 172.21.15.59:0/92865533 <== mgr.4103 v2:172.21.15.83:6832/1736808576 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345297 (secure 0 0 0) 0x7f2a98004030 con 0x7f2a8c06ae30 2023-09-21T00:17:35.991 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:17:35.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.989+0000 7f2aaf581700 1 -- 172.21.15.59:0/92865533 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f2a8c06ae30 msgr2=0x7f2a8c06d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.989+0000 7f2aaf581700 1 --2- 172.21.15.59:0/92865533 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f2a8c06ae30 0x7f2a8c06d2f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2aa815cf50 tx=0x7f2a98008040 comp rx=0 tx=0).stop 2023-09-21T00:17:35.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.989+0000 7f2aaf581700 1 -- 172.21.15.59:0/92865533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2aa806acc0 msgr2=0x7f2aa81f3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:35.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.989+0000 7f2aaf581700 1 --2- 172.21.15.59:0/92865533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2aa806acc0 0x7f2aa81f3610 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2aa400c480 tx=0x7f2aa400c840 comp rx=0 tx=0).stop 2023-09-21T00:17:35.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.989+0000 7f2aaf581700 1 -- 172.21.15.59:0/92865533 shutdown_connections 2023-09-21T00:17:35.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.989+0000 7f2aaf581700 1 --2- 172.21.15.59:0/92865533 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f2a8c06ae30 0x7f2a8c06d2f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.989+0000 7f2aaf581700 1 --2- 172.21.15.59:0/92865533 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2aa815d730 0x7f2aa8157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.989+0000 7f2aaf581700 1 --2- 172.21.15.59:0/92865533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2aa806acc0 0x7f2aa81f3610 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.989+0000 7f2aaf581700 1 --2- 172.21.15.59:0/92865533 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2aa80af230 0x7f2aa81517e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:35.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.989+0000 7f2aaf581700 1 -- 172.21.15.59:0/92865533 >> 172.21.15.59:0/92865533 conn(0x7f2aa80b1d80 msgr2=0x7f2aa8072010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:35.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.989+0000 7f2aaf581700 1 -- 172.21.15.59:0/92865533 shutdown_connections 2023-09-21T00:17:35.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:35.989+0000 7f2aaf581700 1 -- 172.21.15.59:0/92865533 wait complete. 2023-09-21T00:17:35.996 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2023-09-21T00:17:36.002 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2023-09-21T00:17:34.751661+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219368,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755352,"statfs":{"total":773094113280,"available":772869480448,"internally_reserved":0,"allocated":3284992,"data_stored":1988256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003307"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.140365+0000","last_change":"2023-09-21T00:17:06.944984+0000","last_active":"2023-09-21T00:17:11.140365+0000","last_peered":"2023-09-21T00:17:11.140365+0000","last_clean":"2023-09-21T00:17:11.140365+0000","last_became_active":"2023-09-21T00:17:06.944679+0000","last_became_peered":"2023-09-21T00:17:06.944679+0000","last_unstale":"2023-09-21T00:17:11.140365+0000","last_undegraded":"2023-09-21T00:17:11.140365+0000","last_fullsized":"2023-09-21T00:17:11.140365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T11:26:04.778746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.968438+0000","last_change":"2023-09-21T00:17:06.943812+0000","last_active":"2023-09-21T00:17:10.968438+0000","last_peered":"2023-09-21T00:17:10.968438+0000","last_clean":"2023-09-21T00:17:10.968438+0000","last_became_active":"2023-09-21T00:17:06.943477+0000","last_became_peered":"2023-09-21T00:17:06.943477+0000","last_unstale":"2023-09-21T00:17:10.968438+0000","last_undegraded":"2023-09-21T00:17:10.968438+0000","last_fullsized":"2023-09-21T00:17:10.968438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:34:25.102514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.966064+0000","last_change":"2023-09-21T00:17:06.937575+0000","last_active":"2023-09-21T00:17:10.966064+0000","last_peered":"2023-09-21T00:17:10.966064+0000","last_clean":"2023-09-21T00:17:10.966064+0000","last_became_active":"2023-09-21T00:17:06.937284+0000","last_became_peered":"2023-09-21T00:17:06.937284+0000","last_unstale":"2023-09-21T00:17:10.966064+0000","last_undegraded":"2023-09-21T00:17:10.966064+0000","last_fullsized":"2023-09-21T00:17:10.966064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:28:34.014683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963863+0000","last_change":"2023-09-21T00:17:06.949492+0000","last_active":"2023-09-21T00:17:10.963863+0000","last_peered":"2023-09-21T00:17:10.963863+0000","last_clean":"2023-09-21T00:17:10.963863+0000","last_became_active":"2023-09-21T00:17:06.948870+0000","last_became_peered":"2023-09-21T00:17:06.948870+0000","last_unstale":"2023-09-21T00:17:10.963863+0000","last_undegraded":"2023-09-21T00:17:10.963863+0000","last_fullsized":"2023-09-21T00:17:10.963863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T02:36:18.582664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.138593+0000","last_change":"2023-09-21T00:17:06.938470+0000","last_active":"2023-09-21T00:17:11.138593+0000","last_peered":"2023-09-21T00:17:11.138593+0000","last_clean":"2023-09-21T00:17:11.138593+0000","last_became_active":"2023-09-21T00:17:06.938081+0000","last_became_peered":"2023-09-21T00:17:06.938081+0000","last_unstale":"2023-09-21T00:17:11.138593+0000","last_undegraded":"2023-09-21T00:17:11.138593+0000","last_fullsized":"2023-09-21T00:17:11.138593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:11:37.302773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963823+0000","last_change":"2023-09-21T00:17:06.956095+0000","last_active":"2023-09-21T00:17:10.963823+0000","last_peered":"2023-09-21T00:17:10.963823+0000","last_clean":"2023-09-21T00:17:10.963823+0000","last_became_active":"2023-09-21T00:17:06.955148+0000","last_became_peered":"2023-09-21T00:17:06.955148+0000","last_unstale":"2023-09-21T00:17:10.963823+0000","last_undegraded":"2023-09-21T00:17:10.963823+0000","last_fullsized":"2023-09-21T00:17:10.963823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:11:37.302773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.138460+0000","last_change":"2023-09-21T00:17:06.952598+0000","last_active":"2023-09-21T00:17:11.138460+0000","last_peered":"2023-09-21T00:17:11.138460+0000","last_clean":"2023-09-21T00:17:11.138460+0000","last_became_active":"2023-09-21T00:17:06.951582+0000","last_became_peered":"2023-09-21T00:17:06.951582+0000","last_unstale":"2023-09-21T00:17:11.138460+0000","last_undegraded":"2023-09-21T00:17:11.138460+0000","last_fullsized":"2023-09-21T00:17:11.138460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:31:49.356708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.953276+0000","last_change":"2023-09-21T00:17:06.946327+0000","last_active":"2023-09-21T00:17:10.953276+0000","last_peered":"2023-09-21T00:17:10.953276+0000","last_clean":"2023-09-21T00:17:10.953276+0000","last_became_active":"2023-09-21T00:17:06.946035+0000","last_became_peered":"2023-09-21T00:17:06.946035+0000","last_unstale":"2023-09-21T00:17:10.953276+0000","last_undegraded":"2023-09-21T00:17:10.953276+0000","last_fullsized":"2023-09-21T00:17:10.953276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:10:02.229896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.140297+0000","last_change":"2023-09-21T00:17:06.949895+0000","last_active":"2023-09-21T00:17:11.140297+0000","last_peered":"2023-09-21T00:17:11.140297+0000","last_clean":"2023-09-21T00:17:11.140297+0000","last_became_active":"2023-09-21T00:17:06.949445+0000","last_became_peered":"2023-09-21T00:17:06.949445+0000","last_unstale":"2023-09-21T00:17:11.140297+0000","last_undegraded":"2023-09-21T00:17:11.140297+0000","last_fullsized":"2023-09-21T00:17:11.140297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:14:40.821557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.953209+0000","last_change":"2023-09-21T00:17:06.949062+0000","last_active":"2023-09-21T00:17:10.953209+0000","last_peered":"2023-09-21T00:17:10.953209+0000","last_clean":"2023-09-21T00:17:10.953209+0000","last_became_active":"2023-09-21T00:17:06.948581+0000","last_became_peered":"2023-09-21T00:17:06.948581+0000","last_unstale":"2023-09-21T00:17:10.953209+0000","last_undegraded":"2023-09-21T00:17:10.953209+0000","last_fullsized":"2023-09-21T00:17:10.953209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:33:02.098745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.955518+0000","last_change":"2023-09-21T00:17:06.947733+0000","last_active":"2023-09-21T00:17:10.955518+0000","last_peered":"2023-09-21T00:17:10.955518+0000","last_clean":"2023-09-21T00:17:10.955518+0000","last_became_active":"2023-09-21T00:17:06.947437+0000","last_became_peered":"2023-09-21T00:17:06.947437+0000","last_unstale":"2023-09-21T00:17:10.955518+0000","last_undegraded":"2023-09-21T00:17:10.955518+0000","last_fullsized":"2023-09-21T00:17:10.955518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:28:34.014683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.955972+0000","last_change":"2023-09-21T00:17:06.936684+0000","last_active":"2023-09-21T00:17:10.955972+0000","last_peered":"2023-09-21T00:17:10.955972+0000","last_clean":"2023-09-21T00:17:10.955972+0000","last_became_active":"2023-09-21T00:17:06.936417+0000","last_became_peered":"2023-09-21T00:17:06.936417+0000","last_unstale":"2023-09-21T00:17:10.955972+0000","last_undegraded":"2023-09-21T00:17:10.955972+0000","last_fullsized":"2023-09-21T00:17:10.955972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:53:27.597756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952565+0000","last_change":"2023-09-21T00:17:06.934467+0000","last_active":"2023-09-21T00:17:10.952565+0000","last_peered":"2023-09-21T00:17:10.952565+0000","last_clean":"2023-09-21T00:17:10.952565+0000","last_became_active":"2023-09-21T00:17:06.934042+0000","last_became_peered":"2023-09-21T00:17:06.934042+0000","last_unstale":"2023-09-21T00:17:10.952565+0000","last_undegraded":"2023-09-21T00:17:10.952565+0000","last_fullsized":"2023-09-21T00:17:10.952565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:17:22.988451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.960993+0000","last_change":"2023-09-21T00:17:06.933643+0000","last_active":"2023-09-21T00:17:10.960993+0000","last_peered":"2023-09-21T00:17:10.960993+0000","last_clean":"2023-09-21T00:17:10.960993+0000","last_became_active":"2023-09-21T00:17:06.933143+0000","last_became_peered":"2023-09-21T00:17:06.933143+0000","last_unstale":"2023-09-21T00:17:10.960993+0000","last_undegraded":"2023-09-21T00:17:10.960993+0000","last_fullsized":"2023-09-21T00:17:10.960993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:30:26.002264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.966806+0000","last_change":"2023-09-21T00:17:06.932408+0000","last_active":"2023-09-21T00:17:10.966806+0000","last_peered":"2023-09-21T00:17:10.966806+0000","last_clean":"2023-09-21T00:17:10.966806+0000","last_became_active":"2023-09-21T00:17:06.932137+0000","last_became_peered":"2023-09-21T00:17:06.932137+0000","last_unstale":"2023-09-21T00:17:10.966806+0000","last_undegraded":"2023-09-21T00:17:10.966806+0000","last_fullsized":"2023-09-21T00:17:10.966806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:28:34.014683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963484+0000","last_change":"2023-09-21T00:17:06.955886+0000","last_active":"2023-09-21T00:17:10.963484+0000","last_peered":"2023-09-21T00:17:10.963484+0000","last_clean":"2023-09-21T00:17:10.963484+0000","last_became_active":"2023-09-21T00:17:06.955591+0000","last_became_peered":"2023-09-21T00:17:06.955591+0000","last_unstale":"2023-09-21T00:17:10.963484+0000","last_undegraded":"2023-09-21T00:17:10.963484+0000","last_fullsized":"2023-09-21T00:17:10.963484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:34:25.102514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.964176+0000","last_change":"2023-09-21T00:17:06.947508+0000","last_active":"2023-09-21T00:17:10.964176+0000","last_peered":"2023-09-21T00:17:10.964176+0000","last_clean":"2023-09-21T00:17:10.964176+0000","last_became_active":"2023-09-21T00:17:06.947132+0000","last_became_peered":"2023-09-21T00:17:06.947132+0000","last_unstale":"2023-09-21T00:17:10.964176+0000","last_undegraded":"2023-09-21T00:17:10.964176+0000","last_fullsized":"2023-09-21T00:17:10.964176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:34:02.095171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.967783+0000","last_change":"2023-09-21T00:17:06.943217+0000","last_active":"2023-09-21T00:17:10.967783+0000","last_peered":"2023-09-21T00:17:10.967783+0000","last_clean":"2023-09-21T00:17:10.967783+0000","last_became_active":"2023-09-21T00:17:06.942936+0000","last_became_peered":"2023-09-21T00:17:06.942936+0000","last_unstale":"2023-09-21T00:17:10.967783+0000","last_undegraded":"2023-09-21T00:17:10.967783+0000","last_fullsized":"2023-09-21T00:17:10.967783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:53:27.597756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.140089+0000","last_change":"2023-09-21T00:17:06.940613+0000","last_active":"2023-09-21T00:17:11.140089+0000","last_peered":"2023-09-21T00:17:11.140089+0000","last_clean":"2023-09-21T00:17:11.140089+0000","last_became_active":"2023-09-21T00:17:06.939452+0000","last_became_peered":"2023-09-21T00:17:06.939452+0000","last_unstale":"2023-09-21T00:17:11.140089+0000","last_undegraded":"2023-09-21T00:17:11.140089+0000","last_fullsized":"2023-09-21T00:17:11.140089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:45:42.036094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.955621+0000","last_change":"2023-09-21T00:17:11.145149+0000","last_active":"2023-09-21T00:17:11.955621+0000","last_peered":"2023-09-21T00:17:11.955621+0000","last_clean":"2023-09-21T00:17:11.955621+0000","last_became_active":"2023-09-21T00:17:11.144318+0000","last_became_peered":"2023-09-21T00:17:11.144318+0000","last_unstale":"2023-09-21T00:17:11.955621+0000","last_undegraded":"2023-09-21T00:17:11.955621+0000","last_fullsized":"2023-09-21T00:17:11.955621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:46:38.332564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.961534+0000","last_change":"2023-09-21T00:17:05.926207+0000","last_active":"2023-09-21T00:17:10.961534+0000","last_peered":"2023-09-21T00:17:10.961534+0000","last_clean":"2023-09-21T00:17:10.961534+0000","last_became_active":"2023-09-21T00:17:05.925963+0000","last_became_peered":"2023-09-21T00:17:05.925963+0000","last_unstale":"2023-09-21T00:17:10.961534+0000","last_undegraded":"2023-09-21T00:17:10.961534+0000","last_fullsized":"2023-09-21T00:17:10.961534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:53:26.593335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952921+0000","last_change":"2023-09-21T00:17:06.935708+0000","last_active":"2023-09-21T00:17:10.952921+0000","last_peered":"2023-09-21T00:17:10.952921+0000","last_clean":"2023-09-21T00:17:10.952921+0000","last_became_active":"2023-09-21T00:17:06.935402+0000","last_became_peered":"2023-09-21T00:17:06.935402+0000","last_unstale":"2023-09-21T00:17:10.952921+0000","last_undegraded":"2023-09-21T00:17:10.952921+0000","last_fullsized":"2023-09-21T00:17:10.952921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:33:02.098745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.954136+0000","last_change":"2023-09-21T00:17:10.975756+0000","last_active":"2023-09-21T00:17:11.954136+0000","last_peered":"2023-09-21T00:17:11.954136+0000","last_clean":"2023-09-21T00:17:11.954136+0000","last_became_active":"2023-09-21T00:17:10.975403+0000","last_became_peered":"2023-09-21T00:17:10.975403+0000","last_unstale":"2023-09-21T00:17:11.954136+0000","last_undegraded":"2023-09-21T00:17:11.954136+0000","last_fullsized":"2023-09-21T00:17:11.954136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:44:35.401217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.953050+0000","last_change":"2023-09-21T00:17:05.928089+0000","last_active":"2023-09-21T00:17:10.953050+0000","last_peered":"2023-09-21T00:17:10.953050+0000","last_clean":"2023-09-21T00:17:10.953050+0000","last_became_active":"2023-09-21T00:17:05.927587+0000","last_became_peered":"2023-09-21T00:17:05.927587+0000","last_unstale":"2023-09-21T00:17:10.953050+0000","last_undegraded":"2023-09-21T00:17:10.953050+0000","last_fullsized":"2023-09-21T00:17:10.953050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T10:25:25.504437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.961320+0000","last_change":"2023-09-21T00:17:06.950961+0000","last_active":"2023-09-21T00:17:10.961320+0000","last_peered":"2023-09-21T00:17:10.961320+0000","last_clean":"2023-09-21T00:17:10.961320+0000","last_became_active":"2023-09-21T00:17:06.949285+0000","last_became_peered":"2023-09-21T00:17:06.949285+0000","last_unstale":"2023-09-21T00:17:10.961320+0000","last_undegraded":"2023-09-21T00:17:10.961320+0000","last_fullsized":"2023-09-21T00:17:10.961320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:10:02.229896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.954346+0000","last_change":"2023-09-21T00:17:10.976031+0000","last_active":"2023-09-21T00:17:11.954346+0000","last_peered":"2023-09-21T00:17:11.954346+0000","last_clean":"2023-09-21T00:17:11.954346+0000","last_became_active":"2023-09-21T00:17:10.975600+0000","last_became_peered":"2023-09-21T00:17:10.975600+0000","last_unstale":"2023-09-21T00:17:11.954346+0000","last_undegraded":"2023-09-21T00:17:11.954346+0000","last_fullsized":"2023-09-21T00:17:11.954346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:41:31.729189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.139027+0000","last_change":"2023-09-21T00:17:05.933223+0000","last_active":"2023-09-21T00:17:11.139027+0000","last_peered":"2023-09-21T00:17:11.139027+0000","last_clean":"2023-09-21T00:17:11.139027+0000","last_became_active":"2023-09-21T00:17:05.932282+0000","last_became_peered":"2023-09-21T00:17:05.932282+0000","last_unstale":"2023-09-21T00:17:11.139027+0000","last_undegraded":"2023-09-21T00:17:11.139027+0000","last_fullsized":"2023-09-21T00:17:11.139027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:16:30.197907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963765+0000","last_change":"2023-09-21T00:17:06.955597+0000","last_active":"2023-09-21T00:17:10.963765+0000","last_peered":"2023-09-21T00:17:10.963765+0000","last_clean":"2023-09-21T00:17:10.963765+0000","last_became_active":"2023-09-21T00:17:06.955247+0000","last_became_peered":"2023-09-21T00:17:06.955247+0000","last_unstale":"2023-09-21T00:17:10.963765+0000","last_undegraded":"2023-09-21T00:17:10.963765+0000","last_fullsized":"2023-09-21T00:17:10.963765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:44:31.363217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.954336+0000","last_change":"2023-09-21T00:17:10.969390+0000","last_active":"2023-09-21T00:17:11.954336+0000","last_peered":"2023-09-21T00:17:11.954336+0000","last_clean":"2023-09-21T00:17:11.954336+0000","last_became_active":"2023-09-21T00:17:10.969005+0000","last_became_peered":"2023-09-21T00:17:10.969005+0000","last_unstale":"2023-09-21T00:17:11.954336+0000","last_undegraded":"2023-09-21T00:17:11.954336+0000","last_fullsized":"2023-09-21T00:17:11.954336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:31:53.394708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.138610+0000","last_change":"2023-09-21T00:17:05.930194+0000","last_active":"2023-09-21T00:17:11.138610+0000","last_peered":"2023-09-21T00:17:11.138610+0000","last_clean":"2023-09-21T00:17:11.138610+0000","last_became_active":"2023-09-21T00:17:05.929856+0000","last_became_peered":"2023-09-21T00:17:05.929856+0000","last_unstale":"2023-09-21T00:17:11.138610+0000","last_undegraded":"2023-09-21T00:17:11.138610+0000","last_fullsized":"2023-09-21T00:17:11.138610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:53:26.593335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963977+0000","last_change":"2023-09-21T00:17:06.955503+0000","last_active":"2023-09-21T00:17:10.963977+0000","last_peered":"2023-09-21T00:17:10.963977+0000","last_clean":"2023-09-21T00:17:10.963977+0000","last_became_active":"2023-09-21T00:17:06.955193+0000","last_became_peered":"2023-09-21T00:17:06.955193+0000","last_unstale":"2023-09-21T00:17:10.963977+0000","last_undegraded":"2023-09-21T00:17:10.963977+0000","last_fullsized":"2023-09-21T00:17:10.963977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:47:58.590848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.955144+0000","last_change":"2023-09-21T00:17:10.973678+0000","last_active":"2023-09-21T00:17:11.955144+0000","last_peered":"2023-09-21T00:17:11.955144+0000","last_clean":"2023-09-21T00:17:11.955144+0000","last_became_active":"2023-09-21T00:17:10.973186+0000","last_became_peered":"2023-09-21T00:17:10.973186+0000","last_unstale":"2023-09-21T00:17:11.955144+0000","last_undegraded":"2023-09-21T00:17:11.955144+0000","last_fullsized":"2023-09-21T00:17:11.955144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:59:04.499583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952784+0000","last_change":"2023-09-21T00:17:05.925297+0000","last_active":"2023-09-21T00:17:10.952784+0000","last_peered":"2023-09-21T00:17:10.952784+0000","last_clean":"2023-09-21T00:17:10.952784+0000","last_became_active":"2023-09-21T00:17:05.924818+0000","last_became_peered":"2023-09-21T00:17:05.924818+0000","last_unstale":"2023-09-21T00:17:10.952784+0000","last_undegraded":"2023-09-21T00:17:10.952784+0000","last_fullsized":"2023-09-21T00:17:10.952784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:43:06.599691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.954797+0000","last_change":"2023-09-21T00:17:06.937094+0000","last_active":"2023-09-21T00:17:10.954797+0000","last_peered":"2023-09-21T00:17:10.954797+0000","last_clean":"2023-09-21T00:17:10.954797+0000","last_became_active":"2023-09-21T00:17:06.936793+0000","last_became_peered":"2023-09-21T00:17:06.936793+0000","last_unstale":"2023-09-21T00:17:10.954797+0000","last_undegraded":"2023-09-21T00:17:10.954797+0000","last_fullsized":"2023-09-21T00:17:10.954797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:36:18.989655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.954628+0000","last_change":"2023-09-21T00:17:10.979361+0000","last_active":"2023-09-21T00:17:11.954628+0000","last_peered":"2023-09-21T00:17:11.954628+0000","last_clean":"2023-09-21T00:17:11.954628+0000","last_became_active":"2023-09-21T00:17:10.978911+0000","last_became_peered":"2023-09-21T00:17:10.978911+0000","last_unstale":"2023-09-21T00:17:11.954628+0000","last_undegraded":"2023-09-21T00:17:11.954628+0000","last_fullsized":"2023-09-21T00:17:11.954628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:12:56.553383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.953305+0000","last_change":"2023-09-21T00:17:05.923018+0000","last_active":"2023-09-21T00:17:10.953305+0000","last_peered":"2023-09-21T00:17:10.953305+0000","last_clean":"2023-09-21T00:17:10.953305+0000","last_became_active":"2023-09-21T00:17:05.922305+0000","last_became_peered":"2023-09-21T00:17:05.922305+0000","last_unstale":"2023-09-21T00:17:10.953305+0000","last_undegraded":"2023-09-21T00:17:10.953305+0000","last_fullsized":"2023-09-21T00:17:10.953305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T10:25:25.504437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.960533+0000","last_change":"2023-09-21T00:17:06.930143+0000","last_active":"2023-09-21T00:17:10.960533+0000","last_peered":"2023-09-21T00:17:10.960533+0000","last_clean":"2023-09-21T00:17:10.960533+0000","last_became_active":"2023-09-21T00:17:06.929834+0000","last_became_peered":"2023-09-21T00:17:06.929834+0000","last_unstale":"2023-09-21T00:17:10.960533+0000","last_undegraded":"2023-09-21T00:17:10.960533+0000","last_fullsized":"2023-09-21T00:17:10.960533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:33:02.098745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.243648+0000","last_change":"2023-09-21T00:17:10.970839+0000","last_active":"2023-09-21T00:17:12.243648+0000","last_peered":"2023-09-21T00:17:12.243648+0000","last_clean":"2023-09-21T00:17:12.243648+0000","last_became_active":"2023-09-21T00:17:10.970381+0000","last_became_peered":"2023-09-21T00:17:10.970381+0000","last_unstale":"2023-09-21T00:17:12.243648+0000","last_undegraded":"2023-09-21T00:17:12.243648+0000","last_fullsized":"2023-09-21T00:17:12.243648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:34:06.133170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952254+0000","last_change":"2023-09-21T00:17:05.929568+0000","last_active":"2023-09-21T00:17:10.952254+0000","last_peered":"2023-09-21T00:17:10.952254+0000","last_clean":"2023-09-21T00:17:10.952254+0000","last_became_active":"2023-09-21T00:17:05.929279+0000","last_became_peered":"2023-09-21T00:17:05.929279+0000","last_unstale":"2023-09-21T00:17:10.952254+0000","last_undegraded":"2023-09-21T00:17:10.952254+0000","last_fullsized":"2023-09-21T00:17:10.952254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T07:24:34.111510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952180+0000","last_change":"2023-09-21T00:17:06.944506+0000","last_active":"2023-09-21T00:17:10.952180+0000","last_peered":"2023-09-21T00:17:10.952180+0000","last_clean":"2023-09-21T00:17:10.952180+0000","last_became_active":"2023-09-21T00:17:06.944205+0000","last_became_peered":"2023-09-21T00:17:06.944205+0000","last_unstale":"2023-09-21T00:17:10.952180+0000","last_undegraded":"2023-09-21T00:17:10.952180+0000","last_fullsized":"2023-09-21T00:17:10.952180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:12:52.515384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.243135+0000","last_change":"2023-09-21T00:17:11.141670+0000","last_active":"2023-09-21T00:17:12.243135+0000","last_peered":"2023-09-21T00:17:12.243135+0000","last_clean":"2023-09-21T00:17:12.243135+0000","last_became_active":"2023-09-21T00:17:11.141275+0000","last_became_peered":"2023-09-21T00:17:11.141275+0000","last_unstale":"2023-09-21T00:17:12.243135+0000","last_undegraded":"2023-09-21T00:17:12.243135+0000","last_fullsized":"2023-09-21T00:17:12.243135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:01:56.036095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963545+0000","last_change":"2023-09-21T00:17:05.932750+0000","last_active":"2023-09-21T00:17:10.963545+0000","last_peered":"2023-09-21T00:17:10.963545+0000","last_clean":"2023-09-21T00:17:10.963545+0000","last_became_active":"2023-09-21T00:17:05.930778+0000","last_became_peered":"2023-09-21T00:17:05.930778+0000","last_unstale":"2023-09-21T00:17:10.963545+0000","last_undegraded":"2023-09-21T00:17:10.963545+0000","last_fullsized":"2023-09-21T00:17:10.963545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:04:16.077149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.967014+0000","last_change":"2023-09-21T00:17:06.939961+0000","last_active":"2023-09-21T00:17:10.967014+0000","last_peered":"2023-09-21T00:17:10.967014+0000","last_clean":"2023-09-21T00:17:10.967014+0000","last_became_active":"2023-09-21T00:17:06.938086+0000","last_became_peered":"2023-09-21T00:17:06.938086+0000","last_unstale":"2023-09-21T00:17:10.967014+0000","last_undegraded":"2023-09-21T00:17:10.967014+0000","last_fullsized":"2023-09-21T00:17:10.967014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:16:31.202329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.955743+0000","last_change":"2023-09-21T00:17:11.144684+0000","last_active":"2023-09-21T00:17:11.955743+0000","last_peered":"2023-09-21T00:17:11.955743+0000","last_clean":"2023-09-21T00:17:11.955743+0000","last_became_active":"2023-09-21T00:17:11.144213+0000","last_became_peered":"2023-09-21T00:17:11.144213+0000","last_unstale":"2023-09-21T00:17:11.955743+0000","last_undegraded":"2023-09-21T00:17:11.955743+0000","last_fullsized":"2023-09-21T00:17:11.955743+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:16:57.981811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.955244+0000","last_change":"2023-09-21T00:17:05.930497+0000","last_active":"2023-09-21T00:17:10.955244+0000","last_peered":"2023-09-21T00:17:10.955244+0000","last_clean":"2023-09-21T00:17:10.955244+0000","last_became_active":"2023-09-21T00:17:05.930235+0000","last_became_peered":"2023-09-21T00:17:05.930235+0000","last_unstale":"2023-09-21T00:17:10.955244+0000","last_undegraded":"2023-09-21T00:17:10.955244+0000","last_fullsized":"2023-09-21T00:17:10.955244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:15:52.072888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.964068+0000","last_change":"2023-09-21T00:17:06.946691+0000","last_active":"2023-09-21T00:17:10.964068+0000","last_peered":"2023-09-21T00:17:10.964068+0000","last_clean":"2023-09-21T00:17:10.964068+0000","last_became_active":"2023-09-21T00:17:06.946467+0000","last_became_peered":"2023-09-21T00:17:06.946467+0000","last_unstale":"2023-09-21T00:17:10.964068+0000","last_undegraded":"2023-09-21T00:17:10.964068+0000","last_fullsized":"2023-09-21T00:17:10.964068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T12:07:09.891729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.953663+0000","last_change":"2023-09-21T00:17:10.974215+0000","last_active":"2023-09-21T00:17:11.953663+0000","last_peered":"2023-09-21T00:17:11.953663+0000","last_clean":"2023-09-21T00:17:11.953663+0000","last_became_active":"2023-09-21T00:17:10.973666+0000","last_became_peered":"2023-09-21T00:17:10.973666+0000","last_unstale":"2023-09-21T00:17:11.953663+0000","last_undegraded":"2023-09-21T00:17:11.953663+0000","last_fullsized":"2023-09-21T00:17:11.953663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T02:24:55.988982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.964045+0000","last_change":"2023-09-21T00:17:05.932595+0000","last_active":"2023-09-21T00:17:10.964045+0000","last_peered":"2023-09-21T00:17:10.964045+0000","last_clean":"2023-09-21T00:17:10.964045+0000","last_became_active":"2023-09-21T00:17:05.931183+0000","last_became_peered":"2023-09-21T00:17:05.931183+0000","last_unstale":"2023-09-21T00:17:10.964045+0000","last_undegraded":"2023-09-21T00:17:10.964045+0000","last_fullsized":"2023-09-21T00:17:10.964045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:53:26.593335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.961419+0000","last_change":"2023-09-21T00:17:06.953679+0000","last_active":"2023-09-21T00:17:10.961419+0000","last_peered":"2023-09-21T00:17:10.961419+0000","last_clean":"2023-09-21T00:17:10.961419+0000","last_became_active":"2023-09-21T00:17:06.949774+0000","last_became_peered":"2023-09-21T00:17:06.949774+0000","last_unstale":"2023-09-21T00:17:10.961419+0000","last_undegraded":"2023-09-21T00:17:10.961419+0000","last_fullsized":"2023-09-21T00:17:10.961419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:12:52.515384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.954755+0000","last_change":"2023-09-21T00:17:10.969803+0000","last_active":"2023-09-21T00:17:11.954755+0000","last_peered":"2023-09-21T00:17:11.954755+0000","last_clean":"2023-09-21T00:17:11.954755+0000","last_became_active":"2023-09-21T00:17:10.969402+0000","last_became_peered":"2023-09-21T00:17:10.969402+0000","last_unstale":"2023-09-21T00:17:11.954755+0000","last_undegraded":"2023-09-21T00:17:11.954755+0000","last_fullsized":"2023-09-21T00:17:11.954755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:11:41.340772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.971250+0000","last_change":"2023-09-21T00:17:05.924182+0000","last_active":"2023-09-21T00:17:10.971250+0000","last_peered":"2023-09-21T00:17:10.971250+0000","last_clean":"2023-09-21T00:17:10.971250+0000","last_became_active":"2023-09-21T00:17:05.923874+0000","last_became_peered":"2023-09-21T00:17:05.923874+0000","last_unstale":"2023-09-21T00:17:10.971250+0000","last_undegraded":"2023-09-21T00:17:10.971250+0000","last_fullsized":"2023-09-21T00:17:10.971250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T07:53:35.281829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.955876+0000","last_change":"2023-09-21T00:17:06.938055+0000","last_active":"2023-09-21T00:17:10.955876+0000","last_peered":"2023-09-21T00:17:10.955876+0000","last_clean":"2023-09-21T00:17:10.955876+0000","last_became_active":"2023-09-21T00:17:06.937477+0000","last_became_peered":"2023-09-21T00:17:06.937477+0000","last_unstale":"2023-09-21T00:17:10.955876+0000","last_undegraded":"2023-09-21T00:17:10.955876+0000","last_fullsized":"2023-09-21T00:17:10.955876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:43:07.604113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.242273+0000","last_change":"2023-09-21T00:17:10.969820+0000","last_active":"2023-09-21T00:17:12.242273+0000","last_peered":"2023-09-21T00:17:12.242273+0000","last_clean":"2023-09-21T00:17:12.242273+0000","last_became_active":"2023-09-21T00:17:10.969393+0000","last_became_peered":"2023-09-21T00:17:10.969393+0000","last_unstale":"2023-09-21T00:17:12.242273+0000","last_undegraded":"2023-09-21T00:17:12.242273+0000","last_fullsized":"2023-09-21T00:17:12.242273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:14:44.859557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:16.985242+0000","last_change":"2023-09-21T00:17:05.932498+0000","last_active":"2023-09-21T00:17:16.985242+0000","last_peered":"2023-09-21T00:17:16.985242+0000","last_clean":"2023-09-21T00:17:16.985242+0000","last_became_active":"2023-09-21T00:17:05.932192+0000","last_became_peered":"2023-09-21T00:17:05.932192+0000","last_unstale":"2023-09-21T00:17:16.985242+0000","last_undegraded":"2023-09-21T00:17:16.985242+0000","last_fullsized":"2023-09-21T00:17:16.985242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T07:24:34.111510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.139985+0000","last_change":"2023-09-21T00:17:06.944667+0000","last_active":"2023-09-21T00:17:11.139985+0000","last_peered":"2023-09-21T00:17:11.139985+0000","last_clean":"2023-09-21T00:17:11.139985+0000","last_became_active":"2023-09-21T00:17:06.943370+0000","last_became_peered":"2023-09-21T00:17:06.943370+0000","last_unstale":"2023-09-21T00:17:11.139985+0000","last_undegraded":"2023-09-21T00:17:11.139985+0000","last_fullsized":"2023-09-21T00:17:11.139985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T02:36:18.582664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.243233+0000","last_change":"2023-09-21T00:17:11.142786+0000","last_active":"2023-09-21T00:17:12.243233+0000","last_peered":"2023-09-21T00:17:12.243233+0000","last_clean":"2023-09-21T00:17:12.243233+0000","last_became_active":"2023-09-21T00:17:11.142355+0000","last_became_peered":"2023-09-21T00:17:11.142355+0000","last_unstale":"2023-09-21T00:17:12.243233+0000","last_undegraded":"2023-09-21T00:17:12.243233+0000","last_fullsized":"2023-09-21T00:17:12.243233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:32:25.199881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.960849+0000","last_change":"2023-09-21T00:17:05.926948+0000","last_active":"2023-09-21T00:17:10.960849+0000","last_peered":"2023-09-21T00:17:10.960849+0000","last_clean":"2023-09-21T00:17:10.960849+0000","last_became_active":"2023-09-21T00:17:05.926594+0000","last_became_peered":"2023-09-21T00:17:05.926594+0000","last_unstale":"2023-09-21T00:17:10.960849+0000","last_undegraded":"2023-09-21T00:17:10.960849+0000","last_fullsized":"2023-09-21T00:17:10.960849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:36:17.985234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.961082+0000","last_change":"2023-09-21T00:17:06.936852+0000","last_active":"2023-09-21T00:17:10.961082+0000","last_peered":"2023-09-21T00:17:10.961082+0000","last_clean":"2023-09-21T00:17:10.961082+0000","last_became_active":"2023-09-21T00:17:06.936544+0000","last_became_peered":"2023-09-21T00:17:06.936544+0000","last_unstale":"2023-09-21T00:17:10.961082+0000","last_undegraded":"2023-09-21T00:17:10.961082+0000","last_fullsized":"2023-09-21T00:17:10.961082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T11:15:08.495079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.954099+0000","last_change":"2023-09-21T00:17:11.144574+0000","last_active":"2023-09-21T00:17:11.954099+0000","last_peered":"2023-09-21T00:17:11.954099+0000","last_clean":"2023-09-21T00:17:11.954099+0000","last_became_active":"2023-09-21T00:17:11.144167+0000","last_became_peered":"2023-09-21T00:17:11.144167+0000","last_unstale":"2023-09-21T00:17:11.954099+0000","last_undegraded":"2023-09-21T00:17:11.954099+0000","last_fullsized":"2023-09-21T00:17:11.954099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:38:17.728778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963639+0000","last_change":"2023-09-21T00:17:05.933114+0000","last_active":"2023-09-21T00:17:10.963639+0000","last_peered":"2023-09-21T00:17:10.963639+0000","last_clean":"2023-09-21T00:17:10.963639+0000","last_became_active":"2023-09-21T00:17:05.932827+0000","last_became_peered":"2023-09-21T00:17:05.932827+0000","last_unstale":"2023-09-21T00:17:10.963639+0000","last_undegraded":"2023-09-21T00:17:10.963639+0000","last_fullsized":"2023-09-21T00:17:10.963639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:12:51.510962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.138749+0000","last_change":"2023-09-21T00:17:06.947936+0000","last_active":"2023-09-21T00:17:11.138749+0000","last_peered":"2023-09-21T00:17:11.138749+0000","last_clean":"2023-09-21T00:17:11.138749+0000","last_became_active":"2023-09-21T00:17:06.947663+0000","last_became_peered":"2023-09-21T00:17:06.947663+0000","last_unstale":"2023-09-21T00:17:11.138749+0000","last_undegraded":"2023-09-21T00:17:11.138749+0000","last_fullsized":"2023-09-21T00:17:11.138749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:47:58.590848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.955260+0000","last_change":"2023-09-21T00:17:11.146155+0000","last_active":"2023-09-21T00:17:11.955260+0000","last_peered":"2023-09-21T00:17:11.955260+0000","last_clean":"2023-09-21T00:17:11.955260+0000","last_became_active":"2023-09-21T00:17:11.145812+0000","last_became_peered":"2023-09-21T00:17:11.145812+0000","last_unstale":"2023-09-21T00:17:11.955260+0000","last_undegraded":"2023-09-21T00:17:11.955260+0000","last_fullsized":"2023-09-21T00:17:11.955260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:32:25.199881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952759+0000","last_change":"2023-09-21T00:17:05.930675+0000","last_active":"2023-09-21T00:17:10.952759+0000","last_peered":"2023-09-21T00:17:10.952759+0000","last_clean":"2023-09-21T00:17:10.952759+0000","last_became_active":"2023-09-21T00:17:05.930416+0000","last_became_peered":"2023-09-21T00:17:05.930416+0000","last_unstale":"2023-09-21T00:17:10.952759+0000","last_undegraded":"2023-09-21T00:17:10.952759+0000","last_fullsized":"2023-09-21T00:17:10.952759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:02:58.326166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952464+0000","last_change":"2023-09-21T00:17:06.934940+0000","last_active":"2023-09-21T00:17:10.952464+0000","last_peered":"2023-09-21T00:17:10.952464+0000","last_clean":"2023-09-21T00:17:10.952464+0000","last_became_active":"2023-09-21T00:17:06.934319+0000","last_became_peered":"2023-09-21T00:17:06.934319+0000","last_unstale":"2023-09-21T00:17:10.952464+0000","last_undegraded":"2023-09-21T00:17:10.952464+0000","last_fullsized":"2023-09-21T00:17:10.952464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:30:26.002264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.242887+0000","last_change":"2023-09-21T00:17:10.978508+0000","last_active":"2023-09-21T00:17:12.242887+0000","last_peered":"2023-09-21T00:17:12.242887+0000","last_clean":"2023-09-21T00:17:12.242887+0000","last_became_active":"2023-09-21T00:17:10.978085+0000","last_became_peered":"2023-09-21T00:17:10.978085+0000","last_unstale":"2023-09-21T00:17:12.242887+0000","last_undegraded":"2023-09-21T00:17:12.242887+0000","last_fullsized":"2023-09-21T00:17:12.242887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T11:26:08.816745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.965895+0000","last_change":"2023-09-21T00:17:05.917597+0000","last_active":"2023-09-21T00:17:10.965895+0000","last_peered":"2023-09-21T00:17:10.965895+0000","last_clean":"2023-09-21T00:17:10.965895+0000","last_became_active":"2023-09-21T00:17:05.917277+0000","last_became_peered":"2023-09-21T00:17:05.917277+0000","last_unstale":"2023-09-21T00:17:10.965895+0000","last_undegraded":"2023-09-21T00:17:10.965895+0000","last_fullsized":"2023-09-21T00:17:10.965895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:02:58.326166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.138679+0000","last_change":"2023-09-21T00:17:06.947371+0000","last_active":"2023-09-21T00:17:11.138679+0000","last_peered":"2023-09-21T00:17:11.138679+0000","last_clean":"2023-09-21T00:17:11.138679+0000","last_became_active":"2023-09-21T00:17:06.947072+0000","last_became_peered":"2023-09-21T00:17:06.947072+0000","last_unstale":"2023-09-21T00:17:11.138679+0000","last_undegraded":"2023-09-21T00:17:11.138679+0000","last_fullsized":"2023-09-21T00:17:11.138679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:41:27.691190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.954080+0000","last_change":"2023-09-21T00:17:10.974483+0000","last_active":"2023-09-21T00:17:11.954080+0000","last_peered":"2023-09-21T00:17:11.954080+0000","last_clean":"2023-09-21T00:17:11.954080+0000","last_became_active":"2023-09-21T00:17:10.974056+0000","last_became_peered":"2023-09-21T00:17:10.974056+0000","last_unstale":"2023-09-21T00:17:11.954080+0000","last_undegraded":"2023-09-21T00:17:11.954080+0000","last_fullsized":"2023-09-21T00:17:11.954080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T12:07:13.929729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.955489+0000","last_change":"2023-09-21T00:17:05.919312+0000","last_active":"2023-09-21T00:17:10.955489+0000","last_peered":"2023-09-21T00:17:10.955489+0000","last_clean":"2023-09-21T00:17:10.955489+0000","last_became_active":"2023-09-21T00:17:05.919020+0000","last_became_peered":"2023-09-21T00:17:05.919020+0000","last_unstale":"2023-09-21T00:17:10.955489+0000","last_undegraded":"2023-09-21T00:17:10.955489+0000","last_fullsized":"2023-09-21T00:17:10.955489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T12:05:24.959728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.140053+0000","last_change":"2023-09-21T00:17:06.947452+0000","last_active":"2023-09-21T00:17:11.140053+0000","last_peered":"2023-09-21T00:17:11.140053+0000","last_clean":"2023-09-21T00:17:11.140053+0000","last_became_active":"2023-09-21T00:17:06.947158+0000","last_became_peered":"2023-09-21T00:17:06.947158+0000","last_unstale":"2023-09-21T00:17:11.140053+0000","last_undegraded":"2023-09-21T00:17:11.140053+0000","last_fullsized":"2023-09-21T00:17:11.140053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:34:02.095171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.242117+0000","last_change":"2023-09-21T00:17:10.970581+0000","last_active":"2023-09-21T00:17:12.242117+0000","last_peered":"2023-09-21T00:17:12.242117+0000","last_clean":"2023-09-21T00:17:12.242117+0000","last_became_active":"2023-09-21T00:17:10.970163+0000","last_became_peered":"2023-09-21T00:17:10.970163+0000","last_unstale":"2023-09-21T00:17:12.242117+0000","last_undegraded":"2023-09-21T00:17:12.242117+0000","last_fullsized":"2023-09-21T00:17:12.242117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T02:36:22.620663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.967804+0000","last_change":"2023-09-21T00:17:05.927611+0000","last_active":"2023-09-21T00:17:10.967804+0000","last_peered":"2023-09-21T00:17:10.967804+0000","last_clean":"2023-09-21T00:17:10.967804+0000","last_became_active":"2023-09-21T00:17:05.926796+0000","last_became_peered":"2023-09-21T00:17:05.926796+0000","last_unstale":"2023-09-21T00:17:10.967804+0000","last_undegraded":"2023-09-21T00:17:10.967804+0000","last_fullsized":"2023-09-21T00:17:10.967804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:53:26.593335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.964059+0000","last_change":"2023-09-21T00:17:06.954874+0000","last_active":"2023-09-21T00:17:10.964059+0000","last_peered":"2023-09-21T00:17:10.964059+0000","last_clean":"2023-09-21T00:17:10.964059+0000","last_became_active":"2023-09-21T00:17:06.954591+0000","last_became_peered":"2023-09-21T00:17:06.954591+0000","last_unstale":"2023-09-21T00:17:10.964059+0000","last_undegraded":"2023-09-21T00:17:10.964059+0000","last_fullsized":"2023-09-21T00:17:10.964059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:28:47.396022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.242135+0000","last_change":"2023-09-21T00:17:10.978479+0000","last_active":"2023-09-21T00:17:12.242135+0000","last_peered":"2023-09-21T00:17:12.242135+0000","last_clean":"2023-09-21T00:17:12.242135+0000","last_became_active":"2023-09-21T00:17:10.978049+0000","last_became_peered":"2023-09-21T00:17:10.978049+0000","last_unstale":"2023-09-21T00:17:12.242135+0000","last_undegraded":"2023-09-21T00:17:12.242135+0000","last_fullsized":"2023-09-21T00:17:12.242135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:34:06.133170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963681+0000","last_change":"2023-09-21T00:17:05.931755+0000","last_active":"2023-09-21T00:17:10.963681+0000","last_peered":"2023-09-21T00:17:10.963681+0000","last_clean":"2023-09-21T00:17:10.963681+0000","last_became_active":"2023-09-21T00:17:05.931399+0000","last_became_peered":"2023-09-21T00:17:05.931399+0000","last_unstale":"2023-09-21T00:17:10.963681+0000","last_undegraded":"2023-09-21T00:17:10.963681+0000","last_fullsized":"2023-09-21T00:17:10.963681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:10:01.225475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.954552+0000","last_change":"2023-09-21T00:17:06.931255+0000","last_active":"2023-09-21T00:17:10.954552+0000","last_peered":"2023-09-21T00:17:10.954552+0000","last_clean":"2023-09-21T00:17:10.954552+0000","last_became_active":"2023-09-21T00:17:06.930984+0000","last_became_peered":"2023-09-21T00:17:06.930984+0000","last_unstale":"2023-09-21T00:17:10.954552+0000","last_undegraded":"2023-09-21T00:17:10.954552+0000","last_fullsized":"2023-09-21T00:17:10.954552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:15:53.077309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.242888+0000","last_change":"2023-09-21T00:17:10.977159+0000","last_active":"2023-09-21T00:17:12.242888+0000","last_peered":"2023-09-21T00:17:12.242888+0000","last_clean":"2023-09-21T00:17:12.242888+0000","last_became_active":"2023-09-21T00:17:10.976751+0000","last_became_peered":"2023-09-21T00:17:10.976751+0000","last_unstale":"2023-09-21T00:17:12.242888+0000","last_undegraded":"2023-09-21T00:17:12.242888+0000","last_fullsized":"2023-09-21T00:17:12.242888+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T11:26:08.816745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.967010+0000","last_change":"2023-09-21T00:17:06.940149+0000","last_active":"2023-09-21T00:17:10.967010+0000","last_peered":"2023-09-21T00:17:10.967010+0000","last_clean":"2023-09-21T00:17:10.967010+0000","last_became_active":"2023-09-21T00:17:06.939751+0000","last_became_peered":"2023-09-21T00:17:06.939751+0000","last_unstale":"2023-09-21T00:17:10.967010+0000","last_undegraded":"2023-09-21T00:17:10.967010+0000","last_fullsized":"2023-09-21T00:17:10.967010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:30:26.002264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.966501+0000","last_change":"2023-09-21T00:17:05.916234+0000","last_active":"2023-09-21T00:17:10.966501+0000","last_peered":"2023-09-21T00:17:10.966501+0000","last_clean":"2023-09-21T00:17:10.966501+0000","last_became_active":"2023-09-21T00:17:05.915879+0000","last_became_peered":"2023-09-21T00:17:05.915879+0000","last_unstale":"2023-09-21T00:17:10.966501+0000","last_undegraded":"2023-09-21T00:17:10.966501+0000","last_fullsized":"2023-09-21T00:17:10.966501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:06:51.096713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.242460+0000","last_change":"2023-09-21T00:17:11.141271+0000","last_active":"2023-09-21T00:17:12.242460+0000","last_peered":"2023-09-21T00:17:12.242460+0000","last_clean":"2023-09-21T00:17:12.242460+0000","last_became_active":"2023-09-21T00:17:11.140862+0000","last_became_peered":"2023-09-21T00:17:11.140862+0000","last_unstale":"2023-09-21T00:17:12.242460+0000","last_undegraded":"2023-09-21T00:17:12.242460+0000","last_fullsized":"2023-09-21T00:17:12.242460+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:28:51.434022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.953597+0000","last_change":"2023-09-21T00:17:06.948232+0000","last_active":"2023-09-21T00:17:10.953597+0000","last_peered":"2023-09-21T00:17:10.953597+0000","last_clean":"2023-09-21T00:17:10.953597+0000","last_became_active":"2023-09-21T00:17:06.947981+0000","last_became_peered":"2023-09-21T00:17:06.947981+0000","last_unstale":"2023-09-21T00:17:10.953597+0000","last_undegraded":"2023-09-21T00:17:10.953597+0000","last_fullsized":"2023-09-21T00:17:10.953597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:16:31.202329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963721+0000","last_change":"2023-09-21T00:17:05.918340+0000","last_active":"2023-09-21T00:17:10.963721+0000","last_peered":"2023-09-21T00:17:10.963721+0000","last_clean":"2023-09-21T00:17:10.963721+0000","last_became_active":"2023-09-21T00:17:05.918052+0000","last_became_peered":"2023-09-21T00:17:05.918052+0000","last_unstale":"2023-09-21T00:17:10.963721+0000","last_undegraded":"2023-09-21T00:17:10.963721+0000","last_fullsized":"2023-09-21T00:17:10.963721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:05:24.892446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.138422+0000","last_change":"2023-09-21T00:16:57.071188+0000","last_active":"2023-09-21T00:17:11.138422+0000","last_peered":"2023-09-21T00:17:11.138422+0000","last_clean":"2023-09-21T00:17:11.138422+0000","last_became_active":"2023-09-21T00:16:57.070240+0000","last_became_peered":"2023-09-21T00:16:57.070240+0000","last_unstale":"2023-09-21T00:17:11.138422+0000","last_undegraded":"2023-09-21T00:17:11.138422+0000","last_fullsized":"2023-09-21T00:17:11.138422+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:16:55.741965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:16:55.741965+0000","last_clean_scrub_stamp":"2023-09-21T00:16:55.741965+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:21:26.215032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.243013+0000","last_change":"2023-09-21T00:17:11.141697+0000","last_active":"2023-09-21T00:17:12.243013+0000","last_peered":"2023-09-21T00:17:12.243013+0000","last_clean":"2023-09-21T00:17:12.243013+0000","last_became_active":"2023-09-21T00:17:11.141334+0000","last_became_peered":"2023-09-21T00:17:11.141334+0000","last_unstale":"2023-09-21T00:17:12.243013+0000","last_undegraded":"2023-09-21T00:17:12.243013+0000","last_fullsized":"2023-09-21T00:17:12.243013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:53:19.217753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.960197+0000","last_change":"2023-09-21T00:17:06.930523+0000","last_active":"2023-09-21T00:17:10.960197+0000","last_peered":"2023-09-21T00:17:10.960197+0000","last_clean":"2023-09-21T00:17:10.960197+0000","last_became_active":"2023-09-21T00:17:06.929200+0000","last_became_peered":"2023-09-21T00:17:06.929200+0000","last_unstale":"2023-09-21T00:17:10.960197+0000","last_undegraded":"2023-09-21T00:17:10.960197+0000","last_fullsized":"2023-09-21T00:17:10.960197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T07:53:36.286251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.138459+0000","last_change":"2023-09-21T00:17:05.928845+0000","last_active":"2023-09-21T00:17:11.138459+0000","last_peered":"2023-09-21T00:17:11.138459+0000","last_clean":"2023-09-21T00:17:11.138459+0000","last_became_active":"2023-09-21T00:17:05.928617+0000","last_became_peered":"2023-09-21T00:17:05.928617+0000","last_unstale":"2023-09-21T00:17:11.138459+0000","last_undegraded":"2023-09-21T00:17:11.138459+0000","last_fullsized":"2023-09-21T00:17:11.138459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:56:48.483420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.242213+0000","last_change":"2023-09-21T00:17:11.140948+0000","last_active":"2023-09-21T00:17:12.242213+0000","last_peered":"2023-09-21T00:17:12.242213+0000","last_clean":"2023-09-21T00:17:12.242213+0000","last_became_active":"2023-09-21T00:17:11.140588+0000","last_became_peered":"2023-09-21T00:17:11.140588+0000","last_unstale":"2023-09-21T00:17:12.242213+0000","last_undegraded":"2023-09-21T00:17:12.242213+0000","last_fullsized":"2023-09-21T00:17:12.242213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:14:44.859557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.138729+0000","last_change":"2023-09-21T00:17:05.932021+0000","last_active":"2023-09-21T00:17:11.138729+0000","last_peered":"2023-09-21T00:17:11.138729+0000","last_clean":"2023-09-21T00:17:11.138729+0000","last_became_active":"2023-09-21T00:17:05.931524+0000","last_became_peered":"2023-09-21T00:17:05.931524+0000","last_unstale":"2023-09-21T00:17:11.138729+0000","last_undegraded":"2023-09-21T00:17:11.138729+0000","last_fullsized":"2023-09-21T00:17:11.138729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:28:33.010261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.967904+0000","last_change":"2023-09-21T00:17:06.938686+0000","last_active":"2023-09-21T00:17:10.967904+0000","last_peered":"2023-09-21T00:17:10.967904+0000","last_clean":"2023-09-21T00:17:10.967904+0000","last_became_active":"2023-09-21T00:17:06.938296+0000","last_became_peered":"2023-09-21T00:17:06.938296+0000","last_unstale":"2023-09-21T00:17:10.967904+0000","last_undegraded":"2023-09-21T00:17:10.967904+0000","last_fullsized":"2023-09-21T00:17:10.967904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:17:22.988451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.953741+0000","last_change":"2023-09-21T00:17:11.144700+0000","last_active":"2023-09-21T00:17:11.953741+0000","last_peered":"2023-09-21T00:17:11.953741+0000","last_clean":"2023-09-21T00:17:11.953741+0000","last_became_active":"2023-09-21T00:17:11.144270+0000","last_became_peered":"2023-09-21T00:17:11.144270+0000","last_unstale":"2023-09-21T00:17:11.953741+0000","last_undegraded":"2023-09-21T00:17:11.953741+0000","last_fullsized":"2023-09-21T00:17:11.953741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:19:20.916794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.719452+0000","last_change":"2023-09-21T00:17:05.931903+0000","last_active":"2023-09-21T00:17:11.719452+0000","last_peered":"2023-09-21T00:17:11.719452+0000","last_clean":"2023-09-21T00:17:11.719452+0000","last_became_active":"2023-09-21T00:17:05.931473+0000","last_became_peered":"2023-09-21T00:17:05.931473+0000","last_unstale":"2023-09-21T00:17:11.719452+0000","last_undegraded":"2023-09-21T00:17:11.719452+0000","last_fullsized":"2023-09-21T00:17:11.719452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T10:25:25.504437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.953301+0000","last_change":"2023-09-21T00:17:06.937019+0000","last_active":"2023-09-21T00:17:10.953301+0000","last_peered":"2023-09-21T00:17:10.953301+0000","last_clean":"2023-09-21T00:17:10.953301+0000","last_became_active":"2023-09-21T00:17:06.936738+0000","last_became_peered":"2023-09-21T00:17:06.936738+0000","last_unstale":"2023-09-21T00:17:10.953301+0000","last_undegraded":"2023-09-21T00:17:10.953301+0000","last_fullsized":"2023-09-21T00:17:10.953301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T11:15:08.495079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.954064+0000","last_change":"2023-09-21T00:17:11.141893+0000","last_active":"2023-09-21T00:17:11.954064+0000","last_peered":"2023-09-21T00:17:11.954064+0000","last_clean":"2023-09-21T00:17:11.954064+0000","last_became_active":"2023-09-21T00:17:11.141460+0000","last_became_peered":"2023-09-21T00:17:11.141460+0000","last_unstale":"2023-09-21T00:17:11.954064+0000","last_undegraded":"2023-09-21T00:17:11.954064+0000","last_fullsized":"2023-09-21T00:17:11.954064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T11:15:12.533079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.956194+0000","last_change":"2023-09-21T00:17:05.926473+0000","last_active":"2023-09-21T00:17:10.956194+0000","last_peered":"2023-09-21T00:17:10.956194+0000","last_clean":"2023-09-21T00:17:10.956194+0000","last_became_active":"2023-09-21T00:17:05.926158+0000","last_became_peered":"2023-09-21T00:17:05.926158+0000","last_unstale":"2023-09-21T00:17:10.956194+0000","last_undegraded":"2023-09-21T00:17:10.956194+0000","last_fullsized":"2023-09-21T00:17:10.956194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T12:05:24.959728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.964279+0000","last_change":"2023-09-21T00:17:06.933680+0000","last_active":"2023-09-21T00:17:10.964279+0000","last_peered":"2023-09-21T00:17:10.964279+0000","last_clean":"2023-09-21T00:17:10.964279+0000","last_became_active":"2023-09-21T00:17:06.933307+0000","last_became_peered":"2023-09-21T00:17:06.933307+0000","last_unstale":"2023-09-21T00:17:10.964279+0000","last_undegraded":"2023-09-21T00:17:10.964279+0000","last_fullsized":"2023-09-21T00:17:10.964279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:17:22.988451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.955461+0000","last_change":"2023-09-21T00:17:10.974600+0000","last_active":"2023-09-21T00:17:11.955461+0000","last_peered":"2023-09-21T00:17:11.955461+0000","last_clean":"2023-09-21T00:17:11.955461+0000","last_became_active":"2023-09-21T00:17:10.974003+0000","last_became_peered":"2023-09-21T00:17:10.974003+0000","last_unstale":"2023-09-21T00:17:11.955461+0000","last_undegraded":"2023-09-21T00:17:11.955461+0000","last_fullsized":"2023-09-21T00:17:11.955461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:28:51.434022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.138370+0000","last_change":"2023-09-21T00:17:05.931013+0000","last_active":"2023-09-21T00:17:11.138370+0000","last_peered":"2023-09-21T00:17:11.138370+0000","last_clean":"2023-09-21T00:17:11.138370+0000","last_became_active":"2023-09-21T00:17:05.930722+0000","last_became_peered":"2023-09-21T00:17:05.930722+0000","last_unstale":"2023-09-21T00:17:11.138370+0000","last_undegraded":"2023-09-21T00:17:11.138370+0000","last_fullsized":"2023-09-21T00:17:11.138370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:43:06.599691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.954572+0000","last_change":"2023-09-21T00:17:06.939541+0000","last_active":"2023-09-21T00:17:10.954572+0000","last_peered":"2023-09-21T00:17:10.954572+0000","last_clean":"2023-09-21T00:17:10.954572+0000","last_became_active":"2023-09-21T00:17:06.939222+0000","last_became_peered":"2023-09-21T00:17:06.939222+0000","last_unstale":"2023-09-21T00:17:10.954572+0000","last_undegraded":"2023-09-21T00:17:10.954572+0000","last_fullsized":"2023-09-21T00:17:10.954572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:04:17.081570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.243107+0000","last_change":"2023-09-21T00:17:11.141846+0000","last_active":"2023-09-21T00:17:12.243107+0000","last_peered":"2023-09-21T00:17:12.243107+0000","last_clean":"2023-09-21T00:17:12.243107+0000","last_became_active":"2023-09-21T00:17:11.141470+0000","last_became_peered":"2023-09-21T00:17:11.141470+0000","last_unstale":"2023-09-21T00:17:12.243107+0000","last_undegraded":"2023-09-21T00:17:12.243107+0000","last_fullsized":"2023-09-21T00:17:12.243107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:53:19.217753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.966909+0000","last_change":"2023-09-21T00:17:05.929236+0000","last_active":"2023-09-21T00:17:10.966909+0000","last_peered":"2023-09-21T00:17:10.966909+0000","last_clean":"2023-09-21T00:17:10.966909+0000","last_became_active":"2023-09-21T00:17:05.928922+0000","last_became_peered":"2023-09-21T00:17:05.928922+0000","last_unstale":"2023-09-21T00:17:10.966909+0000","last_undegraded":"2023-09-21T00:17:10.966909+0000","last_fullsized":"2023-09-21T00:17:10.966909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:04:16.077149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952071+0000","last_change":"2023-09-21T00:17:06.936721+0000","last_active":"2023-09-21T00:17:10.952071+0000","last_peered":"2023-09-21T00:17:10.952071+0000","last_clean":"2023-09-21T00:17:10.952071+0000","last_became_active":"2023-09-21T00:17:06.936421+0000","last_became_peered":"2023-09-21T00:17:06.936421+0000","last_unstale":"2023-09-21T00:17:10.952071+0000","last_undegraded":"2023-09-21T00:17:10.952071+0000","last_fullsized":"2023-09-21T00:17:10.952071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:28:34.014683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.955164+0000","last_change":"2023-09-21T00:17:10.974427+0000","last_active":"2023-09-21T00:17:11.955164+0000","last_peered":"2023-09-21T00:17:11.955164+0000","last_clean":"2023-09-21T00:17:11.955164+0000","last_became_active":"2023-09-21T00:17:10.973986+0000","last_became_peered":"2023-09-21T00:17:10.973986+0000","last_unstale":"2023-09-21T00:17:11.955164+0000","last_undegraded":"2023-09-21T00:17:11.955164+0000","last_fullsized":"2023-09-21T00:17:11.955164+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:48:02.628848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.968204+0000","last_change":"2023-09-21T00:17:05.920076+0000","last_active":"2023-09-21T00:17:10.968204+0000","last_peered":"2023-09-21T00:17:10.968204+0000","last_clean":"2023-09-21T00:17:10.968204+0000","last_became_active":"2023-09-21T00:17:05.919755+0000","last_became_peered":"2023-09-21T00:17:05.919755+0000","last_unstale":"2023-09-21T00:17:10.968204+0000","last_undegraded":"2023-09-21T00:17:10.968204+0000","last_fullsized":"2023-09-21T00:17:10.968204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T07:24:34.111510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952901+0000","last_change":"2023-09-21T00:17:06.944470+0000","last_active":"2023-09-21T00:17:10.952901+0000","last_peered":"2023-09-21T00:17:10.952901+0000","last_clean":"2023-09-21T00:17:10.952901+0000","last_became_active":"2023-09-21T00:17:06.944166+0000","last_became_peered":"2023-09-21T00:17:06.944166+0000","last_unstale":"2023-09-21T00:17:10.952901+0000","last_undegraded":"2023-09-21T00:17:10.952901+0000","last_fullsized":"2023-09-21T00:17:10.952901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T12:07:09.891729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.955249+0000","last_change":"2023-09-21T00:17:10.970352+0000","last_active":"2023-09-21T00:17:11.955249+0000","last_peered":"2023-09-21T00:17:11.955249+0000","last_clean":"2023-09-21T00:17:11.955249+0000","last_became_active":"2023-09-21T00:17:10.969785+0000","last_became_peered":"2023-09-21T00:17:10.969785+0000","last_unstale":"2023-09-21T00:17:11.955249+0000","last_undegraded":"2023-09-21T00:17:11.955249+0000","last_fullsized":"2023-09-21T00:17:11.955249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:45:46.074093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.140070+0000","last_change":"2023-09-21T00:17:05.925648+0000","last_active":"2023-09-21T00:17:11.140070+0000","last_peered":"2023-09-21T00:17:11.140070+0000","last_clean":"2023-09-21T00:17:11.140070+0000","last_became_active":"2023-09-21T00:17:05.925319+0000","last_became_peered":"2023-09-21T00:17:05.925319+0000","last_unstale":"2023-09-21T00:17:11.140070+0000","last_undegraded":"2023-09-21T00:17:11.140070+0000","last_fullsized":"2023-09-21T00:17:11.140070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:01:37.682581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.953404+0000","last_change":"2023-09-21T00:17:06.931298+0000","last_active":"2023-09-21T00:17:10.953404+0000","last_peered":"2023-09-21T00:17:10.953404+0000","last_clean":"2023-09-21T00:17:10.953404+0000","last_became_active":"2023-09-21T00:17:06.931014+0000","last_became_peered":"2023-09-21T00:17:06.931014+0000","last_unstale":"2023-09-21T00:17:10.953404+0000","last_undegraded":"2023-09-21T00:17:10.953404+0000","last_fullsized":"2023-09-21T00:17:10.953404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:12:52.515384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.242802+0000","last_change":"2023-09-21T00:17:11.139811+0000","last_active":"2023-09-21T00:17:12.242802+0000","last_peered":"2023-09-21T00:17:12.242802+0000","last_clean":"2023-09-21T00:17:12.242802+0000","last_became_active":"2023-09-21T00:17:11.139325+0000","last_became_peered":"2023-09-21T00:17:11.139325+0000","last_unstale":"2023-09-21T00:17:12.242802+0000","last_undegraded":"2023-09-21T00:17:12.242802+0000","last_fullsized":"2023-09-21T00:17:12.242802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T02:36:22.620663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.967086+0000","last_change":"2023-09-21T00:17:05.920539+0000","last_active":"2023-09-21T00:17:10.967086+0000","last_peered":"2023-09-21T00:17:10.967086+0000","last_clean":"2023-09-21T00:17:10.967086+0000","last_became_active":"2023-09-21T00:17:05.920322+0000","last_became_peered":"2023-09-21T00:17:05.920322+0000","last_unstale":"2023-09-21T00:17:10.967086+0000","last_undegraded":"2023-09-21T00:17:10.967086+0000","last_fullsized":"2023-09-21T00:17:10.967086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:05:24.892446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.139033+0000","last_change":"2023-09-21T00:17:06.948781+0000","last_active":"2023-09-21T00:17:11.139033+0000","last_peered":"2023-09-21T00:17:11.139033+0000","last_clean":"2023-09-21T00:17:11.139033+0000","last_became_active":"2023-09-21T00:17:06.948444+0000","last_became_peered":"2023-09-21T00:17:06.948444+0000","last_unstale":"2023-09-21T00:17:11.139033+0000","last_undegraded":"2023-09-21T00:17:11.139033+0000","last_fullsized":"2023-09-21T00:17:11.139033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:28:47.396022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.242087+0000","last_change":"2023-09-21T00:17:10.975994+0000","last_active":"2023-09-21T00:17:12.242087+0000","last_peered":"2023-09-21T00:17:12.242087+0000","last_clean":"2023-09-21T00:17:12.242087+0000","last_became_active":"2023-09-21T00:17:10.975468+0000","last_became_peered":"2023-09-21T00:17:10.975468+0000","last_unstale":"2023-09-21T00:17:12.242087+0000","last_undegraded":"2023-09-21T00:17:12.242087+0000","last_fullsized":"2023-09-21T00:17:12.242087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:34:06.133170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.971145+0000","last_change":"2023-09-21T00:17:05.921232+0000","last_active":"2023-09-21T00:17:10.971145+0000","last_peered":"2023-09-21T00:17:10.971145+0000","last_clean":"2023-09-21T00:17:10.971145+0000","last_became_active":"2023-09-21T00:17:05.920883+0000","last_became_peered":"2023-09-21T00:17:05.920883+0000","last_unstale":"2023-09-21T00:17:10.971145+0000","last_undegraded":"2023-09-21T00:17:10.971145+0000","last_fullsized":"2023-09-21T00:17:10.971145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:56:48.483420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963842+0000","last_change":"2023-09-21T00:17:06.949150+0000","last_active":"2023-09-21T00:17:10.963842+0000","last_peered":"2023-09-21T00:17:10.963842+0000","last_clean":"2023-09-21T00:17:10.963842+0000","last_became_active":"2023-09-21T00:17:06.948425+0000","last_became_peered":"2023-09-21T00:17:06.948425+0000","last_unstale":"2023-09-21T00:17:10.963842+0000","last_undegraded":"2023-09-21T00:17:10.963842+0000","last_fullsized":"2023-09-21T00:17:10.963842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:45:42.036094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.242401+0000","last_change":"2023-09-21T00:17:11.139787+0000","last_active":"2023-09-21T00:17:12.242401+0000","last_peered":"2023-09-21T00:17:12.242401+0000","last_clean":"2023-09-21T00:17:12.242401+0000","last_became_active":"2023-09-21T00:17:11.139473+0000","last_became_peered":"2023-09-21T00:17:11.139473+0000","last_unstale":"2023-09-21T00:17:12.242401+0000","last_undegraded":"2023-09-21T00:17:12.242401+0000","last_fullsized":"2023-09-21T00:17:12.242401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:38:17.728778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.967627+0000","last_change":"2023-09-21T00:17:05.919490+0000","last_active":"2023-09-21T00:17:10.967627+0000","last_peered":"2023-09-21T00:17:10.967627+0000","last_clean":"2023-09-21T00:17:10.967627+0000","last_became_active":"2023-09-21T00:17:05.919182+0000","last_became_peered":"2023-09-21T00:17:05.919182+0000","last_unstale":"2023-09-21T00:17:10.967627+0000","last_undegraded":"2023-09-21T00:17:10.967627+0000","last_fullsized":"2023-09-21T00:17:10.967627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T12:05:24.959728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.140401+0000","last_change":"2023-09-21T00:17:06.947423+0000","last_active":"2023-09-21T00:17:11.140401+0000","last_peered":"2023-09-21T00:17:11.140401+0000","last_clean":"2023-09-21T00:17:11.140401+0000","last_became_active":"2023-09-21T00:17:06.947138+0000","last_became_peered":"2023-09-21T00:17:06.947138+0000","last_unstale":"2023-09-21T00:17:11.140401+0000","last_undegraded":"2023-09-21T00:17:11.140401+0000","last_fullsized":"2023-09-21T00:17:11.140401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:53:15.179754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952567+0000","last_change":"2023-09-21T00:17:06.935110+0000","last_active":"2023-09-21T00:17:10.952567+0000","last_peered":"2023-09-21T00:17:10.952567+0000","last_clean":"2023-09-21T00:17:10.952567+0000","last_became_active":"2023-09-21T00:17:06.934658+0000","last_became_peered":"2023-09-21T00:17:06.934658+0000","last_unstale":"2023-09-21T00:17:10.952567+0000","last_undegraded":"2023-09-21T00:17:10.952567+0000","last_fullsized":"2023-09-21T00:17:10.952567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:17:22.988451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.966596+0000","last_change":"2023-09-21T00:17:06.947131+0000","last_active":"2023-09-21T00:17:10.966596+0000","last_peered":"2023-09-21T00:17:10.966596+0000","last_clean":"2023-09-21T00:17:10.966596+0000","last_became_active":"2023-09-21T00:17:06.946817+0000","last_became_peered":"2023-09-21T00:17:06.946817+0000","last_unstale":"2023-09-21T00:17:10.966596+0000","last_undegraded":"2023-09-21T00:17:10.966596+0000","last_fullsized":"2023-09-21T00:17:10.966596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:43:07.604113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963724+0000","last_change":"2023-09-21T00:17:06.950723+0000","last_active":"2023-09-21T00:17:10.963724+0000","last_peered":"2023-09-21T00:17:10.963724+0000","last_clean":"2023-09-21T00:17:10.963724+0000","last_became_active":"2023-09-21T00:17:06.950464+0000","last_became_peered":"2023-09-21T00:17:06.950464+0000","last_unstale":"2023-09-21T00:17:10.963724+0000","last_undegraded":"2023-09-21T00:17:10.963724+0000","last_fullsized":"2023-09-21T00:17:10.963724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:31:49.356708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.960636+0000","last_change":"2023-09-21T00:17:06.931583+0000","last_active":"2023-09-21T00:17:10.960636+0000","last_peered":"2023-09-21T00:17:10.960636+0000","last_clean":"2023-09-21T00:17:10.960636+0000","last_became_active":"2023-09-21T00:17:06.931288+0000","last_became_peered":"2023-09-21T00:17:06.931288+0000","last_unstale":"2023-09-21T00:17:10.960636+0000","last_undegraded":"2023-09-21T00:17:10.960636+0000","last_fullsized":"2023-09-21T00:17:10.960636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:16:31.202329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952778+0000","last_change":"2023-09-21T00:17:06.935897+0000","last_active":"2023-09-21T00:17:10.952778+0000","last_peered":"2023-09-21T00:17:10.952778+0000","last_clean":"2023-09-21T00:17:10.952778+0000","last_became_active":"2023-09-21T00:17:06.934839+0000","last_became_peered":"2023-09-21T00:17:06.934839+0000","last_unstale":"2023-09-21T00:17:10.952778+0000","last_undegraded":"2023-09-21T00:17:10.952778+0000","last_fullsized":"2023-09-21T00:17:10.952778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:44:31.363217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.971043+0000","last_change":"2023-09-21T00:17:06.938775+0000","last_active":"2023-09-21T00:17:10.971043+0000","last_peered":"2023-09-21T00:17:10.971043+0000","last_clean":"2023-09-21T00:17:10.971043+0000","last_became_active":"2023-09-21T00:17:06.938299+0000","last_became_peered":"2023-09-21T00:17:06.938299+0000","last_unstale":"2023-09-21T00:17:10.971043+0000","last_undegraded":"2023-09-21T00:17:10.971043+0000","last_fullsized":"2023-09-21T00:17:10.971043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:33:02.098745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.953339+0000","last_change":"2023-09-21T00:17:06.936698+0000","last_active":"2023-09-21T00:17:10.953339+0000","last_peered":"2023-09-21T00:17:10.953339+0000","last_clean":"2023-09-21T00:17:10.953339+0000","last_became_active":"2023-09-21T00:17:06.936405+0000","last_became_peered":"2023-09-21T00:17:06.936405+0000","last_unstale":"2023-09-21T00:17:10.953339+0000","last_undegraded":"2023-09-21T00:17:10.953339+0000","last_fullsized":"2023-09-21T00:17:10.953339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:34:25.102514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.953420+0000","last_change":"2023-09-21T00:17:06.934511+0000","last_active":"2023-09-21T00:17:10.953420+0000","last_peered":"2023-09-21T00:17:10.953420+0000","last_clean":"2023-09-21T00:17:10.953420+0000","last_became_active":"2023-09-21T00:17:06.934142+0000","last_became_peered":"2023-09-21T00:17:06.934142+0000","last_unstale":"2023-09-21T00:17:10.953420+0000","last_undegraded":"2023-09-21T00:17:10.953420+0000","last_fullsized":"2023-09-21T00:17:10.953420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:34:25.102514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963582+0000","last_change":"2023-09-21T00:17:06.948765+0000","last_active":"2023-09-21T00:17:10.963582+0000","last_peered":"2023-09-21T00:17:10.963582+0000","last_clean":"2023-09-21T00:17:10.963582+0000","last_became_active":"2023-09-21T00:17:06.948437+0000","last_became_peered":"2023-09-21T00:17:06.948437+0000","last_unstale":"2023-09-21T00:17:10.963582+0000","last_undegraded":"2023-09-21T00:17:10.963582+0000","last_fullsized":"2023-09-21T00:17:10.963582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T11:15:08.495079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952376+0000","last_change":"2023-09-21T00:17:06.934818+0000","last_active":"2023-09-21T00:17:10.952376+0000","last_peered":"2023-09-21T00:17:10.952376+0000","last_clean":"2023-09-21T00:17:10.952376+0000","last_became_active":"2023-09-21T00:17:06.934520+0000","last_became_peered":"2023-09-21T00:17:06.934520+0000","last_unstale":"2023-09-21T00:17:10.952376+0000","last_undegraded":"2023-09-21T00:17:10.952376+0000","last_fullsized":"2023-09-21T00:17:10.952376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:30:26.002264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963843+0000","last_change":"2023-09-21T00:17:06.947489+0000","last_active":"2023-09-21T00:17:10.963843+0000","last_peered":"2023-09-21T00:17:10.963843+0000","last_clean":"2023-09-21T00:17:10.963843+0000","last_became_active":"2023-09-21T00:17:06.947209+0000","last_became_peered":"2023-09-21T00:17:06.947209+0000","last_unstale":"2023-09-21T00:17:10.963843+0000","last_undegraded":"2023-09-21T00:17:10.963843+0000","last_fullsized":"2023-09-21T00:17:10.963843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:41:27.691190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.960736+0000","last_change":"2023-09-21T00:17:06.938924+0000","last_active":"2023-09-21T00:17:10.960736+0000","last_peered":"2023-09-21T00:17:10.960736+0000","last_clean":"2023-09-21T00:17:10.960736+0000","last_became_active":"2023-09-21T00:17:06.938643+0000","last_became_peered":"2023-09-21T00:17:06.938643+0000","last_unstale":"2023-09-21T00:17:10.960736+0000","last_undegraded":"2023-09-21T00:17:10.960736+0000","last_fullsized":"2023-09-21T00:17:10.960736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:34:25.102514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.953697+0000","last_change":"2023-09-21T00:17:06.931839+0000","last_active":"2023-09-21T00:17:10.953697+0000","last_peered":"2023-09-21T00:17:10.953697+0000","last_clean":"2023-09-21T00:17:10.953697+0000","last_became_active":"2023-09-21T00:17:06.931573+0000","last_became_peered":"2023-09-21T00:17:06.931573+0000","last_unstale":"2023-09-21T00:17:10.953697+0000","last_undegraded":"2023-09-21T00:17:10.953697+0000","last_fullsized":"2023-09-21T00:17:10.953697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:16:31.202329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":690786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-21T00:17:36.010 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-21T00:17:36.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.167+0000 7f8b557a1700 1 Processor -- start 2023-09-21T00:17:36.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.167+0000 7f8b557a1700 1 -- start start 2023-09-21T00:17:36.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.168+0000 7f8b557a1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b5015e950 0x7f8b500cd630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:36.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.168+0000 7f8b557a1700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8b5006f100 0x7f8b5015ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:36.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.168+0000 7f8b557a1700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b500708d0 con 0x7f8b50070d60 2023-09-21T00:17:36.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.168+0000 7f8b557a1700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b500d0ca0 con 0x7f8b5006f100 2023-09-21T00:17:36.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.168+0000 7f8b557a1700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5015ed30 con 0x7f8b5015e950 2023-09-21T00:17:36.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.168+0000 7f8b4effd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b5015e950 0x7f8b500cd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:36.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.168+0000 7f8b4effd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b5015e950 0x7f8b500cd630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.59:52440/0 (socket says 172.21.15.59:52440) 2023-09-21T00:17:36.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.168+0000 7f8b4f7fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8b5006f100 0x7f8b5015ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:36.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.168+0000 7f8b4effd700 1 -- 172.21.15.59:0/2646207266 learned_addr learned my addr 172.21.15.59:0/2646207266 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:36.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.168+0000 7f8b4effd700 1 -- 172.21.15.59:0/2646207266 >> v2:172.21.15.83:3300/0 conn(0x7f8b5006f100 msgr2=0x7f8b5015ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:36.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.168+0000 7f8b4effd700 1 --2- 172.21.15.59:0/2646207266 >> v2:172.21.15.83:3300/0 conn(0x7f8b5006f100 0x7f8b5015ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:36.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.169+0000 7f8b4effd700 1 -- 172.21.15.59:0/2646207266 >> v1:172.21.15.83:6789/0 conn(0x7f8b50070d60 legacy=0x7f8b5006e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:36.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.169+0000 7f8b4effd700 1 -- 172.21.15.59:0/2646207266 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b50070280 con 0x7f8b5015e950 2023-09-21T00:17:36.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.169+0000 7f8b4dffb700 1 -- 172.21.15.59:0/2646207266 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2262451732 0 0) 0x7f8b500708d0 con 0x7f8b50070d60 2023-09-21T00:17:36.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.169+0000 7f8b4f7fe700 1 --2- 172.21.15.59:0/2646207266 >> v2:172.21.15.83:3300/0 conn(0x7f8b5006f100 0x7f8b5015ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T00:17:36.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.169+0000 7f8b4effd700 1 --2- 172.21.15.59:0/2646207266 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b5015e950 0x7f8b500cd630 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8b440098f0 tx=0x7f8b44009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59946a785763d2d1 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:36.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.169+0000 7f8b4dffb700 1 -- 172.21.15.59:0/2646207266 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b44011830 con 0x7f8b5015e950 2023-09-21T00:17:36.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.169+0000 7f8b4dffb700 1 -- 172.21.15.59:0/2646207266 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b44011990 con 0x7f8b5015e950 2023-09-21T00:17:36.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.169+0000 7f8b4dffb700 1 -- 172.21.15.59:0/2646207266 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b44011d20 con 0x7f8b5015e950 2023-09-21T00:17:36.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.169+0000 7f8b557a1700 1 -- 172.21.15.59:0/2646207266 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b5015e950 msgr2=0x7f8b500cd630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:36.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.169+0000 7f8b557a1700 1 --2- 172.21.15.59:0/2646207266 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b5015e950 0x7f8b500cd630 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8b440098f0 tx=0x7f8b44009c00 comp rx=0 tx=0).stop 2023-09-21T00:17:36.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.169+0000 7f8b557a1700 1 -- 172.21.15.59:0/2646207266 shutdown_connections 2023-09-21T00:17:36.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.169+0000 7f8b557a1700 1 --2- 172.21.15.59:0/2646207266 >> v2:172.21.15.83:3300/0 conn(0x7f8b5006f100 0x7f8b5015ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:36.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.169+0000 7f8b557a1700 1 --2- 172.21.15.59:0/2646207266 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b5015e950 0x7f8b500cd630 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:36.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.169+0000 7f8b557a1700 1 -- 172.21.15.59:0/2646207266 >> 172.21.15.59:0/2646207266 conn(0x7f8b500d11e0 msgr2=0x7f8b500d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:36.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.170+0000 7f8b557a1700 1 -- 172.21.15.59:0/2646207266 shutdown_connections 2023-09-21T00:17:36.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.170+0000 7f8b557a1700 1 -- 172.21.15.59:0/2646207266 wait complete. 2023-09-21T00:17:36.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.171+0000 7f8b557a1700 1 Processor -- start 2023-09-21T00:17:36.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.171+0000 7f8b557a1700 1 -- start start 2023-09-21T00:17:36.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.172+0000 7f8b557a1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b5006f100 0x7f8b501587b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:36.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.172+0000 7f8b557a1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b50070d60 0x7f8b50153350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:36.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.172+0000 7f8b557a1700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b5015e950 0x7f8b5006b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:36.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.172+0000 7f8b557a1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5006cd00 con 0x7f8b50070d60 2023-09-21T00:17:36.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.172+0000 7f8b557a1700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b50153890 con 0x7f8b5015e950 2023-09-21T00:17:36.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.172+0000 7f8b557a1700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5006bdd0 con 0x7f8b5006f100 2023-09-21T00:17:36.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.172+0000 7f8b4e7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b50070d60 0x7f8b50153350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:36.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.172+0000 7f8b4e7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b50070d60 0x7f8b50153350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51832/0 (socket says 172.21.15.59:51832) 2023-09-21T00:17:36.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.172+0000 7f8b4e7fc700 1 -- 172.21.15.59:0/3288937229 learned_addr learned my addr 172.21.15.59:0/3288937229 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:36.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.172+0000 7f8b4effd700 1 --2- 172.21.15.59:0/3288937229 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b5006f100 0x7f8b501587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:36.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.172+0000 7f8b4f7fe700 1 --2- 172.21.15.59:0/3288937229 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b5015e950 0x7f8b5006b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:36.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.172+0000 7f8b4e7fc700 1 -- 172.21.15.59:0/3288937229 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b5006f100 msgr2=0x7f8b501587b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:36.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.172+0000 7f8b4e7fc700 1 --2- 172.21.15.59:0/3288937229 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b5006f100 0x7f8b501587b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:36.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.172+0000 7f8b4e7fc700 1 -- 172.21.15.59:0/3288937229 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b5015e950 msgr2=0x7f8b5006b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:36.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.172+0000 7f8b4e7fc700 1 --2- 172.21.15.59:0/3288937229 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b5015e950 0x7f8b5006b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:36.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.172+0000 7f8b4e7fc700 1 -- 172.21.15.59:0/3288937229 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b48009a70 con 0x7f8b50070d60 2023-09-21T00:17:36.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.172+0000 7f8b4e7fc700 1 --2- 172.21.15.59:0/3288937229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b50070d60 0x7f8b50153350 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8b400011e0 tx=0x7f8b4000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:36.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.172+0000 7f8b377fe700 1 -- 172.21.15.59:0/3288937229 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b400054e0 con 0x7f8b50070d60 2023-09-21T00:17:36.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.173+0000 7f8b377fe700 1 -- 172.21.15.59:0/3288937229 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b40003680 con 0x7f8b50070d60 2023-09-21T00:17:36.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.173+0000 7f8b557a1700 1 -- 172.21.15.59:0/3288937229 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b44009550 con 0x7f8b50070d60 2023-09-21T00:17:36.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.173+0000 7f8b377fe700 1 -- 172.21.15.59:0/3288937229 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b40003a30 con 0x7f8b50070d60 2023-09-21T00:17:36.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.173+0000 7f8b557a1700 1 -- 172.21.15.59:0/3288937229 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b5006c360 con 0x7f8b50070d60 2023-09-21T00:17:36.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.174+0000 7f8b557a1700 1 -- 172.21.15.59:0/3288937229 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b5006ce40 con 0x7f8b50070d60 2023-09-21T00:17:36.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.174+0000 7f8b377fe700 1 -- 172.21.15.59:0/3288937229 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f8b40003b90 con 0x7f8b50070d60 2023-09-21T00:17:36.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.175+0000 7f8b377fe700 1 --2- 172.21.15.59:0/3288937229 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f8b3c06ae00 0x7f8b3c06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:36.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.175+0000 7f8b377fe700 1 -- 172.21.15.59:0/3288937229 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8b40088c70 con 0x7f8b50070d60 2023-09-21T00:17:36.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.175+0000 7f8b4effd700 1 --2- 172.21.15.59:0/3288937229 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f8b3c06ae00 0x7f8b3c06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:36.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.175+0000 7f8b4effd700 1 --2- 172.21.15.59:0/3288937229 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f8b3c06ae00 0x7f8b3c06d2c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8b44014040 tx=0x7f8b44008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:36.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.179+0000 7f8b377fe700 1 -- 172.21.15.59:0/3288937229 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f8b40053aa0 con 0x7f8b50070d60 2023-09-21T00:17:36.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.376+0000 7f8b557a1700 1 -- 172.21.15.59:0/3288937229 --> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8b500d0f10 con 0x7f8b3c06ae00 2023-09-21T00:17:36.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.386+0000 7f8b377fe700 1 -- 172.21.15.59:0/3288937229 <== mgr.4103 v2:172.21.15.83:6832/1736808576 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345297 (secure 0 0 0) 0x7f8b44011b80 con 0x7f8b3c06ae00 2023-09-21T00:17:36.391 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:17:36.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.390+0000 7f8b557a1700 1 -- 172.21.15.59:0/3288937229 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f8b3c06ae00 msgr2=0x7f8b3c06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:36.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.390+0000 7f8b557a1700 1 --2- 172.21.15.59:0/3288937229 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f8b3c06ae00 0x7f8b3c06d2c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8b44014040 tx=0x7f8b44008030 comp rx=0 tx=0).stop 2023-09-21T00:17:36.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.390+0000 7f8b557a1700 1 -- 172.21.15.59:0/3288937229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b50070d60 msgr2=0x7f8b50153350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:36.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.390+0000 7f8b557a1700 1 --2- 172.21.15.59:0/3288937229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b50070d60 0x7f8b50153350 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8b400011e0 tx=0x7f8b4000ca30 comp rx=0 tx=0).stop 2023-09-21T00:17:36.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.390+0000 7f8b557a1700 1 -- 172.21.15.59:0/3288937229 shutdown_connections 2023-09-21T00:17:36.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.390+0000 7f8b557a1700 1 --2- 172.21.15.59:0/3288937229 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b5015e950 0x7f8b5006b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:36.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.390+0000 7f8b557a1700 1 --2- 172.21.15.59:0/3288937229 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f8b3c06ae00 0x7f8b3c06d2c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:36.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.390+0000 7f8b557a1700 1 --2- 172.21.15.59:0/3288937229 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8b5006f100 0x7f8b501587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:36.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.390+0000 7f8b557a1700 1 --2- 172.21.15.59:0/3288937229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b50070d60 0x7f8b50153350 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:36.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.390+0000 7f8b557a1700 1 -- 172.21.15.59:0/3288937229 >> 172.21.15.59:0/3288937229 conn(0x7f8b500d11e0 msgr2=0x7f8b5006e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:36.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.390+0000 7f8b557a1700 1 -- 172.21.15.59:0/3288937229 shutdown_connections 2023-09-21T00:17:36.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.390+0000 7f8b557a1700 1 -- 172.21.15.59:0/3288937229 wait complete. 2023-09-21T00:17:36.396 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2023-09-21T00:17:36.404 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2023-09-21T00:17:34.751661+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219368,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755352,"statfs":{"total":773094113280,"available":772869480448,"internally_reserved":0,"allocated":3284992,"data_stored":1988256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003307"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.140365+0000","last_change":"2023-09-21T00:17:06.944984+0000","last_active":"2023-09-21T00:17:11.140365+0000","last_peered":"2023-09-21T00:17:11.140365+0000","last_clean":"2023-09-21T00:17:11.140365+0000","last_became_active":"2023-09-21T00:17:06.944679+0000","last_became_peered":"2023-09-21T00:17:06.944679+0000","last_unstale":"2023-09-21T00:17:11.140365+0000","last_undegraded":"2023-09-21T00:17:11.140365+0000","last_fullsized":"2023-09-21T00:17:11.140365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T11:26:04.778746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.968438+0000","last_change":"2023-09-21T00:17:06.943812+0000","last_active":"2023-09-21T00:17:10.968438+0000","last_peered":"2023-09-21T00:17:10.968438+0000","last_clean":"2023-09-21T00:17:10.968438+0000","last_became_active":"2023-09-21T00:17:06.943477+0000","last_became_peered":"2023-09-21T00:17:06.943477+0000","last_unstale":"2023-09-21T00:17:10.968438+0000","last_undegraded":"2023-09-21T00:17:10.968438+0000","last_fullsized":"2023-09-21T00:17:10.968438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:34:25.102514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.966064+0000","last_change":"2023-09-21T00:17:06.937575+0000","last_active":"2023-09-21T00:17:10.966064+0000","last_peered":"2023-09-21T00:17:10.966064+0000","last_clean":"2023-09-21T00:17:10.966064+0000","last_became_active":"2023-09-21T00:17:06.937284+0000","last_became_peered":"2023-09-21T00:17:06.937284+0000","last_unstale":"2023-09-21T00:17:10.966064+0000","last_undegraded":"2023-09-21T00:17:10.966064+0000","last_fullsized":"2023-09-21T00:17:10.966064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:28:34.014683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963863+0000","last_change":"2023-09-21T00:17:06.949492+0000","last_active":"2023-09-21T00:17:10.963863+0000","last_peered":"2023-09-21T00:17:10.963863+0000","last_clean":"2023-09-21T00:17:10.963863+0000","last_became_active":"2023-09-21T00:17:06.948870+0000","last_became_peered":"2023-09-21T00:17:06.948870+0000","last_unstale":"2023-09-21T00:17:10.963863+0000","last_undegraded":"2023-09-21T00:17:10.963863+0000","last_fullsized":"2023-09-21T00:17:10.963863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T02:36:18.582664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.138593+0000","last_change":"2023-09-21T00:17:06.938470+0000","last_active":"2023-09-21T00:17:11.138593+0000","last_peered":"2023-09-21T00:17:11.138593+0000","last_clean":"2023-09-21T00:17:11.138593+0000","last_became_active":"2023-09-21T00:17:06.938081+0000","last_became_peered":"2023-09-21T00:17:06.938081+0000","last_unstale":"2023-09-21T00:17:11.138593+0000","last_undegraded":"2023-09-21T00:17:11.138593+0000","last_fullsized":"2023-09-21T00:17:11.138593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:11:37.302773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963823+0000","last_change":"2023-09-21T00:17:06.956095+0000","last_active":"2023-09-21T00:17:10.963823+0000","last_peered":"2023-09-21T00:17:10.963823+0000","last_clean":"2023-09-21T00:17:10.963823+0000","last_became_active":"2023-09-21T00:17:06.955148+0000","last_became_peered":"2023-09-21T00:17:06.955148+0000","last_unstale":"2023-09-21T00:17:10.963823+0000","last_undegraded":"2023-09-21T00:17:10.963823+0000","last_fullsized":"2023-09-21T00:17:10.963823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:11:37.302773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.138460+0000","last_change":"2023-09-21T00:17:06.952598+0000","last_active":"2023-09-21T00:17:11.138460+0000","last_peered":"2023-09-21T00:17:11.138460+0000","last_clean":"2023-09-21T00:17:11.138460+0000","last_became_active":"2023-09-21T00:17:06.951582+0000","last_became_peered":"2023-09-21T00:17:06.951582+0000","last_unstale":"2023-09-21T00:17:11.138460+0000","last_undegraded":"2023-09-21T00:17:11.138460+0000","last_fullsized":"2023-09-21T00:17:11.138460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:31:49.356708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.953276+0000","last_change":"2023-09-21T00:17:06.946327+0000","last_active":"2023-09-21T00:17:10.953276+0000","last_peered":"2023-09-21T00:17:10.953276+0000","last_clean":"2023-09-21T00:17:10.953276+0000","last_became_active":"2023-09-21T00:17:06.946035+0000","last_became_peered":"2023-09-21T00:17:06.946035+0000","last_unstale":"2023-09-21T00:17:10.953276+0000","last_undegraded":"2023-09-21T00:17:10.953276+0000","last_fullsized":"2023-09-21T00:17:10.953276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:10:02.229896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.140297+0000","last_change":"2023-09-21T00:17:06.949895+0000","last_active":"2023-09-21T00:17:11.140297+0000","last_peered":"2023-09-21T00:17:11.140297+0000","last_clean":"2023-09-21T00:17:11.140297+0000","last_became_active":"2023-09-21T00:17:06.949445+0000","last_became_peered":"2023-09-21T00:17:06.949445+0000","last_unstale":"2023-09-21T00:17:11.140297+0000","last_undegraded":"2023-09-21T00:17:11.140297+0000","last_fullsized":"2023-09-21T00:17:11.140297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:14:40.821557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.953209+0000","last_change":"2023-09-21T00:17:06.949062+0000","last_active":"2023-09-21T00:17:10.953209+0000","last_peered":"2023-09-21T00:17:10.953209+0000","last_clean":"2023-09-21T00:17:10.953209+0000","last_became_active":"2023-09-21T00:17:06.948581+0000","last_became_peered":"2023-09-21T00:17:06.948581+0000","last_unstale":"2023-09-21T00:17:10.953209+0000","last_undegraded":"2023-09-21T00:17:10.953209+0000","last_fullsized":"2023-09-21T00:17:10.953209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:33:02.098745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.955518+0000","last_change":"2023-09-21T00:17:06.947733+0000","last_active":"2023-09-21T00:17:10.955518+0000","last_peered":"2023-09-21T00:17:10.955518+0000","last_clean":"2023-09-21T00:17:10.955518+0000","last_became_active":"2023-09-21T00:17:06.947437+0000","last_became_peered":"2023-09-21T00:17:06.947437+0000","last_unstale":"2023-09-21T00:17:10.955518+0000","last_undegraded":"2023-09-21T00:17:10.955518+0000","last_fullsized":"2023-09-21T00:17:10.955518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:28:34.014683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.955972+0000","last_change":"2023-09-21T00:17:06.936684+0000","last_active":"2023-09-21T00:17:10.955972+0000","last_peered":"2023-09-21T00:17:10.955972+0000","last_clean":"2023-09-21T00:17:10.955972+0000","last_became_active":"2023-09-21T00:17:06.936417+0000","last_became_peered":"2023-09-21T00:17:06.936417+0000","last_unstale":"2023-09-21T00:17:10.955972+0000","last_undegraded":"2023-09-21T00:17:10.955972+0000","last_fullsized":"2023-09-21T00:17:10.955972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:53:27.597756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952565+0000","last_change":"2023-09-21T00:17:06.934467+0000","last_active":"2023-09-21T00:17:10.952565+0000","last_peered":"2023-09-21T00:17:10.952565+0000","last_clean":"2023-09-21T00:17:10.952565+0000","last_became_active":"2023-09-21T00:17:06.934042+0000","last_became_peered":"2023-09-21T00:17:06.934042+0000","last_unstale":"2023-09-21T00:17:10.952565+0000","last_undegraded":"2023-09-21T00:17:10.952565+0000","last_fullsized":"2023-09-21T00:17:10.952565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:17:22.988451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.960993+0000","last_change":"2023-09-21T00:17:06.933643+0000","last_active":"2023-09-21T00:17:10.960993+0000","last_peered":"2023-09-21T00:17:10.960993+0000","last_clean":"2023-09-21T00:17:10.960993+0000","last_became_active":"2023-09-21T00:17:06.933143+0000","last_became_peered":"2023-09-21T00:17:06.933143+0000","last_unstale":"2023-09-21T00:17:10.960993+0000","last_undegraded":"2023-09-21T00:17:10.960993+0000","last_fullsized":"2023-09-21T00:17:10.960993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:30:26.002264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.966806+0000","last_change":"2023-09-21T00:17:06.932408+0000","last_active":"2023-09-21T00:17:10.966806+0000","last_peered":"2023-09-21T00:17:10.966806+0000","last_clean":"2023-09-21T00:17:10.966806+0000","last_became_active":"2023-09-21T00:17:06.932137+0000","last_became_peered":"2023-09-21T00:17:06.932137+0000","last_unstale":"2023-09-21T00:17:10.966806+0000","last_undegraded":"2023-09-21T00:17:10.966806+0000","last_fullsized":"2023-09-21T00:17:10.966806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:28:34.014683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963484+0000","last_change":"2023-09-21T00:17:06.955886+0000","last_active":"2023-09-21T00:17:10.963484+0000","last_peered":"2023-09-21T00:17:10.963484+0000","last_clean":"2023-09-21T00:17:10.963484+0000","last_became_active":"2023-09-21T00:17:06.955591+0000","last_became_peered":"2023-09-21T00:17:06.955591+0000","last_unstale":"2023-09-21T00:17:10.963484+0000","last_undegraded":"2023-09-21T00:17:10.963484+0000","last_fullsized":"2023-09-21T00:17:10.963484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:34:25.102514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.964176+0000","last_change":"2023-09-21T00:17:06.947508+0000","last_active":"2023-09-21T00:17:10.964176+0000","last_peered":"2023-09-21T00:17:10.964176+0000","last_clean":"2023-09-21T00:17:10.964176+0000","last_became_active":"2023-09-21T00:17:06.947132+0000","last_became_peered":"2023-09-21T00:17:06.947132+0000","last_unstale":"2023-09-21T00:17:10.964176+0000","last_undegraded":"2023-09-21T00:17:10.964176+0000","last_fullsized":"2023-09-21T00:17:10.964176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:34:02.095171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.967783+0000","last_change":"2023-09-21T00:17:06.943217+0000","last_active":"2023-09-21T00:17:10.967783+0000","last_peered":"2023-09-21T00:17:10.967783+0000","last_clean":"2023-09-21T00:17:10.967783+0000","last_became_active":"2023-09-21T00:17:06.942936+0000","last_became_peered":"2023-09-21T00:17:06.942936+0000","last_unstale":"2023-09-21T00:17:10.967783+0000","last_undegraded":"2023-09-21T00:17:10.967783+0000","last_fullsized":"2023-09-21T00:17:10.967783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:53:27.597756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.140089+0000","last_change":"2023-09-21T00:17:06.940613+0000","last_active":"2023-09-21T00:17:11.140089+0000","last_peered":"2023-09-21T00:17:11.140089+0000","last_clean":"2023-09-21T00:17:11.140089+0000","last_became_active":"2023-09-21T00:17:06.939452+0000","last_became_peered":"2023-09-21T00:17:06.939452+0000","last_unstale":"2023-09-21T00:17:11.140089+0000","last_undegraded":"2023-09-21T00:17:11.140089+0000","last_fullsized":"2023-09-21T00:17:11.140089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:45:42.036094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.955621+0000","last_change":"2023-09-21T00:17:11.145149+0000","last_active":"2023-09-21T00:17:11.955621+0000","last_peered":"2023-09-21T00:17:11.955621+0000","last_clean":"2023-09-21T00:17:11.955621+0000","last_became_active":"2023-09-21T00:17:11.144318+0000","last_became_peered":"2023-09-21T00:17:11.144318+0000","last_unstale":"2023-09-21T00:17:11.955621+0000","last_undegraded":"2023-09-21T00:17:11.955621+0000","last_fullsized":"2023-09-21T00:17:11.955621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:46:38.332564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.961534+0000","last_change":"2023-09-21T00:17:05.926207+0000","last_active":"2023-09-21T00:17:10.961534+0000","last_peered":"2023-09-21T00:17:10.961534+0000","last_clean":"2023-09-21T00:17:10.961534+0000","last_became_active":"2023-09-21T00:17:05.925963+0000","last_became_peered":"2023-09-21T00:17:05.925963+0000","last_unstale":"2023-09-21T00:17:10.961534+0000","last_undegraded":"2023-09-21T00:17:10.961534+0000","last_fullsized":"2023-09-21T00:17:10.961534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:53:26.593335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952921+0000","last_change":"2023-09-21T00:17:06.935708+0000","last_active":"2023-09-21T00:17:10.952921+0000","last_peered":"2023-09-21T00:17:10.952921+0000","last_clean":"2023-09-21T00:17:10.952921+0000","last_became_active":"2023-09-21T00:17:06.935402+0000","last_became_peered":"2023-09-21T00:17:06.935402+0000","last_unstale":"2023-09-21T00:17:10.952921+0000","last_undegraded":"2023-09-21T00:17:10.952921+0000","last_fullsized":"2023-09-21T00:17:10.952921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:33:02.098745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.954136+0000","last_change":"2023-09-21T00:17:10.975756+0000","last_active":"2023-09-21T00:17:11.954136+0000","last_peered":"2023-09-21T00:17:11.954136+0000","last_clean":"2023-09-21T00:17:11.954136+0000","last_became_active":"2023-09-21T00:17:10.975403+0000","last_became_peered":"2023-09-21T00:17:10.975403+0000","last_unstale":"2023-09-21T00:17:11.954136+0000","last_undegraded":"2023-09-21T00:17:11.954136+0000","last_fullsized":"2023-09-21T00:17:11.954136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:44:35.401217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.953050+0000","last_change":"2023-09-21T00:17:05.928089+0000","last_active":"2023-09-21T00:17:10.953050+0000","last_peered":"2023-09-21T00:17:10.953050+0000","last_clean":"2023-09-21T00:17:10.953050+0000","last_became_active":"2023-09-21T00:17:05.927587+0000","last_became_peered":"2023-09-21T00:17:05.927587+0000","last_unstale":"2023-09-21T00:17:10.953050+0000","last_undegraded":"2023-09-21T00:17:10.953050+0000","last_fullsized":"2023-09-21T00:17:10.953050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T10:25:25.504437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.961320+0000","last_change":"2023-09-21T00:17:06.950961+0000","last_active":"2023-09-21T00:17:10.961320+0000","last_peered":"2023-09-21T00:17:10.961320+0000","last_clean":"2023-09-21T00:17:10.961320+0000","last_became_active":"2023-09-21T00:17:06.949285+0000","last_became_peered":"2023-09-21T00:17:06.949285+0000","last_unstale":"2023-09-21T00:17:10.961320+0000","last_undegraded":"2023-09-21T00:17:10.961320+0000","last_fullsized":"2023-09-21T00:17:10.961320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:10:02.229896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.954346+0000","last_change":"2023-09-21T00:17:10.976031+0000","last_active":"2023-09-21T00:17:11.954346+0000","last_peered":"2023-09-21T00:17:11.954346+0000","last_clean":"2023-09-21T00:17:11.954346+0000","last_became_active":"2023-09-21T00:17:10.975600+0000","last_became_peered":"2023-09-21T00:17:10.975600+0000","last_unstale":"2023-09-21T00:17:11.954346+0000","last_undegraded":"2023-09-21T00:17:11.954346+0000","last_fullsized":"2023-09-21T00:17:11.954346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:41:31.729189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.139027+0000","last_change":"2023-09-21T00:17:05.933223+0000","last_active":"2023-09-21T00:17:11.139027+0000","last_peered":"2023-09-21T00:17:11.139027+0000","last_clean":"2023-09-21T00:17:11.139027+0000","last_became_active":"2023-09-21T00:17:05.932282+0000","last_became_peered":"2023-09-21T00:17:05.932282+0000","last_unstale":"2023-09-21T00:17:11.139027+0000","last_undegraded":"2023-09-21T00:17:11.139027+0000","last_fullsized":"2023-09-21T00:17:11.139027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:16:30.197907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963765+0000","last_change":"2023-09-21T00:17:06.955597+0000","last_active":"2023-09-21T00:17:10.963765+0000","last_peered":"2023-09-21T00:17:10.963765+0000","last_clean":"2023-09-21T00:17:10.963765+0000","last_became_active":"2023-09-21T00:17:06.955247+0000","last_became_peered":"2023-09-21T00:17:06.955247+0000","last_unstale":"2023-09-21T00:17:10.963765+0000","last_undegraded":"2023-09-21T00:17:10.963765+0000","last_fullsized":"2023-09-21T00:17:10.963765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:44:31.363217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.954336+0000","last_change":"2023-09-21T00:17:10.969390+0000","last_active":"2023-09-21T00:17:11.954336+0000","last_peered":"2023-09-21T00:17:11.954336+0000","last_clean":"2023-09-21T00:17:11.954336+0000","last_became_active":"2023-09-21T00:17:10.969005+0000","last_became_peered":"2023-09-21T00:17:10.969005+0000","last_unstale":"2023-09-21T00:17:11.954336+0000","last_undegraded":"2023-09-21T00:17:11.954336+0000","last_fullsized":"2023-09-21T00:17:11.954336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:31:53.394708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.138610+0000","last_change":"2023-09-21T00:17:05.930194+0000","last_active":"2023-09-21T00:17:11.138610+0000","last_peered":"2023-09-21T00:17:11.138610+0000","last_clean":"2023-09-21T00:17:11.138610+0000","last_became_active":"2023-09-21T00:17:05.929856+0000","last_became_peered":"2023-09-21T00:17:05.929856+0000","last_unstale":"2023-09-21T00:17:11.138610+0000","last_undegraded":"2023-09-21T00:17:11.138610+0000","last_fullsized":"2023-09-21T00:17:11.138610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:53:26.593335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963977+0000","last_change":"2023-09-21T00:17:06.955503+0000","last_active":"2023-09-21T00:17:10.963977+0000","last_peered":"2023-09-21T00:17:10.963977+0000","last_clean":"2023-09-21T00:17:10.963977+0000","last_became_active":"2023-09-21T00:17:06.955193+0000","last_became_peered":"2023-09-21T00:17:06.955193+0000","last_unstale":"2023-09-21T00:17:10.963977+0000","last_undegraded":"2023-09-21T00:17:10.963977+0000","last_fullsized":"2023-09-21T00:17:10.963977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:47:58.590848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.955144+0000","last_change":"2023-09-21T00:17:10.973678+0000","last_active":"2023-09-21T00:17:11.955144+0000","last_peered":"2023-09-21T00:17:11.955144+0000","last_clean":"2023-09-21T00:17:11.955144+0000","last_became_active":"2023-09-21T00:17:10.973186+0000","last_became_peered":"2023-09-21T00:17:10.973186+0000","last_unstale":"2023-09-21T00:17:11.955144+0000","last_undegraded":"2023-09-21T00:17:11.955144+0000","last_fullsized":"2023-09-21T00:17:11.955144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:59:04.499583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952784+0000","last_change":"2023-09-21T00:17:05.925297+0000","last_active":"2023-09-21T00:17:10.952784+0000","last_peered":"2023-09-21T00:17:10.952784+0000","last_clean":"2023-09-21T00:17:10.952784+0000","last_became_active":"2023-09-21T00:17:05.924818+0000","last_became_peered":"2023-09-21T00:17:05.924818+0000","last_unstale":"2023-09-21T00:17:10.952784+0000","last_undegraded":"2023-09-21T00:17:10.952784+0000","last_fullsized":"2023-09-21T00:17:10.952784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:43:06.599691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.954797+0000","last_change":"2023-09-21T00:17:06.937094+0000","last_active":"2023-09-21T00:17:10.954797+0000","last_peered":"2023-09-21T00:17:10.954797+0000","last_clean":"2023-09-21T00:17:10.954797+0000","last_became_active":"2023-09-21T00:17:06.936793+0000","last_became_peered":"2023-09-21T00:17:06.936793+0000","last_unstale":"2023-09-21T00:17:10.954797+0000","last_undegraded":"2023-09-21T00:17:10.954797+0000","last_fullsized":"2023-09-21T00:17:10.954797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:36:18.989655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.954628+0000","last_change":"2023-09-21T00:17:10.979361+0000","last_active":"2023-09-21T00:17:11.954628+0000","last_peered":"2023-09-21T00:17:11.954628+0000","last_clean":"2023-09-21T00:17:11.954628+0000","last_became_active":"2023-09-21T00:17:10.978911+0000","last_became_peered":"2023-09-21T00:17:10.978911+0000","last_unstale":"2023-09-21T00:17:11.954628+0000","last_undegraded":"2023-09-21T00:17:11.954628+0000","last_fullsized":"2023-09-21T00:17:11.954628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:12:56.553383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.953305+0000","last_change":"2023-09-21T00:17:05.923018+0000","last_active":"2023-09-21T00:17:10.953305+0000","last_peered":"2023-09-21T00:17:10.953305+0000","last_clean":"2023-09-21T00:17:10.953305+0000","last_became_active":"2023-09-21T00:17:05.922305+0000","last_became_peered":"2023-09-21T00:17:05.922305+0000","last_unstale":"2023-09-21T00:17:10.953305+0000","last_undegraded":"2023-09-21T00:17:10.953305+0000","last_fullsized":"2023-09-21T00:17:10.953305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T10:25:25.504437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.960533+0000","last_change":"2023-09-21T00:17:06.930143+0000","last_active":"2023-09-21T00:17:10.960533+0000","last_peered":"2023-09-21T00:17:10.960533+0000","last_clean":"2023-09-21T00:17:10.960533+0000","last_became_active":"2023-09-21T00:17:06.929834+0000","last_became_peered":"2023-09-21T00:17:06.929834+0000","last_unstale":"2023-09-21T00:17:10.960533+0000","last_undegraded":"2023-09-21T00:17:10.960533+0000","last_fullsized":"2023-09-21T00:17:10.960533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:33:02.098745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.243648+0000","last_change":"2023-09-21T00:17:10.970839+0000","last_active":"2023-09-21T00:17:12.243648+0000","last_peered":"2023-09-21T00:17:12.243648+0000","last_clean":"2023-09-21T00:17:12.243648+0000","last_became_active":"2023-09-21T00:17:10.970381+0000","last_became_peered":"2023-09-21T00:17:10.970381+0000","last_unstale":"2023-09-21T00:17:12.243648+0000","last_undegraded":"2023-09-21T00:17:12.243648+0000","last_fullsized":"2023-09-21T00:17:12.243648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:34:06.133170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952254+0000","last_change":"2023-09-21T00:17:05.929568+0000","last_active":"2023-09-21T00:17:10.952254+0000","last_peered":"2023-09-21T00:17:10.952254+0000","last_clean":"2023-09-21T00:17:10.952254+0000","last_became_active":"2023-09-21T00:17:05.929279+0000","last_became_peered":"2023-09-21T00:17:05.929279+0000","last_unstale":"2023-09-21T00:17:10.952254+0000","last_undegraded":"2023-09-21T00:17:10.952254+0000","last_fullsized":"2023-09-21T00:17:10.952254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T07:24:34.111510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952180+0000","last_change":"2023-09-21T00:17:06.944506+0000","last_active":"2023-09-21T00:17:10.952180+0000","last_peered":"2023-09-21T00:17:10.952180+0000","last_clean":"2023-09-21T00:17:10.952180+0000","last_became_active":"2023-09-21T00:17:06.944205+0000","last_became_peered":"2023-09-21T00:17:06.944205+0000","last_unstale":"2023-09-21T00:17:10.952180+0000","last_undegraded":"2023-09-21T00:17:10.952180+0000","last_fullsized":"2023-09-21T00:17:10.952180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:12:52.515384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.243135+0000","last_change":"2023-09-21T00:17:11.141670+0000","last_active":"2023-09-21T00:17:12.243135+0000","last_peered":"2023-09-21T00:17:12.243135+0000","last_clean":"2023-09-21T00:17:12.243135+0000","last_became_active":"2023-09-21T00:17:11.141275+0000","last_became_peered":"2023-09-21T00:17:11.141275+0000","last_unstale":"2023-09-21T00:17:12.243135+0000","last_undegraded":"2023-09-21T00:17:12.243135+0000","last_fullsized":"2023-09-21T00:17:12.243135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:01:56.036095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963545+0000","last_change":"2023-09-21T00:17:05.932750+0000","last_active":"2023-09-21T00:17:10.963545+0000","last_peered":"2023-09-21T00:17:10.963545+0000","last_clean":"2023-09-21T00:17:10.963545+0000","last_became_active":"2023-09-21T00:17:05.930778+0000","last_became_peered":"2023-09-21T00:17:05.930778+0000","last_unstale":"2023-09-21T00:17:10.963545+0000","last_undegraded":"2023-09-21T00:17:10.963545+0000","last_fullsized":"2023-09-21T00:17:10.963545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:04:16.077149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.967014+0000","last_change":"2023-09-21T00:17:06.939961+0000","last_active":"2023-09-21T00:17:10.967014+0000","last_peered":"2023-09-21T00:17:10.967014+0000","last_clean":"2023-09-21T00:17:10.967014+0000","last_became_active":"2023-09-21T00:17:06.938086+0000","last_became_peered":"2023-09-21T00:17:06.938086+0000","last_unstale":"2023-09-21T00:17:10.967014+0000","last_undegraded":"2023-09-21T00:17:10.967014+0000","last_fullsized":"2023-09-21T00:17:10.967014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:16:31.202329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.955743+0000","last_change":"2023-09-21T00:17:11.144684+0000","last_active":"2023-09-21T00:17:11.955743+0000","last_peered":"2023-09-21T00:17:11.955743+0000","last_clean":"2023-09-21T00:17:11.955743+0000","last_became_active":"2023-09-21T00:17:11.144213+0000","last_became_peered":"2023-09-21T00:17:11.144213+0000","last_unstale":"2023-09-21T00:17:11.955743+0000","last_undegraded":"2023-09-21T00:17:11.955743+0000","last_fullsized":"2023-09-21T00:17:11.955743+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:16:57.981811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.955244+0000","last_change":"2023-09-21T00:17:05.930497+0000","last_active":"2023-09-21T00:17:10.955244+0000","last_peered":"2023-09-21T00:17:10.955244+0000","last_clean":"2023-09-21T00:17:10.955244+0000","last_became_active":"2023-09-21T00:17:05.930235+0000","last_became_peered":"2023-09-21T00:17:05.930235+0000","last_unstale":"2023-09-21T00:17:10.955244+0000","last_undegraded":"2023-09-21T00:17:10.955244+0000","last_fullsized":"2023-09-21T00:17:10.955244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:15:52.072888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.964068+0000","last_change":"2023-09-21T00:17:06.946691+0000","last_active":"2023-09-21T00:17:10.964068+0000","last_peered":"2023-09-21T00:17:10.964068+0000","last_clean":"2023-09-21T00:17:10.964068+0000","last_became_active":"2023-09-21T00:17:06.946467+0000","last_became_peered":"2023-09-21T00:17:06.946467+0000","last_unstale":"2023-09-21T00:17:10.964068+0000","last_undegraded":"2023-09-21T00:17:10.964068+0000","last_fullsized":"2023-09-21T00:17:10.964068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T12:07:09.891729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.953663+0000","last_change":"2023-09-21T00:17:10.974215+0000","last_active":"2023-09-21T00:17:11.953663+0000","last_peered":"2023-09-21T00:17:11.953663+0000","last_clean":"2023-09-21T00:17:11.953663+0000","last_became_active":"2023-09-21T00:17:10.973666+0000","last_became_peered":"2023-09-21T00:17:10.973666+0000","last_unstale":"2023-09-21T00:17:11.953663+0000","last_undegraded":"2023-09-21T00:17:11.953663+0000","last_fullsized":"2023-09-21T00:17:11.953663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T02:24:55.988982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.964045+0000","last_change":"2023-09-21T00:17:05.932595+0000","last_active":"2023-09-21T00:17:10.964045+0000","last_peered":"2023-09-21T00:17:10.964045+0000","last_clean":"2023-09-21T00:17:10.964045+0000","last_became_active":"2023-09-21T00:17:05.931183+0000","last_became_peered":"2023-09-21T00:17:05.931183+0000","last_unstale":"2023-09-21T00:17:10.964045+0000","last_undegraded":"2023-09-21T00:17:10.964045+0000","last_fullsized":"2023-09-21T00:17:10.964045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:53:26.593335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.961419+0000","last_change":"2023-09-21T00:17:06.953679+0000","last_active":"2023-09-21T00:17:10.961419+0000","last_peered":"2023-09-21T00:17:10.961419+0000","last_clean":"2023-09-21T00:17:10.961419+0000","last_became_active":"2023-09-21T00:17:06.949774+0000","last_became_peered":"2023-09-21T00:17:06.949774+0000","last_unstale":"2023-09-21T00:17:10.961419+0000","last_undegraded":"2023-09-21T00:17:10.961419+0000","last_fullsized":"2023-09-21T00:17:10.961419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:12:52.515384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.954755+0000","last_change":"2023-09-21T00:17:10.969803+0000","last_active":"2023-09-21T00:17:11.954755+0000","last_peered":"2023-09-21T00:17:11.954755+0000","last_clean":"2023-09-21T00:17:11.954755+0000","last_became_active":"2023-09-21T00:17:10.969402+0000","last_became_peered":"2023-09-21T00:17:10.969402+0000","last_unstale":"2023-09-21T00:17:11.954755+0000","last_undegraded":"2023-09-21T00:17:11.954755+0000","last_fullsized":"2023-09-21T00:17:11.954755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:11:41.340772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.971250+0000","last_change":"2023-09-21T00:17:05.924182+0000","last_active":"2023-09-21T00:17:10.971250+0000","last_peered":"2023-09-21T00:17:10.971250+0000","last_clean":"2023-09-21T00:17:10.971250+0000","last_became_active":"2023-09-21T00:17:05.923874+0000","last_became_peered":"2023-09-21T00:17:05.923874+0000","last_unstale":"2023-09-21T00:17:10.971250+0000","last_undegraded":"2023-09-21T00:17:10.971250+0000","last_fullsized":"2023-09-21T00:17:10.971250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T07:53:35.281829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.955876+0000","last_change":"2023-09-21T00:17:06.938055+0000","last_active":"2023-09-21T00:17:10.955876+0000","last_peered":"2023-09-21T00:17:10.955876+0000","last_clean":"2023-09-21T00:17:10.955876+0000","last_became_active":"2023-09-21T00:17:06.937477+0000","last_became_peered":"2023-09-21T00:17:06.937477+0000","last_unstale":"2023-09-21T00:17:10.955876+0000","last_undegraded":"2023-09-21T00:17:10.955876+0000","last_fullsized":"2023-09-21T00:17:10.955876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:43:07.604113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.242273+0000","last_change":"2023-09-21T00:17:10.969820+0000","last_active":"2023-09-21T00:17:12.242273+0000","last_peered":"2023-09-21T00:17:12.242273+0000","last_clean":"2023-09-21T00:17:12.242273+0000","last_became_active":"2023-09-21T00:17:10.969393+0000","last_became_peered":"2023-09-21T00:17:10.969393+0000","last_unstale":"2023-09-21T00:17:12.242273+0000","last_undegraded":"2023-09-21T00:17:12.242273+0000","last_fullsized":"2023-09-21T00:17:12.242273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:14:44.859557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:16.985242+0000","last_change":"2023-09-21T00:17:05.932498+0000","last_active":"2023-09-21T00:17:16.985242+0000","last_peered":"2023-09-21T00:17:16.985242+0000","last_clean":"2023-09-21T00:17:16.985242+0000","last_became_active":"2023-09-21T00:17:05.932192+0000","last_became_peered":"2023-09-21T00:17:05.932192+0000","last_unstale":"2023-09-21T00:17:16.985242+0000","last_undegraded":"2023-09-21T00:17:16.985242+0000","last_fullsized":"2023-09-21T00:17:16.985242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T07:24:34.111510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.139985+0000","last_change":"2023-09-21T00:17:06.944667+0000","last_active":"2023-09-21T00:17:11.139985+0000","last_peered":"2023-09-21T00:17:11.139985+0000","last_clean":"2023-09-21T00:17:11.139985+0000","last_became_active":"2023-09-21T00:17:06.943370+0000","last_became_peered":"2023-09-21T00:17:06.943370+0000","last_unstale":"2023-09-21T00:17:11.139985+0000","last_undegraded":"2023-09-21T00:17:11.139985+0000","last_fullsized":"2023-09-21T00:17:11.139985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T02:36:18.582664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.243233+0000","last_change":"2023-09-21T00:17:11.142786+0000","last_active":"2023-09-21T00:17:12.243233+0000","last_peered":"2023-09-21T00:17:12.243233+0000","last_clean":"2023-09-21T00:17:12.243233+0000","last_became_active":"2023-09-21T00:17:11.142355+0000","last_became_peered":"2023-09-21T00:17:11.142355+0000","last_unstale":"2023-09-21T00:17:12.243233+0000","last_undegraded":"2023-09-21T00:17:12.243233+0000","last_fullsized":"2023-09-21T00:17:12.243233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:32:25.199881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.960849+0000","last_change":"2023-09-21T00:17:05.926948+0000","last_active":"2023-09-21T00:17:10.960849+0000","last_peered":"2023-09-21T00:17:10.960849+0000","last_clean":"2023-09-21T00:17:10.960849+0000","last_became_active":"2023-09-21T00:17:05.926594+0000","last_became_peered":"2023-09-21T00:17:05.926594+0000","last_unstale":"2023-09-21T00:17:10.960849+0000","last_undegraded":"2023-09-21T00:17:10.960849+0000","last_fullsized":"2023-09-21T00:17:10.960849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:36:17.985234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.961082+0000","last_change":"2023-09-21T00:17:06.936852+0000","last_active":"2023-09-21T00:17:10.961082+0000","last_peered":"2023-09-21T00:17:10.961082+0000","last_clean":"2023-09-21T00:17:10.961082+0000","last_became_active":"2023-09-21T00:17:06.936544+0000","last_became_peered":"2023-09-21T00:17:06.936544+0000","last_unstale":"2023-09-21T00:17:10.961082+0000","last_undegraded":"2023-09-21T00:17:10.961082+0000","last_fullsized":"2023-09-21T00:17:10.961082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T11:15:08.495079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.954099+0000","last_change":"2023-09-21T00:17:11.144574+0000","last_active":"2023-09-21T00:17:11.954099+0000","last_peered":"2023-09-21T00:17:11.954099+0000","last_clean":"2023-09-21T00:17:11.954099+0000","last_became_active":"2023-09-21T00:17:11.144167+0000","last_became_peered":"2023-09-21T00:17:11.144167+0000","last_unstale":"2023-09-21T00:17:11.954099+0000","last_undegraded":"2023-09-21T00:17:11.954099+0000","last_fullsized":"2023-09-21T00:17:11.954099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:38:17.728778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963639+0000","last_change":"2023-09-21T00:17:05.933114+0000","last_active":"2023-09-21T00:17:10.963639+0000","last_peered":"2023-09-21T00:17:10.963639+0000","last_clean":"2023-09-21T00:17:10.963639+0000","last_became_active":"2023-09-21T00:17:05.932827+0000","last_became_peered":"2023-09-21T00:17:05.932827+0000","last_unstale":"2023-09-21T00:17:10.963639+0000","last_undegraded":"2023-09-21T00:17:10.963639+0000","last_fullsized":"2023-09-21T00:17:10.963639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:12:51.510962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.138749+0000","last_change":"2023-09-21T00:17:06.947936+0000","last_active":"2023-09-21T00:17:11.138749+0000","last_peered":"2023-09-21T00:17:11.138749+0000","last_clean":"2023-09-21T00:17:11.138749+0000","last_became_active":"2023-09-21T00:17:06.947663+0000","last_became_peered":"2023-09-21T00:17:06.947663+0000","last_unstale":"2023-09-21T00:17:11.138749+0000","last_undegraded":"2023-09-21T00:17:11.138749+0000","last_fullsized":"2023-09-21T00:17:11.138749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:47:58.590848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.955260+0000","last_change":"2023-09-21T00:17:11.146155+0000","last_active":"2023-09-21T00:17:11.955260+0000","last_peered":"2023-09-21T00:17:11.955260+0000","last_clean":"2023-09-21T00:17:11.955260+0000","last_became_active":"2023-09-21T00:17:11.145812+0000","last_became_peered":"2023-09-21T00:17:11.145812+0000","last_unstale":"2023-09-21T00:17:11.955260+0000","last_undegraded":"2023-09-21T00:17:11.955260+0000","last_fullsized":"2023-09-21T00:17:11.955260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:32:25.199881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952759+0000","last_change":"2023-09-21T00:17:05.930675+0000","last_active":"2023-09-21T00:17:10.952759+0000","last_peered":"2023-09-21T00:17:10.952759+0000","last_clean":"2023-09-21T00:17:10.952759+0000","last_became_active":"2023-09-21T00:17:05.930416+0000","last_became_peered":"2023-09-21T00:17:05.930416+0000","last_unstale":"2023-09-21T00:17:10.952759+0000","last_undegraded":"2023-09-21T00:17:10.952759+0000","last_fullsized":"2023-09-21T00:17:10.952759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:02:58.326166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952464+0000","last_change":"2023-09-21T00:17:06.934940+0000","last_active":"2023-09-21T00:17:10.952464+0000","last_peered":"2023-09-21T00:17:10.952464+0000","last_clean":"2023-09-21T00:17:10.952464+0000","last_became_active":"2023-09-21T00:17:06.934319+0000","last_became_peered":"2023-09-21T00:17:06.934319+0000","last_unstale":"2023-09-21T00:17:10.952464+0000","last_undegraded":"2023-09-21T00:17:10.952464+0000","last_fullsized":"2023-09-21T00:17:10.952464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:30:26.002264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.242887+0000","last_change":"2023-09-21T00:17:10.978508+0000","last_active":"2023-09-21T00:17:12.242887+0000","last_peered":"2023-09-21T00:17:12.242887+0000","last_clean":"2023-09-21T00:17:12.242887+0000","last_became_active":"2023-09-21T00:17:10.978085+0000","last_became_peered":"2023-09-21T00:17:10.978085+0000","last_unstale":"2023-09-21T00:17:12.242887+0000","last_undegraded":"2023-09-21T00:17:12.242887+0000","last_fullsized":"2023-09-21T00:17:12.242887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T11:26:08.816745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.965895+0000","last_change":"2023-09-21T00:17:05.917597+0000","last_active":"2023-09-21T00:17:10.965895+0000","last_peered":"2023-09-21T00:17:10.965895+0000","last_clean":"2023-09-21T00:17:10.965895+0000","last_became_active":"2023-09-21T00:17:05.917277+0000","last_became_peered":"2023-09-21T00:17:05.917277+0000","last_unstale":"2023-09-21T00:17:10.965895+0000","last_undegraded":"2023-09-21T00:17:10.965895+0000","last_fullsized":"2023-09-21T00:17:10.965895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:02:58.326166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.138679+0000","last_change":"2023-09-21T00:17:06.947371+0000","last_active":"2023-09-21T00:17:11.138679+0000","last_peered":"2023-09-21T00:17:11.138679+0000","last_clean":"2023-09-21T00:17:11.138679+0000","last_became_active":"2023-09-21T00:17:06.947072+0000","last_became_peered":"2023-09-21T00:17:06.947072+0000","last_unstale":"2023-09-21T00:17:11.138679+0000","last_undegraded":"2023-09-21T00:17:11.138679+0000","last_fullsized":"2023-09-21T00:17:11.138679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:41:27.691190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.954080+0000","last_change":"2023-09-21T00:17:10.974483+0000","last_active":"2023-09-21T00:17:11.954080+0000","last_peered":"2023-09-21T00:17:11.954080+0000","last_clean":"2023-09-21T00:17:11.954080+0000","last_became_active":"2023-09-21T00:17:10.974056+0000","last_became_peered":"2023-09-21T00:17:10.974056+0000","last_unstale":"2023-09-21T00:17:11.954080+0000","last_undegraded":"2023-09-21T00:17:11.954080+0000","last_fullsized":"2023-09-21T00:17:11.954080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T12:07:13.929729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.955489+0000","last_change":"2023-09-21T00:17:05.919312+0000","last_active":"2023-09-21T00:17:10.955489+0000","last_peered":"2023-09-21T00:17:10.955489+0000","last_clean":"2023-09-21T00:17:10.955489+0000","last_became_active":"2023-09-21T00:17:05.919020+0000","last_became_peered":"2023-09-21T00:17:05.919020+0000","last_unstale":"2023-09-21T00:17:10.955489+0000","last_undegraded":"2023-09-21T00:17:10.955489+0000","last_fullsized":"2023-09-21T00:17:10.955489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T12:05:24.959728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.140053+0000","last_change":"2023-09-21T00:17:06.947452+0000","last_active":"2023-09-21T00:17:11.140053+0000","last_peered":"2023-09-21T00:17:11.140053+0000","last_clean":"2023-09-21T00:17:11.140053+0000","last_became_active":"2023-09-21T00:17:06.947158+0000","last_became_peered":"2023-09-21T00:17:06.947158+0000","last_unstale":"2023-09-21T00:17:11.140053+0000","last_undegraded":"2023-09-21T00:17:11.140053+0000","last_fullsized":"2023-09-21T00:17:11.140053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:34:02.095171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.242117+0000","last_change":"2023-09-21T00:17:10.970581+0000","last_active":"2023-09-21T00:17:12.242117+0000","last_peered":"2023-09-21T00:17:12.242117+0000","last_clean":"2023-09-21T00:17:12.242117+0000","last_became_active":"2023-09-21T00:17:10.970163+0000","last_became_peered":"2023-09-21T00:17:10.970163+0000","last_unstale":"2023-09-21T00:17:12.242117+0000","last_undegraded":"2023-09-21T00:17:12.242117+0000","last_fullsized":"2023-09-21T00:17:12.242117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T02:36:22.620663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.967804+0000","last_change":"2023-09-21T00:17:05.927611+0000","last_active":"2023-09-21T00:17:10.967804+0000","last_peered":"2023-09-21T00:17:10.967804+0000","last_clean":"2023-09-21T00:17:10.967804+0000","last_became_active":"2023-09-21T00:17:05.926796+0000","last_became_peered":"2023-09-21T00:17:05.926796+0000","last_unstale":"2023-09-21T00:17:10.967804+0000","last_undegraded":"2023-09-21T00:17:10.967804+0000","last_fullsized":"2023-09-21T00:17:10.967804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:53:26.593335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.964059+0000","last_change":"2023-09-21T00:17:06.954874+0000","last_active":"2023-09-21T00:17:10.964059+0000","last_peered":"2023-09-21T00:17:10.964059+0000","last_clean":"2023-09-21T00:17:10.964059+0000","last_became_active":"2023-09-21T00:17:06.954591+0000","last_became_peered":"2023-09-21T00:17:06.954591+0000","last_unstale":"2023-09-21T00:17:10.964059+0000","last_undegraded":"2023-09-21T00:17:10.964059+0000","last_fullsized":"2023-09-21T00:17:10.964059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:28:47.396022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.242135+0000","last_change":"2023-09-21T00:17:10.978479+0000","last_active":"2023-09-21T00:17:12.242135+0000","last_peered":"2023-09-21T00:17:12.242135+0000","last_clean":"2023-09-21T00:17:12.242135+0000","last_became_active":"2023-09-21T00:17:10.978049+0000","last_became_peered":"2023-09-21T00:17:10.978049+0000","last_unstale":"2023-09-21T00:17:12.242135+0000","last_undegraded":"2023-09-21T00:17:12.242135+0000","last_fullsized":"2023-09-21T00:17:12.242135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:34:06.133170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963681+0000","last_change":"2023-09-21T00:17:05.931755+0000","last_active":"2023-09-21T00:17:10.963681+0000","last_peered":"2023-09-21T00:17:10.963681+0000","last_clean":"2023-09-21T00:17:10.963681+0000","last_became_active":"2023-09-21T00:17:05.931399+0000","last_became_peered":"2023-09-21T00:17:05.931399+0000","last_unstale":"2023-09-21T00:17:10.963681+0000","last_undegraded":"2023-09-21T00:17:10.963681+0000","last_fullsized":"2023-09-21T00:17:10.963681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:10:01.225475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.954552+0000","last_change":"2023-09-21T00:17:06.931255+0000","last_active":"2023-09-21T00:17:10.954552+0000","last_peered":"2023-09-21T00:17:10.954552+0000","last_clean":"2023-09-21T00:17:10.954552+0000","last_became_active":"2023-09-21T00:17:06.930984+0000","last_became_peered":"2023-09-21T00:17:06.930984+0000","last_unstale":"2023-09-21T00:17:10.954552+0000","last_undegraded":"2023-09-21T00:17:10.954552+0000","last_fullsized":"2023-09-21T00:17:10.954552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:15:53.077309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.242888+0000","last_change":"2023-09-21T00:17:10.977159+0000","last_active":"2023-09-21T00:17:12.242888+0000","last_peered":"2023-09-21T00:17:12.242888+0000","last_clean":"2023-09-21T00:17:12.242888+0000","last_became_active":"2023-09-21T00:17:10.976751+0000","last_became_peered":"2023-09-21T00:17:10.976751+0000","last_unstale":"2023-09-21T00:17:12.242888+0000","last_undegraded":"2023-09-21T00:17:12.242888+0000","last_fullsized":"2023-09-21T00:17:12.242888+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T11:26:08.816745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.967010+0000","last_change":"2023-09-21T00:17:06.940149+0000","last_active":"2023-09-21T00:17:10.967010+0000","last_peered":"2023-09-21T00:17:10.967010+0000","last_clean":"2023-09-21T00:17:10.967010+0000","last_became_active":"2023-09-21T00:17:06.939751+0000","last_became_peered":"2023-09-21T00:17:06.939751+0000","last_unstale":"2023-09-21T00:17:10.967010+0000","last_undegraded":"2023-09-21T00:17:10.967010+0000","last_fullsized":"2023-09-21T00:17:10.967010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:30:26.002264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.966501+0000","last_change":"2023-09-21T00:17:05.916234+0000","last_active":"2023-09-21T00:17:10.966501+0000","last_peered":"2023-09-21T00:17:10.966501+0000","last_clean":"2023-09-21T00:17:10.966501+0000","last_became_active":"2023-09-21T00:17:05.915879+0000","last_became_peered":"2023-09-21T00:17:05.915879+0000","last_unstale":"2023-09-21T00:17:10.966501+0000","last_undegraded":"2023-09-21T00:17:10.966501+0000","last_fullsized":"2023-09-21T00:17:10.966501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:06:51.096713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.242460+0000","last_change":"2023-09-21T00:17:11.141271+0000","last_active":"2023-09-21T00:17:12.242460+0000","last_peered":"2023-09-21T00:17:12.242460+0000","last_clean":"2023-09-21T00:17:12.242460+0000","last_became_active":"2023-09-21T00:17:11.140862+0000","last_became_peered":"2023-09-21T00:17:11.140862+0000","last_unstale":"2023-09-21T00:17:12.242460+0000","last_undegraded":"2023-09-21T00:17:12.242460+0000","last_fullsized":"2023-09-21T00:17:12.242460+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:28:51.434022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.953597+0000","last_change":"2023-09-21T00:17:06.948232+0000","last_active":"2023-09-21T00:17:10.953597+0000","last_peered":"2023-09-21T00:17:10.953597+0000","last_clean":"2023-09-21T00:17:10.953597+0000","last_became_active":"2023-09-21T00:17:06.947981+0000","last_became_peered":"2023-09-21T00:17:06.947981+0000","last_unstale":"2023-09-21T00:17:10.953597+0000","last_undegraded":"2023-09-21T00:17:10.953597+0000","last_fullsized":"2023-09-21T00:17:10.953597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:16:31.202329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963721+0000","last_change":"2023-09-21T00:17:05.918340+0000","last_active":"2023-09-21T00:17:10.963721+0000","last_peered":"2023-09-21T00:17:10.963721+0000","last_clean":"2023-09-21T00:17:10.963721+0000","last_became_active":"2023-09-21T00:17:05.918052+0000","last_became_peered":"2023-09-21T00:17:05.918052+0000","last_unstale":"2023-09-21T00:17:10.963721+0000","last_undegraded":"2023-09-21T00:17:10.963721+0000","last_fullsized":"2023-09-21T00:17:10.963721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:05:24.892446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.138422+0000","last_change":"2023-09-21T00:16:57.071188+0000","last_active":"2023-09-21T00:17:11.138422+0000","last_peered":"2023-09-21T00:17:11.138422+0000","last_clean":"2023-09-21T00:17:11.138422+0000","last_became_active":"2023-09-21T00:16:57.070240+0000","last_became_peered":"2023-09-21T00:16:57.070240+0000","last_unstale":"2023-09-21T00:17:11.138422+0000","last_undegraded":"2023-09-21T00:17:11.138422+0000","last_fullsized":"2023-09-21T00:17:11.138422+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:16:55.741965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:16:55.741965+0000","last_clean_scrub_stamp":"2023-09-21T00:16:55.741965+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:21:26.215032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.243013+0000","last_change":"2023-09-21T00:17:11.141697+0000","last_active":"2023-09-21T00:17:12.243013+0000","last_peered":"2023-09-21T00:17:12.243013+0000","last_clean":"2023-09-21T00:17:12.243013+0000","last_became_active":"2023-09-21T00:17:11.141334+0000","last_became_peered":"2023-09-21T00:17:11.141334+0000","last_unstale":"2023-09-21T00:17:12.243013+0000","last_undegraded":"2023-09-21T00:17:12.243013+0000","last_fullsized":"2023-09-21T00:17:12.243013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:53:19.217753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.960197+0000","last_change":"2023-09-21T00:17:06.930523+0000","last_active":"2023-09-21T00:17:10.960197+0000","last_peered":"2023-09-21T00:17:10.960197+0000","last_clean":"2023-09-21T00:17:10.960197+0000","last_became_active":"2023-09-21T00:17:06.929200+0000","last_became_peered":"2023-09-21T00:17:06.929200+0000","last_unstale":"2023-09-21T00:17:10.960197+0000","last_undegraded":"2023-09-21T00:17:10.960197+0000","last_fullsized":"2023-09-21T00:17:10.960197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T07:53:36.286251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.138459+0000","last_change":"2023-09-21T00:17:05.928845+0000","last_active":"2023-09-21T00:17:11.138459+0000","last_peered":"2023-09-21T00:17:11.138459+0000","last_clean":"2023-09-21T00:17:11.138459+0000","last_became_active":"2023-09-21T00:17:05.928617+0000","last_became_peered":"2023-09-21T00:17:05.928617+0000","last_unstale":"2023-09-21T00:17:11.138459+0000","last_undegraded":"2023-09-21T00:17:11.138459+0000","last_fullsized":"2023-09-21T00:17:11.138459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:56:48.483420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.242213+0000","last_change":"2023-09-21T00:17:11.140948+0000","last_active":"2023-09-21T00:17:12.242213+0000","last_peered":"2023-09-21T00:17:12.242213+0000","last_clean":"2023-09-21T00:17:12.242213+0000","last_became_active":"2023-09-21T00:17:11.140588+0000","last_became_peered":"2023-09-21T00:17:11.140588+0000","last_unstale":"2023-09-21T00:17:12.242213+0000","last_undegraded":"2023-09-21T00:17:12.242213+0000","last_fullsized":"2023-09-21T00:17:12.242213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:14:44.859557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.138729+0000","last_change":"2023-09-21T00:17:05.932021+0000","last_active":"2023-09-21T00:17:11.138729+0000","last_peered":"2023-09-21T00:17:11.138729+0000","last_clean":"2023-09-21T00:17:11.138729+0000","last_became_active":"2023-09-21T00:17:05.931524+0000","last_became_peered":"2023-09-21T00:17:05.931524+0000","last_unstale":"2023-09-21T00:17:11.138729+0000","last_undegraded":"2023-09-21T00:17:11.138729+0000","last_fullsized":"2023-09-21T00:17:11.138729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:28:33.010261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.967904+0000","last_change":"2023-09-21T00:17:06.938686+0000","last_active":"2023-09-21T00:17:10.967904+0000","last_peered":"2023-09-21T00:17:10.967904+0000","last_clean":"2023-09-21T00:17:10.967904+0000","last_became_active":"2023-09-21T00:17:06.938296+0000","last_became_peered":"2023-09-21T00:17:06.938296+0000","last_unstale":"2023-09-21T00:17:10.967904+0000","last_undegraded":"2023-09-21T00:17:10.967904+0000","last_fullsized":"2023-09-21T00:17:10.967904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:17:22.988451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.953741+0000","last_change":"2023-09-21T00:17:11.144700+0000","last_active":"2023-09-21T00:17:11.953741+0000","last_peered":"2023-09-21T00:17:11.953741+0000","last_clean":"2023-09-21T00:17:11.953741+0000","last_became_active":"2023-09-21T00:17:11.144270+0000","last_became_peered":"2023-09-21T00:17:11.144270+0000","last_unstale":"2023-09-21T00:17:11.953741+0000","last_undegraded":"2023-09-21T00:17:11.953741+0000","last_fullsized":"2023-09-21T00:17:11.953741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:19:20.916794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.719452+0000","last_change":"2023-09-21T00:17:05.931903+0000","last_active":"2023-09-21T00:17:11.719452+0000","last_peered":"2023-09-21T00:17:11.719452+0000","last_clean":"2023-09-21T00:17:11.719452+0000","last_became_active":"2023-09-21T00:17:05.931473+0000","last_became_peered":"2023-09-21T00:17:05.931473+0000","last_unstale":"2023-09-21T00:17:11.719452+0000","last_undegraded":"2023-09-21T00:17:11.719452+0000","last_fullsized":"2023-09-21T00:17:11.719452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T10:25:25.504437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.953301+0000","last_change":"2023-09-21T00:17:06.937019+0000","last_active":"2023-09-21T00:17:10.953301+0000","last_peered":"2023-09-21T00:17:10.953301+0000","last_clean":"2023-09-21T00:17:10.953301+0000","last_became_active":"2023-09-21T00:17:06.936738+0000","last_became_peered":"2023-09-21T00:17:06.936738+0000","last_unstale":"2023-09-21T00:17:10.953301+0000","last_undegraded":"2023-09-21T00:17:10.953301+0000","last_fullsized":"2023-09-21T00:17:10.953301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T11:15:08.495079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.954064+0000","last_change":"2023-09-21T00:17:11.141893+0000","last_active":"2023-09-21T00:17:11.954064+0000","last_peered":"2023-09-21T00:17:11.954064+0000","last_clean":"2023-09-21T00:17:11.954064+0000","last_became_active":"2023-09-21T00:17:11.141460+0000","last_became_peered":"2023-09-21T00:17:11.141460+0000","last_unstale":"2023-09-21T00:17:11.954064+0000","last_undegraded":"2023-09-21T00:17:11.954064+0000","last_fullsized":"2023-09-21T00:17:11.954064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T11:15:12.533079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.956194+0000","last_change":"2023-09-21T00:17:05.926473+0000","last_active":"2023-09-21T00:17:10.956194+0000","last_peered":"2023-09-21T00:17:10.956194+0000","last_clean":"2023-09-21T00:17:10.956194+0000","last_became_active":"2023-09-21T00:17:05.926158+0000","last_became_peered":"2023-09-21T00:17:05.926158+0000","last_unstale":"2023-09-21T00:17:10.956194+0000","last_undegraded":"2023-09-21T00:17:10.956194+0000","last_fullsized":"2023-09-21T00:17:10.956194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T12:05:24.959728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.964279+0000","last_change":"2023-09-21T00:17:06.933680+0000","last_active":"2023-09-21T00:17:10.964279+0000","last_peered":"2023-09-21T00:17:10.964279+0000","last_clean":"2023-09-21T00:17:10.964279+0000","last_became_active":"2023-09-21T00:17:06.933307+0000","last_became_peered":"2023-09-21T00:17:06.933307+0000","last_unstale":"2023-09-21T00:17:10.964279+0000","last_undegraded":"2023-09-21T00:17:10.964279+0000","last_fullsized":"2023-09-21T00:17:10.964279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:17:22.988451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.955461+0000","last_change":"2023-09-21T00:17:10.974600+0000","last_active":"2023-09-21T00:17:11.955461+0000","last_peered":"2023-09-21T00:17:11.955461+0000","last_clean":"2023-09-21T00:17:11.955461+0000","last_became_active":"2023-09-21T00:17:10.974003+0000","last_became_peered":"2023-09-21T00:17:10.974003+0000","last_unstale":"2023-09-21T00:17:11.955461+0000","last_undegraded":"2023-09-21T00:17:11.955461+0000","last_fullsized":"2023-09-21T00:17:11.955461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:28:51.434022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.138370+0000","last_change":"2023-09-21T00:17:05.931013+0000","last_active":"2023-09-21T00:17:11.138370+0000","last_peered":"2023-09-21T00:17:11.138370+0000","last_clean":"2023-09-21T00:17:11.138370+0000","last_became_active":"2023-09-21T00:17:05.930722+0000","last_became_peered":"2023-09-21T00:17:05.930722+0000","last_unstale":"2023-09-21T00:17:11.138370+0000","last_undegraded":"2023-09-21T00:17:11.138370+0000","last_fullsized":"2023-09-21T00:17:11.138370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:43:06.599691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.954572+0000","last_change":"2023-09-21T00:17:06.939541+0000","last_active":"2023-09-21T00:17:10.954572+0000","last_peered":"2023-09-21T00:17:10.954572+0000","last_clean":"2023-09-21T00:17:10.954572+0000","last_became_active":"2023-09-21T00:17:06.939222+0000","last_became_peered":"2023-09-21T00:17:06.939222+0000","last_unstale":"2023-09-21T00:17:10.954572+0000","last_undegraded":"2023-09-21T00:17:10.954572+0000","last_fullsized":"2023-09-21T00:17:10.954572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:04:17.081570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.243107+0000","last_change":"2023-09-21T00:17:11.141846+0000","last_active":"2023-09-21T00:17:12.243107+0000","last_peered":"2023-09-21T00:17:12.243107+0000","last_clean":"2023-09-21T00:17:12.243107+0000","last_became_active":"2023-09-21T00:17:11.141470+0000","last_became_peered":"2023-09-21T00:17:11.141470+0000","last_unstale":"2023-09-21T00:17:12.243107+0000","last_undegraded":"2023-09-21T00:17:12.243107+0000","last_fullsized":"2023-09-21T00:17:12.243107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:53:19.217753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.966909+0000","last_change":"2023-09-21T00:17:05.929236+0000","last_active":"2023-09-21T00:17:10.966909+0000","last_peered":"2023-09-21T00:17:10.966909+0000","last_clean":"2023-09-21T00:17:10.966909+0000","last_became_active":"2023-09-21T00:17:05.928922+0000","last_became_peered":"2023-09-21T00:17:05.928922+0000","last_unstale":"2023-09-21T00:17:10.966909+0000","last_undegraded":"2023-09-21T00:17:10.966909+0000","last_fullsized":"2023-09-21T00:17:10.966909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:04:16.077149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952071+0000","last_change":"2023-09-21T00:17:06.936721+0000","last_active":"2023-09-21T00:17:10.952071+0000","last_peered":"2023-09-21T00:17:10.952071+0000","last_clean":"2023-09-21T00:17:10.952071+0000","last_became_active":"2023-09-21T00:17:06.936421+0000","last_became_peered":"2023-09-21T00:17:06.936421+0000","last_unstale":"2023-09-21T00:17:10.952071+0000","last_undegraded":"2023-09-21T00:17:10.952071+0000","last_fullsized":"2023-09-21T00:17:10.952071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:28:34.014683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.955164+0000","last_change":"2023-09-21T00:17:10.974427+0000","last_active":"2023-09-21T00:17:11.955164+0000","last_peered":"2023-09-21T00:17:11.955164+0000","last_clean":"2023-09-21T00:17:11.955164+0000","last_became_active":"2023-09-21T00:17:10.973986+0000","last_became_peered":"2023-09-21T00:17:10.973986+0000","last_unstale":"2023-09-21T00:17:11.955164+0000","last_undegraded":"2023-09-21T00:17:11.955164+0000","last_fullsized":"2023-09-21T00:17:11.955164+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:48:02.628848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.968204+0000","last_change":"2023-09-21T00:17:05.920076+0000","last_active":"2023-09-21T00:17:10.968204+0000","last_peered":"2023-09-21T00:17:10.968204+0000","last_clean":"2023-09-21T00:17:10.968204+0000","last_became_active":"2023-09-21T00:17:05.919755+0000","last_became_peered":"2023-09-21T00:17:05.919755+0000","last_unstale":"2023-09-21T00:17:10.968204+0000","last_undegraded":"2023-09-21T00:17:10.968204+0000","last_fullsized":"2023-09-21T00:17:10.968204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T07:24:34.111510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952901+0000","last_change":"2023-09-21T00:17:06.944470+0000","last_active":"2023-09-21T00:17:10.952901+0000","last_peered":"2023-09-21T00:17:10.952901+0000","last_clean":"2023-09-21T00:17:10.952901+0000","last_became_active":"2023-09-21T00:17:06.944166+0000","last_became_peered":"2023-09-21T00:17:06.944166+0000","last_unstale":"2023-09-21T00:17:10.952901+0000","last_undegraded":"2023-09-21T00:17:10.952901+0000","last_fullsized":"2023-09-21T00:17:10.952901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T12:07:09.891729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.955249+0000","last_change":"2023-09-21T00:17:10.970352+0000","last_active":"2023-09-21T00:17:11.955249+0000","last_peered":"2023-09-21T00:17:11.955249+0000","last_clean":"2023-09-21T00:17:11.955249+0000","last_became_active":"2023-09-21T00:17:10.969785+0000","last_became_peered":"2023-09-21T00:17:10.969785+0000","last_unstale":"2023-09-21T00:17:11.955249+0000","last_undegraded":"2023-09-21T00:17:11.955249+0000","last_fullsized":"2023-09-21T00:17:11.955249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:45:46.074093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.140070+0000","last_change":"2023-09-21T00:17:05.925648+0000","last_active":"2023-09-21T00:17:11.140070+0000","last_peered":"2023-09-21T00:17:11.140070+0000","last_clean":"2023-09-21T00:17:11.140070+0000","last_became_active":"2023-09-21T00:17:05.925319+0000","last_became_peered":"2023-09-21T00:17:05.925319+0000","last_unstale":"2023-09-21T00:17:11.140070+0000","last_undegraded":"2023-09-21T00:17:11.140070+0000","last_fullsized":"2023-09-21T00:17:11.140070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:01:37.682581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.953404+0000","last_change":"2023-09-21T00:17:06.931298+0000","last_active":"2023-09-21T00:17:10.953404+0000","last_peered":"2023-09-21T00:17:10.953404+0000","last_clean":"2023-09-21T00:17:10.953404+0000","last_became_active":"2023-09-21T00:17:06.931014+0000","last_became_peered":"2023-09-21T00:17:06.931014+0000","last_unstale":"2023-09-21T00:17:10.953404+0000","last_undegraded":"2023-09-21T00:17:10.953404+0000","last_fullsized":"2023-09-21T00:17:10.953404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:12:52.515384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.242802+0000","last_change":"2023-09-21T00:17:11.139811+0000","last_active":"2023-09-21T00:17:12.242802+0000","last_peered":"2023-09-21T00:17:12.242802+0000","last_clean":"2023-09-21T00:17:12.242802+0000","last_became_active":"2023-09-21T00:17:11.139325+0000","last_became_peered":"2023-09-21T00:17:11.139325+0000","last_unstale":"2023-09-21T00:17:12.242802+0000","last_undegraded":"2023-09-21T00:17:12.242802+0000","last_fullsized":"2023-09-21T00:17:12.242802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T02:36:22.620663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.967086+0000","last_change":"2023-09-21T00:17:05.920539+0000","last_active":"2023-09-21T00:17:10.967086+0000","last_peered":"2023-09-21T00:17:10.967086+0000","last_clean":"2023-09-21T00:17:10.967086+0000","last_became_active":"2023-09-21T00:17:05.920322+0000","last_became_peered":"2023-09-21T00:17:05.920322+0000","last_unstale":"2023-09-21T00:17:10.967086+0000","last_undegraded":"2023-09-21T00:17:10.967086+0000","last_fullsized":"2023-09-21T00:17:10.967086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:05:24.892446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.139033+0000","last_change":"2023-09-21T00:17:06.948781+0000","last_active":"2023-09-21T00:17:11.139033+0000","last_peered":"2023-09-21T00:17:11.139033+0000","last_clean":"2023-09-21T00:17:11.139033+0000","last_became_active":"2023-09-21T00:17:06.948444+0000","last_became_peered":"2023-09-21T00:17:06.948444+0000","last_unstale":"2023-09-21T00:17:11.139033+0000","last_undegraded":"2023-09-21T00:17:11.139033+0000","last_fullsized":"2023-09-21T00:17:11.139033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:28:47.396022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.242087+0000","last_change":"2023-09-21T00:17:10.975994+0000","last_active":"2023-09-21T00:17:12.242087+0000","last_peered":"2023-09-21T00:17:12.242087+0000","last_clean":"2023-09-21T00:17:12.242087+0000","last_became_active":"2023-09-21T00:17:10.975468+0000","last_became_peered":"2023-09-21T00:17:10.975468+0000","last_unstale":"2023-09-21T00:17:12.242087+0000","last_undegraded":"2023-09-21T00:17:12.242087+0000","last_fullsized":"2023-09-21T00:17:12.242087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:34:06.133170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.971145+0000","last_change":"2023-09-21T00:17:05.921232+0000","last_active":"2023-09-21T00:17:10.971145+0000","last_peered":"2023-09-21T00:17:10.971145+0000","last_clean":"2023-09-21T00:17:10.971145+0000","last_became_active":"2023-09-21T00:17:05.920883+0000","last_became_peered":"2023-09-21T00:17:05.920883+0000","last_unstale":"2023-09-21T00:17:10.971145+0000","last_undegraded":"2023-09-21T00:17:10.971145+0000","last_fullsized":"2023-09-21T00:17:10.971145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:56:48.483420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963842+0000","last_change":"2023-09-21T00:17:06.949150+0000","last_active":"2023-09-21T00:17:10.963842+0000","last_peered":"2023-09-21T00:17:10.963842+0000","last_clean":"2023-09-21T00:17:10.963842+0000","last_became_active":"2023-09-21T00:17:06.948425+0000","last_became_peered":"2023-09-21T00:17:06.948425+0000","last_unstale":"2023-09-21T00:17:10.963842+0000","last_undegraded":"2023-09-21T00:17:10.963842+0000","last_fullsized":"2023-09-21T00:17:10.963842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:45:42.036094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-21T00:17:12.242401+0000","last_change":"2023-09-21T00:17:11.139787+0000","last_active":"2023-09-21T00:17:12.242401+0000","last_peered":"2023-09-21T00:17:12.242401+0000","last_clean":"2023-09-21T00:17:12.242401+0000","last_became_active":"2023-09-21T00:17:11.139473+0000","last_became_peered":"2023-09-21T00:17:11.139473+0000","last_unstale":"2023-09-21T00:17:12.242401+0000","last_undegraded":"2023-09-21T00:17:12.242401+0000","last_fullsized":"2023-09-21T00:17:12.242401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:09.943052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:09.943052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:38:17.728778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.967627+0000","last_change":"2023-09-21T00:17:05.919490+0000","last_active":"2023-09-21T00:17:10.967627+0000","last_peered":"2023-09-21T00:17:10.967627+0000","last_clean":"2023-09-21T00:17:10.967627+0000","last_became_active":"2023-09-21T00:17:05.919182+0000","last_became_peered":"2023-09-21T00:17:05.919182+0000","last_unstale":"2023-09-21T00:17:10.967627+0000","last_undegraded":"2023-09-21T00:17:10.967627+0000","last_fullsized":"2023-09-21T00:17:10.967627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:04.900631+0000","last_clean_scrub_stamp":"2023-09-21T00:17:04.900631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T12:05:24.959728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:11.140401+0000","last_change":"2023-09-21T00:17:06.947423+0000","last_active":"2023-09-21T00:17:11.140401+0000","last_peered":"2023-09-21T00:17:11.140401+0000","last_clean":"2023-09-21T00:17:11.140401+0000","last_became_active":"2023-09-21T00:17:06.947138+0000","last_became_peered":"2023-09-21T00:17:06.947138+0000","last_unstale":"2023-09-21T00:17:11.140401+0000","last_undegraded":"2023-09-21T00:17:11.140401+0000","last_fullsized":"2023-09-21T00:17:11.140401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:53:15.179754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952567+0000","last_change":"2023-09-21T00:17:06.935110+0000","last_active":"2023-09-21T00:17:10.952567+0000","last_peered":"2023-09-21T00:17:10.952567+0000","last_clean":"2023-09-21T00:17:10.952567+0000","last_became_active":"2023-09-21T00:17:06.934658+0000","last_became_peered":"2023-09-21T00:17:06.934658+0000","last_unstale":"2023-09-21T00:17:10.952567+0000","last_undegraded":"2023-09-21T00:17:10.952567+0000","last_fullsized":"2023-09-21T00:17:10.952567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:17:22.988451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.966596+0000","last_change":"2023-09-21T00:17:06.947131+0000","last_active":"2023-09-21T00:17:10.966596+0000","last_peered":"2023-09-21T00:17:10.966596+0000","last_clean":"2023-09-21T00:17:10.966596+0000","last_became_active":"2023-09-21T00:17:06.946817+0000","last_became_peered":"2023-09-21T00:17:06.946817+0000","last_unstale":"2023-09-21T00:17:10.966596+0000","last_undegraded":"2023-09-21T00:17:10.966596+0000","last_fullsized":"2023-09-21T00:17:10.966596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:43:07.604113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963724+0000","last_change":"2023-09-21T00:17:06.950723+0000","last_active":"2023-09-21T00:17:10.963724+0000","last_peered":"2023-09-21T00:17:10.963724+0000","last_clean":"2023-09-21T00:17:10.963724+0000","last_became_active":"2023-09-21T00:17:06.950464+0000","last_became_peered":"2023-09-21T00:17:06.950464+0000","last_unstale":"2023-09-21T00:17:10.963724+0000","last_undegraded":"2023-09-21T00:17:10.963724+0000","last_fullsized":"2023-09-21T00:17:10.963724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:31:49.356708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.960636+0000","last_change":"2023-09-21T00:17:06.931583+0000","last_active":"2023-09-21T00:17:10.960636+0000","last_peered":"2023-09-21T00:17:10.960636+0000","last_clean":"2023-09-21T00:17:10.960636+0000","last_became_active":"2023-09-21T00:17:06.931288+0000","last_became_peered":"2023-09-21T00:17:06.931288+0000","last_unstale":"2023-09-21T00:17:10.960636+0000","last_undegraded":"2023-09-21T00:17:10.960636+0000","last_fullsized":"2023-09-21T00:17:10.960636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:16:31.202329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952778+0000","last_change":"2023-09-21T00:17:06.935897+0000","last_active":"2023-09-21T00:17:10.952778+0000","last_peered":"2023-09-21T00:17:10.952778+0000","last_clean":"2023-09-21T00:17:10.952778+0000","last_became_active":"2023-09-21T00:17:06.934839+0000","last_became_peered":"2023-09-21T00:17:06.934839+0000","last_unstale":"2023-09-21T00:17:10.952778+0000","last_undegraded":"2023-09-21T00:17:10.952778+0000","last_fullsized":"2023-09-21T00:17:10.952778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:44:31.363217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.971043+0000","last_change":"2023-09-21T00:17:06.938775+0000","last_active":"2023-09-21T00:17:10.971043+0000","last_peered":"2023-09-21T00:17:10.971043+0000","last_clean":"2023-09-21T00:17:10.971043+0000","last_became_active":"2023-09-21T00:17:06.938299+0000","last_became_peered":"2023-09-21T00:17:06.938299+0000","last_unstale":"2023-09-21T00:17:10.971043+0000","last_undegraded":"2023-09-21T00:17:10.971043+0000","last_fullsized":"2023-09-21T00:17:10.971043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:33:02.098745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.953339+0000","last_change":"2023-09-21T00:17:06.936698+0000","last_active":"2023-09-21T00:17:10.953339+0000","last_peered":"2023-09-21T00:17:10.953339+0000","last_clean":"2023-09-21T00:17:10.953339+0000","last_became_active":"2023-09-21T00:17:06.936405+0000","last_became_peered":"2023-09-21T00:17:06.936405+0000","last_unstale":"2023-09-21T00:17:10.953339+0000","last_undegraded":"2023-09-21T00:17:10.953339+0000","last_fullsized":"2023-09-21T00:17:10.953339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:34:25.102514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.953420+0000","last_change":"2023-09-21T00:17:06.934511+0000","last_active":"2023-09-21T00:17:10.953420+0000","last_peered":"2023-09-21T00:17:10.953420+0000","last_clean":"2023-09-21T00:17:10.953420+0000","last_became_active":"2023-09-21T00:17:06.934142+0000","last_became_peered":"2023-09-21T00:17:06.934142+0000","last_unstale":"2023-09-21T00:17:10.953420+0000","last_undegraded":"2023-09-21T00:17:10.953420+0000","last_fullsized":"2023-09-21T00:17:10.953420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:34:25.102514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963582+0000","last_change":"2023-09-21T00:17:06.948765+0000","last_active":"2023-09-21T00:17:10.963582+0000","last_peered":"2023-09-21T00:17:10.963582+0000","last_clean":"2023-09-21T00:17:10.963582+0000","last_became_active":"2023-09-21T00:17:06.948437+0000","last_became_peered":"2023-09-21T00:17:06.948437+0000","last_unstale":"2023-09-21T00:17:10.963582+0000","last_undegraded":"2023-09-21T00:17:10.963582+0000","last_fullsized":"2023-09-21T00:17:10.963582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T11:15:08.495079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.952376+0000","last_change":"2023-09-21T00:17:06.934818+0000","last_active":"2023-09-21T00:17:10.952376+0000","last_peered":"2023-09-21T00:17:10.952376+0000","last_clean":"2023-09-21T00:17:10.952376+0000","last_became_active":"2023-09-21T00:17:06.934520+0000","last_became_peered":"2023-09-21T00:17:06.934520+0000","last_unstale":"2023-09-21T00:17:10.952376+0000","last_undegraded":"2023-09-21T00:17:10.952376+0000","last_fullsized":"2023-09-21T00:17:10.952376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:30:26.002264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.963843+0000","last_change":"2023-09-21T00:17:06.947489+0000","last_active":"2023-09-21T00:17:10.963843+0000","last_peered":"2023-09-21T00:17:10.963843+0000","last_clean":"2023-09-21T00:17:10.963843+0000","last_became_active":"2023-09-21T00:17:06.947209+0000","last_became_peered":"2023-09-21T00:17:06.947209+0000","last_unstale":"2023-09-21T00:17:10.963843+0000","last_undegraded":"2023-09-21T00:17:10.963843+0000","last_fullsized":"2023-09-21T00:17:10.963843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:41:27.691190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.960736+0000","last_change":"2023-09-21T00:17:06.938924+0000","last_active":"2023-09-21T00:17:10.960736+0000","last_peered":"2023-09-21T00:17:10.960736+0000","last_clean":"2023-09-21T00:17:10.960736+0000","last_became_active":"2023-09-21T00:17:06.938643+0000","last_became_peered":"2023-09-21T00:17:06.938643+0000","last_unstale":"2023-09-21T00:17:10.960736+0000","last_undegraded":"2023-09-21T00:17:10.960736+0000","last_fullsized":"2023-09-21T00:17:10.960736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:34:25.102514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-21T00:17:10.953697+0000","last_change":"2023-09-21T00:17:06.931839+0000","last_active":"2023-09-21T00:17:10.953697+0000","last_peered":"2023-09-21T00:17:10.953697+0000","last_clean":"2023-09-21T00:17:10.953697+0000","last_became_active":"2023-09-21T00:17:06.931573+0000","last_became_peered":"2023-09-21T00:17:06.931573+0000","last_unstale":"2023-09-21T00:17:10.953697+0000","last_undegraded":"2023-09-21T00:17:10.953697+0000","last_fullsized":"2023-09-21T00:17:10.953697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:17:05.905052+0000","last_clean_scrub_stamp":"2023-09-21T00:17:05.905052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:16:31.202329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":690786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-21T00:17:36.410 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-09-21T00:17:36.411 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-09-21T00:17:36.411 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-09-21T00:17:36.411 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-21T00:17:36.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.566+0000 7f6d71b4b700 1 Processor -- start 2023-09-21T00:17:36.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.566+0000 7f6d71b4b700 1 -- start start 2023-09-21T00:17:36.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.567+0000 7f6d71b4b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6d6c15e910 0x7f6d6c15f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:36.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.567+0000 7f6d71b4b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6d6c0b54a0 0x7f6d6c0cc250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:36.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.567+0000 7f6d71b4b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d6c0cc790 0x7f6d6c070de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:36.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.567+0000 7f6d71b4b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d6c0ccc40 con 0x7f6d6c0b54a0 2023-09-21T00:17:36.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.567+0000 7f6d71b4b700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d6c06d080 con 0x7f6d6c15e910 2023-09-21T00:17:36.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.567+0000 7f6d71b4b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c15ecf0 con 0x7f6d6c0cc790 2023-09-21T00:17:36.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.567+0000 7f6d6affd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6d6c0b54a0 0x7f6d6c0cc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:36.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.567+0000 7f6d6affd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6d6c0b54a0 0x7f6d6c0cc250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51840/0 (socket says 172.21.15.59:51840) 2023-09-21T00:17:36.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.567+0000 7f6d6affd700 1 -- 172.21.15.59:0/3870890802 learned_addr learned my addr 172.21.15.59:0/3870890802 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:36.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.567+0000 7f6d6b7fe700 1 --2- 172.21.15.59:0/3870890802 >> v2:172.21.15.83:3300/0 conn(0x7f6d6c15e910 0x7f6d6c15f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:36.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.567+0000 7f6d6bfff700 1 --2- 172.21.15.59:0/3870890802 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d6c0cc790 0x7f6d6c070de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:36.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.568+0000 7f6d6affd700 1 -- 172.21.15.59:0/3870890802 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d6c0cc790 msgr2=0x7f6d6c070de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:36.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.568+0000 7f6d6affd700 1 --2- 172.21.15.59:0/3870890802 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d6c0cc790 0x7f6d6c070de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:36.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.568+0000 7f6d6affd700 1 -- 172.21.15.59:0/3870890802 >> v2:172.21.15.83:3300/0 conn(0x7f6d6c15e910 msgr2=0x7f6d6c15f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:36.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.568+0000 7f6d6affd700 1 --2- 172.21.15.59:0/3870890802 >> v2:172.21.15.83:3300/0 conn(0x7f6d6c15e910 0x7f6d6c15f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:36.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.568+0000 7f6d6affd700 1 -- 172.21.15.59:0/3870890802 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d6c15fe10 con 0x7f6d6c0b54a0 2023-09-21T00:17:36.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.568+0000 7f6d6b7fe700 1 --2- 172.21.15.59:0/3870890802 >> v2:172.21.15.83:3300/0 conn(0x7f6d6c15e910 0x7f6d6c15f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:17:36.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.568+0000 7f6d6affd700 1 --2- 172.21.15.59:0/3870890802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d6c0b54a0 0x7f6d6c0cc250 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c0b5900 tx=0x7f6d54009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f231fb6f968177 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:36.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.568+0000 7f6d6a7fc700 1 -- 172.21.15.59:0/3870890802 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5400b870 con 0x7f6d6c0b54a0 2023-09-21T00:17:36.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.568+0000 7f6d6a7fc700 1 -- 172.21.15.59:0/3870890802 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d5400b9d0 con 0x7f6d6c0b54a0 2023-09-21T00:17:36.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.568+0000 7f6d6a7fc700 1 -- 172.21.15.59:0/3870890802 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5400bd60 con 0x7f6d6c0b54a0 2023-09-21T00:17:36.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.568+0000 7f6d71b4b700 1 -- 172.21.15.59:0/3870890802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d6c0b54a0 msgr2=0x7f6d6c0cc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:36.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.568+0000 7f6d71b4b700 1 --2- 172.21.15.59:0/3870890802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d6c0b54a0 0x7f6d6c0cc250 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c0b5900 tx=0x7f6d54009bd0 comp rx=0 tx=0).stop 2023-09-21T00:17:36.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.568+0000 7f6d71b4b700 1 -- 172.21.15.59:0/3870890802 shutdown_connections 2023-09-21T00:17:36.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.568+0000 7f6d71b4b700 1 --2- 172.21.15.59:0/3870890802 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d6c0cc790 0x7f6d6c070de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:36.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.568+0000 7f6d71b4b700 1 --2- 172.21.15.59:0/3870890802 >> v2:172.21.15.83:3300/0 conn(0x7f6d6c15e910 0x7f6d6c15f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:36.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.568+0000 7f6d71b4b700 1 --2- 172.21.15.59:0/3870890802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d6c0b54a0 0x7f6d6c0cc250 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:36.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.568+0000 7f6d71b4b700 1 -- 172.21.15.59:0/3870890802 >> 172.21.15.59:0/3870890802 conn(0x7f6d6c06a780 msgr2=0x7f6d6c06ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:36.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.569+0000 7f6d71b4b700 1 -- 172.21.15.59:0/3870890802 shutdown_connections 2023-09-21T00:17:36.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.569+0000 7f6d71b4b700 1 -- 172.21.15.59:0/3870890802 wait complete. 2023-09-21T00:17:36.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.570+0000 7f6d71b4b700 1 Processor -- start 2023-09-21T00:17:36.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.570+0000 7f6d71b4b700 1 -- start start 2023-09-21T00:17:36.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.571+0000 7f6d71b4b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d6c0b54a0 0x7f6d6c0cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:36.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.571+0000 7f6d71b4b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d6c0cc790 0x7f6d6c149270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:36.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.571+0000 7f6d71b4b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d6c15e910 0x7f6d6c154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:36.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.571+0000 7f6d71b4b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c1497b0 con 0x7f6d6c0cc790 2023-09-21T00:17:36.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.571+0000 7f6d71b4b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c151960 con 0x7f6d6c15e910 2023-09-21T00:17:36.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.571+0000 7f6d71b4b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c15ddc0 con 0x7f6d6c0b54a0 2023-09-21T00:17:36.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.571+0000 7f6d6affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d6c0cc790 0x7f6d6c149270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:36.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.571+0000 7f6d6b7fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d6c0b54a0 0x7f6d6c0cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:36.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.571+0000 7f6d6bfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d6c15e910 0x7f6d6c154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:36.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.571+0000 7f6d6affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d6c0cc790 0x7f6d6c149270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51846/0 (socket says 172.21.15.59:51846) 2023-09-21T00:17:36.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.571+0000 7f6d6b7fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d6c0b54a0 0x7f6d6c0cbab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.59:52460/0 (socket says 172.21.15.59:52460) 2023-09-21T00:17:36.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.571+0000 7f6d6affd700 1 -- 172.21.15.59:0/2526182644 learned_addr learned my addr 172.21.15.59:0/2526182644 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:36.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.571+0000 7f6d6affd700 1 -- 172.21.15.59:0/2526182644 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d6c0b54a0 msgr2=0x7f6d6c0cbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:36.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.571+0000 7f6d6affd700 1 --2- 172.21.15.59:0/2526182644 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d6c0b54a0 0x7f6d6c0cbab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:36.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.571+0000 7f6d6affd700 1 -- 172.21.15.59:0/2526182644 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d6c15e910 msgr2=0x7f6d6c154a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:36.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.571+0000 7f6d6affd700 1 --2- 172.21.15.59:0/2526182644 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d6c15e910 0x7f6d6c154a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:36.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.571+0000 7f6d6affd700 1 -- 172.21.15.59:0/2526182644 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d54009550 con 0x7f6d6c0cc790 2023-09-21T00:17:36.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.571+0000 7f6d6affd700 1 --2- 172.21.15.59:0/2526182644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d6c0cc790 0x7f6d6c149270 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6d54013000 tx=0x7f6d54004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:36.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.571+0000 7f6d63fff700 1 -- 172.21.15.59:0/2526182644 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d54004480 con 0x7f6d6c0cc790 2023-09-21T00:17:36.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.571+0000 7f6d63fff700 1 -- 172.21.15.59:0/2526182644 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d540045e0 con 0x7f6d6c0cc790 2023-09-21T00:17:36.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.572+0000 7f6d63fff700 1 -- 172.21.15.59:0/2526182644 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d540038e0 con 0x7f6d6c0cc790 2023-09-21T00:17:36.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.572+0000 7f6d71b4b700 1 -- 172.21.15.59:0/2526182644 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d6c15dae0 con 0x7f6d6c0cc790 2023-09-21T00:17:36.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.572+0000 7f6d71b4b700 1 -- 172.21.15.59:0/2526182644 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d6c0cb2b0 con 0x7f6d6c0cc790 2023-09-21T00:17:36.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.572+0000 7f6d71b4b700 1 -- 172.21.15.59:0/2526182644 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d6c06b780 con 0x7f6d6c0cc790 2023-09-21T00:17:36.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.573+0000 7f6d63fff700 1 -- 172.21.15.59:0/2526182644 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f6d54021070 con 0x7f6d6c0cc790 2023-09-21T00:17:36.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.573+0000 7f6d63fff700 1 --2- 172.21.15.59:0/2526182644 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f6d4c06ae00 0x7f6d4c06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:36.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.574+0000 7f6d63fff700 1 -- 172.21.15.59:0/2526182644 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6d5408ae10 con 0x7f6d6c0cc790 2023-09-21T00:17:36.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.574+0000 7f6d6b7fe700 1 --2- 172.21.15.59:0/2526182644 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f6d4c06ae00 0x7f6d4c06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:36.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.574+0000 7f6d6b7fe700 1 --2- 172.21.15.59:0/2526182644 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f6d4c06ae00 0x7f6d4c06d2c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c006f10 tx=0x7f6d5c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:36.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.578+0000 7f6d63fff700 1 -- 172.21.15.59:0/2526182644 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f6d54055cd0 con 0x7f6d6c0cc790 2023-09-21T00:17:36.676 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:17:36.679 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:17:36.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.825+0000 7f6d71b4b700 1 -- 172.21.15.59:0/2526182644 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f6d6c0ce400 con 0x7f6d6c0cc790 2023-09-21T00:17:36.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.826+0000 7f6d63fff700 1 -- 172.21.15.59:0/2526182644 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f6d54015040 con 0x7f6d6c0cc790 2023-09-21T00:17:36.827 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:17:36.827 INFO:teuthology.orchestra.run.smithi059.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-09-21T00:17:36.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.827+0000 7f6d71b4b700 1 -- 172.21.15.59:0/2526182644 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f6d4c06ae00 msgr2=0x7f6d4c06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:36.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.828+0000 7f6d71b4b700 1 --2- 172.21.15.59:0/2526182644 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f6d4c06ae00 0x7f6d4c06d2c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c006f10 tx=0x7f6d5c008040 comp rx=0 tx=0).stop 2023-09-21T00:17:36.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.828+0000 7f6d71b4b700 1 -- 172.21.15.59:0/2526182644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d6c0cc790 msgr2=0x7f6d6c149270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:36.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.828+0000 7f6d71b4b700 1 --2- 172.21.15.59:0/2526182644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d6c0cc790 0x7f6d6c149270 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6d54013000 tx=0x7f6d54004750 comp rx=0 tx=0).stop 2023-09-21T00:17:36.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.828+0000 7f6d71b4b700 1 -- 172.21.15.59:0/2526182644 shutdown_connections 2023-09-21T00:17:36.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.828+0000 7f6d71b4b700 1 --2- 172.21.15.59:0/2526182644 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d6c15e910 0x7f6d6c154a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:36.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.828+0000 7f6d71b4b700 1 --2- 172.21.15.59:0/2526182644 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f6d4c06ae00 0x7f6d4c06d2c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:36.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.828+0000 7f6d71b4b700 1 --2- 172.21.15.59:0/2526182644 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6d6c0b54a0 0x7f6d6c0cbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:36.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.828+0000 7f6d71b4b700 1 --2- 172.21.15.59:0/2526182644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d6c0cc790 0x7f6d6c149270 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:36.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.828+0000 7f6d71b4b700 1 -- 172.21.15.59:0/2526182644 >> 172.21.15.59:0/2526182644 conn(0x7f6d6c06a780 msgr2=0x7f6d6c070ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:36.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.828+0000 7f6d71b4b700 1 -- 172.21.15.59:0/2526182644 shutdown_connections 2023-09-21T00:17:36.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.828+0000 7f6d71b4b700 1 -- 172.21.15.59:0/2526182644 wait complete. 2023-09-21T00:17:36.841 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-09-21T00:17:36.841 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T00:17:36.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.965+0000 7f2bf4fe0700 1 Processor -- start 2023-09-21T00:17:36.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.965+0000 7f2bf4fe0700 1 -- start start 2023-09-21T00:17:36.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.966+0000 7f2bf4fe0700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2bf015b2b0 0x7f2bf00cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:36.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.966+0000 7f2bf4fe0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bf006a780 0x7f2bf006abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:36.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.966+0000 7f2bf4fe0700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bf006b110 con 0x7f2bf00ce420 2023-09-21T00:17:36.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.966+0000 7f2bf4fe0700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bf00ce250 con 0x7f2bf015b2b0 2023-09-21T00:17:36.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.966+0000 7f2bf4fe0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf01618a0 con 0x7f2bf006a780 2023-09-21T00:17:36.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.967+0000 7f2beed9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bf006a780 0x7f2bf006abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:36.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.967+0000 7f2bee59c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2bf015b2b0 0x7f2bf00cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:36.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.967+0000 7f2beed9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bf006a780 0x7f2bf006abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.59:52470/0 (socket says 172.21.15.59:52470) 2023-09-21T00:17:36.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.967+0000 7f2bee59c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2bf015b2b0 0x7f2bf00cdd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.59:37968/0 (socket says 172.21.15.59:37968) 2023-09-21T00:17:36.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.967+0000 7f2bedd9b700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f2bf00ce420 0x7f2bf0161190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.59:47920/0 (socket says 172.21.15.59:47920) 2023-09-21T00:17:36.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.967+0000 7f2beed9d700 1 -- 172.21.15.59:0/175604507 learned_addr learned my addr 172.21.15.59:0/175604507 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:36.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.967+0000 7f2beed9d700 1 -- 172.21.15.59:0/175604507 >> v2:172.21.15.83:3300/0 conn(0x7f2bf015b2b0 msgr2=0x7f2bf00cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:36.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.967+0000 7f2beed9d700 1 --2- 172.21.15.59:0/175604507 >> v2:172.21.15.83:3300/0 conn(0x7f2bf015b2b0 0x7f2bf00cdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:36.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.967+0000 7f2beed9d700 1 -- 172.21.15.59:0/175604507 >> v1:172.21.15.83:6789/0 conn(0x7f2bf00ce420 legacy=0x7f2bf0161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:36.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.967+0000 7f2beed9d700 1 -- 172.21.15.59:0/175604507 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf00cfee0 con 0x7f2bf006a780 2023-09-21T00:17:36.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.967+0000 7f2beed9d700 1 --2- 172.21.15.59:0/175604507 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bf006a780 0x7f2bf006abd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2be8009e50 tx=0x7f2be800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a5b641242a17612 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:36.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.967+0000 7f2bed59a700 1 -- 172.21.15.59:0/175604507 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be800e070 con 0x7f2bf006a780 2023-09-21T00:17:36.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.967+0000 7f2bed59a700 1 -- 172.21.15.59:0/175604507 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2be800b910 con 0x7f2bf006a780 2023-09-21T00:17:36.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.967+0000 7f2bed59a700 1 -- 172.21.15.59:0/175604507 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be800bcc0 con 0x7f2bf006a780 2023-09-21T00:17:36.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.968+0000 7f2bf4fe0700 1 -- 172.21.15.59:0/175604507 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bf006a780 msgr2=0x7f2bf006abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:36.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.968+0000 7f2bf4fe0700 1 --2- 172.21.15.59:0/175604507 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bf006a780 0x7f2bf006abd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2be8009e50 tx=0x7f2be800b330 comp rx=0 tx=0).stop 2023-09-21T00:17:36.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.968+0000 7f2bf4fe0700 1 -- 172.21.15.59:0/175604507 shutdown_connections 2023-09-21T00:17:36.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.968+0000 7f2bf4fe0700 1 --2- 172.21.15.59:0/175604507 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bf006a780 0x7f2bf006abd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:36.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.968+0000 7f2bf4fe0700 1 --2- 172.21.15.59:0/175604507 >> v2:172.21.15.83:3300/0 conn(0x7f2bf015b2b0 0x7f2bf00cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:36.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.968+0000 7f2bf4fe0700 1 -- 172.21.15.59:0/175604507 >> 172.21.15.59:0/175604507 conn(0x7f2bf00d0140 msgr2=0x7f2bf00d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:36.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.968+0000 7f2bf4fe0700 1 -- 172.21.15.59:0/175604507 shutdown_connections 2023-09-21T00:17:36.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.968+0000 7f2bf4fe0700 1 -- 172.21.15.59:0/175604507 wait complete. 2023-09-21T00:17:36.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.969+0000 7f2bf4fe0700 1 Processor -- start 2023-09-21T00:17:36.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.969+0000 7f2bf4fe0700 1 -- start start 2023-09-21T00:17:36.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.970+0000 7f2bf4fe0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2bf006a780 0x7f2bf014c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:36.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.970+0000 7f2bf4fe0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bf00ce420 0x7f2bf00c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:36.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.970+0000 7f2bf4fe0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bf015b2b0 0x7f2bf00c6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:36.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.970+0000 7f2bf4fe0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf01f4000 con 0x7f2bf015b2b0 2023-09-21T00:17:36.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.970+0000 7f2bf4fe0700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf01f3380 con 0x7f2bf006a780 2023-09-21T00:17:36.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.970+0000 7f2bf4fe0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf01f3660 con 0x7f2bf00ce420 2023-09-21T00:17:36.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.970+0000 7f2beed9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bf015b2b0 0x7f2bf00c6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:36.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.970+0000 7f2beed9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bf015b2b0 0x7f2bf00c6380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51860/0 (socket says 172.21.15.59:51860) 2023-09-21T00:17:36.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.970+0000 7f2beed9d700 1 -- 172.21.15.59:0/1597391882 learned_addr learned my addr 172.21.15.59:0/1597391882 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:36.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.970+0000 7f2bee59c700 1 --2- 172.21.15.59:0/1597391882 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2bf006a780 0x7f2bf014c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:36.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.970+0000 7f2bedd9b700 1 --2- 172.21.15.59:0/1597391882 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bf00ce420 0x7f2bf00c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:36.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.971+0000 7f2beed9d700 1 -- 172.21.15.59:0/1597391882 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bf00ce420 msgr2=0x7f2bf00c5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:36.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.971+0000 7f2beed9d700 1 --2- 172.21.15.59:0/1597391882 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bf00ce420 0x7f2bf00c5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:36.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.971+0000 7f2beed9d700 1 -- 172.21.15.59:0/1597391882 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2bf006a780 msgr2=0x7f2bf014c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:36.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.971+0000 7f2beed9d700 1 --2- 172.21.15.59:0/1597391882 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2bf006a780 0x7f2bf014c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:36.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.971+0000 7f2beed9d700 1 -- 172.21.15.59:0/1597391882 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be8009b30 con 0x7f2bf015b2b0 2023-09-21T00:17:36.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.971+0000 7f2bee59c700 1 --2- 172.21.15.59:0/1597391882 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2bf006a780 0x7f2bf014c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T00:17:36.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.971+0000 7f2beed9d700 1 --2- 172.21.15.59:0/1597391882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bf015b2b0 0x7f2bf00c6380 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2bf01619e0 tx=0x7f2be8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:36.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.971+0000 7f2bdeffd700 1 -- 172.21.15.59:0/1597391882 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be8004800 con 0x7f2bf015b2b0 2023-09-21T00:17:36.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.971+0000 7f2bdeffd700 1 -- 172.21.15.59:0/1597391882 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2be8004960 con 0x7f2bf015b2b0 2023-09-21T00:17:36.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.971+0000 7f2bf4fe0700 1 -- 172.21.15.59:0/1597391882 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bf01f3940 con 0x7f2bf015b2b0 2023-09-21T00:17:36.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.971+0000 7f2bdeffd700 1 -- 172.21.15.59:0/1597391882 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be801c680 con 0x7f2bf015b2b0 2023-09-21T00:17:36.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.971+0000 7f2bf4fe0700 1 -- 172.21.15.59:0/1597391882 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bf00b3fa0 con 0x7f2bf015b2b0 2023-09-21T00:17:36.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.972+0000 7f2bf4fe0700 1 -- 172.21.15.59:0/1597391882 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bf0067e50 con 0x7f2bf015b2b0 2023-09-21T00:17:36.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.972+0000 7f2bdeffd700 1 -- 172.21.15.59:0/1597391882 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f2be801c7e0 con 0x7f2bf015b2b0 2023-09-21T00:17:36.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.973+0000 7f2bdeffd700 1 --2- 172.21.15.59:0/1597391882 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f2bd006ae00 0x7f2bd006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:36.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.973+0000 7f2bdeffd700 1 -- 172.21.15.59:0/1597391882 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2be808b410 con 0x7f2bf015b2b0 2023-09-21T00:17:36.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.973+0000 7f2bee59c700 1 --2- 172.21.15.59:0/1597391882 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f2bd006ae00 0x7f2bd006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:36.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.973+0000 7f2bee59c700 1 --2- 172.21.15.59:0/1597391882 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f2bd006ae00 0x7f2bd006d2c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2bf00b5ca0 tx=0x7f2be4009210 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:36.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:36.977+0000 7f2bdeffd700 1 -- 172.21.15.59:0/1597391882 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f2be8056250 con 0x7f2bf015b2b0 2023-09-21T00:17:37.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.181+0000 7f2bf4fe0700 1 -- 172.21.15.59:0/1597391882 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2bf00cee90 con 0x7f2bf015b2b0 2023-09-21T00:17:37.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.182+0000 7f2bdeffd700 1 -- 172.21.15.59:0/1597391882 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18262 (secure 0 0 0) 0x7f2be8059870 con 0x7f2bf015b2b0 2023-09-21T00:17:37.183 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:17:37.183 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":24,"fsid":"dd69925c-6e25-42fe-880b-2f60fc6f384b","created":"2023-09-21T00:16:43.074489+0000","modified":"2023-09-21T00:17:11.387529+0000","last_up_change":"2023-09-21T00:16:54.740101+0000","last_in_change":"2023-09-21T00:16:45.987089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T00:16:54.796248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-21T00:17:04.167102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-21T00:17:05.313188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-21T00:17:08.977609+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d4b18344-74c0-4f75-920b-7a9247e48914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6809","nonce":2418314235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6811","nonce":2418314235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6815","nonce":2418314235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6813","nonce":2418314235}]},"public_addr":"172.21.15.59:6809/2418314235","cluster_addr":"172.21.15.59:6811/2418314235","heartbeat_back_addr":"172.21.15.59:6815/2418314235","heartbeat_front_addr":"172.21.15.59:6813/2418314235","state":["exists","up"]},{"osd":1,"uuid":"80940d50-a248-4e64-a282-7ffcdad790ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6801","nonce":869668251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6803","nonce":869668251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6807","nonce":869668251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6805","nonce":869668251}]},"public_addr":"172.21.15.59:6801/869668251","cluster_addr":"172.21.15.59:6803/869668251","heartbeat_back_addr":"172.21.15.59:6807/869668251","heartbeat_front_addr":"172.21.15.59:6805/869668251","state":["exists","up"]},{"osd":2,"uuid":"55f2eceb-c54a-4879-a6ce-968c1c548b5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6817","nonce":372517778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6819","nonce":372517778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6823","nonce":372517778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6821","nonce":372517778}]},"public_addr":"172.21.15.59:6817/372517778","cluster_addr":"172.21.15.59:6819/372517778","heartbeat_back_addr":"172.21.15.59:6823/372517778","heartbeat_front_addr":"172.21.15.59:6821/372517778","state":["exists","up"]},{"osd":3,"uuid":"92b89cd0-869c-49b9-a9f9-97ac8423f304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6825","nonce":575188498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6827","nonce":575188498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6831","nonce":575188498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6829","nonce":575188498}]},"public_addr":"172.21.15.59:6825/575188498","cluster_addr":"172.21.15.59:6827/575188498","heartbeat_back_addr":"172.21.15.59:6831/575188498","heartbeat_front_addr":"172.21.15.59:6829/575188498","state":["exists","up"]},{"osd":4,"uuid":"25b80e94-e0e6-403d-b69f-61542f289637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6803","nonce":1741219098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6805","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6807","nonce":1741219098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6815","nonce":1741219098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6811","nonce":1741219098}]},"public_addr":"172.21.15.83:6803/1741219098","cluster_addr":"172.21.15.83:6807/1741219098","heartbeat_back_addr":"172.21.15.83:6815/1741219098","heartbeat_front_addr":"172.21.15.83:6811/1741219098","state":["exists","up"]},{"osd":5,"uuid":"5498d9ab-1086-4796-a199-9051e6dfea91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6817","nonce":156730565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6819","nonce":156730565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6823","nonce":156730565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6821","nonce":156730565}]},"public_addr":"172.21.15.83:6817/156730565","cluster_addr":"172.21.15.83:6819/156730565","heartbeat_back_addr":"172.21.15.83:6823/156730565","heartbeat_front_addr":"172.21.15.83:6821/156730565","state":["exists","up"]},{"osd":6,"uuid":"cfd810c0-5015-4d60-9a75-7efc93a32e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6801","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6800","nonce":1337723778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6806","nonce":1337723778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6814","nonce":1337723778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6810","nonce":1337723778}]},"public_addr":"172.21.15.83:6800/1337723778","cluster_addr":"172.21.15.83:6806/1337723778","heartbeat_back_addr":"172.21.15.83:6814/1337723778","heartbeat_front_addr":"172.21.15.83:6810/1337723778","state":["exists","up"]},{"osd":7,"uuid":"e992c8fa-0a3d-4b3c-85b5-2c511223dee4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6825","nonce":4204859272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6827","nonce":4204859272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6831","nonce":4204859272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6829","nonce":4204859272}]},"public_addr":"172.21.15.83:6825/4204859272","cluster_addr":"172.21.15.83:6827/4204859272","heartbeat_back_addr":"172.21.15.83:6831/4204859272","heartbeat_front_addr":"172.21.15.83:6829/4204859272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.156498+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.882707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.093978+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.158565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.173933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.888606+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.135525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.149712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T00:17:37.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.184+0000 7f2bf4fe0700 1 -- 172.21.15.59:0/1597391882 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f2bd006ae00 msgr2=0x7f2bd006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:37.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.184+0000 7f2bf4fe0700 1 --2- 172.21.15.59:0/1597391882 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f2bd006ae00 0x7f2bd006d2c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2bf00b5ca0 tx=0x7f2be4009210 comp rx=0 tx=0).stop 2023-09-21T00:17:37.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.184+0000 7f2bf4fe0700 1 -- 172.21.15.59:0/1597391882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bf015b2b0 msgr2=0x7f2bf00c6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:37.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.184+0000 7f2bf4fe0700 1 --2- 172.21.15.59:0/1597391882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bf015b2b0 0x7f2bf00c6380 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2bf01619e0 tx=0x7f2be8004ad0 comp rx=0 tx=0).stop 2023-09-21T00:17:37.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.184+0000 7f2bf4fe0700 1 -- 172.21.15.59:0/1597391882 shutdown_connections 2023-09-21T00:17:37.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.184+0000 7f2bf4fe0700 1 --2- 172.21.15.59:0/1597391882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bf015b2b0 0x7f2bf00c6380 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:37.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.184+0000 7f2bf4fe0700 1 --2- 172.21.15.59:0/1597391882 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2bf006a780 0x7f2bf014c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:37.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.184+0000 7f2bf4fe0700 1 --2- 172.21.15.59:0/1597391882 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f2bd006ae00 0x7f2bd006d2c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:37.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.184+0000 7f2bf4fe0700 1 --2- 172.21.15.59:0/1597391882 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bf00ce420 0x7f2bf00c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:37.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.184+0000 7f2bf4fe0700 1 -- 172.21.15.59:0/1597391882 >> 172.21.15.59:0/1597391882 conn(0x7f2bf00d0140 msgr2=0x7f2bf015a730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:37.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.184+0000 7f2bf4fe0700 1 -- 172.21.15.59:0/1597391882 shutdown_connections 2023-09-21T00:17:37.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.184+0000 7f2bf4fe0700 1 -- 172.21.15.59:0/1597391882 wait complete. 2023-09-21T00:17:37.198 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-21T00:16:54.796248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-21T00:17:04.167102+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-21T00:17:05.313188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-21T00:17:08.977609+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-21T00:17:37.198 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-21T00:17:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.326+0000 7f8bc486c700 1 Processor -- start 2023-09-21T00:17:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.326+0000 7f8bc486c700 1 -- start start 2023-09-21T00:17:37.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.327+0000 7f8bc486c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8bc015b2b0 0x7f8bc00cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:37.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.327+0000 7f8bc486c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8bc00ce420 0x7f8bc0161190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:37.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.327+0000 7f8bc486c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8bc006a780 0x7f8bc006abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:37.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.327+0000 7f8bc486c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bc00ce250 con 0x7f8bc015b2b0 2023-09-21T00:17:37.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.327+0000 7f8bc486c700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bc006b110 con 0x7f8bc006a780 2023-09-21T00:17:37.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.327+0000 7f8bc486c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc00cfee0 con 0x7f8bc00ce420 2023-09-21T00:17:37.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.327+0000 7f8bbe59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8bc015b2b0 0x7f8bc00cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:37.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.327+0000 7f8bbe59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8bc015b2b0 0x7f8bc00cdd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51864/0 (socket says 172.21.15.59:51864) 2023-09-21T00:17:37.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.327+0000 7f8bbe59c700 1 -- 172.21.15.59:0/1667917606 learned_addr learned my addr 172.21.15.59:0/1667917606 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:37.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.327+0000 7f8bbed9d700 1 --2- 172.21.15.59:0/1667917606 >> v2:172.21.15.83:3300/0 conn(0x7f8bc006a780 0x7f8bc006abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:37.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.327+0000 7f8bbdd9b700 1 --2- 172.21.15.59:0/1667917606 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8bc00ce420 0x7f8bc0161190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:37.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.327+0000 7f8bbe59c700 1 -- 172.21.15.59:0/1667917606 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8bc00ce420 msgr2=0x7f8bc0161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.327+0000 7f8bbe59c700 1 --2- 172.21.15.59:0/1667917606 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8bc00ce420 0x7f8bc0161190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.327+0000 7f8bbe59c700 1 -- 172.21.15.59:0/1667917606 >> v2:172.21.15.83:3300/0 conn(0x7f8bc006a780 msgr2=0x7f8bc006abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.327+0000 7f8bbe59c700 1 --2- 172.21.15.59:0/1667917606 >> v2:172.21.15.83:3300/0 conn(0x7f8bc006a780 0x7f8bc006abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.327+0000 7f8bbe59c700 1 -- 172.21.15.59:0/1667917606 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc00ce900 con 0x7f8bc015b2b0 2023-09-21T00:17:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.327+0000 7f8bbe59c700 1 --2- 172.21.15.59:0/1667917606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bc015b2b0 0x7f8bc00cdd10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0072bd0 tx=0x7f8bb0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da17acba283ecd9c server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:37.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.327+0000 7f8bbd59a700 1 -- 172.21.15.59:0/1667917606 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb000b870 con 0x7f8bc015b2b0 2023-09-21T00:17:37.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.327+0000 7f8bbd59a700 1 -- 172.21.15.59:0/1667917606 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb000b9d0 con 0x7f8bc015b2b0 2023-09-21T00:17:37.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.327+0000 7f8bbd59a700 1 -- 172.21.15.59:0/1667917606 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb000bd60 con 0x7f8bc015b2b0 2023-09-21T00:17:37.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.328+0000 7f8bc486c700 1 -- 172.21.15.59:0/1667917606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bc015b2b0 msgr2=0x7f8bc00cdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:37.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.328+0000 7f8bc486c700 1 --2- 172.21.15.59:0/1667917606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bc015b2b0 0x7f8bc00cdd10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0072bd0 tx=0x7f8bb0009bd0 comp rx=0 tx=0).stop 2023-09-21T00:17:37.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.328+0000 7f8bc486c700 1 -- 172.21.15.59:0/1667917606 shutdown_connections 2023-09-21T00:17:37.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.328+0000 7f8bc486c700 1 --2- 172.21.15.59:0/1667917606 >> v2:172.21.15.83:3300/0 conn(0x7f8bc006a780 0x7f8bc006abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:37.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.328+0000 7f8bc486c700 1 --2- 172.21.15.59:0/1667917606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bc015b2b0 0x7f8bc00cdd10 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:37.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.328+0000 7f8bc486c700 1 --2- 172.21.15.59:0/1667917606 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8bc00ce420 0x7f8bc0161190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:37.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.328+0000 7f8bc486c700 1 -- 172.21.15.59:0/1667917606 >> 172.21.15.59:0/1667917606 conn(0x7f8bc00d0140 msgr2=0x7f8bc00d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:37.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.328+0000 7f8bc486c700 1 -- 172.21.15.59:0/1667917606 shutdown_connections 2023-09-21T00:17:37.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.328+0000 7f8bc486c700 1 -- 172.21.15.59:0/1667917606 wait complete. 2023-09-21T00:17:37.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.329+0000 7f8bc486c700 1 Processor -- start 2023-09-21T00:17:37.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.330+0000 7f8bc486c700 1 -- start start 2023-09-21T00:17:37.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.330+0000 7f8bc486c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bc006a780 0x7f8bc01494c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:37.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.330+0000 7f8bc486c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8bc00ce420 0x7f8bc00ad4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:37.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.330+0000 7f8bc486c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8bc015b2b0 0x7f8bc00ad9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:37.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.330+0000 7f8bc486c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc00c42a0 con 0x7f8bc006a780 2023-09-21T00:17:37.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.330+0000 7f8bc486c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc00c3c70 con 0x7f8bc00ce420 2023-09-21T00:17:37.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.330+0000 7f8bc486c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc01e7e30 con 0x7f8bc015b2b0 2023-09-21T00:17:37.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.330+0000 7f8bbe59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bc006a780 0x7f8bc01494c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:37.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.330+0000 7f8bbe59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bc006a780 0x7f8bc01494c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51870/0 (socket says 172.21.15.59:51870) 2023-09-21T00:17:37.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.330+0000 7f8bbe59c700 1 -- 172.21.15.59:0/1165582308 learned_addr learned my addr 172.21.15.59:0/1165582308 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:37.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.331+0000 7f8bbdd9b700 1 --2- 172.21.15.59:0/1165582308 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8bc00ce420 0x7f8bc00ad4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:37.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.331+0000 7f8bbed9d700 1 --2- 172.21.15.59:0/1165582308 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8bc015b2b0 0x7f8bc00ad9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:37.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.331+0000 7f8bbe59c700 1 -- 172.21.15.59:0/1165582308 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8bc015b2b0 msgr2=0x7f8bc00ad9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:37.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.331+0000 7f8bbe59c700 1 --2- 172.21.15.59:0/1165582308 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8bc015b2b0 0x7f8bc00ad9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:37.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.331+0000 7f8bbe59c700 1 -- 172.21.15.59:0/1165582308 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8bc00ce420 msgr2=0x7f8bc00ad4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:37.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.331+0000 7f8bbe59c700 1 --2- 172.21.15.59:0/1165582308 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8bc00ce420 0x7f8bc00ad4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:37.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.331+0000 7f8bbe59c700 1 -- 172.21.15.59:0/1165582308 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb0009550 con 0x7f8bc006a780 2023-09-21T00:17:37.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.331+0000 7f8bbdd9b700 1 --2- 172.21.15.59:0/1165582308 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8bc00ce420 0x7f8bc00ad4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:17:37.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.331+0000 7f8bbe59c700 1 --2- 172.21.15.59:0/1165582308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bc006a780 0x7f8bc01494c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8bc00728c0 tx=0x7f8bb0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:37.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.331+0000 7f8baeffd700 1 -- 172.21.15.59:0/1165582308 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb0004540 con 0x7f8bc006a780 2023-09-21T00:17:37.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.331+0000 7f8baeffd700 1 -- 172.21.15.59:0/1165582308 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb00036a0 con 0x7f8bc006a780 2023-09-21T00:17:37.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.331+0000 7f8bc486c700 1 -- 172.21.15.59:0/1165582308 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bc01e8110 con 0x7f8bc006a780 2023-09-21T00:17:37.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.331+0000 7f8baeffd700 1 -- 172.21.15.59:0/1165582308 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb0003a50 con 0x7f8bc006a780 2023-09-21T00:17:37.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.331+0000 7f8bc486c700 1 -- 172.21.15.59:0/1165582308 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bc0149a00 con 0x7f8bc006a780 2023-09-21T00:17:37.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.332+0000 7f8bc486c700 1 -- 172.21.15.59:0/1165582308 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bc0149b90 con 0x7f8bc006a780 2023-09-21T00:17:37.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.332+0000 7f8baeffd700 1 -- 172.21.15.59:0/1165582308 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f8bb0021070 con 0x7f8bc006a780 2023-09-21T00:17:37.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.333+0000 7f8baeffd700 1 --2- 172.21.15.59:0/1165582308 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f8ba006ae00 0x7f8ba006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:37.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.333+0000 7f8baeffd700 1 -- 172.21.15.59:0/1165582308 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8bb008af10 con 0x7f8bc006a780 2023-09-21T00:17:37.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.333+0000 7f8bbdd9b700 1 --2- 172.21.15.59:0/1165582308 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f8ba006ae00 0x7f8ba006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:37.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.334+0000 7f8bbdd9b700 1 --2- 172.21.15.59:0/1165582308 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f8ba006ae00 0x7f8ba006d2c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8bc00ae2a0 tx=0x7f8bb4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:37.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.337+0000 7f8baeffd700 1 -- 172.21.15.59:0/1165582308 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f8bb0055dd0 con 0x7f8bc006a780 2023-09-21T00:17:37.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.538+0000 7f8bc486c700 1 -- 172.21.15.59:0/1165582308 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8bc0067e50 con 0x7f8bc006a780 2023-09-21T00:17:37.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.539+0000 7f8baeffd700 1 -- 172.21.15.59:0/1165582308 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8bb00593f0 con 0x7f8bc006a780 2023-09-21T00:17:37.540 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-09-21T00:17:37.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.541+0000 7f8bc486c700 1 -- 172.21.15.59:0/1165582308 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f8ba006ae00 msgr2=0x7f8ba006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:37.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.541+0000 7f8bc486c700 1 --2- 172.21.15.59:0/1165582308 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f8ba006ae00 0x7f8ba006d2c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8bc00ae2a0 tx=0x7f8bb4008040 comp rx=0 tx=0).stop 2023-09-21T00:17:37.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.541+0000 7f8bc486c700 1 -- 172.21.15.59:0/1165582308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bc006a780 msgr2=0x7f8bc01494c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:37.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.541+0000 7f8bc486c700 1 --2- 172.21.15.59:0/1165582308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bc006a780 0x7f8bc01494c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8bc00728c0 tx=0x7f8bb0004750 comp rx=0 tx=0).stop 2023-09-21T00:17:37.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.541+0000 7f8bc486c700 1 -- 172.21.15.59:0/1165582308 shutdown_connections 2023-09-21T00:17:37.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.541+0000 7f8bc486c700 1 --2- 172.21.15.59:0/1165582308 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f8ba006ae00 0x7f8ba006d2c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:37.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.541+0000 7f8bc486c700 1 --2- 172.21.15.59:0/1165582308 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8bc015b2b0 0x7f8bc00ad9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:37.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.541+0000 7f8bc486c700 1 --2- 172.21.15.59:0/1165582308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bc006a780 0x7f8bc01494c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:37.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.541+0000 7f8bc486c700 1 --2- 172.21.15.59:0/1165582308 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8bc00ce420 0x7f8bc00ad4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:37.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.541+0000 7f8bc486c700 1 -- 172.21.15.59:0/1165582308 >> 172.21.15.59:0/1165582308 conn(0x7f8bc00d0140 msgr2=0x7f8bc006f820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:37.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.541+0000 7f8bc486c700 1 -- 172.21.15.59:0/1165582308 shutdown_connections 2023-09-21T00:17:37.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.541+0000 7f8bc486c700 1 -- 172.21.15.59:0/1165582308 wait complete. 2023-09-21T00:17:37.554 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-21T00:17:37.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.681+0000 7f70db819700 1 Processor -- start 2023-09-21T00:17:37.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.681+0000 7f70db819700 1 -- start start 2023-09-21T00:17:37.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.682+0000 7f70db819700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f70d415a230 0x7f70d415e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:37.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.682+0000 7f70db819700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f70d40ca790 0x7f70d4071680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:37.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.682+0000 7f70db819700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f70d40cabf0 0x7f70d4071bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:37.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.682+0000 7f70db819700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70d40cb780 con 0x7f70d40ca790 2023-09-21T00:17:37.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.682+0000 7f70db819700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70d40cb1c0 con 0x7f70d40cabf0 2023-09-21T00:17:37.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.682+0000 7f70db819700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d40cb4a0 con 0x7f70d415a230 2023-09-21T00:17:37.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.682+0000 7f70d8db4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f70d40ca790 0x7f70d4071680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:37.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.682+0000 7f70d8db4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f70d40ca790 0x7f70d4071680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51878/0 (socket says 172.21.15.59:51878) 2023-09-21T00:17:37.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.682+0000 7f70d8db4700 1 -- 172.21.15.59:0/2908380009 learned_addr learned my addr 172.21.15.59:0/2908380009 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:37.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.682+0000 7f70d9db6700 1 --2- 172.21.15.59:0/2908380009 >> v2:172.21.15.83:3300/0 conn(0x7f70d40cabf0 0x7f70d4071bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:37.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.682+0000 7f70d95b5700 1 --2- 172.21.15.59:0/2908380009 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f70d415a230 0x7f70d415e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:37.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.682+0000 7f70d8db4700 1 -- 172.21.15.59:0/2908380009 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f70d415a230 msgr2=0x7f70d415e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:37.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.682+0000 7f70d8db4700 1 --2- 172.21.15.59:0/2908380009 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f70d415a230 0x7f70d415e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:37.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.682+0000 7f70d8db4700 1 -- 172.21.15.59:0/2908380009 >> v2:172.21.15.83:3300/0 conn(0x7f70d40cabf0 msgr2=0x7f70d4071bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:37.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.682+0000 7f70d8db4700 1 --2- 172.21.15.59:0/2908380009 >> v2:172.21.15.83:3300/0 conn(0x7f70d40cabf0 0x7f70d4071bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:37.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.683+0000 7f70d8db4700 1 -- 172.21.15.59:0/2908380009 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d415e0b0 con 0x7f70d40ca790 2023-09-21T00:17:37.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.683+0000 7f70d8db4700 1 --2- 172.21.15.59:0/2908380009 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70d40ca790 0x7f70d4071680 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f70d415de50 tx=0x7f70d0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc04dcf6f67da629 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:37.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.683+0000 7f70cbfff700 1 -- 172.21.15.59:0/2908380009 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d0011830 con 0x7f70d40ca790 2023-09-21T00:17:37.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.683+0000 7f70cbfff700 1 -- 172.21.15.59:0/2908380009 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d0011990 con 0x7f70d40ca790 2023-09-21T00:17:37.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.683+0000 7f70cbfff700 1 -- 172.21.15.59:0/2908380009 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d0011d20 con 0x7f70d40ca790 2023-09-21T00:17:37.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.683+0000 7f70db819700 1 -- 172.21.15.59:0/2908380009 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70d40ca790 msgr2=0x7f70d4071680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:37.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.683+0000 7f70db819700 1 --2- 172.21.15.59:0/2908380009 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70d40ca790 0x7f70d4071680 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f70d415de50 tx=0x7f70d0009bd0 comp rx=0 tx=0).stop 2023-09-21T00:17:37.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.683+0000 7f70db819700 1 -- 172.21.15.59:0/2908380009 shutdown_connections 2023-09-21T00:17:37.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.683+0000 7f70db819700 1 --2- 172.21.15.59:0/2908380009 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f70d415a230 0x7f70d415e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:37.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.683+0000 7f70db819700 1 --2- 172.21.15.59:0/2908380009 >> v2:172.21.15.83:3300/0 conn(0x7f70d40cabf0 0x7f70d4071bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:37.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.683+0000 7f70db819700 1 --2- 172.21.15.59:0/2908380009 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70d40ca790 0x7f70d4071680 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:37.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.683+0000 7f70db819700 1 -- 172.21.15.59:0/2908380009 >> 172.21.15.59:0/2908380009 conn(0x7f70d40d0140 msgr2=0x7f70d40d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:37.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.684+0000 7f70db819700 1 -- 172.21.15.59:0/2908380009 shutdown_connections 2023-09-21T00:17:37.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.684+0000 7f70db819700 1 -- 172.21.15.59:0/2908380009 wait complete. 2023-09-21T00:17:37.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.685+0000 7f70db819700 1 Processor -- start 2023-09-21T00:17:37.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.685+0000 7f70db819700 1 -- start start 2023-09-21T00:17:37.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.686+0000 7f70db819700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f70d40ca790 0x7f70d41f36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:37.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.686+0000 7f70db819700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70d40cabf0 0x7f70d40a86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:37.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.686+0000 7f70db819700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70d415a230 0x7f70d40a8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:37.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.686+0000 7f70db819700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d406a780 con 0x7f70d415a230 2023-09-21T00:17:37.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.686+0000 7f70db819700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d406b5e0 con 0x7f70d40cabf0 2023-09-21T00:17:37.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.686+0000 7f70db819700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d406a9d0 con 0x7f70d40ca790 2023-09-21T00:17:37.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.686+0000 7f70d9db6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70d415a230 0x7f70d40a8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:37.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.686+0000 7f70d9db6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70d415a230 0x7f70d40a8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51888/0 (socket says 172.21.15.59:51888) 2023-09-21T00:17:37.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.686+0000 7f70d9db6700 1 -- 172.21.15.59:0/3032327406 learned_addr learned my addr 172.21.15.59:0/3032327406 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:37.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.686+0000 7f70d8db4700 1 --2- 172.21.15.59:0/3032327406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70d40cabf0 0x7f70d40a86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:37.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.686+0000 7f70d95b5700 1 --2- 172.21.15.59:0/3032327406 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f70d40ca790 0x7f70d41f36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:37.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.687+0000 7f70d9db6700 1 -- 172.21.15.59:0/3032327406 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f70d40ca790 msgr2=0x7f70d41f36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:37.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.687+0000 7f70d9db6700 1 --2- 172.21.15.59:0/3032327406 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f70d40ca790 0x7f70d41f36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:37.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.687+0000 7f70d9db6700 1 -- 172.21.15.59:0/3032327406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70d40cabf0 msgr2=0x7f70d40a86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:37.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.687+0000 7f70d9db6700 1 --2- 172.21.15.59:0/3032327406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70d40cabf0 0x7f70d40a86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:37.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.687+0000 7f70d9db6700 1 -- 172.21.15.59:0/3032327406 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d0009550 con 0x7f70d415a230 2023-09-21T00:17:37.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.687+0000 7f70d9db6700 1 --2- 172.21.15.59:0/3032327406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70d415a230 0x7f70d40a8bf0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f70cc00ef00 tx=0x7f70cc00b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:37.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.687+0000 7f70c9ffb700 1 -- 172.21.15.59:0/3032327406 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70cc010040 con 0x7f70d415a230 2023-09-21T00:17:37.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.687+0000 7f70c9ffb700 1 -- 172.21.15.59:0/3032327406 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70cc00bc80 con 0x7f70d415a230 2023-09-21T00:17:37.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.687+0000 7f70db819700 1 -- 172.21.15.59:0/3032327406 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70d406acb0 con 0x7f70d415a230 2023-09-21T00:17:37.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.687+0000 7f70c9ffb700 1 -- 172.21.15.59:0/3032327406 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70cc009e40 con 0x7f70d415a230 2023-09-21T00:17:37.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.687+0000 7f70db819700 1 -- 172.21.15.59:0/3032327406 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d406b270 con 0x7f70d415a230 2023-09-21T00:17:37.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.688+0000 7f70db819700 1 -- 172.21.15.59:0/3032327406 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70d4067e50 con 0x7f70d415a230 2023-09-21T00:17:37.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.689+0000 7f70c9ffb700 1 -- 172.21.15.59:0/3032327406 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f70cc014400 con 0x7f70d415a230 2023-09-21T00:17:37.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.689+0000 7f70c9ffb700 1 --2- 172.21.15.59:0/3032327406 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f70b806ae00 0x7f70b806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:37.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.689+0000 7f70c9ffb700 1 -- 172.21.15.59:0/3032327406 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f70cc089c20 con 0x7f70d415a230 2023-09-21T00:17:37.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.689+0000 7f70d95b5700 1 --2- 172.21.15.59:0/3032327406 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f70b806ae00 0x7f70b806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:37.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.690+0000 7f70d95b5700 1 --2- 172.21.15.59:0/3032327406 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f70b806ae00 0x7f70b806d2c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f70c4006b20 tx=0x7f70c4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:37.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.693+0000 7f70c9ffb700 1 -- 172.21.15.59:0/3032327406 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f70cc054a50 con 0x7f70d415a230 2023-09-21T00:17:37.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.894+0000 7f70db819700 1 -- 172.21.15.59:0/3032327406 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f70d4070040 con 0x7f70d415a230 2023-09-21T00:17:37.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.894+0000 7f70c9ffb700 1 -- 172.21.15.59:0/3032327406 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f70cc0180a0 con 0x7f70d415a230 2023-09-21T00:17:37.896 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-09-21T00:17:37.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.896+0000 7f70db819700 1 -- 172.21.15.59:0/3032327406 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f70b806ae00 msgr2=0x7f70b806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:37.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.896+0000 7f70db819700 1 --2- 172.21.15.59:0/3032327406 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f70b806ae00 0x7f70b806d2c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f70c4006b20 tx=0x7f70c4008040 comp rx=0 tx=0).stop 2023-09-21T00:17:37.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.896+0000 7f70db819700 1 -- 172.21.15.59:0/3032327406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70d415a230 msgr2=0x7f70d40a8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:37.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.896+0000 7f70db819700 1 --2- 172.21.15.59:0/3032327406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70d415a230 0x7f70d40a8bf0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f70cc00ef00 tx=0x7f70cc00b390 comp rx=0 tx=0).stop 2023-09-21T00:17:37.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.897+0000 7f70db819700 1 -- 172.21.15.59:0/3032327406 shutdown_connections 2023-09-21T00:17:37.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.897+0000 7f70db819700 1 --2- 172.21.15.59:0/3032327406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70d415a230 0x7f70d40a8bf0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:37.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.897+0000 7f70db819700 1 --2- 172.21.15.59:0/3032327406 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f70b806ae00 0x7f70b806d2c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:37.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.897+0000 7f70db819700 1 --2- 172.21.15.59:0/3032327406 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f70d40ca790 0x7f70d41f36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:37.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.897+0000 7f70db819700 1 --2- 172.21.15.59:0/3032327406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70d40cabf0 0x7f70d40a86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:37.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.897+0000 7f70db819700 1 -- 172.21.15.59:0/3032327406 >> 172.21.15.59:0/3032327406 conn(0x7f70d40d0140 msgr2=0x7f70d4159790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:37.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.897+0000 7f70db819700 1 -- 172.21.15.59:0/3032327406 shutdown_connections 2023-09-21T00:17:37.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:37.897+0000 7f70db819700 1 -- 172.21.15.59:0/3032327406 wait complete. 2023-09-21T00:17:37.910 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-21T00:17:38.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.039+0000 7fa0ee0d5700 1 Processor -- start 2023-09-21T00:17:38.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.039+0000 7fa0ee0d5700 1 -- start start 2023-09-21T00:17:38.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.040+0000 7fa0ee0d5700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa0e815d690 0x7fa0e80d1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:38.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.040+0000 7fa0ee0d5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa0e80b5630 0x7fa0e80b65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:38.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.040+0000 7fa0ee0d5700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0e80d1ee0 con 0x7fa0e80d1a60 2023-09-21T00:17:38.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.040+0000 7fa0ee0d5700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0e80d21c0 con 0x7fa0e815d690 2023-09-21T00:17:38.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.040+0000 7fa0ee0d5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e80d24a0 con 0x7fa0e80b5630 2023-09-21T00:17:38.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.041+0000 7fa0e77fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa0e815d690 0x7fa0e80d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:38.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.041+0000 7fa0e7fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa0e80b5630 0x7fa0e80b65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:38.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.041+0000 7fa0e6ffd700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fa0e80d1a60 0x7fa0e80b4f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.59:47960/0 (socket says 172.21.15.59:47960) 2023-09-21T00:17:38.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.041+0000 7fa0e6ffd700 1 -- 172.21.15.59:0/10808968 learned_addr learned my addr 172.21.15.59:0/10808968 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:38.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.041+0000 7fa0e77fe700 1 -- 172.21.15.59:0/10808968 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa0e80b5630 msgr2=0x7fa0e80b65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:38.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.041+0000 7fa0e77fe700 1 --2- 172.21.15.59:0/10808968 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa0e80b5630 0x7fa0e80b65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:38.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.041+0000 7fa0e77fe700 1 -- 172.21.15.59:0/10808968 >> v1:172.21.15.83:6789/0 conn(0x7fa0e80d1a60 legacy=0x7fa0e80b4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:38.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.041+0000 7fa0e67fc700 1 -- 172.21.15.59:0/10808968 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1121956056 0 0) 0x7fa0e80d1ee0 con 0x7fa0e80d1a60 2023-09-21T00:17:38.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.041+0000 7fa0e77fe700 1 -- 172.21.15.59:0/10808968 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e80d2780 con 0x7fa0e815d690 2023-09-21T00:17:38.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.041+0000 7fa0e7fff700 1 --2- 172.21.15.59:0/10808968 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa0e80b5630 0x7fa0e80b65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T00:17:38.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.041+0000 7fa0e77fe700 1 --2- 172.21.15.59:0/10808968 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa0e815d690 0x7fa0e80d1520 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8009840 tx=0x7fa0d8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db1515581e07e64c server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:38.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.041+0000 7fa0e67fc700 1 -- 172.21.15.59:0/10808968 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d8011830 con 0x7fa0e815d690 2023-09-21T00:17:38.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.041+0000 7fa0e67fc700 1 -- 172.21.15.59:0/10808968 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d8011990 con 0x7fa0e815d690 2023-09-21T00:17:38.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.041+0000 7fa0e67fc700 1 -- 172.21.15.59:0/10808968 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d8011d20 con 0x7fa0e815d690 2023-09-21T00:17:38.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.042+0000 7fa0ee0d5700 1 -- 172.21.15.59:0/10808968 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa0e815d690 msgr2=0x7fa0e80d1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:38.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.042+0000 7fa0ee0d5700 1 --2- 172.21.15.59:0/10808968 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa0e815d690 0x7fa0e80d1520 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8009840 tx=0x7fa0d8009b50 comp rx=0 tx=0).stop 2023-09-21T00:17:38.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.042+0000 7fa0ee0d5700 1 -- 172.21.15.59:0/10808968 shutdown_connections 2023-09-21T00:17:38.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.042+0000 7fa0ee0d5700 1 --2- 172.21.15.59:0/10808968 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa0e80b5630 0x7fa0e80b65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:38.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.042+0000 7fa0ee0d5700 1 --2- 172.21.15.59:0/10808968 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa0e815d690 0x7fa0e80d1520 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:38.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.042+0000 7fa0ee0d5700 1 -- 172.21.15.59:0/10808968 >> 172.21.15.59:0/10808968 conn(0x7fa0e8072560 msgr2=0x7fa0e80cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:38.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.042+0000 7fa0ee0d5700 1 -- 172.21.15.59:0/10808968 shutdown_connections 2023-09-21T00:17:38.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.042+0000 7fa0ee0d5700 1 -- 172.21.15.59:0/10808968 wait complete. 2023-09-21T00:17:38.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.043+0000 7fa0ee0d5700 1 Processor -- start 2023-09-21T00:17:38.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.043+0000 7fa0ee0d5700 1 -- start start 2023-09-21T00:17:38.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.044+0000 7fa0ee0d5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0e80b5630 0x7fa0e80c9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:38.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.044+0000 7fa0ee0d5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa0e80d1a60 0x7fa0e80c6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:38.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.044+0000 7fa0ee0d5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa0e815d690 0x7fa0e81f60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:38.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.044+0000 7fa0ee0d5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e81f2960 con 0x7fa0e80b5630 2023-09-21T00:17:38.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.044+0000 7fa0ee0d5700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e8148a40 con 0x7fa0e815d690 2023-09-21T00:17:38.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.044+0000 7fa0ee0d5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e81f6930 con 0x7fa0e80d1a60 2023-09-21T00:17:38.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.044+0000 7fa0e77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0e80b5630 0x7fa0e80c9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:38.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.044+0000 7fa0e77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0e80b5630 0x7fa0e80c9a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51898/0 (socket says 172.21.15.59:51898) 2023-09-21T00:17:38.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.044+0000 7fa0e77fe700 1 -- 172.21.15.59:0/460858317 learned_addr learned my addr 172.21.15.59:0/460858317 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:38.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.044+0000 7fa0e7fff700 1 --2- 172.21.15.59:0/460858317 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa0e815d690 0x7fa0e81f60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:38.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.044+0000 7fa0e6ffd700 1 --2- 172.21.15.59:0/460858317 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa0e80d1a60 0x7fa0e80c6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:38.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.045+0000 7fa0e7fff700 1 -- 172.21.15.59:0/460858317 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa0e80d1a60 msgr2=0x7fa0e80c6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:38.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.045+0000 7fa0e7fff700 1 --2- 172.21.15.59:0/460858317 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa0e80d1a60 0x7fa0e80c6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:38.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.045+0000 7fa0e7fff700 1 -- 172.21.15.59:0/460858317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0e80b5630 msgr2=0x7fa0e80c9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:38.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.045+0000 7fa0e7fff700 1 --2- 172.21.15.59:0/460858317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0e80b5630 0x7fa0e80c9a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:38.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.045+0000 7fa0e7fff700 1 -- 172.21.15.59:0/460858317 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e0009a70 con 0x7fa0e815d690 2023-09-21T00:17:38.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.045+0000 7fa0e77fe700 1 --2- 172.21.15.59:0/460858317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0e80b5630 0x7fa0e80c9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T00:17:38.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.045+0000 7fa0e7fff700 1 --2- 172.21.15.59:0/460858317 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa0e815d690 0x7fa0e81f60e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8161170 tx=0x7fa0e000ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:38.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.045+0000 7fa0cffff700 1 -- 172.21.15.59:0/460858317 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e0003a20 con 0x7fa0e815d690 2023-09-21T00:17:38.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.045+0000 7fa0cffff700 1 -- 172.21.15.59:0/460858317 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e000f040 con 0x7fa0e815d690 2023-09-21T00:17:38.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.045+0000 7fa0cffff700 1 -- 172.21.15.59:0/460858317 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e0003dc0 con 0x7fa0e815d690 2023-09-21T00:17:38.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.045+0000 7fa0ee0d5700 1 -- 172.21.15.59:0/460858317 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0d80094a0 con 0x7fa0e815d690 2023-09-21T00:17:38.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.045+0000 7fa0ee0d5700 1 -- 172.21.15.59:0/460858317 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0e81f6ef0 con 0x7fa0e815d690 2023-09-21T00:17:38.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.046+0000 7fa0ee0d5700 1 -- 172.21.15.59:0/460858317 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0e8068590 con 0x7fa0e815d690 2023-09-21T00:17:38.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.047+0000 7fa0cffff700 1 -- 172.21.15.59:0/460858317 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fa0e000ca20 con 0x7fa0e815d690 2023-09-21T00:17:38.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.047+0000 7fa0cffff700 1 --2- 172.21.15.59:0/460858317 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa0d406ae00 0x7fa0d406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:38.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.047+0000 7fa0cffff700 1 -- 172.21.15.59:0/460858317 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa0e0089ff0 con 0x7fa0e815d690 2023-09-21T00:17:38.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.047+0000 7fa0e77fe700 1 --2- 172.21.15.59:0/460858317 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa0d406ae00 0x7fa0d406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:38.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.048+0000 7fa0e77fe700 1 --2- 172.21.15.59:0/460858317 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa0d406ae00 0x7fa0d406d2c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8009b90 tx=0x7fa0d801c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:38.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.052+0000 7fa0cffff700 1 -- 172.21.15.59:0/460858317 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fa0e8068590 con 0x7fa0e815d690 2023-09-21T00:17:38.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.253+0000 7fa0ee0d5700 1 -- 172.21.15.59:0/460858317 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa0e8068590 con 0x7fa0e815d690 2023-09-21T00:17:38.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.254+0000 7fa0cffff700 1 -- 172.21.15.59:0/460858317 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa0e8068590 con 0x7fa0e815d690 2023-09-21T00:17:38.255 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-09-21T00:17:38.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.256+0000 7fa0ee0d5700 1 -- 172.21.15.59:0/460858317 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa0d406ae00 msgr2=0x7fa0d406d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:38.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.256+0000 7fa0ee0d5700 1 --2- 172.21.15.59:0/460858317 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa0d406ae00 0x7fa0d406d2c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8009b90 tx=0x7fa0d801c040 comp rx=0 tx=0).stop 2023-09-21T00:17:38.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.256+0000 7fa0ee0d5700 1 -- 172.21.15.59:0/460858317 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa0e815d690 msgr2=0x7fa0e81f60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:38.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.256+0000 7fa0ee0d5700 1 --2- 172.21.15.59:0/460858317 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa0e815d690 0x7fa0e81f60e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8161170 tx=0x7fa0e000ef90 comp rx=0 tx=0).stop 2023-09-21T00:17:38.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.256+0000 7fa0ee0d5700 1 -- 172.21.15.59:0/460858317 shutdown_connections 2023-09-21T00:17:38.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.256+0000 7fa0ee0d5700 1 --2- 172.21.15.59:0/460858317 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa0e815d690 0x7fa0e81f60e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:38.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.256+0000 7fa0ee0d5700 1 --2- 172.21.15.59:0/460858317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0e80b5630 0x7fa0e80c9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:38.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.256+0000 7fa0ee0d5700 1 --2- 172.21.15.59:0/460858317 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa0d406ae00 0x7fa0d406d2c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:38.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.256+0000 7fa0ee0d5700 1 --2- 172.21.15.59:0/460858317 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa0e80d1a60 0x7fa0e80c6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:38.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.256+0000 7fa0ee0d5700 1 -- 172.21.15.59:0/460858317 >> 172.21.15.59:0/460858317 conn(0x7fa0e8072560 msgr2=0x7fa0e8073200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:38.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.256+0000 7fa0ee0d5700 1 -- 172.21.15.59:0/460858317 shutdown_connections 2023-09-21T00:17:38.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.256+0000 7fa0ee0d5700 1 -- 172.21.15.59:0/460858317 wait complete. 2023-09-21T00:17:38.269 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-21T00:17:38.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.396+0000 7feceeb94700 1 Processor -- start 2023-09-21T00:17:38.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.397+0000 7feceeb94700 1 -- start start 2023-09-21T00:17:38.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.397+0000 7feceeb94700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fece815d690 0x7fece8070b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:38.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.397+0000 7feceeb94700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fece80cedb0 0x7fece80cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:38.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.397+0000 7feceeb94700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fece8162170 con 0x7fece8143ce0 2023-09-21T00:17:38.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.397+0000 7feceeb94700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fece8161990 con 0x7fece815d690 2023-09-21T00:17:38.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.397+0000 7feceeb94700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece80cf720 con 0x7fece80cedb0 2023-09-21T00:17:38.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.397+0000 7fece7fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fece8143ce0 0x7fece8161280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57476/0 (socket says 172.21.15.59:57476) 2023-09-21T00:17:38.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.397+0000 7fece7fff700 1 -- 172.21.15.59:0/563086823 learned_addr learned my addr 172.21.15.59:0/563086823 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:38.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.398+0000 7fecec930700 1 --2- 172.21.15.59:0/563086823 >> v2:172.21.15.83:3300/0 conn(0x7fece815d690 0x7fece8070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:38.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.398+0000 7feced131700 1 --2- 172.21.15.59:0/563086823 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fece80cedb0 0x7fece80cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:38.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.398+0000 7fece77fe700 1 -- 172.21.15.59:0/563086823 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1574882404 0 0) 0x7fece8162170 con 0x7fece8143ce0 2023-09-21T00:17:38.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.398+0000 7fece77fe700 1 -- 172.21.15.59:0/563086823 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecd80035b0 con 0x7fece8143ce0 2023-09-21T00:17:38.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.398+0000 7fece77fe700 1 -- 172.21.15.59:0/563086823 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3146969027 0 0) 0x7fecd80035b0 con 0x7fece8143ce0 2023-09-21T00:17:38.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.398+0000 7fecec930700 1 -- 172.21.15.59:0/563086823 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fece80cedb0 msgr2=0x7fece80cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:38.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.398+0000 7fecec930700 1 --2- 172.21.15.59:0/563086823 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fece80cedb0 0x7fece80cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:38.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.398+0000 7fecec930700 1 -- 172.21.15.59:0/563086823 >> v1:172.21.15.59:6789/0 conn(0x7fece8143ce0 legacy=0x7fece8161280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:38.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.398+0000 7fecec930700 1 -- 172.21.15.59:0/563086823 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece8161bb0 con 0x7fece815d690 2023-09-21T00:17:38.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.398+0000 7fecec930700 1 --2- 172.21.15.59:0/563086823 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fece815d690 0x7fece8070b10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fecdc009840 tx=0x7fecdc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87a97c8371b79f36 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:38.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.398+0000 7fece77fe700 1 -- 172.21.15.59:0/563086823 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd4001670 con 0x7fece815d690 2023-09-21T00:17:38.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.398+0000 7fece77fe700 1 -- 172.21.15.59:0/563086823 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecdc004030 con 0x7fece815d690 2023-09-21T00:17:38.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.398+0000 7fece77fe700 1 -- 172.21.15.59:0/563086823 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecdc0043a0 con 0x7fece815d690 2023-09-21T00:17:38.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.399+0000 7feceeb94700 1 -- 172.21.15.59:0/563086823 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fece815d690 msgr2=0x7fece8070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:38.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.399+0000 7feceeb94700 1 --2- 172.21.15.59:0/563086823 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fece815d690 0x7fece8070b10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fecdc009840 tx=0x7fecdc009b50 comp rx=0 tx=0).stop 2023-09-21T00:17:38.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.399+0000 7feceeb94700 1 -- 172.21.15.59:0/563086823 shutdown_connections 2023-09-21T00:17:38.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.399+0000 7feceeb94700 1 --2- 172.21.15.59:0/563086823 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fece80cedb0 0x7fece80cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:38.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.399+0000 7feceeb94700 1 --2- 172.21.15.59:0/563086823 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fece815d690 0x7fece8070b10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:38.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.399+0000 7feceeb94700 1 -- 172.21.15.59:0/563086823 >> 172.21.15.59:0/563086823 conn(0x7fece80d11e0 msgr2=0x7fece80d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:38.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.399+0000 7feceeb94700 1 -- 172.21.15.59:0/563086823 shutdown_connections 2023-09-21T00:17:38.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.399+0000 7feceeb94700 1 -- 172.21.15.59:0/563086823 wait complete. 2023-09-21T00:17:38.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.400+0000 7feceeb94700 1 Processor -- start 2023-09-21T00:17:38.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.400+0000 7feceeb94700 1 -- start start 2023-09-21T00:17:38.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.401+0000 7feceeb94700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fece80cedb0 0x7fece80b6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:38.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.401+0000 7feceeb94700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fece8143ce0 0x7fece81f20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:38.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.401+0000 7feceeb94700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fece815d690 0x7fece81f2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:38.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.401+0000 7feceeb94700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece80c8970 con 0x7fece80cedb0 2023-09-21T00:17:38.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.401+0000 7feceeb94700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece80c8690 con 0x7fece815d690 2023-09-21T00:17:38.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.401+0000 7feceeb94700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece815f600 con 0x7fece8143ce0 2023-09-21T00:17:38.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.401+0000 7fecec930700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fece80cedb0 0x7fece80b6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:38.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.401+0000 7fecec930700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fece80cedb0 0x7fece80b6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51912/0 (socket says 172.21.15.59:51912) 2023-09-21T00:17:38.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.401+0000 7fecec930700 1 -- 172.21.15.59:0/3829093739 learned_addr learned my addr 172.21.15.59:0/3829093739 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:38.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.401+0000 7fece7fff700 1 --2- 172.21.15.59:0/3829093739 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fece8143ce0 0x7fece81f20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:38.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.401+0000 7feced131700 1 --2- 172.21.15.59:0/3829093739 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fece815d690 0x7fece81f2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:38.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.402+0000 7fecec930700 1 -- 172.21.15.59:0/3829093739 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fece8143ce0 msgr2=0x7fece81f20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:38.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.402+0000 7fecec930700 1 --2- 172.21.15.59:0/3829093739 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fece8143ce0 0x7fece81f20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:38.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.402+0000 7fecec930700 1 -- 172.21.15.59:0/3829093739 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fece815d690 msgr2=0x7fece81f2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:38.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.402+0000 7fecec930700 1 --2- 172.21.15.59:0/3829093739 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fece815d690 0x7fece81f2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:38.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.402+0000 7fecec930700 1 -- 172.21.15.59:0/3829093739 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecdc0094a0 con 0x7fece80cedb0 2023-09-21T00:17:38.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.402+0000 7feced131700 1 --2- 172.21.15.59:0/3829093739 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fece815d690 0x7fece81f2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:17:38.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.402+0000 7fecec930700 1 --2- 172.21.15.59:0/3829093739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fece80cedb0 0x7fece80b6510 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fecdc009b90 tx=0x7fecdc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:38.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.402+0000 7fece57fa700 1 -- 172.21.15.59:0/3829093739 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecdc004590 con 0x7fece80cedb0 2023-09-21T00:17:38.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.402+0000 7fece57fa700 1 -- 172.21.15.59:0/3829093739 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecdc01f070 con 0x7fece80cedb0 2023-09-21T00:17:38.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.402+0000 7feceeb94700 1 -- 172.21.15.59:0/3829093739 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fece815f8e0 con 0x7fece80cedb0 2023-09-21T00:17:38.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.402+0000 7fece57fa700 1 -- 172.21.15.59:0/3829093739 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecdc011870 con 0x7fece80cedb0 2023-09-21T00:17:38.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.402+0000 7feceeb94700 1 -- 172.21.15.59:0/3829093739 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fece80c82b0 con 0x7fece80cedb0 2023-09-21T00:17:38.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.403+0000 7feceeb94700 1 -- 172.21.15.59:0/3829093739 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fece80c8440 con 0x7fece80cedb0 2023-09-21T00:17:38.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.403+0000 7fece57fa700 1 -- 172.21.15.59:0/3829093739 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fecdc0119d0 con 0x7fece80cedb0 2023-09-21T00:17:38.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.404+0000 7fece57fa700 1 --2- 172.21.15.59:0/3829093739 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7feccc06ae00 0x7feccc06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:38.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.404+0000 7fece57fa700 1 -- 172.21.15.59:0/3829093739 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fecdc021070 con 0x7fece80cedb0 2023-09-21T00:17:38.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.404+0000 7fece7fff700 1 --2- 172.21.15.59:0/3829093739 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7feccc06ae00 0x7feccc06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:38.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.404+0000 7fece7fff700 1 --2- 172.21.15.59:0/3829093739 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7feccc06ae00 0x7feccc06d2c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fecd4001eb0 tx=0x7fecd4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:38.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.408+0000 7fece57fa700 1 -- 172.21.15.59:0/3829093739 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fecdc056010 con 0x7fece80cedb0 2023-09-21T00:17:38.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.607+0000 7feceeb94700 1 -- 172.21.15.59:0/3829093739 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fece8067e50 con 0x7fece80cedb0 2023-09-21T00:17:38.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.607+0000 7fece57fa700 1 -- 172.21.15.59:0/3829093739 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fecdc059630 con 0x7fece80cedb0 2023-09-21T00:17:38.610 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-09-21T00:17:38.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.609+0000 7feceeb94700 1 -- 172.21.15.59:0/3829093739 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7feccc06ae00 msgr2=0x7feccc06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:38.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.609+0000 7feceeb94700 1 --2- 172.21.15.59:0/3829093739 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7feccc06ae00 0x7feccc06d2c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fecd4001eb0 tx=0x7fecd4009040 comp rx=0 tx=0).stop 2023-09-21T00:17:38.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.609+0000 7feceeb94700 1 -- 172.21.15.59:0/3829093739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fece80cedb0 msgr2=0x7fece80b6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:38.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.609+0000 7feceeb94700 1 --2- 172.21.15.59:0/3829093739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fece80cedb0 0x7fece80b6510 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fecdc009b90 tx=0x7fecdc004750 comp rx=0 tx=0).stop 2023-09-21T00:17:38.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.609+0000 7feceeb94700 1 -- 172.21.15.59:0/3829093739 shutdown_connections 2023-09-21T00:17:38.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.610+0000 7feceeb94700 1 --2- 172.21.15.59:0/3829093739 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fece815d690 0x7fece81f2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:38.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.610+0000 7feceeb94700 1 --2- 172.21.15.59:0/3829093739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fece80cedb0 0x7fece80b6510 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:38.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.610+0000 7feceeb94700 1 --2- 172.21.15.59:0/3829093739 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7feccc06ae00 0x7feccc06d2c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:38.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.610+0000 7feceeb94700 1 --2- 172.21.15.59:0/3829093739 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fece8143ce0 0x7fece81f20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:38.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.610+0000 7feceeb94700 1 -- 172.21.15.59:0/3829093739 >> 172.21.15.59:0/3829093739 conn(0x7fece80d11e0 msgr2=0x7fece8144120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:38.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.610+0000 7feceeb94700 1 -- 172.21.15.59:0/3829093739 shutdown_connections 2023-09-21T00:17:38.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.610+0000 7feceeb94700 1 -- 172.21.15.59:0/3829093739 wait complete. 2023-09-21T00:17:38.623 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T00:17:38.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.748+0000 7f3ee12a3700 1 Processor -- start 2023-09-21T00:17:38.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.749+0000 7f3ee12a3700 1 -- start start 2023-09-21T00:17:38.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.749+0000 7f3ee12a3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3edc15d7e0 0x7f3edc0cf120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:38.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.749+0000 7f3ee12a3700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3edc0d11b0 0x7f3edc0b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:38.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.749+0000 7f3ee12a3700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3edc0d1720 con 0x7f3edc0cf660 2023-09-21T00:17:38.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.749+0000 7f3ee12a3700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3edc0ced00 con 0x7f3edc0d11b0 2023-09-21T00:17:38.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.749+0000 7f3ee12a3700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3edc0ce360 con 0x7f3edc15d7e0 2023-09-21T00:17:38.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.750+0000 7f3edaffd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3edc15d7e0 0x7f3edc0cf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:38.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.750+0000 7f3eda7fc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3edc0d11b0 0x7f3edc0b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:38.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.750+0000 7f3eda7fc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3edc0d11b0 0x7f3edc0b2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.59:38038/0 (socket says 172.21.15.59:38038) 2023-09-21T00:17:38.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.750+0000 7f3edb7fe700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f3edc0cf660 0x7f3edc0d1990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.59:47992/0 (socket says 172.21.15.59:47992) 2023-09-21T00:17:38.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.750+0000 7f3edaffd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3edc15d7e0 0x7f3edc0cf120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.59:52536/0 (socket says 172.21.15.59:52536) 2023-09-21T00:17:38.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.750+0000 7f3eda7fc700 1 -- 172.21.15.59:0/3038886194 learned_addr learned my addr 172.21.15.59:0/3038886194 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:38.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.750+0000 7f3eda7fc700 1 -- 172.21.15.59:0/3038886194 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3edc15d7e0 msgr2=0x7f3edc0cf120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:38.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.750+0000 7f3eda7fc700 1 --2- 172.21.15.59:0/3038886194 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3edc15d7e0 0x7f3edc0cf120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:38.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.750+0000 7f3eda7fc700 1 -- 172.21.15.59:0/3038886194 >> v1:172.21.15.83:6789/0 conn(0x7f3edc0cf660 legacy=0x7f3edc0d1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:38.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.750+0000 7f3eda7fc700 1 -- 172.21.15.59:0/3038886194 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3edc0ce640 con 0x7f3edc0d11b0 2023-09-21T00:17:38.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.750+0000 7f3eda7fc700 1 --2- 172.21.15.59:0/3038886194 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3edc0d11b0 0x7f3edc0b2d30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3ec40098f0 tx=0x7f3ec4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cadd874880469509 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:38.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.750+0000 7f3ed9ffb700 1 -- 172.21.15.59:0/3038886194 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec4011830 con 0x7f3edc0d11b0 2023-09-21T00:17:38.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.750+0000 7f3ed9ffb700 1 -- 172.21.15.59:0/3038886194 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec4011990 con 0x7f3edc0d11b0 2023-09-21T00:17:38.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.750+0000 7f3ed9ffb700 1 -- 172.21.15.59:0/3038886194 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec4011d20 con 0x7f3edc0d11b0 2023-09-21T00:17:38.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.751+0000 7f3ee12a3700 1 -- 172.21.15.59:0/3038886194 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3edc0d11b0 msgr2=0x7f3edc0b2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:38.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.751+0000 7f3ee12a3700 1 --2- 172.21.15.59:0/3038886194 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3edc0d11b0 0x7f3edc0b2d30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3ec40098f0 tx=0x7f3ec4009c00 comp rx=0 tx=0).stop 2023-09-21T00:17:38.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.751+0000 7f3ee12a3700 1 -- 172.21.15.59:0/3038886194 shutdown_connections 2023-09-21T00:17:38.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.751+0000 7f3ee12a3700 1 --2- 172.21.15.59:0/3038886194 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3edc15d7e0 0x7f3edc0cf120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:38.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.751+0000 7f3ee12a3700 1 --2- 172.21.15.59:0/3038886194 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3edc0d11b0 0x7f3edc0b2d30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:38.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.751+0000 7f3ee12a3700 1 -- 172.21.15.59:0/3038886194 >> 172.21.15.59:0/3038886194 conn(0x7f3edc09c740 msgr2=0x7f3edc0d33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:38.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.751+0000 7f3ee12a3700 1 -- 172.21.15.59:0/3038886194 shutdown_connections 2023-09-21T00:17:38.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.751+0000 7f3ee12a3700 1 -- 172.21.15.59:0/3038886194 wait complete. 2023-09-21T00:17:38.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.752+0000 7f3ee12a3700 1 Processor -- start 2023-09-21T00:17:38.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.752+0000 7f3ee12a3700 1 -- start start 2023-09-21T00:17:38.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.753+0000 7f3ee12a3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3edc0cf660 0x7f3edc1590c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:38.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.753+0000 7f3ee12a3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3edc0d11b0 0x7f3edc158ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:38.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.753+0000 7f3ee12a3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3edc15d7e0 0x7f3edc1f6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:38.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.753+0000 7f3ee12a3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3edc1599c0 con 0x7f3edc15d7e0 2023-09-21T00:17:38.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.753+0000 7f3ee12a3700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3edc0b38e0 con 0x7f3edc0cf660 2023-09-21T00:17:38.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.753+0000 7f3ee12a3700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3edc0b3b80 con 0x7f3edc0d11b0 2023-09-21T00:17:38.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.753+0000 7f3edb7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3edc15d7e0 0x7f3edc1f6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:38.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.753+0000 7f3edb7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3edc15d7e0 0x7f3edc1f6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51930/0 (socket says 172.21.15.59:51930) 2023-09-21T00:17:38.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.753+0000 7f3edb7fe700 1 -- 172.21.15.59:0/1413024219 learned_addr learned my addr 172.21.15.59:0/1413024219 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:38.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.753+0000 7f3edaffd700 1 --2- 172.21.15.59:0/1413024219 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3edc0cf660 0x7f3edc1590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:38.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.753+0000 7f3eda7fc700 1 --2- 172.21.15.59:0/1413024219 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3edc0d11b0 0x7f3edc158ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:38.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.754+0000 7f3edb7fe700 1 -- 172.21.15.59:0/1413024219 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3edc0d11b0 msgr2=0x7f3edc158ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:38.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.754+0000 7f3edb7fe700 1 --2- 172.21.15.59:0/1413024219 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3edc0d11b0 0x7f3edc158ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:38.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.754+0000 7f3edb7fe700 1 -- 172.21.15.59:0/1413024219 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3edc0cf660 msgr2=0x7f3edc1590c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:38.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.754+0000 7f3edb7fe700 1 --2- 172.21.15.59:0/1413024219 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3edc0cf660 0x7f3edc1590c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:38.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.754+0000 7f3edb7fe700 1 -- 172.21.15.59:0/1413024219 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec4009550 con 0x7f3edc15d7e0 2023-09-21T00:17:38.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.754+0000 7f3edb7fe700 1 --2- 172.21.15.59:0/1413024219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3edc15d7e0 0x7f3edc1f6730 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3ed400cbc0 tx=0x7f3ed400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:38.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.754+0000 7f3ed37fe700 1 -- 172.21.15.59:0/1413024219 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed400a9e0 con 0x7f3edc15d7e0 2023-09-21T00:17:38.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.754+0000 7f3ed37fe700 1 -- 172.21.15.59:0/1413024219 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed400ab40 con 0x7f3edc15d7e0 2023-09-21T00:17:38.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.754+0000 7f3ed37fe700 1 -- 172.21.15.59:0/1413024219 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed4007070 con 0x7f3edc15d7e0 2023-09-21T00:17:38.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.754+0000 7f3ee12a3700 1 -- 172.21.15.59:0/1413024219 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3edc0b3e60 con 0x7f3edc15d7e0 2023-09-21T00:17:38.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.754+0000 7f3ee12a3700 1 -- 172.21.15.59:0/1413024219 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3edc1f6c70 con 0x7f3edc15d7e0 2023-09-21T00:17:38.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.755+0000 7f3ee12a3700 1 -- 172.21.15.59:0/1413024219 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3edc0b2ba0 con 0x7f3edc15d7e0 2023-09-21T00:17:38.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.755+0000 7f3ed37fe700 1 -- 172.21.15.59:0/1413024219 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f3ed40071d0 con 0x7f3edc15d7e0 2023-09-21T00:17:38.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.756+0000 7f3ed37fe700 1 --2- 172.21.15.59:0/1413024219 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f3ebc06ae00 0x7f3ebc06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:38.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.756+0000 7f3ed37fe700 1 -- 172.21.15.59:0/1413024219 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3ed4089350 con 0x7f3edc15d7e0 2023-09-21T00:17:38.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.756+0000 7f3edaffd700 1 --2- 172.21.15.59:0/1413024219 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f3ebc06ae00 0x7f3ebc06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:38.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.756+0000 7f3edaffd700 1 --2- 172.21.15.59:0/1413024219 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f3ebc06ae00 0x7f3ebc06d2c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3edc1f6690 tx=0x7f3ecc0091c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:38.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:38.760+0000 7f3ed37fe700 1 -- 172.21.15.59:0/1413024219 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f3ed40542c0 con 0x7f3edc15d7e0 2023-09-21T00:17:39.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.004+0000 7f3ee12a3700 1 -- 172.21.15.59:0/1413024219 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3edc067e50 con 0x7f3edc15d7e0 2023-09-21T00:17:39.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.005+0000 7f3ed37fe700 1 -- 172.21.15.59:0/1413024219 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4903 (secure 0 0 0) 0x7f3ed4017090 con 0x7f3edc15d7e0 2023-09-21T00:17:39.006 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:17:39.006 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/461673980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":461673980},{"type":"v1","addr":"172.21.15.59:6835","nonce":461673980}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/3148728526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3148728526},{"type":"v1","addr":"172.21.15.59:6834","nonce":3148728526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/3250481509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3250481509},{"type":"v1","addr":"172.21.15.83:6836","nonce":3250481509}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-21T00:17:06.338694+0000","modified":"2023-09-21T00:17:29.401478+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6837/792952552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":792952552},{"type":"v1","addr":"172.21.15.83:6837","nonce":792952552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-21T00:17:39.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.007+0000 7f3ee12a3700 1 -- 172.21.15.59:0/1413024219 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f3ebc06ae00 msgr2=0x7f3ebc06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:39.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.007+0000 7f3ee12a3700 1 --2- 172.21.15.59:0/1413024219 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f3ebc06ae00 0x7f3ebc06d2c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3edc1f6690 tx=0x7f3ecc0091c0 comp rx=0 tx=0).stop 2023-09-21T00:17:39.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.007+0000 7f3ee12a3700 1 -- 172.21.15.59:0/1413024219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3edc15d7e0 msgr2=0x7f3edc1f6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:39.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.007+0000 7f3ee12a3700 1 --2- 172.21.15.59:0/1413024219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3edc15d7e0 0x7f3edc1f6730 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3ed400cbc0 tx=0x7f3ed400ced0 comp rx=0 tx=0).stop 2023-09-21T00:17:39.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.007+0000 7f3ee12a3700 1 -- 172.21.15.59:0/1413024219 shutdown_connections 2023-09-21T00:17:39.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.007+0000 7f3ee12a3700 1 --2- 172.21.15.59:0/1413024219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3edc15d7e0 0x7f3edc1f6730 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:39.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.007+0000 7f3ee12a3700 1 --2- 172.21.15.59:0/1413024219 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3edc0cf660 0x7f3edc1590c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:39.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.007+0000 7f3ee12a3700 1 --2- 172.21.15.59:0/1413024219 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f3ebc06ae00 0x7f3ebc06d2c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:39.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.007+0000 7f3ee12a3700 1 --2- 172.21.15.59:0/1413024219 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3edc0d11b0 0x7f3edc158ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:39.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.007+0000 7f3ee12a3700 1 -- 172.21.15.59:0/1413024219 >> 172.21.15.59:0/1413024219 conn(0x7f3edc09c740 msgr2=0x7f3edc06c340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:39.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.007+0000 7f3ee12a3700 1 -- 172.21.15.59:0/1413024219 shutdown_connections 2023-09-21T00:17:39.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.007+0000 7f3ee12a3700 1 -- 172.21.15.59:0/1413024219 wait complete. 2023-09-21T00:17:39.011 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 8 2023-09-21T00:17:39.020 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T00:17:39.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.145+0000 7ff76f129700 1 Processor -- start 2023-09-21T00:17:39.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.145+0000 7ff76f129700 1 -- start start 2023-09-21T00:17:39.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.146+0000 7ff76f129700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff76815b260 0x7ff76815f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:39.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.146+0000 7ff76f129700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff76806dfc0 con 0x7ff7680cc940 2023-09-21T00:17:39.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.146+0000 7ff76f129700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff76815fde0 con 0x7ff7680b54b0 2023-09-21T00:17:39.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.146+0000 7ff76f129700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff76806d1a0 con 0x7ff76815b260 2023-09-21T00:17:39.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.146+0000 7ff76d6c6700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff7680cc940 0x7ff7680b2810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57504/0 (socket says 172.21.15.59:57504) 2023-09-21T00:17:39.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.146+0000 7ff76d6c6700 1 -- 172.21.15.59:0/3934447822 learned_addr learned my addr 172.21.15.59:0/3934447822 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:39.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.146+0000 7ff76cec5700 1 --2- 172.21.15.59:0/3934447822 >> v2:172.21.15.83:3300/0 conn(0x7ff76815b260 0x7ff76815f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:39.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.147+0000 7ff7677fe700 1 -- 172.21.15.59:0/3934447822 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2422075337 0 0) 0x7ff76806dfc0 con 0x7ff7680cc940 2023-09-21T00:17:39.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.147+0000 7ff7677fe700 1 -- 172.21.15.59:0/3934447822 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7580035b0 con 0x7ff7680cc940 2023-09-21T00:17:39.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.147+0000 7ff7677fe700 1 -- 172.21.15.59:0/3934447822 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 530371001 0 0) 0x7ff76815fde0 con 0x7ff7680b54b0 2023-09-21T00:17:39.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.147+0000 7ff7677fe700 1 -- 172.21.15.59:0/3934447822 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff76806dfc0 con 0x7ff7680b54b0 2023-09-21T00:17:39.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.147+0000 7ff76cec5700 1 -- 172.21.15.59:0/3934447822 >> v1:172.21.15.83:6789/0 conn(0x7ff7680b54b0 legacy=0x7ff7680cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:39.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.147+0000 7ff76cec5700 1 -- 172.21.15.59:0/3934447822 >> v1:172.21.15.59:6789/0 conn(0x7ff7680cc940 legacy=0x7ff7680b2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:39.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.147+0000 7ff76cec5700 1 -- 172.21.15.59:0/3934447822 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff76806e450 con 0x7ff76815b260 2023-09-21T00:17:39.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.147+0000 7ff76cec5700 1 --2- 172.21.15.59:0/3934447822 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff76815b260 0x7ff76815f8a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff75c009840 tx=0x7ff75c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5766e8576ca5500b server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:39.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.147+0000 7ff7677fe700 1 -- 172.21.15.59:0/3934447822 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75c011830 con 0x7ff76815b260 2023-09-21T00:17:39.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.147+0000 7ff7677fe700 1 -- 172.21.15.59:0/3934447822 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff75c011990 con 0x7ff76815b260 2023-09-21T00:17:39.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.147+0000 7ff7677fe700 1 -- 172.21.15.59:0/3934447822 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75c011d20 con 0x7ff76815b260 2023-09-21T00:17:39.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.148+0000 7ff76f129700 1 -- 172.21.15.59:0/3934447822 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff76815b260 msgr2=0x7ff76815f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:39.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.148+0000 7ff76f129700 1 --2- 172.21.15.59:0/3934447822 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff76815b260 0x7ff76815f8a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff75c009840 tx=0x7ff75c009b50 comp rx=0 tx=0).stop 2023-09-21T00:17:39.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.148+0000 7ff76f129700 1 -- 172.21.15.59:0/3934447822 shutdown_connections 2023-09-21T00:17:39.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.148+0000 7ff76f129700 1 --2- 172.21.15.59:0/3934447822 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff76815b260 0x7ff76815f8a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:39.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.148+0000 7ff76f129700 1 -- 172.21.15.59:0/3934447822 >> 172.21.15.59:0/3934447822 conn(0x7ff76806a780 msgr2=0x7ff76806ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:39.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.148+0000 7ff76f129700 1 -- 172.21.15.59:0/3934447822 shutdown_connections 2023-09-21T00:17:39.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.148+0000 7ff76f129700 1 -- 172.21.15.59:0/3934447822 wait complete. 2023-09-21T00:17:39.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.149+0000 7ff76f129700 1 Processor -- start 2023-09-21T00:17:39.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.149+0000 7ff76f129700 1 -- start start 2023-09-21T00:17:39.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.150+0000 7ff76f129700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7680b54b0 0x7ff76814e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:39.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.150+0000 7ff76f129700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff7680cc940 0x7ff7680c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:39.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.150+0000 7ff76f129700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff76815b260 0x7ff7680c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:39.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.150+0000 7ff76f129700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff76815e4c0 con 0x7ff76815b260 2023-09-21T00:17:39.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.150+0000 7ff76f129700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7680af570 con 0x7ff7680b54b0 2023-09-21T00:17:39.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.150+0000 7ff76f129700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76814f740 con 0x7ff7680cc940 2023-09-21T00:17:39.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.150+0000 7ff76d6c6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff76815b260 0x7ff7680c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:39.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.150+0000 7ff76d6c6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff76815b260 0x7ff7680c90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51942/0 (socket says 172.21.15.59:51942) 2023-09-21T00:17:39.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.150+0000 7ff76d6c6700 1 -- 172.21.15.59:0/4059169730 learned_addr learned my addr 172.21.15.59:0/4059169730 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:39.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.150+0000 7ff76cec5700 1 --2- 172.21.15.59:0/4059169730 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7680b54b0 0x7ff76814e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:39.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.150+0000 7ff767fff700 1 --2- 172.21.15.59:0/4059169730 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff7680cc940 0x7ff7680c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:39.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.150+0000 7ff76d6c6700 1 -- 172.21.15.59:0/4059169730 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff7680cc940 msgr2=0x7ff7680c8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:39.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.150+0000 7ff76d6c6700 1 --2- 172.21.15.59:0/4059169730 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff7680cc940 0x7ff7680c8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:39.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.150+0000 7ff76d6c6700 1 -- 172.21.15.59:0/4059169730 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7680b54b0 msgr2=0x7ff76814e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:39.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.150+0000 7ff76d6c6700 1 --2- 172.21.15.59:0/4059169730 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7680b54b0 0x7ff76814e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:39.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.150+0000 7ff76d6c6700 1 -- 172.21.15.59:0/4059169730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff75c0094a0 con 0x7ff76815b260 2023-09-21T00:17:39.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.151+0000 7ff767fff700 1 --2- 172.21.15.59:0/4059169730 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff7680cc940 0x7ff7680c8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:17:39.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.151+0000 7ff76d6c6700 1 --2- 172.21.15.59:0/4059169730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff76815b260 0x7ff7680c90d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff76000cae0 tx=0x7ff76000cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:39.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.151+0000 7ff7657fa700 1 -- 172.21.15.59:0/4059169730 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76000aac0 con 0x7ff76815b260 2023-09-21T00:17:39.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.151+0000 7ff7657fa700 1 -- 172.21.15.59:0/4059169730 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76000ac20 con 0x7ff76815b260 2023-09-21T00:17:39.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.151+0000 7ff76f129700 1 -- 172.21.15.59:0/4059169730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff76814eea0 con 0x7ff76815b260 2023-09-21T00:17:39.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.151+0000 7ff7657fa700 1 -- 172.21.15.59:0/4059169730 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff760012400 con 0x7ff76815b260 2023-09-21T00:17:39.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.151+0000 7ff76f129700 1 -- 172.21.15.59:0/4059169730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff76814f460 con 0x7ff76815b260 2023-09-21T00:17:39.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.152+0000 7ff76f129700 1 -- 172.21.15.59:0/4059169730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7680af720 con 0x7ff76815b260 2023-09-21T00:17:39.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.152+0000 7ff7657fa700 1 -- 172.21.15.59:0/4059169730 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7ff760007d50 con 0x7ff76815b260 2023-09-21T00:17:39.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.153+0000 7ff7657fa700 1 --2- 172.21.15.59:0/4059169730 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ff74c06ae00 0x7ff74c06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:39.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.153+0000 7ff7657fa700 1 -- 172.21.15.59:0/4059169730 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff7600890d0 con 0x7ff76815b260 2023-09-21T00:17:39.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.153+0000 7ff76cec5700 1 --2- 172.21.15.59:0/4059169730 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ff74c06ae00 0x7ff74c06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:39.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.154+0000 7ff76cec5700 1 --2- 172.21.15.59:0/4059169730 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ff74c06ae00 0x7ff74c06d2c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff75c009fd0 tx=0x7ff75c01c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:39.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.157+0000 7ff7657fa700 1 -- 172.21.15.59:0/4059169730 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7ff7680af720 con 0x7ff76815b260 2023-09-21T00:17:39.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.360+0000 7ff76f129700 1 -- 172.21.15.59:0/4059169730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7680af6e0 con 0x7ff76815b260 2023-09-21T00:17:39.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.361+0000 7ff7657fa700 1 -- 172.21.15.59:0/4059169730 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18262 (secure 0 0 0) 0x7ff760053fb0 con 0x7ff76815b260 2023-09-21T00:17:39.362 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:17:39.362 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":24,"fsid":"dd69925c-6e25-42fe-880b-2f60fc6f384b","created":"2023-09-21T00:16:43.074489+0000","modified":"2023-09-21T00:17:11.387529+0000","last_up_change":"2023-09-21T00:16:54.740101+0000","last_in_change":"2023-09-21T00:16:45.987089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T00:16:54.796248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-21T00:17:04.167102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-21T00:17:05.313188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-21T00:17:08.977609+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d4b18344-74c0-4f75-920b-7a9247e48914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6809","nonce":2418314235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6811","nonce":2418314235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6815","nonce":2418314235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6813","nonce":2418314235}]},"public_addr":"172.21.15.59:6809/2418314235","cluster_addr":"172.21.15.59:6811/2418314235","heartbeat_back_addr":"172.21.15.59:6815/2418314235","heartbeat_front_addr":"172.21.15.59:6813/2418314235","state":["exists","up"]},{"osd":1,"uuid":"80940d50-a248-4e64-a282-7ffcdad790ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6801","nonce":869668251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6803","nonce":869668251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6807","nonce":869668251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6805","nonce":869668251}]},"public_addr":"172.21.15.59:6801/869668251","cluster_addr":"172.21.15.59:6803/869668251","heartbeat_back_addr":"172.21.15.59:6807/869668251","heartbeat_front_addr":"172.21.15.59:6805/869668251","state":["exists","up"]},{"osd":2,"uuid":"55f2eceb-c54a-4879-a6ce-968c1c548b5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6817","nonce":372517778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6819","nonce":372517778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6823","nonce":372517778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6821","nonce":372517778}]},"public_addr":"172.21.15.59:6817/372517778","cluster_addr":"172.21.15.59:6819/372517778","heartbeat_back_addr":"172.21.15.59:6823/372517778","heartbeat_front_addr":"172.21.15.59:6821/372517778","state":["exists","up"]},{"osd":3,"uuid":"92b89cd0-869c-49b9-a9f9-97ac8423f304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6825","nonce":575188498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6827","nonce":575188498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6831","nonce":575188498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6829","nonce":575188498}]},"public_addr":"172.21.15.59:6825/575188498","cluster_addr":"172.21.15.59:6827/575188498","heartbeat_back_addr":"172.21.15.59:6831/575188498","heartbeat_front_addr":"172.21.15.59:6829/575188498","state":["exists","up"]},{"osd":4,"uuid":"25b80e94-e0e6-403d-b69f-61542f289637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6803","nonce":1741219098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6805","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6807","nonce":1741219098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6815","nonce":1741219098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6811","nonce":1741219098}]},"public_addr":"172.21.15.83:6803/1741219098","cluster_addr":"172.21.15.83:6807/1741219098","heartbeat_back_addr":"172.21.15.83:6815/1741219098","heartbeat_front_addr":"172.21.15.83:6811/1741219098","state":["exists","up"]},{"osd":5,"uuid":"5498d9ab-1086-4796-a199-9051e6dfea91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6817","nonce":156730565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6819","nonce":156730565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6823","nonce":156730565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6821","nonce":156730565}]},"public_addr":"172.21.15.83:6817/156730565","cluster_addr":"172.21.15.83:6819/156730565","heartbeat_back_addr":"172.21.15.83:6823/156730565","heartbeat_front_addr":"172.21.15.83:6821/156730565","state":["exists","up"]},{"osd":6,"uuid":"cfd810c0-5015-4d60-9a75-7efc93a32e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6801","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6800","nonce":1337723778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6806","nonce":1337723778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6814","nonce":1337723778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6810","nonce":1337723778}]},"public_addr":"172.21.15.83:6800/1337723778","cluster_addr":"172.21.15.83:6806/1337723778","heartbeat_back_addr":"172.21.15.83:6814/1337723778","heartbeat_front_addr":"172.21.15.83:6810/1337723778","state":["exists","up"]},{"osd":7,"uuid":"e992c8fa-0a3d-4b3c-85b5-2c511223dee4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6825","nonce":4204859272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6827","nonce":4204859272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6831","nonce":4204859272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6829","nonce":4204859272}]},"public_addr":"172.21.15.83:6825/4204859272","cluster_addr":"172.21.15.83:6827/4204859272","heartbeat_back_addr":"172.21.15.83:6831/4204859272","heartbeat_front_addr":"172.21.15.83:6829/4204859272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.156498+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.882707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.093978+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.158565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.173933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.888606+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.135525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.149712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T00:17:39.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.363+0000 7ff76f129700 1 -- 172.21.15.59:0/4059169730 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ff74c06ae00 msgr2=0x7ff74c06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:39.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.363+0000 7ff76f129700 1 --2- 172.21.15.59:0/4059169730 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ff74c06ae00 0x7ff74c06d2c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff75c009fd0 tx=0x7ff75c01c040 comp rx=0 tx=0).stop 2023-09-21T00:17:39.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.363+0000 7ff76f129700 1 -- 172.21.15.59:0/4059169730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff76815b260 msgr2=0x7ff7680c90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:39.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.363+0000 7ff76f129700 1 --2- 172.21.15.59:0/4059169730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff76815b260 0x7ff7680c90d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff76000cae0 tx=0x7ff76000cea0 comp rx=0 tx=0).stop 2023-09-21T00:17:39.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.363+0000 7ff76f129700 1 -- 172.21.15.59:0/4059169730 shutdown_connections 2023-09-21T00:17:39.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.363+0000 7ff76f129700 1 --2- 172.21.15.59:0/4059169730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff76815b260 0x7ff7680c90d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:39.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.363+0000 7ff76f129700 1 --2- 172.21.15.59:0/4059169730 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7680b54b0 0x7ff76814e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:39.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.363+0000 7ff76f129700 1 --2- 172.21.15.59:0/4059169730 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ff74c06ae00 0x7ff74c06d2c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:39.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.363+0000 7ff76f129700 1 --2- 172.21.15.59:0/4059169730 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff7680cc940 0x7ff7680c8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:39.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.363+0000 7ff76f129700 1 -- 172.21.15.59:0/4059169730 >> 172.21.15.59:0/4059169730 conn(0x7ff76806a780 msgr2=0x7ff768159e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:39.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.363+0000 7ff76f129700 1 -- 172.21.15.59:0/4059169730 shutdown_connections 2023-09-21T00:17:39.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.363+0000 7ff76f129700 1 -- 172.21.15.59:0/4059169730 wait complete. 2023-09-21T00:17:39.377 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-21T00:16:54.796248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-21T00:17:04.167102+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-21T00:17:05.313188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-21T00:17:08.977609+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-21T00:17:39.377 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-21T00:17:39.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.505+0000 7fc8e4802700 1 Processor -- start 2023-09-21T00:17:39.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.505+0000 7fc8e4802700 1 -- start start 2023-09-21T00:17:39.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.506+0000 7fc8e4802700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc8e015b4e0 0x7fc8e00cd970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:39.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.506+0000 7fc8e4802700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc8e00cdeb0 0x7fc8e00b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:39.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.506+0000 7fc8e4802700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8e00b4930 con 0x7fc8e015b100 2023-09-21T00:17:39.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.506+0000 7fc8e4802700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8e00ce320 con 0x7fc8e00cdeb0 2023-09-21T00:17:39.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.506+0000 7fc8e4802700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8e00b4000 con 0x7fc8e015b4e0 2023-09-21T00:17:39.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.506+0000 7fc8df59e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc8e00cdeb0 0x7fc8e00b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:39.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.506+0000 7fc8df59e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc8e00cdeb0 0x7fc8e00b1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51950/0 (socket says 172.21.15.59:51950) 2023-09-21T00:17:39.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.506+0000 7fc8df59e700 1 -- 172.21.15.59:0/1985808590 learned_addr learned my addr 172.21.15.59:0/1985808590 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:39.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.506+0000 7fc8de59c700 1 --2- 172.21.15.59:0/1985808590 >> v2:172.21.15.83:3300/0 conn(0x7fc8e015b4e0 0x7fc8e00cd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:39.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.506+0000 7fc8df59e700 1 -- 172.21.15.59:0/1985808590 >> v2:172.21.15.83:3300/0 conn(0x7fc8e015b4e0 msgr2=0x7fc8e00cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:39.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.506+0000 7fc8df59e700 1 --2- 172.21.15.59:0/1985808590 >> v2:172.21.15.83:3300/0 conn(0x7fc8e015b4e0 0x7fc8e00cd970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:39.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.506+0000 7fc8df59e700 1 -- 172.21.15.59:0/1985808590 >> v1:172.21.15.83:6789/0 conn(0x7fc8e015b100 legacy=0x7fc8e00cf5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:39.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.506+0000 7fc8df59e700 1 -- 172.21.15.59:0/1985808590 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e00b42e0 con 0x7fc8e00cdeb0 2023-09-21T00:17:39.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.506+0000 7fc8de59c700 1 --2- 172.21.15.59:0/1985808590 >> v2:172.21.15.83:3300/0 conn(0x7fc8e015b4e0 0x7fc8e00cd970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:17:39.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.506+0000 7fc8df59e700 1 --2- 172.21.15.59:0/1985808590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8e00cdeb0 0x7fc8e00b1c20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc8e015ed50 tx=0x7fc8d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4f0e06d107c73e4 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:39.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.507+0000 7fc8ddd9b700 1 -- 172.21.15.59:0/1985808590 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d800e070 con 0x7fc8e00cdeb0 2023-09-21T00:17:39.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.507+0000 7fc8ddd9b700 1 -- 172.21.15.59:0/1985808590 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d800b9c0 con 0x7fc8e00cdeb0 2023-09-21T00:17:39.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.507+0000 7fc8ddd9b700 1 -- 172.21.15.59:0/1985808590 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d800bd70 con 0x7fc8e00cdeb0 2023-09-21T00:17:39.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.507+0000 7fc8e4802700 1 -- 172.21.15.59:0/1985808590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8e00cdeb0 msgr2=0x7fc8e00b1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:39.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.507+0000 7fc8e4802700 1 --2- 172.21.15.59:0/1985808590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8e00cdeb0 0x7fc8e00b1c20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc8e015ed50 tx=0x7fc8d800b330 comp rx=0 tx=0).stop 2023-09-21T00:17:39.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.507+0000 7fc8e4802700 1 -- 172.21.15.59:0/1985808590 shutdown_connections 2023-09-21T00:17:39.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.507+0000 7fc8e4802700 1 --2- 172.21.15.59:0/1985808590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8e00cdeb0 0x7fc8e00b1c20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:39.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.507+0000 7fc8e4802700 1 --2- 172.21.15.59:0/1985808590 >> v2:172.21.15.83:3300/0 conn(0x7fc8e015b4e0 0x7fc8e00cd970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:39.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.507+0000 7fc8e4802700 1 -- 172.21.15.59:0/1985808590 >> 172.21.15.59:0/1985808590 conn(0x7fc8e008afa0 msgr2=0x7fc8e00d1010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:39.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.507+0000 7fc8e4802700 1 -- 172.21.15.59:0/1985808590 shutdown_connections 2023-09-21T00:17:39.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.507+0000 7fc8e4802700 1 -- 172.21.15.59:0/1985808590 wait complete. 2023-09-21T00:17:39.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.509+0000 7fc8e4802700 1 Processor -- start 2023-09-21T00:17:39.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.509+0000 7fc8e4802700 1 -- start start 2023-09-21T00:17:39.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.509+0000 7fc8e4802700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8e00cdeb0 0x7fc8e01587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:39.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.510+0000 7fc8e4802700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc8e015b100 0x7fc8e00c5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:39.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.510+0000 7fc8e4802700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc8e015b4e0 0x7fc8e006d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:39.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.510+0000 7fc8e4802700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e006c3d0 con 0x7fc8e00cdeb0 2023-09-21T00:17:39.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.510+0000 7fc8e4802700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e0158d10 con 0x7fc8e015b100 2023-09-21T00:17:39.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.510+0000 7fc8e4802700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e006c670 con 0x7fc8e015b4e0 2023-09-21T00:17:39.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.510+0000 7fc8ded9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8e00cdeb0 0x7fc8e01587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:39.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.510+0000 7fc8ded9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8e00cdeb0 0x7fc8e01587d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51952/0 (socket says 172.21.15.59:51952) 2023-09-21T00:17:39.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.510+0000 7fc8ded9d700 1 -- 172.21.15.59:0/1987181074 learned_addr learned my addr 172.21.15.59:0/1987181074 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:39.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.510+0000 7fc8de59c700 1 --2- 172.21.15.59:0/1987181074 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc8e015b100 0x7fc8e00c5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:39.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.510+0000 7fc8df59e700 1 --2- 172.21.15.59:0/1987181074 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc8e015b4e0 0x7fc8e006d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:39.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.510+0000 7fc8ded9d700 1 -- 172.21.15.59:0/1987181074 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc8e015b4e0 msgr2=0x7fc8e006d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:39.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.510+0000 7fc8ded9d700 1 --2- 172.21.15.59:0/1987181074 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc8e015b4e0 0x7fc8e006d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:39.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.510+0000 7fc8ded9d700 1 -- 172.21.15.59:0/1987181074 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc8e015b100 msgr2=0x7fc8e00c5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:39.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.510+0000 7fc8ded9d700 1 --2- 172.21.15.59:0/1987181074 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc8e015b100 0x7fc8e00c5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:39.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.510+0000 7fc8ded9d700 1 -- 172.21.15.59:0/1987181074 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d8009b30 con 0x7fc8e00cdeb0 2023-09-21T00:17:39.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.510+0000 7fc8df59e700 1 --2- 172.21.15.59:0/1987181074 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc8e015b4e0 0x7fc8e006d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:17:39.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.510+0000 7fc8ded9d700 1 --2- 172.21.15.59:0/1987181074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8e00cdeb0 0x7fc8e01587d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc8d000c4d0 tx=0x7fc8d000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:39.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.510+0000 7fc8d77fe700 1 -- 172.21.15.59:0/1987181074 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d00052d0 con 0x7fc8e00cdeb0 2023-09-21T00:17:39.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.510+0000 7fc8d77fe700 1 -- 172.21.15.59:0/1987181074 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d0005430 con 0x7fc8e00cdeb0 2023-09-21T00:17:39.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.510+0000 7fc8e4802700 1 -- 172.21.15.59:0/1987181074 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8e006c950 con 0x7fc8e00cdeb0 2023-09-21T00:17:39.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.510+0000 7fc8d77fe700 1 -- 172.21.15.59:0/1987181074 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d00038f0 con 0x7fc8e00cdeb0 2023-09-21T00:17:39.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.510+0000 7fc8e4802700 1 -- 172.21.15.59:0/1987181074 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8e00c5e90 con 0x7fc8e00cdeb0 2023-09-21T00:17:39.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.511+0000 7fc8e4802700 1 -- 172.21.15.59:0/1987181074 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8e00c9d10 con 0x7fc8e00cdeb0 2023-09-21T00:17:39.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.512+0000 7fc8d77fe700 1 -- 172.21.15.59:0/1987181074 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fc8d0003a50 con 0x7fc8e00cdeb0 2023-09-21T00:17:39.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.512+0000 7fc8d77fe700 1 --2- 172.21.15.59:0/1987181074 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fc8c006ae00 0x7fc8c006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:39.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.512+0000 7fc8d77fe700 1 -- 172.21.15.59:0/1987181074 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc8d0088c40 con 0x7fc8e00cdeb0 2023-09-21T00:17:39.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.512+0000 7fc8de59c700 1 --2- 172.21.15.59:0/1987181074 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fc8c006ae00 0x7fc8c006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:39.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.513+0000 7fc8de59c700 1 --2- 172.21.15.59:0/1987181074 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fc8c006ae00 0x7fc8c006d2c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc8e00b2bb0 tx=0x7fc8c8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:39.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.517+0000 7fc8d77fe700 1 -- 172.21.15.59:0/1987181074 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fc8e00c9d10 con 0x7fc8e00cdeb0 2023-09-21T00:17:39.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.716+0000 7fc8e4802700 1 -- 172.21.15.59:0/1987181074 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc8e00c9d10 con 0x7fc8e00cdeb0 2023-09-21T00:17:39.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.716+0000 7fc8d77fe700 1 -- 172.21.15.59:0/1987181074 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc8d00170a0 con 0x7fc8e00cdeb0 2023-09-21T00:17:39.717 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-09-21T00:17:39.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.718+0000 7fc8e4802700 1 -- 172.21.15.59:0/1987181074 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fc8c006ae00 msgr2=0x7fc8c006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:39.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.718+0000 7fc8e4802700 1 --2- 172.21.15.59:0/1987181074 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fc8c006ae00 0x7fc8c006d2c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc8e00b2bb0 tx=0x7fc8c8008040 comp rx=0 tx=0).stop 2023-09-21T00:17:39.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.718+0000 7fc8e4802700 1 -- 172.21.15.59:0/1987181074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8e00cdeb0 msgr2=0x7fc8e01587d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:39.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.718+0000 7fc8e4802700 1 --2- 172.21.15.59:0/1987181074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8e00cdeb0 0x7fc8e01587d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc8d000c4d0 tx=0x7fc8d000c7e0 comp rx=0 tx=0).stop 2023-09-21T00:17:39.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.718+0000 7fc8e4802700 1 -- 172.21.15.59:0/1987181074 shutdown_connections 2023-09-21T00:17:39.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.718+0000 7fc8e4802700 1 --2- 172.21.15.59:0/1987181074 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fc8c006ae00 0x7fc8c006d2c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:39.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.718+0000 7fc8e4802700 1 --2- 172.21.15.59:0/1987181074 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc8e015b4e0 0x7fc8e006d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:39.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.718+0000 7fc8e4802700 1 --2- 172.21.15.59:0/1987181074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8e00cdeb0 0x7fc8e01587d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:39.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.718+0000 7fc8e4802700 1 --2- 172.21.15.59:0/1987181074 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc8e015b100 0x7fc8e00c5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:39.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.718+0000 7fc8e4802700 1 -- 172.21.15.59:0/1987181074 >> 172.21.15.59:0/1987181074 conn(0x7fc8e008afa0 msgr2=0x7fc8e006e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:39.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.718+0000 7fc8e4802700 1 -- 172.21.15.59:0/1987181074 shutdown_connections 2023-09-21T00:17:39.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.718+0000 7fc8e4802700 1 -- 172.21.15.59:0/1987181074 wait complete. 2023-09-21T00:17:39.732 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-21T00:17:39.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.860+0000 7f1de0b74700 1 Processor -- start 2023-09-21T00:17:39.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.860+0000 7f1de0b74700 1 -- start start 2023-09-21T00:17:39.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.861+0000 7f1de0b74700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1ddc0ce420 0x7f1ddc0cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:39.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.861+0000 7f1de0b74700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1ddc06a780 0x7f1ddc06abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:39.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.861+0000 7f1de0b74700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ddc06b110 con 0x7f1ddc15b2b0 2023-09-21T00:17:39.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.861+0000 7f1de0b74700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ddc0ce250 con 0x7f1ddc0ce420 2023-09-21T00:17:39.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.861+0000 7f1de0b74700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ddc1618a0 con 0x7f1ddc06a780 2023-09-21T00:17:39.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.861+0000 7f1dd9d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1ddc0ce420 0x7f1ddc0cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:39.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.861+0000 7f1dda59c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1ddc15b2b0 0x7f1ddc161190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57528/0 (socket says 172.21.15.59:57528) 2023-09-21T00:17:39.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.861+0000 7f1dda59c700 1 -- 172.21.15.59:0/998913188 learned_addr learned my addr 172.21.15.59:0/998913188 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:39.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.861+0000 7f1ddad9d700 1 --2- 172.21.15.59:0/998913188 >> v2:172.21.15.83:3300/0 conn(0x7f1ddc06a780 0x7f1ddc06abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:39.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.861+0000 7f1dd959a700 1 -- 172.21.15.59:0/998913188 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2438354493 0 0) 0x7f1dd0001110 con 0x7f1ddc15b2b0 2023-09-21T00:17:39.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.861+0000 7f1dd959a700 1 -- 172.21.15.59:0/998913188 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1dc40035b0 con 0x7f1ddc15b2b0 2023-09-21T00:17:39.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.861+0000 7f1dd9d9b700 1 -- 172.21.15.59:0/998913188 >> v2:172.21.15.83:3300/0 conn(0x7f1ddc06a780 msgr2=0x7f1ddc06abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:39.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.861+0000 7f1dd9d9b700 1 --2- 172.21.15.59:0/998913188 >> v2:172.21.15.83:3300/0 conn(0x7f1ddc06a780 0x7f1ddc06abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:39.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.861+0000 7f1dd9d9b700 1 -- 172.21.15.59:0/998913188 >> v1:172.21.15.59:6789/0 conn(0x7f1ddc15b2b0 legacy=0x7f1ddc161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:39.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.861+0000 7f1dd9d9b700 1 -- 172.21.15.59:0/998913188 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ddc0cfee0 con 0x7f1ddc0ce420 2023-09-21T00:17:39.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.861+0000 7f1dd9d9b700 1 --2- 172.21.15.59:0/998913188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ddc0ce420 0x7f1ddc0cdd10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc0cbf10 tx=0x7f1dcc009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe82ab666f80e39 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:39.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.861+0000 7f1dd959a700 1 -- 172.21.15.59:0/998913188 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc011830 con 0x7f1ddc0ce420 2023-09-21T00:17:39.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.861+0000 7f1dd959a700 1 -- 172.21.15.59:0/998913188 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dcc011990 con 0x7f1ddc0ce420 2023-09-21T00:17:39.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.861+0000 7f1dd959a700 1 -- 172.21.15.59:0/998913188 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc011d20 con 0x7f1ddc0ce420 2023-09-21T00:17:39.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.862+0000 7f1de0b74700 1 -- 172.21.15.59:0/998913188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ddc0ce420 msgr2=0x7f1ddc0cdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:39.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.862+0000 7f1de0b74700 1 --2- 172.21.15.59:0/998913188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ddc0ce420 0x7f1ddc0cdd10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc0cbf10 tx=0x7f1dcc009b20 comp rx=0 tx=0).stop 2023-09-21T00:17:39.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.862+0000 7f1de0b74700 1 -- 172.21.15.59:0/998913188 shutdown_connections 2023-09-21T00:17:39.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.862+0000 7f1de0b74700 1 --2- 172.21.15.59:0/998913188 >> v2:172.21.15.83:3300/0 conn(0x7f1ddc06a780 0x7f1ddc06abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:39.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.862+0000 7f1de0b74700 1 --2- 172.21.15.59:0/998913188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ddc0ce420 0x7f1ddc0cdd10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:39.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.862+0000 7f1de0b74700 1 -- 172.21.15.59:0/998913188 >> 172.21.15.59:0/998913188 conn(0x7f1ddc0d0140 msgr2=0x7f1ddc0d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:39.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.862+0000 7f1de0b74700 1 -- 172.21.15.59:0/998913188 shutdown_connections 2023-09-21T00:17:39.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.862+0000 7f1de0b74700 1 -- 172.21.15.59:0/998913188 wait complete. 2023-09-21T00:17:39.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.863+0000 7f1de0b74700 1 Processor -- start 2023-09-21T00:17:39.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.864+0000 7f1de0b74700 1 -- start start 2023-09-21T00:17:39.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.864+0000 7f1de0b74700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ddc06a780 0x7f1ddc0c2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:39.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.864+0000 7f1de0b74700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ddc0ce420 0x7f1ddc0ae050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:39.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.864+0000 7f1de0b74700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ddc15b2b0 0x7f1ddc0ae590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:39.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.864+0000 7f1de0b74700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc0c3240 con 0x7f1ddc0ce420 2023-09-21T00:17:39.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.864+0000 7f1de0b74700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc0c3c70 con 0x7f1ddc15b2b0 2023-09-21T00:17:39.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.864+0000 7f1de0b74700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc0c3ec0 con 0x7f1ddc06a780 2023-09-21T00:17:39.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.864+0000 7f1dd9d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ddc0ce420 0x7f1ddc0ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:39.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.864+0000 7f1dd9d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ddc0ce420 0x7f1ddc0ae050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51964/0 (socket says 172.21.15.59:51964) 2023-09-21T00:17:39.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.864+0000 7f1dd9d9b700 1 -- 172.21.15.59:0/2419358313 learned_addr learned my addr 172.21.15.59:0/2419358313 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:39.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.865+0000 7f1ddad9d700 1 --2- 172.21.15.59:0/2419358313 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ddc15b2b0 0x7f1ddc0ae590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:39.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.865+0000 7f1dda59c700 1 --2- 172.21.15.59:0/2419358313 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ddc06a780 0x7f1ddc0c2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:39.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.865+0000 7f1dd9d9b700 1 -- 172.21.15.59:0/2419358313 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ddc06a780 msgr2=0x7f1ddc0c2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:39.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.865+0000 7f1dd9d9b700 1 --2- 172.21.15.59:0/2419358313 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ddc06a780 0x7f1ddc0c2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:39.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.865+0000 7f1dd9d9b700 1 -- 172.21.15.59:0/2419358313 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ddc15b2b0 msgr2=0x7f1ddc0ae590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:39.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.865+0000 7f1dd9d9b700 1 --2- 172.21.15.59:0/2419358313 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ddc15b2b0 0x7f1ddc0ae590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:39.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.865+0000 7f1dd9d9b700 1 -- 172.21.15.59:0/2419358313 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dcc0094a0 con 0x7f1ddc0ce420 2023-09-21T00:17:39.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.865+0000 7f1dd9d9b700 1 --2- 172.21.15.59:0/2419358313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ddc0ce420 0x7f1ddc0ae050 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc009b60 tx=0x7f1dcc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:39.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.865+0000 7f1dcaffd700 1 -- 172.21.15.59:0/2419358313 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc0038a0 con 0x7f1ddc0ce420 2023-09-21T00:17:39.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.865+0000 7f1dcaffd700 1 -- 172.21.15.59:0/2419358313 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dcc01f070 con 0x7f1ddc0ce420 2023-09-21T00:17:39.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.865+0000 7f1de0b74700 1 -- 172.21.15.59:0/2419358313 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ddc0c41a0 con 0x7f1ddc0ce420 2023-09-21T00:17:39.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.865+0000 7f1dcaffd700 1 -- 172.21.15.59:0/2419358313 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc003c40 con 0x7f1ddc0ce420 2023-09-21T00:17:39.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.865+0000 7f1de0b74700 1 -- 172.21.15.59:0/2419358313 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ddc0c4760 con 0x7f1ddc0ce420 2023-09-21T00:17:39.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.866+0000 7f1de0b74700 1 -- 172.21.15.59:0/2419358313 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ddc067e50 con 0x7f1ddc0ce420 2023-09-21T00:17:39.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.866+0000 7f1dcaffd700 1 -- 172.21.15.59:0/2419358313 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f1dcc026480 con 0x7f1ddc0ce420 2023-09-21T00:17:39.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.867+0000 7f1dcaffd700 1 --2- 172.21.15.59:0/2419358313 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f1dbc06ae00 0x7f1dbc06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:39.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.867+0000 7f1dcaffd700 1 -- 172.21.15.59:0/2419358313 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1dcc021070 con 0x7f1ddc0ce420 2023-09-21T00:17:39.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.867+0000 7f1dda59c700 1 --2- 172.21.15.59:0/2419358313 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f1dbc06ae00 0x7f1dbc06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:39.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.868+0000 7f1dda59c700 1 --2- 172.21.15.59:0/2419358313 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f1dbc06ae00 0x7f1dbc06d2c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0001270 tx=0x7f1dd0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:39.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:39.872+0000 7f1dcaffd700 1 -- 172.21.15.59:0/2419358313 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f1dcc055ed0 con 0x7f1ddc0ce420 2023-09-21T00:17:40.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.071+0000 7f1de0b74700 1 -- 172.21.15.59:0/2419358313 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1ddc0af470 con 0x7f1ddc0ce420 2023-09-21T00:17:40.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.074+0000 7f1dcaffd700 1 -- 172.21.15.59:0/2419358313 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1dcc0150a0 con 0x7f1ddc0ce420 2023-09-21T00:17:40.075 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-09-21T00:17:40.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.076+0000 7f1de0b74700 1 -- 172.21.15.59:0/2419358313 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f1dbc06ae00 msgr2=0x7f1dbc06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:40.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.076+0000 7f1de0b74700 1 --2- 172.21.15.59:0/2419358313 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f1dbc06ae00 0x7f1dbc06d2c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0001270 tx=0x7f1dd0009040 comp rx=0 tx=0).stop 2023-09-21T00:17:40.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.076+0000 7f1de0b74700 1 -- 172.21.15.59:0/2419358313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ddc0ce420 msgr2=0x7f1ddc0ae050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:40.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.076+0000 7f1de0b74700 1 --2- 172.21.15.59:0/2419358313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ddc0ce420 0x7f1ddc0ae050 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc009b60 tx=0x7f1dcc004750 comp rx=0 tx=0).stop 2023-09-21T00:17:40.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.076+0000 7f1de0b74700 1 -- 172.21.15.59:0/2419358313 shutdown_connections 2023-09-21T00:17:40.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.076+0000 7f1de0b74700 1 --2- 172.21.15.59:0/2419358313 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ddc15b2b0 0x7f1ddc0ae590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:40.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.076+0000 7f1de0b74700 1 --2- 172.21.15.59:0/2419358313 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f1dbc06ae00 0x7f1dbc06d2c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:40.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.076+0000 7f1de0b74700 1 --2- 172.21.15.59:0/2419358313 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ddc06a780 0x7f1ddc0c2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:40.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.076+0000 7f1de0b74700 1 --2- 172.21.15.59:0/2419358313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ddc0ce420 0x7f1ddc0ae050 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:40.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.076+0000 7f1de0b74700 1 -- 172.21.15.59:0/2419358313 >> 172.21.15.59:0/2419358313 conn(0x7f1ddc0d0140 msgr2=0x7f1ddc06f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:40.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.076+0000 7f1de0b74700 1 -- 172.21.15.59:0/2419358313 shutdown_connections 2023-09-21T00:17:40.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.076+0000 7f1de0b74700 1 -- 172.21.15.59:0/2419358313 wait complete. 2023-09-21T00:17:40.089 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-21T00:17:40.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.216+0000 7ff5b3b43700 1 Processor -- start 2023-09-21T00:17:40.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.217+0000 7ff5b3b43700 1 -- start start 2023-09-21T00:17:40.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.217+0000 7ff5b3b43700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff5ac0ca790 0x7ff5ac071680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:40.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.217+0000 7ff5b3b43700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5ac0cb1c0 con 0x7ff5ac0cabf0 2023-09-21T00:17:40.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.217+0000 7ff5b3b43700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5ac0cb4a0 con 0x7ff5ac15a230 2023-09-21T00:17:40.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.217+0000 7ff5b3b43700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac0cb780 con 0x7ff5ac0ca790 2023-09-21T00:17:40.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.218+0000 7ff5b20e0700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff5ac0cabf0 0x7ff5ac06eaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57542/0 (socket says 172.21.15.59:57542) 2023-09-21T00:17:40.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.218+0000 7ff5b20e0700 1 -- 172.21.15.59:0/2586730144 learned_addr learned my addr 172.21.15.59:0/2586730144 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:40.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.218+0000 7ff5b10de700 1 --2- 172.21.15.59:0/2586730144 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff5ac0ca790 0x7ff5ac071680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:40.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.218+0000 7ff5b08dd700 1 -- 172.21.15.59:0/2586730144 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 609117613 0 0) 0x7ff5ac0cb1c0 con 0x7ff5ac0cabf0 2023-09-21T00:17:40.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.218+0000 7ff5b08dd700 1 -- 172.21.15.59:0/2586730144 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5980035b0 con 0x7ff5ac0cabf0 2023-09-21T00:17:40.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.218+0000 7ff5b08dd700 1 -- 172.21.15.59:0/2586730144 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1727511211 0 0) 0x7ff5ac0cb4a0 con 0x7ff5ac15a230 2023-09-21T00:17:40.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.218+0000 7ff5b08dd700 1 -- 172.21.15.59:0/2586730144 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5ac0cb1c0 con 0x7ff5ac15a230 2023-09-21T00:17:40.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.218+0000 7ff5b10de700 1 -- 172.21.15.59:0/2586730144 >> v1:172.21.15.83:6789/0 conn(0x7ff5ac15a230 legacy=0x7ff5ac15e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:40.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.218+0000 7ff5b10de700 1 -- 172.21.15.59:0/2586730144 >> v1:172.21.15.59:6789/0 conn(0x7ff5ac0cabf0 legacy=0x7ff5ac06eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:40.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.218+0000 7ff5b10de700 1 -- 172.21.15.59:0/2586730144 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ac15e0b0 con 0x7ff5ac0ca790 2023-09-21T00:17:40.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.218+0000 7ff5b10de700 1 --2- 172.21.15.59:0/2586730144 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff5ac0ca790 0x7ff5ac071680 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8009870 tx=0x7ff5a8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc35b646e3cfd3c5 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:40.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.218+0000 7ff5b08dd700 1 -- 172.21.15.59:0/2586730144 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a8011830 con 0x7ff5ac0ca790 2023-09-21T00:17:40.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.218+0000 7ff5b08dd700 1 -- 172.21.15.59:0/2586730144 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a8011990 con 0x7ff5ac0ca790 2023-09-21T00:17:40.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.218+0000 7ff5b08dd700 1 -- 172.21.15.59:0/2586730144 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a8011d20 con 0x7ff5ac0ca790 2023-09-21T00:17:40.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.219+0000 7ff5b3b43700 1 -- 172.21.15.59:0/2586730144 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff5ac0ca790 msgr2=0x7ff5ac071680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:40.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.219+0000 7ff5b3b43700 1 --2- 172.21.15.59:0/2586730144 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff5ac0ca790 0x7ff5ac071680 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8009870 tx=0x7ff5a8009b80 comp rx=0 tx=0).stop 2023-09-21T00:17:40.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.219+0000 7ff5b3b43700 1 -- 172.21.15.59:0/2586730144 shutdown_connections 2023-09-21T00:17:40.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.219+0000 7ff5b3b43700 1 --2- 172.21.15.59:0/2586730144 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff5ac0ca790 0x7ff5ac071680 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:40.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.219+0000 7ff5b3b43700 1 -- 172.21.15.59:0/2586730144 >> 172.21.15.59:0/2586730144 conn(0x7ff5ac0d0140 msgr2=0x7ff5ac0d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:40.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.219+0000 7ff5b3b43700 1 -- 172.21.15.59:0/2586730144 shutdown_connections 2023-09-21T00:17:40.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.219+0000 7ff5b3b43700 1 -- 172.21.15.59:0/2586730144 wait complete. 2023-09-21T00:17:40.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.220+0000 7ff5b3b43700 1 Processor -- start 2023-09-21T00:17:40.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.220+0000 7ff5b3b43700 1 -- start start 2023-09-21T00:17:40.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.221+0000 7ff5b3b43700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5ac0ca790 0x7ff5ac154a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:40.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.221+0000 7ff5b3b43700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff5ac0cabf0 0x7ff5ac0a8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:40.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.221+0000 7ff5b3b43700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5ac15a230 0x7ff5ac15b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:40.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.221+0000 7ff5b3b43700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac0c9190 con 0x7ff5ac15a230 2023-09-21T00:17:40.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.221+0000 7ff5b3b43700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac0c87f0 con 0x7ff5ac0ca790 2023-09-21T00:17:40.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.221+0000 7ff5b3b43700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac0c8ad0 con 0x7ff5ac0cabf0 2023-09-21T00:17:40.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.221+0000 7ff5b20e0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5ac15a230 0x7ff5ac15b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:40.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.221+0000 7ff5b20e0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5ac15a230 0x7ff5ac15b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51980/0 (socket says 172.21.15.59:51980) 2023-09-21T00:17:40.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.221+0000 7ff5b20e0700 1 -- 172.21.15.59:0/2958188905 learned_addr learned my addr 172.21.15.59:0/2958188905 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:40.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.221+0000 7ff5b10de700 1 --2- 172.21.15.59:0/2958188905 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff5ac0cabf0 0x7ff5ac0a8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:40.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.221+0000 7ff5b18df700 1 --2- 172.21.15.59:0/2958188905 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5ac0ca790 0x7ff5ac154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:40.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.222+0000 7ff5b20e0700 1 -- 172.21.15.59:0/2958188905 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff5ac0cabf0 msgr2=0x7ff5ac0a8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:40.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.222+0000 7ff5b20e0700 1 --2- 172.21.15.59:0/2958188905 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff5ac0cabf0 0x7ff5ac0a8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:40.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.222+0000 7ff5b20e0700 1 -- 172.21.15.59:0/2958188905 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5ac0ca790 msgr2=0x7ff5ac154a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:40.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.222+0000 7ff5b20e0700 1 --2- 172.21.15.59:0/2958188905 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5ac0ca790 0x7ff5ac154a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:40.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.222+0000 7ff5b20e0700 1 -- 172.21.15.59:0/2958188905 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a80094a0 con 0x7ff5ac15a230 2023-09-21T00:17:40.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.222+0000 7ff5b20e0700 1 --2- 172.21.15.59:0/2958188905 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5ac15a230 0x7ff5ac15b320 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff5a400cba0 tx=0x7ff5a400ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:40.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.222+0000 7ff5a27fc700 1 -- 172.21.15.59:0/2958188905 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a400aa40 con 0x7ff5ac15a230 2023-09-21T00:17:40.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.222+0000 7ff5a27fc700 1 -- 172.21.15.59:0/2958188905 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a400aba0 con 0x7ff5ac15a230 2023-09-21T00:17:40.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.222+0000 7ff5b3b43700 1 -- 172.21.15.59:0/2958188905 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5ac0c8db0 con 0x7ff5ac15a230 2023-09-21T00:17:40.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.222+0000 7ff5a27fc700 1 -- 172.21.15.59:0/2958188905 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4012400 con 0x7ff5ac15a230 2023-09-21T00:17:40.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.222+0000 7ff5b3b43700 1 -- 172.21.15.59:0/2958188905 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5ac154f60 con 0x7ff5ac15a230 2023-09-21T00:17:40.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.223+0000 7ff5b3b43700 1 -- 172.21.15.59:0/2958188905 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5ac067e50 con 0x7ff5ac15a230 2023-09-21T00:17:40.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.223+0000 7ff5a27fc700 1 -- 172.21.15.59:0/2958188905 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7ff5a401b3b0 con 0x7ff5ac15a230 2023-09-21T00:17:40.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.224+0000 7ff5a27fc700 1 --2- 172.21.15.59:0/2958188905 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ff59006ae00 0x7ff59006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:40.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.224+0000 7ff5a27fc700 1 -- 172.21.15.59:0/2958188905 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff5a4089450 con 0x7ff5ac15a230 2023-09-21T00:17:40.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.224+0000 7ff5b18df700 1 --2- 172.21.15.59:0/2958188905 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ff59006ae00 0x7ff59006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:40.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.224+0000 7ff5b18df700 1 --2- 172.21.15.59:0/2958188905 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ff59006ae00 0x7ff59006d2c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff59c0011e0 tx=0x7ff59c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:40.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.228+0000 7ff5a27fc700 1 -- 172.21.15.59:0/2958188905 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7ff5a4054310 con 0x7ff5ac15a230 2023-09-21T00:17:40.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.431+0000 7ff5b3b43700 1 -- 172.21.15.59:0/2958188905 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff5ac0ca450 con 0x7ff5ac15a230 2023-09-21T00:17:40.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.431+0000 7ff5a27fc700 1 -- 172.21.15.59:0/2958188905 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff5a4057930 con 0x7ff5ac15a230 2023-09-21T00:17:40.432 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-09-21T00:17:40.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.433+0000 7ff5b3b43700 1 -- 172.21.15.59:0/2958188905 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ff59006ae00 msgr2=0x7ff59006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:40.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.433+0000 7ff5b3b43700 1 --2- 172.21.15.59:0/2958188905 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ff59006ae00 0x7ff59006d2c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff59c0011e0 tx=0x7ff59c009040 comp rx=0 tx=0).stop 2023-09-21T00:17:40.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.433+0000 7ff5b3b43700 1 -- 172.21.15.59:0/2958188905 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5ac15a230 msgr2=0x7ff5ac15b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:40.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.433+0000 7ff5b3b43700 1 --2- 172.21.15.59:0/2958188905 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5ac15a230 0x7ff5ac15b320 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff5a400cba0 tx=0x7ff5a400ceb0 comp rx=0 tx=0).stop 2023-09-21T00:17:40.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.433+0000 7ff5b3b43700 1 -- 172.21.15.59:0/2958188905 shutdown_connections 2023-09-21T00:17:40.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.433+0000 7ff5b3b43700 1 --2- 172.21.15.59:0/2958188905 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5ac15a230 0x7ff5ac15b320 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:40.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.433+0000 7ff5b3b43700 1 --2- 172.21.15.59:0/2958188905 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff5ac0ca790 0x7ff5ac154a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:40.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.433+0000 7ff5b3b43700 1 --2- 172.21.15.59:0/2958188905 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ff59006ae00 0x7ff59006d2c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:40.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.433+0000 7ff5b3b43700 1 --2- 172.21.15.59:0/2958188905 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff5ac0cabf0 0x7ff5ac0a8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:40.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.433+0000 7ff5b3b43700 1 -- 172.21.15.59:0/2958188905 >> 172.21.15.59:0/2958188905 conn(0x7ff5ac0d0140 msgr2=0x7ff5ac1598b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:40.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.433+0000 7ff5b3b43700 1 -- 172.21.15.59:0/2958188905 shutdown_connections 2023-09-21T00:17:40.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.433+0000 7ff5b3b43700 1 -- 172.21.15.59:0/2958188905 wait complete. 2023-09-21T00:17:40.446 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-21T00:17:40.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.574+0000 7fd9c7c99700 1 Processor -- start 2023-09-21T00:17:40.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.575+0000 7fd9c7c99700 1 -- start start 2023-09-21T00:17:40.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.576+0000 7fd9c7c99700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd9c00cb210 0x7fd9c015e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:40.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.576+0000 7fd9c7c99700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9c0070de0 0x7fd9c0071250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:40.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.576+0000 7fd9c7c99700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9c00b2b10 con 0x7fd9c015b550 2023-09-21T00:17:40.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.576+0000 7fd9c7c99700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9c00cc120 con 0x7fd9c00cb210 2023-09-21T00:17:40.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.576+0000 7fd9c7c99700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c015eda0 con 0x7fd9c0070de0 2023-09-21T00:17:40.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.576+0000 7fd9c5a35700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd9c00cb210 0x7fd9c015e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:40.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.576+0000 7fd9c5234700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fd9c015b550 0x7fd9c00cb5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.59:48054/0 (socket says 172.21.15.59:48054) 2023-09-21T00:17:40.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.576+0000 7fd9c6236700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9c0070de0 0x7fd9c0071250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:40.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.576+0000 7fd9c5234700 1 -- 172.21.15.59:0/1144961997 learned_addr learned my addr 172.21.15.59:0/1144961997 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:40.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.576+0000 7fd9c4a33700 1 -- 172.21.15.59:0/1144961997 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2061018785 0 0) 0x7fd9c00b2b10 con 0x7fd9c015b550 2023-09-21T00:17:40.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.576+0000 7fd9c4a33700 1 -- 172.21.15.59:0/1144961997 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9ac0035b0 con 0x7fd9c015b550 2023-09-21T00:17:40.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.576+0000 7fd9c5a35700 1 -- 172.21.15.59:0/1144961997 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9c0070de0 msgr2=0x7fd9c0071250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:40.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.576+0000 7fd9c5a35700 1 --2- 172.21.15.59:0/1144961997 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9c0070de0 0x7fd9c0071250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:40.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.576+0000 7fd9c5a35700 1 -- 172.21.15.59:0/1144961997 >> v1:172.21.15.83:6789/0 conn(0x7fd9c015b550 legacy=0x7fd9c00cb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:40.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.576+0000 7fd9c5a35700 1 -- 172.21.15.59:0/1144961997 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c00cbe40 con 0x7fd9c00cb210 2023-09-21T00:17:40.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.576+0000 7fd9c6236700 1 --2- 172.21.15.59:0/1144961997 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9c0070de0 0x7fd9c0071250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T00:17:40.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.577+0000 7fd9c5a35700 1 --2- 172.21.15.59:0/1144961997 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9c00cb210 0x7fd9c015e860 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc009840 tx=0x7fd9bc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fff7a217b5ae1d8 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:40.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.577+0000 7fd9c4a33700 1 -- 172.21.15.59:0/1144961997 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc011830 con 0x7fd9c00cb210 2023-09-21T00:17:40.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.577+0000 7fd9c4a33700 1 -- 172.21.15.59:0/1144961997 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9bc011990 con 0x7fd9c00cb210 2023-09-21T00:17:40.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.577+0000 7fd9c4a33700 1 -- 172.21.15.59:0/1144961997 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc011d20 con 0x7fd9c00cb210 2023-09-21T00:17:40.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.577+0000 7fd9c7c99700 1 -- 172.21.15.59:0/1144961997 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9c00cb210 msgr2=0x7fd9c015e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:40.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.577+0000 7fd9c7c99700 1 --2- 172.21.15.59:0/1144961997 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9c00cb210 0x7fd9c015e860 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc009840 tx=0x7fd9bc009b50 comp rx=0 tx=0).stop 2023-09-21T00:17:40.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.577+0000 7fd9c7c99700 1 -- 172.21.15.59:0/1144961997 shutdown_connections 2023-09-21T00:17:40.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.577+0000 7fd9c7c99700 1 --2- 172.21.15.59:0/1144961997 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9c0070de0 0x7fd9c0071250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:40.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.577+0000 7fd9c7c99700 1 --2- 172.21.15.59:0/1144961997 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9c00cb210 0x7fd9c015e860 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:40.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.577+0000 7fd9c7c99700 1 -- 172.21.15.59:0/1144961997 >> 172.21.15.59:0/1144961997 conn(0x7fd9c006a780 msgr2=0x7fd9c006ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:40.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.577+0000 7fd9c7c99700 1 -- 172.21.15.59:0/1144961997 shutdown_connections 2023-09-21T00:17:40.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.577+0000 7fd9c7c99700 1 -- 172.21.15.59:0/1144961997 wait complete. 2023-09-21T00:17:40.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.579+0000 7fd9c7c99700 1 Processor -- start 2023-09-21T00:17:40.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.579+0000 7fd9c7c99700 1 -- start start 2023-09-21T00:17:40.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.579+0000 7fd9c7c99700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9c0070de0 0x7fd9c00ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:40.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.579+0000 7fd9c7c99700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9c00cb210 0x7fd9c0150320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:40.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.579+0000 7fd9c7c99700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9c015b550 0x7fd9c00c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:40.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.579+0000 7fd9c7c99700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c00afa80 con 0x7fd9c00cb210 2023-09-21T00:17:40.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.579+0000 7fd9c7c99700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c00afd20 con 0x7fd9c0070de0 2023-09-21T00:17:40.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.579+0000 7fd9c7c99700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c00aef00 con 0x7fd9c015b550 2023-09-21T00:17:40.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.579+0000 7fd9c5234700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9c00cb210 0x7fd9c0150320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:40.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.579+0000 7fd9c5234700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9c00cb210 0x7fd9c0150320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51992/0 (socket says 172.21.15.59:51992) 2023-09-21T00:17:40.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.580+0000 7fd9c5234700 1 -- 172.21.15.59:0/555318770 learned_addr learned my addr 172.21.15.59:0/555318770 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:40.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.580+0000 7fd9c5a35700 1 --2- 172.21.15.59:0/555318770 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9c0070de0 0x7fd9c00ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:40.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.580+0000 7fd9c6236700 1 --2- 172.21.15.59:0/555318770 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9c015b550 0x7fd9c00c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:40.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.580+0000 7fd9c5234700 1 -- 172.21.15.59:0/555318770 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9c015b550 msgr2=0x7fd9c00c8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:40.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.580+0000 7fd9c5234700 1 --2- 172.21.15.59:0/555318770 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9c015b550 0x7fd9c00c8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:40.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.580+0000 7fd9c5234700 1 -- 172.21.15.59:0/555318770 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9c0070de0 msgr2=0x7fd9c00ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:40.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.580+0000 7fd9c5234700 1 --2- 172.21.15.59:0/555318770 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9c0070de0 0x7fd9c00ae6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:40.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.580+0000 7fd9c5234700 1 -- 172.21.15.59:0/555318770 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b8009a70 con 0x7fd9c00cb210 2023-09-21T00:17:40.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.580+0000 7fd9c5234700 1 --2- 172.21.15.59:0/555318770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9c00cb210 0x7fd9c0150320 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4005910 tx=0x7fd9b400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:40.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.580+0000 7fd9b27fc700 1 -- 172.21.15.59:0/555318770 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b4005d70 con 0x7fd9c00cb210 2023-09-21T00:17:40.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.580+0000 7fd9b27fc700 1 -- 172.21.15.59:0/555318770 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b40070d0 con 0x7fd9c00cb210 2023-09-21T00:17:40.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.580+0000 7fd9c7c99700 1 -- 172.21.15.59:0/555318770 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9bc0094a0 con 0x7fd9c00cb210 2023-09-21T00:17:40.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.580+0000 7fd9b27fc700 1 -- 172.21.15.59:0/555318770 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b4007440 con 0x7fd9c00cb210 2023-09-21T00:17:40.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.580+0000 7fd9c7c99700 1 -- 172.21.15.59:0/555318770 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9c00af4c0 con 0x7fd9c00cb210 2023-09-21T00:17:40.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.581+0000 7fd9c7c99700 1 -- 172.21.15.59:0/555318770 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9c00af6b0 con 0x7fd9c00cb210 2023-09-21T00:17:40.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.581+0000 7fd9b27fc700 1 -- 172.21.15.59:0/555318770 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fd9b40075a0 con 0x7fd9c00cb210 2023-09-21T00:17:40.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.582+0000 7fd9b27fc700 1 --2- 172.21.15.59:0/555318770 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd9a406ae00 0x7fd9a406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:40.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.582+0000 7fd9b27fc700 1 -- 172.21.15.59:0/555318770 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd9b4088c10 con 0x7fd9c00cb210 2023-09-21T00:17:40.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.582+0000 7fd9c5a35700 1 --2- 172.21.15.59:0/555318770 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd9a406ae00 0x7fd9a406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:40.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.583+0000 7fd9c5a35700 1 --2- 172.21.15.59:0/555318770 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd9a406ae00 0x7fd9a406d2c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc009fd0 tx=0x7fd9bc008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:40.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.586+0000 7fd9b27fc700 1 -- 172.21.15.59:0/555318770 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fd9b4053af0 con 0x7fd9c00cb210 2023-09-21T00:17:40.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.784+0000 7fd9c7c99700 1 -- 172.21.15.59:0/555318770 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd9c00afe90 con 0x7fd9c00cb210 2023-09-21T00:17:40.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.784+0000 7fd9b27fc700 1 -- 172.21.15.59:0/555318770 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd9b40170a0 con 0x7fd9c00cb210 2023-09-21T00:17:40.786 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-09-21T00:17:40.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.787+0000 7fd9c7c99700 1 -- 172.21.15.59:0/555318770 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd9a406ae00 msgr2=0x7fd9a406d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:40.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.787+0000 7fd9c7c99700 1 --2- 172.21.15.59:0/555318770 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd9a406ae00 0x7fd9a406d2c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc009fd0 tx=0x7fd9bc008030 comp rx=0 tx=0).stop 2023-09-21T00:17:40.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.787+0000 7fd9c7c99700 1 -- 172.21.15.59:0/555318770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9c00cb210 msgr2=0x7fd9c0150320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:40.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.787+0000 7fd9c7c99700 1 --2- 172.21.15.59:0/555318770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9c00cb210 0x7fd9c0150320 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4005910 tx=0x7fd9b400c860 comp rx=0 tx=0).stop 2023-09-21T00:17:40.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.787+0000 7fd9c7c99700 1 -- 172.21.15.59:0/555318770 shutdown_connections 2023-09-21T00:17:40.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.787+0000 7fd9c7c99700 1 --2- 172.21.15.59:0/555318770 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd9a406ae00 0x7fd9a406d2c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:40.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.787+0000 7fd9c7c99700 1 --2- 172.21.15.59:0/555318770 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9c015b550 0x7fd9c00c8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:40.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.787+0000 7fd9c7c99700 1 --2- 172.21.15.59:0/555318770 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9c0070de0 0x7fd9c00ae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:40.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.787+0000 7fd9c7c99700 1 --2- 172.21.15.59:0/555318770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9c00cb210 0x7fd9c0150320 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:40.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.787+0000 7fd9c7c99700 1 -- 172.21.15.59:0/555318770 >> 172.21.15.59:0/555318770 conn(0x7fd9c006a780 msgr2=0x7fd9c015c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:40.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.787+0000 7fd9c7c99700 1 -- 172.21.15.59:0/555318770 shutdown_connections 2023-09-21T00:17:40.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.787+0000 7fd9c7c99700 1 -- 172.21.15.59:0/555318770 wait complete. 2023-09-21T00:17:40.800 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T00:17:40.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.924+0000 7f5069009700 1 Processor -- start 2023-09-21T00:17:40.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.924+0000 7f5069009700 1 -- start start 2023-09-21T00:17:40.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.925+0000 7f5069009700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f50640cee40 0x7f506415b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:40.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.925+0000 7f5069009700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f50640cf220 0x7f506415e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:40.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.925+0000 7f5069009700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f506415e9f0 con 0x7f506415e560 2023-09-21T00:17:40.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.925+0000 7f5069009700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5064072a20 con 0x7f50640cee40 2023-09-21T00:17:40.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.925+0000 7f5069009700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f506415b190 con 0x7f50640cf220 2023-09-21T00:17:40.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.925+0000 7f5062d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f50640cee40 0x7f506415b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:40.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.925+0000 7f506359e700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f506415e560 0x7f506406eb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57570/0 (socket says 172.21.15.59:57570) 2023-09-21T00:17:40.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.925+0000 7f506359e700 1 -- 172.21.15.59:0/1958679145 learned_addr learned my addr 172.21.15.59:0/1958679145 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:40.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.925+0000 7f506259c700 1 --2- 172.21.15.59:0/1958679145 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f50640cf220 0x7f506415e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:40.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.925+0000 7f5062d9d700 1 -- 172.21.15.59:0/1958679145 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f50640cf220 msgr2=0x7f506415e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:40.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.925+0000 7f5062d9d700 1 --2- 172.21.15.59:0/1958679145 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f50640cf220 0x7f506415e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:40.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.925+0000 7f5062d9d700 1 -- 172.21.15.59:0/1958679145 >> v1:172.21.15.59:6789/0 conn(0x7f506415e560 legacy=0x7f506406eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:40.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.925+0000 7f5062d9d700 1 -- 172.21.15.59:0/1958679145 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f506415ec30 con 0x7f50640cee40 2023-09-21T00:17:40.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.925+0000 7f5061d9b700 1 -- 172.21.15.59:0/1958679145 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 947882606 0 0) 0x7f505c001490 con 0x7f506415e560 2023-09-21T00:17:40.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.925+0000 7f5062d9d700 1 --2- 172.21.15.59:0/1958679145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50640cee40 0x7f506415b620 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5058009840 tx=0x7f5058009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75ceb7f755e69521 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:40.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.925+0000 7f5061d9b700 1 -- 172.21.15.59:0/1958679145 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5058011830 con 0x7f50640cee40 2023-09-21T00:17:40.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.925+0000 7f5061d9b700 1 -- 172.21.15.59:0/1958679145 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5058011990 con 0x7f50640cee40 2023-09-21T00:17:40.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.925+0000 7f5061d9b700 1 -- 172.21.15.59:0/1958679145 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5058011d20 con 0x7f50640cee40 2023-09-21T00:17:40.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.926+0000 7f5069009700 1 -- 172.21.15.59:0/1958679145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50640cee40 msgr2=0x7f506415b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:40.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.926+0000 7f5069009700 1 --2- 172.21.15.59:0/1958679145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50640cee40 0x7f506415b620 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5058009840 tx=0x7f5058009b50 comp rx=0 tx=0).stop 2023-09-21T00:17:40.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.926+0000 7f5069009700 1 -- 172.21.15.59:0/1958679145 shutdown_connections 2023-09-21T00:17:40.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.926+0000 7f5069009700 1 --2- 172.21.15.59:0/1958679145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50640cee40 0x7f506415b620 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:40.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.926+0000 7f5069009700 1 --2- 172.21.15.59:0/1958679145 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f50640cf220 0x7f506415e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:40.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.926+0000 7f5069009700 1 -- 172.21.15.59:0/1958679145 >> 172.21.15.59:0/1958679145 conn(0x7f50640b1d20 msgr2=0x7f50640b2130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:40.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.926+0000 7f5069009700 1 -- 172.21.15.59:0/1958679145 shutdown_connections 2023-09-21T00:17:40.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.926+0000 7f5069009700 1 -- 172.21.15.59:0/1958679145 wait complete. 2023-09-21T00:17:40.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.928+0000 7f5069009700 1 Processor -- start 2023-09-21T00:17:40.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.928+0000 7f5069009700 1 -- start start 2023-09-21T00:17:40.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.928+0000 7f5069009700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50640cee40 0x7f5064150a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:40.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.928+0000 7f5069009700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50640cf220 0x7f506414f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:40.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.928+0000 7f5069009700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f506415e560 0x7f50640cbe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:40.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.928+0000 7f5069009700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5064151df0 con 0x7f50640cee40 2023-09-21T00:17:40.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.928+0000 7f5069009700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50640c86d0 con 0x7f50640cf220 2023-09-21T00:17:40.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.928+0000 7f5069009700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50640c89b0 con 0x7f506415e560 2023-09-21T00:17:40.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.928+0000 7f5062d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50640cee40 0x7f5064150a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:40.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.928+0000 7f5062d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50640cee40 0x7f5064150a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52004/0 (socket says 172.21.15.59:52004) 2023-09-21T00:17:40.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.928+0000 7f5062d9d700 1 -- 172.21.15.59:0/2507404580 learned_addr learned my addr 172.21.15.59:0/2507404580 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:40.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.929+0000 7f506259c700 1 --2- 172.21.15.59:0/2507404580 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50640cf220 0x7f506414f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:40.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.929+0000 7f506359e700 1 --2- 172.21.15.59:0/2507404580 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f506415e560 0x7f50640cbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:40.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.929+0000 7f5062d9d700 1 -- 172.21.15.59:0/2507404580 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f506415e560 msgr2=0x7f50640cbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:40.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.929+0000 7f5062d9d700 1 --2- 172.21.15.59:0/2507404580 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f506415e560 0x7f50640cbe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:40.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.929+0000 7f5062d9d700 1 -- 172.21.15.59:0/2507404580 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50640cf220 msgr2=0x7f506414f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:40.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.929+0000 7f5062d9d700 1 --2- 172.21.15.59:0/2507404580 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50640cf220 0x7f506414f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:40.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.929+0000 7f5062d9d700 1 -- 172.21.15.59:0/2507404580 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50580094a0 con 0x7f50640cee40 2023-09-21T00:17:40.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.929+0000 7f5062d9d700 1 --2- 172.21.15.59:0/2507404580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50640cee40 0x7f5064150a80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5058014040 tx=0x7f5058004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:40.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.929+0000 7f504b7fe700 1 -- 172.21.15.59:0/2507404580 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50580036a0 con 0x7f50640cee40 2023-09-21T00:17:40.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.929+0000 7f504b7fe700 1 -- 172.21.15.59:0/2507404580 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f505801e070 con 0x7f50640cee40 2023-09-21T00:17:40.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.929+0000 7f5069009700 1 -- 172.21.15.59:0/2507404580 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50640c8c90 con 0x7f50640cee40 2023-09-21T00:17:40.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.929+0000 7f504b7fe700 1 -- 172.21.15.59:0/2507404580 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5058003a60 con 0x7f50640cee40 2023-09-21T00:17:40.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.929+0000 7f5069009700 1 -- 172.21.15.59:0/2507404580 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50640c9250 con 0x7f50640cee40 2023-09-21T00:17:40.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.930+0000 7f5069009700 1 -- 172.21.15.59:0/2507404580 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f506404f330 con 0x7f50640cee40 2023-09-21T00:17:40.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.930+0000 7f504b7fe700 1 -- 172.21.15.59:0/2507404580 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f5058003bc0 con 0x7f50640cee40 2023-09-21T00:17:40.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.931+0000 7f504b7fe700 1 --2- 172.21.15.59:0/2507404580 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f505006ae00 0x7f505006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:40.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.931+0000 7f504b7fe700 1 -- 172.21.15.59:0/2507404580 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f505808a650 con 0x7f50640cee40 2023-09-21T00:17:40.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.931+0000 7f506259c700 1 --2- 172.21.15.59:0/2507404580 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f505006ae00 0x7f505006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:40.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.932+0000 7f506259c700 1 --2- 172.21.15.59:0/2507404580 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f505006ae00 0x7f505006d2c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f50640ca300 tx=0x7f5054008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:40.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:40.936+0000 7f504b7fe700 1 -- 172.21.15.59:0/2507404580 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f5058055510 con 0x7f50640cee40 2023-09-21T00:17:41.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.181+0000 7f5069009700 1 -- 172.21.15.59:0/2507404580 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f50640ca5c0 con 0x7f50640cee40 2023-09-21T00:17:41.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.181+0000 7f504b7fe700 1 -- 172.21.15.59:0/2507404580 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4903 (secure 0 0 0) 0x7f5058058b30 con 0x7f50640cee40 2023-09-21T00:17:41.183 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:17:41.183 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/461673980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":461673980},{"type":"v1","addr":"172.21.15.59:6835","nonce":461673980}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/3148728526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3148728526},{"type":"v1","addr":"172.21.15.59:6834","nonce":3148728526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/3250481509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3250481509},{"type":"v1","addr":"172.21.15.83:6836","nonce":3250481509}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-21T00:17:06.338694+0000","modified":"2023-09-21T00:17:29.401478+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6837/792952552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":792952552},{"type":"v1","addr":"172.21.15.83:6837","nonce":792952552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-21T00:17:41.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.184+0000 7f5069009700 1 -- 172.21.15.59:0/2507404580 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f505006ae00 msgr2=0x7f505006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:41.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.184+0000 7f5069009700 1 --2- 172.21.15.59:0/2507404580 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f505006ae00 0x7f505006d2c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f50640ca300 tx=0x7f5054008040 comp rx=0 tx=0).stop 2023-09-21T00:17:41.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.184+0000 7f5069009700 1 -- 172.21.15.59:0/2507404580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50640cee40 msgr2=0x7f5064150a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:41.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.184+0000 7f5069009700 1 --2- 172.21.15.59:0/2507404580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50640cee40 0x7f5064150a80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5058014040 tx=0x7f5058004750 comp rx=0 tx=0).stop 2023-09-21T00:17:41.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.184+0000 7f5069009700 1 -- 172.21.15.59:0/2507404580 shutdown_connections 2023-09-21T00:17:41.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.184+0000 7f5069009700 1 --2- 172.21.15.59:0/2507404580 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f505006ae00 0x7f505006d2c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:41.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.184+0000 7f5069009700 1 --2- 172.21.15.59:0/2507404580 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f506415e560 0x7f50640cbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:41.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.184+0000 7f5069009700 1 --2- 172.21.15.59:0/2507404580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50640cee40 0x7f5064150a80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:41.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.184+0000 7f5069009700 1 --2- 172.21.15.59:0/2507404580 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50640cf220 0x7f506414f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:41.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.184+0000 7f5069009700 1 -- 172.21.15.59:0/2507404580 >> 172.21.15.59:0/2507404580 conn(0x7f50640b1d20 msgr2=0x7f5064071e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:41.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.184+0000 7f5069009700 1 -- 172.21.15.59:0/2507404580 shutdown_connections 2023-09-21T00:17:41.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.184+0000 7f5069009700 1 -- 172.21.15.59:0/2507404580 wait complete. 2023-09-21T00:17:41.188 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 8 2023-09-21T00:17:41.197 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T00:17:41.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.321+0000 7f0294e7e700 1 Processor -- start 2023-09-21T00:17:41.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.321+0000 7f0294e7e700 1 -- start start 2023-09-21T00:17:41.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.322+0000 7f0294e7e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f029015a230 0x7f029015e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:41.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.322+0000 7f0294e7e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f02900ca790 0x7f0290071680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:41.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.322+0000 7f0294e7e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02900cb1c0 con 0x7f02900cabf0 2023-09-21T00:17:41.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.322+0000 7f0294e7e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02900cb780 con 0x7f02900ca790 2023-09-21T00:17:41.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.322+0000 7f0294e7e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02900cb4a0 con 0x7f029015a230 2023-09-21T00:17:41.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.323+0000 7f028e59c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f029015a230 0x7f029015e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:41.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.323+0000 7f028dd9b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f02900ca790 0x7f0290071680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:41.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.323+0000 7f028e59c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f029015a230 0x7f029015e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.59:52628/0 (socket says 172.21.15.59:52628) 2023-09-21T00:17:41.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.323+0000 7f028ed9d700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f02900cabf0 0x7f029006eaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.59:48084/0 (socket says 172.21.15.59:48084) 2023-09-21T00:17:41.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.323+0000 7f028e59c700 1 -- 172.21.15.59:0/3617066923 learned_addr learned my addr 172.21.15.59:0/3617066923 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:41.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.323+0000 7f028e59c700 1 -- 172.21.15.59:0/3617066923 >> v2:172.21.15.83:3300/0 conn(0x7f02900ca790 msgr2=0x7f0290071680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:41.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.323+0000 7f028e59c700 1 --2- 172.21.15.59:0/3617066923 >> v2:172.21.15.83:3300/0 conn(0x7f02900ca790 0x7f0290071680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:41.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.323+0000 7f028e59c700 1 -- 172.21.15.59:0/3617066923 >> v1:172.21.15.83:6789/0 conn(0x7f02900cabf0 legacy=0x7f029006eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:41.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.323+0000 7f028e59c700 1 -- 172.21.15.59:0/3617066923 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f029015e0b0 con 0x7f029015a230 2023-09-21T00:17:41.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.323+0000 7f028d59a700 1 -- 172.21.15.59:0/3617066923 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1496392376 0 0) 0x7f02900cb1c0 con 0x7f02900cabf0 2023-09-21T00:17:41.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.323+0000 7f028dd9b700 1 --2- 172.21.15.59:0/3617066923 >> v2:172.21.15.83:3300/0 conn(0x7f02900ca790 0x7f0290071680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T00:17:41.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.323+0000 7f028e59c700 1 --2- 172.21.15.59:0/3617066923 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f029015a230 0x7f029015e8b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f02840098f0 tx=0x7f0284009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40ecd0d97354b2eb server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:41.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.323+0000 7f028d59a700 1 -- 172.21.15.59:0/3617066923 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0284011830 con 0x7f029015a230 2023-09-21T00:17:41.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.323+0000 7f028d59a700 1 -- 172.21.15.59:0/3617066923 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0284011990 con 0x7f029015a230 2023-09-21T00:17:41.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.323+0000 7f028d59a700 1 -- 172.21.15.59:0/3617066923 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0284011d20 con 0x7f029015a230 2023-09-21T00:17:41.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.324+0000 7f0294e7e700 1 -- 172.21.15.59:0/3617066923 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f029015a230 msgr2=0x7f029015e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:41.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.324+0000 7f0294e7e700 1 --2- 172.21.15.59:0/3617066923 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f029015a230 0x7f029015e8b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f02840098f0 tx=0x7f0284009c00 comp rx=0 tx=0).stop 2023-09-21T00:17:41.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.324+0000 7f0294e7e700 1 -- 172.21.15.59:0/3617066923 shutdown_connections 2023-09-21T00:17:41.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.324+0000 7f0294e7e700 1 --2- 172.21.15.59:0/3617066923 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f029015a230 0x7f029015e8b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:41.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.324+0000 7f0294e7e700 1 --2- 172.21.15.59:0/3617066923 >> v2:172.21.15.83:3300/0 conn(0x7f02900ca790 0x7f0290071680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:41.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.324+0000 7f0294e7e700 1 -- 172.21.15.59:0/3617066923 >> 172.21.15.59:0/3617066923 conn(0x7f02900d0140 msgr2=0x7f02900d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:41.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.324+0000 7f0294e7e700 1 -- 172.21.15.59:0/3617066923 shutdown_connections 2023-09-21T00:17:41.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.324+0000 7f0294e7e700 1 -- 172.21.15.59:0/3617066923 wait complete. 2023-09-21T00:17:41.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.325+0000 7f0294e7e700 1 Processor -- start 2023-09-21T00:17:41.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.325+0000 7f0294e7e700 1 -- start start 2023-09-21T00:17:41.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.326+0000 7f0294e7e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02900ca790 0x7f02900b2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:41.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.326+0000 7f0294e7e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02900cabf0 0x7f02900b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:41.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.326+0000 7f0294e7e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f029015a230 0x7f029014aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:41.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.326+0000 7f0294e7e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02900b3250 con 0x7f02900cabf0 2023-09-21T00:17:41.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.326+0000 7f0294e7e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02900b47d0 con 0x7f02900ca790 2023-09-21T00:17:41.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.326+0000 7f0294e7e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02900b4ab0 con 0x7f029015a230 2023-09-21T00:17:41.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.326+0000 7f028dd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02900cabf0 0x7f02900b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:41.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.326+0000 7f028dd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02900cabf0 0x7f02900b0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52020/0 (socket says 172.21.15.59:52020) 2023-09-21T00:17:41.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.326+0000 7f028dd9b700 1 -- 172.21.15.59:0/998956114 learned_addr learned my addr 172.21.15.59:0/998956114 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:41.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.327+0000 7f028e59c700 1 --2- 172.21.15.59:0/998956114 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02900ca790 0x7f02900b2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:41.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.327+0000 7f028ed9d700 1 --2- 172.21.15.59:0/998956114 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f029015a230 0x7f029014aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:41.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.327+0000 7f028dd9b700 1 -- 172.21.15.59:0/998956114 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f029015a230 msgr2=0x7f029014aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:41.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.327+0000 7f028dd9b700 1 --2- 172.21.15.59:0/998956114 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f029015a230 0x7f029014aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:41.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.327+0000 7f028dd9b700 1 -- 172.21.15.59:0/998956114 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02900ca790 msgr2=0x7f02900b2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:41.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.327+0000 7f028dd9b700 1 --2- 172.21.15.59:0/998956114 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02900ca790 0x7f02900b2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:41.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.327+0000 7f028dd9b700 1 -- 172.21.15.59:0/998956114 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02800094a0 con 0x7f02900cabf0 2023-09-21T00:17:41.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.327+0000 7f028dd9b700 1 --2- 172.21.15.59:0/998956114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02900cabf0 0x7f02900b0ec0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f028000ebe0 tx=0x7f028000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:41.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.327+0000 7f027effd700 1 -- 172.21.15.59:0/998956114 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028000c850 con 0x7f02900cabf0 2023-09-21T00:17:41.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.327+0000 7f027effd700 1 -- 172.21.15.59:0/998956114 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f028000c9b0 con 0x7f02900cabf0 2023-09-21T00:17:41.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.327+0000 7f027effd700 1 -- 172.21.15.59:0/998956114 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028000cd40 con 0x7f02900cabf0 2023-09-21T00:17:41.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.327+0000 7f0294e7e700 1 -- 172.21.15.59:0/998956114 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0284009550 con 0x7f02900cabf0 2023-09-21T00:17:41.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.327+0000 7f0294e7e700 1 -- 172.21.15.59:0/998956114 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02900b5070 con 0x7f02900cabf0 2023-09-21T00:17:41.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.328+0000 7f0294e7e700 1 -- 172.21.15.59:0/998956114 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0290067e50 con 0x7f02900cabf0 2023-09-21T00:17:41.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.329+0000 7f027effd700 1 -- 172.21.15.59:0/998956114 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f0280013470 con 0x7f02900cabf0 2023-09-21T00:17:41.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.329+0000 7f027effd700 1 --2- 172.21.15.59:0/998956114 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f027006ae00 0x7f027006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:41.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.329+0000 7f027effd700 1 -- 172.21.15.59:0/998956114 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0280089890 con 0x7f02900cabf0 2023-09-21T00:17:41.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.329+0000 7f028e59c700 1 --2- 172.21.15.59:0/998956114 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f027006ae00 0x7f027006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:41.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.330+0000 7f028e59c700 1 --2- 172.21.15.59:0/998956114 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f027006ae00 0x7f027006d2c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0284014040 tx=0x7f0284008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:41.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.334+0000 7f027effd700 1 -- 172.21.15.59:0/998956114 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f02800546c0 con 0x7f02900cabf0 2023-09-21T00:17:41.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.535+0000 7f0294e7e700 1 -- 172.21.15.59:0/998956114 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02900c8cc0 con 0x7f02900cabf0 2023-09-21T00:17:41.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.537+0000 7f027effd700 1 -- 172.21.15.59:0/998956114 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18262 (secure 0 0 0) 0x7f028000cea0 con 0x7f02900cabf0 2023-09-21T00:17:41.538 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:17:41.538 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":24,"fsid":"dd69925c-6e25-42fe-880b-2f60fc6f384b","created":"2023-09-21T00:16:43.074489+0000","modified":"2023-09-21T00:17:11.387529+0000","last_up_change":"2023-09-21T00:16:54.740101+0000","last_in_change":"2023-09-21T00:16:45.987089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T00:16:54.796248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-21T00:17:04.167102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-21T00:17:05.313188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-21T00:17:08.977609+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d4b18344-74c0-4f75-920b-7a9247e48914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6809","nonce":2418314235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6811","nonce":2418314235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6815","nonce":2418314235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6813","nonce":2418314235}]},"public_addr":"172.21.15.59:6809/2418314235","cluster_addr":"172.21.15.59:6811/2418314235","heartbeat_back_addr":"172.21.15.59:6815/2418314235","heartbeat_front_addr":"172.21.15.59:6813/2418314235","state":["exists","up"]},{"osd":1,"uuid":"80940d50-a248-4e64-a282-7ffcdad790ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6801","nonce":869668251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6803","nonce":869668251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6807","nonce":869668251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6805","nonce":869668251}]},"public_addr":"172.21.15.59:6801/869668251","cluster_addr":"172.21.15.59:6803/869668251","heartbeat_back_addr":"172.21.15.59:6807/869668251","heartbeat_front_addr":"172.21.15.59:6805/869668251","state":["exists","up"]},{"osd":2,"uuid":"55f2eceb-c54a-4879-a6ce-968c1c548b5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6817","nonce":372517778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6819","nonce":372517778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6823","nonce":372517778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6821","nonce":372517778}]},"public_addr":"172.21.15.59:6817/372517778","cluster_addr":"172.21.15.59:6819/372517778","heartbeat_back_addr":"172.21.15.59:6823/372517778","heartbeat_front_addr":"172.21.15.59:6821/372517778","state":["exists","up"]},{"osd":3,"uuid":"92b89cd0-869c-49b9-a9f9-97ac8423f304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6825","nonce":575188498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6827","nonce":575188498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6831","nonce":575188498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6829","nonce":575188498}]},"public_addr":"172.21.15.59:6825/575188498","cluster_addr":"172.21.15.59:6827/575188498","heartbeat_back_addr":"172.21.15.59:6831/575188498","heartbeat_front_addr":"172.21.15.59:6829/575188498","state":["exists","up"]},{"osd":4,"uuid":"25b80e94-e0e6-403d-b69f-61542f289637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6803","nonce":1741219098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6805","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6807","nonce":1741219098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6815","nonce":1741219098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6811","nonce":1741219098}]},"public_addr":"172.21.15.83:6803/1741219098","cluster_addr":"172.21.15.83:6807/1741219098","heartbeat_back_addr":"172.21.15.83:6815/1741219098","heartbeat_front_addr":"172.21.15.83:6811/1741219098","state":["exists","up"]},{"osd":5,"uuid":"5498d9ab-1086-4796-a199-9051e6dfea91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6817","nonce":156730565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6819","nonce":156730565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6823","nonce":156730565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6821","nonce":156730565}]},"public_addr":"172.21.15.83:6817/156730565","cluster_addr":"172.21.15.83:6819/156730565","heartbeat_back_addr":"172.21.15.83:6823/156730565","heartbeat_front_addr":"172.21.15.83:6821/156730565","state":["exists","up"]},{"osd":6,"uuid":"cfd810c0-5015-4d60-9a75-7efc93a32e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6801","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6800","nonce":1337723778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6806","nonce":1337723778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6814","nonce":1337723778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6810","nonce":1337723778}]},"public_addr":"172.21.15.83:6800/1337723778","cluster_addr":"172.21.15.83:6806/1337723778","heartbeat_back_addr":"172.21.15.83:6814/1337723778","heartbeat_front_addr":"172.21.15.83:6810/1337723778","state":["exists","up"]},{"osd":7,"uuid":"e992c8fa-0a3d-4b3c-85b5-2c511223dee4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6825","nonce":4204859272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6827","nonce":4204859272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6831","nonce":4204859272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6829","nonce":4204859272}]},"public_addr":"172.21.15.83:6825/4204859272","cluster_addr":"172.21.15.83:6827/4204859272","heartbeat_back_addr":"172.21.15.83:6831/4204859272","heartbeat_front_addr":"172.21.15.83:6829/4204859272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.156498+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.882707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.093978+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.158565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.173933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.888606+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.135525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.149712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T00:17:41.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.539+0000 7f0294e7e700 1 -- 172.21.15.59:0/998956114 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f027006ae00 msgr2=0x7f027006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:41.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.539+0000 7f0294e7e700 1 --2- 172.21.15.59:0/998956114 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f027006ae00 0x7f027006d2c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0284014040 tx=0x7f0284008030 comp rx=0 tx=0).stop 2023-09-21T00:17:41.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.539+0000 7f0294e7e700 1 -- 172.21.15.59:0/998956114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02900cabf0 msgr2=0x7f02900b0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:41.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.539+0000 7f0294e7e700 1 --2- 172.21.15.59:0/998956114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02900cabf0 0x7f02900b0ec0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f028000ebe0 tx=0x7f028000eef0 comp rx=0 tx=0).stop 2023-09-21T00:17:41.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.539+0000 7f0294e7e700 1 -- 172.21.15.59:0/998956114 shutdown_connections 2023-09-21T00:17:41.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.539+0000 7f0294e7e700 1 --2- 172.21.15.59:0/998956114 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f027006ae00 0x7f027006d2c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:41.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.539+0000 7f0294e7e700 1 --2- 172.21.15.59:0/998956114 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f029015a230 0x7f029014aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:41.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.539+0000 7f0294e7e700 1 --2- 172.21.15.59:0/998956114 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02900ca790 0x7f02900b2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:41.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.539+0000 7f0294e7e700 1 --2- 172.21.15.59:0/998956114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02900cabf0 0x7f02900b0ec0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:41.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.539+0000 7f0294e7e700 1 -- 172.21.15.59:0/998956114 >> 172.21.15.59:0/998956114 conn(0x7f02900d0140 msgr2=0x7f02900cefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:41.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.539+0000 7f0294e7e700 1 -- 172.21.15.59:0/998956114 shutdown_connections 2023-09-21T00:17:41.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.539+0000 7f0294e7e700 1 -- 172.21.15.59:0/998956114 wait complete. 2023-09-21T00:17:41.552 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T00:17:41.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.676+0000 7f078c9df700 1 Processor -- start 2023-09-21T00:17:41.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.676+0000 7f078c9df700 1 -- start start 2023-09-21T00:17:41.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.677+0000 7f078c9df700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f078815b2b0 0x7f07880cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:41.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.677+0000 7f078c9df700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f07880ce420 0x7f0788161190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:41.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.677+0000 7f078c9df700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07880cfee0 con 0x7f078806a780 2023-09-21T00:17:41.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.677+0000 7f078c9df700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07880ce250 con 0x7f078815b2b0 2023-09-21T00:17:41.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.677+0000 7f078c9df700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07880ce900 con 0x7f07880ce420 2023-09-21T00:17:41.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.677+0000 7f078659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f078815b2b0 0x7f07880cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:41.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.677+0000 7f078659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f078815b2b0 0x7f07880cdd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52026/0 (socket says 172.21.15.59:52026) 2023-09-21T00:17:41.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.677+0000 7f078659c700 1 -- 172.21.15.59:0/613715173 learned_addr learned my addr 172.21.15.59:0/613715173 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:41.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.677+0000 7f0785d9b700 1 --2- 172.21.15.59:0/613715173 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f07880ce420 0x7f0788161190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:41.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.677+0000 7f078659c700 1 -- 172.21.15.59:0/613715173 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f07880ce420 msgr2=0x7f0788161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:41.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.677+0000 7f078659c700 1 --2- 172.21.15.59:0/613715173 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f07880ce420 0x7f0788161190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:41.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.677+0000 7f078659c700 1 -- 172.21.15.59:0/613715173 >> v1:172.21.15.83:6789/0 conn(0x7f078806a780 legacy=0x7f078815e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:41.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.677+0000 7f078659c700 1 -- 172.21.15.59:0/613715173 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07880cebe0 con 0x7f078815b2b0 2023-09-21T00:17:41.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.677+0000 7f078659c700 1 --2- 172.21.15.59:0/613715173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f078815b2b0 0x7f07880cdd10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f07780098f0 tx=0x7f0778009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fa56daf0cf44e69 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:41.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.677+0000 7f078559a700 1 -- 172.21.15.59:0/613715173 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077800b8a0 con 0x7f078815b2b0 2023-09-21T00:17:41.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.678+0000 7f078559a700 1 -- 172.21.15.59:0/613715173 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077800ba00 con 0x7f078815b2b0 2023-09-21T00:17:41.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.678+0000 7f078559a700 1 -- 172.21.15.59:0/613715173 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077800bd90 con 0x7f078815b2b0 2023-09-21T00:17:41.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.678+0000 7f078c9df700 1 -- 172.21.15.59:0/613715173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f078815b2b0 msgr2=0x7f07880cdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:41.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.678+0000 7f078c9df700 1 --2- 172.21.15.59:0/613715173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f078815b2b0 0x7f07880cdd10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f07780098f0 tx=0x7f0778009c00 comp rx=0 tx=0).stop 2023-09-21T00:17:41.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.678+0000 7f078c9df700 1 -- 172.21.15.59:0/613715173 shutdown_connections 2023-09-21T00:17:41.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.678+0000 7f078c9df700 1 --2- 172.21.15.59:0/613715173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f078815b2b0 0x7f07880cdd10 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:41.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.678+0000 7f078c9df700 1 --2- 172.21.15.59:0/613715173 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f07880ce420 0x7f0788161190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:41.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.678+0000 7f078c9df700 1 -- 172.21.15.59:0/613715173 >> 172.21.15.59:0/613715173 conn(0x7f07880d0140 msgr2=0x7f07880d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:41.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.678+0000 7f078c9df700 1 -- 172.21.15.59:0/613715173 shutdown_connections 2023-09-21T00:17:41.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.678+0000 7f078c9df700 1 -- 172.21.15.59:0/613715173 wait complete. 2023-09-21T00:17:41.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.679+0000 7f078c9df700 1 Processor -- start 2023-09-21T00:17:41.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.679+0000 7f078c9df700 1 -- start start 2023-09-21T00:17:41.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.680+0000 7f078c9df700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f078806a780 0x7f0788158980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:41.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.680+0000 7f078c9df700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07880ce420 0x7f078806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:41.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.680+0000 7f078c9df700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f078815b2b0 0x7f078806f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:41.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.680+0000 7f078c9df700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07881e5da0 con 0x7f078815b2b0 2023-09-21T00:17:41.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.680+0000 7f078c9df700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07880c61c0 con 0x7f07880ce420 2023-09-21T00:17:41.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.680+0000 7f078c9df700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07881e8080 con 0x7f078806a780 2023-09-21T00:17:41.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.680+0000 7f0786d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f078815b2b0 0x7f078806f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:41.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.680+0000 7f0786d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f078815b2b0 0x7f078806f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52036/0 (socket says 172.21.15.59:52036) 2023-09-21T00:17:41.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.680+0000 7f0786d9d700 1 -- 172.21.15.59:0/3787795209 learned_addr learned my addr 172.21.15.59:0/3787795209 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:41.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.681+0000 7f0785d9b700 1 --2- 172.21.15.59:0/3787795209 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07880ce420 0x7f078806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:41.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.681+0000 7f078659c700 1 --2- 172.21.15.59:0/3787795209 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f078806a780 0x7f0788158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:41.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.681+0000 7f0786d9d700 1 -- 172.21.15.59:0/3787795209 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f078806a780 msgr2=0x7f0788158980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:41.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.681+0000 7f0786d9d700 1 --2- 172.21.15.59:0/3787795209 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f078806a780 0x7f0788158980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:41.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.681+0000 7f0786d9d700 1 -- 172.21.15.59:0/3787795209 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07880ce420 msgr2=0x7f078806eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:41.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.681+0000 7f0786d9d700 1 --2- 172.21.15.59:0/3787795209 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07880ce420 0x7f078806eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:41.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.681+0000 7f0786d9d700 1 -- 172.21.15.59:0/3787795209 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0778009550 con 0x7f078815b2b0 2023-09-21T00:17:41.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.681+0000 7f0786d9d700 1 --2- 172.21.15.59:0/3787795209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f078815b2b0 0x7f078806f070 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f078000cb50 tx=0x7f078000cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:41.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.681+0000 7f0776ffd700 1 -- 172.21.15.59:0/3787795209 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0780003c00 con 0x7f078815b2b0 2023-09-21T00:17:41.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.681+0000 7f0776ffd700 1 -- 172.21.15.59:0/3787795209 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0780003d60 con 0x7f078815b2b0 2023-09-21T00:17:41.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.681+0000 7f078c9df700 1 -- 172.21.15.59:0/3787795209 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07881e5400 con 0x7f078815b2b0 2023-09-21T00:17:41.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.681+0000 7f0776ffd700 1 -- 172.21.15.59:0/3787795209 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078000ab70 con 0x7f078815b2b0 2023-09-21T00:17:41.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.681+0000 7f078c9df700 1 -- 172.21.15.59:0/3787795209 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07881e59c0 con 0x7f078815b2b0 2023-09-21T00:17:41.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.682+0000 7f078c9df700 1 -- 172.21.15.59:0/3787795209 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07881e5ee0 con 0x7f078815b2b0 2023-09-21T00:17:41.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.682+0000 7f0776ffd700 1 -- 172.21.15.59:0/3787795209 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f078000acd0 con 0x7f078815b2b0 2023-09-21T00:17:41.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.683+0000 7f0776ffd700 1 --2- 172.21.15.59:0/3787795209 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f076806ae00 0x7f076806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:41.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.683+0000 7f0776ffd700 1 -- 172.21.15.59:0/3787795209 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0780089850 con 0x7f078815b2b0 2023-09-21T00:17:41.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.683+0000 7f078659c700 1 --2- 172.21.15.59:0/3787795209 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f076806ae00 0x7f076806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:41.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.684+0000 7f078659c700 1 --2- 172.21.15.59:0/3787795209 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f076806ae00 0x7f076806d2c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0778009c40 tx=0x7f0778008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:41.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.688+0000 7f0776ffd700 1 -- 172.21.15.59:0/3787795209 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f07881e5ee0 con 0x7f078815b2b0 2023-09-21T00:17:41.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.933+0000 7f078c9df700 1 -- 172.21.15.59:0/3787795209 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f07881e5ee0 con 0x7f078815b2b0 2023-09-21T00:17:41.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.933+0000 7f0776ffd700 1 -- 172.21.15.59:0/3787795209 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4903 (secure 0 0 0) 0x7f07881e5ee0 con 0x7f078815b2b0 2023-09-21T00:17:41.935 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:17:41.935 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/461673980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":461673980},{"type":"v1","addr":"172.21.15.59:6835","nonce":461673980}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/3148728526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3148728526},{"type":"v1","addr":"172.21.15.59:6834","nonce":3148728526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/3250481509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3250481509},{"type":"v1","addr":"172.21.15.83:6836","nonce":3250481509}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-21T00:17:06.338694+0000","modified":"2023-09-21T00:17:29.401478+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6837/792952552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":792952552},{"type":"v1","addr":"172.21.15.83:6837","nonce":792952552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-21T00:17:41.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.935+0000 7f078c9df700 1 -- 172.21.15.59:0/3787795209 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f076806ae00 msgr2=0x7f076806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:41.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.935+0000 7f078c9df700 1 --2- 172.21.15.59:0/3787795209 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f076806ae00 0x7f076806d2c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0778009c40 tx=0x7f0778008030 comp rx=0 tx=0).stop 2023-09-21T00:17:41.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.935+0000 7f078c9df700 1 -- 172.21.15.59:0/3787795209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f078815b2b0 msgr2=0x7f078806f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:41.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.935+0000 7f078c9df700 1 --2- 172.21.15.59:0/3787795209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f078815b2b0 0x7f078806f070 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f078000cb50 tx=0x7f078000cf10 comp rx=0 tx=0).stop 2023-09-21T00:17:41.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.935+0000 7f078c9df700 1 -- 172.21.15.59:0/3787795209 shutdown_connections 2023-09-21T00:17:41.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.935+0000 7f078c9df700 1 --2- 172.21.15.59:0/3787795209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f078815b2b0 0x7f078806f070 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:41.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.935+0000 7f078c9df700 1 --2- 172.21.15.59:0/3787795209 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f076806ae00 0x7f076806d2c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:41.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.935+0000 7f078c9df700 1 --2- 172.21.15.59:0/3787795209 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f078806a780 0x7f0788158980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:41.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.935+0000 7f078c9df700 1 --2- 172.21.15.59:0/3787795209 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07880ce420 0x7f078806eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:41.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.935+0000 7f078c9df700 1 -- 172.21.15.59:0/3787795209 >> 172.21.15.59:0/3787795209 conn(0x7f07880d0140 msgr2=0x7f078815a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:41.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.935+0000 7f078c9df700 1 -- 172.21.15.59:0/3787795209 shutdown_connections 2023-09-21T00:17:41.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:41.935+0000 7f078c9df700 1 -- 172.21.15.59:0/3787795209 wait complete. 2023-09-21T00:17:41.939 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 8 2023-09-21T00:17:42.351 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-21T00:17:06.338694+0000', 'modified': '2023-09-21T00:17:29.401478+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4299}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4299': {'gid': 4299, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.83:6837/792952552', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.83:6835', 'nonce': 792952552}, {'type': 'v1', 'addr': '172.21.15.83:6837', 'nonce': 792952552}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-09-21T00:17:42.351 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-21T00:17:42.352 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-09-21T00:17:42.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.481+0000 7f7955887700 1 Processor -- start 2023-09-21T00:17:42.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.481+0000 7f7955887700 1 -- start start 2023-09-21T00:17:42.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.481+0000 7f7955887700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f795015b730 0x7f79500b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:42.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.481+0000 7f7955887700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f795006edc0 con 0x7f79500ccbf0 2023-09-21T00:17:42.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.481+0000 7f7955887700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79500cf470 con 0x7f79500ceeb0 2023-09-21T00:17:42.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.481+0000 7f7955887700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79500cd080 con 0x7f795015b730 2023-09-21T00:17:42.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.482+0000 7f794effd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f795015b730 0x7f79500b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:42.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.482+0000 7f794f7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f79500ccbf0 0x7f795006f960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57612/0 (socket says 172.21.15.59:57612) 2023-09-21T00:17:42.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.482+0000 7f794f7fe700 1 -- 172.21.15.59:0/1463315000 learned_addr learned my addr 172.21.15.59:0/1463315000 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:42.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.482+0000 7f794effd700 1 -- 172.21.15.59:0/1463315000 >> v1:172.21.15.83:6789/0 conn(0x7f79500ceeb0 legacy=0x7f795006f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:42.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.482+0000 7f794effd700 1 -- 172.21.15.59:0/1463315000 >> v1:172.21.15.59:6789/0 conn(0x7f79500ccbf0 legacy=0x7f795006f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:42.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.482+0000 7f794effd700 1 -- 172.21.15.59:0/1463315000 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f795006e490 con 0x7f795015b730 2023-09-21T00:17:42.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.482+0000 7f794dffb700 1 -- 172.21.15.59:0/1463315000 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 720835999 0 0) 0x7f795006edc0 con 0x7f79500ccbf0 2023-09-21T00:17:42.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.482+0000 7f794effd700 1 --2- 172.21.15.59:0/1463315000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f795015b730 0x7f79500b2be0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7940009820 tx=0x7f7940009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb31ec39085336dd server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:42.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.482+0000 7f794dffb700 1 -- 172.21.15.59:0/1463315000 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7940005e30 con 0x7f795015b730 2023-09-21T00:17:42.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.482+0000 7f794dffb700 1 -- 172.21.15.59:0/1463315000 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7940006030 con 0x7f795015b730 2023-09-21T00:17:42.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.482+0000 7f794dffb700 1 -- 172.21.15.59:0/1463315000 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79400063e0 con 0x7f795015b730 2023-09-21T00:17:42.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.483+0000 7f7955887700 1 -- 172.21.15.59:0/1463315000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f795015b730 msgr2=0x7f79500b2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:42.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.483+0000 7f7955887700 1 --2- 172.21.15.59:0/1463315000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f795015b730 0x7f79500b2be0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7940009820 tx=0x7f7940009b30 comp rx=0 tx=0).stop 2023-09-21T00:17:42.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.483+0000 7f7955887700 1 -- 172.21.15.59:0/1463315000 shutdown_connections 2023-09-21T00:17:42.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.483+0000 7f7955887700 1 --2- 172.21.15.59:0/1463315000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f795015b730 0x7f79500b2be0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:42.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.483+0000 7f7955887700 1 -- 172.21.15.59:0/1463315000 >> 172.21.15.59:0/1463315000 conn(0x7f79500d1160 msgr2=0x7f79500d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:42.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.483+0000 7f7955887700 1 -- 172.21.15.59:0/1463315000 shutdown_connections 2023-09-21T00:17:42.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.483+0000 7f7955887700 1 -- 172.21.15.59:0/1463315000 wait complete. 2023-09-21T00:17:42.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.484+0000 7f7955887700 1 Processor -- start 2023-09-21T00:17:42.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.484+0000 7f7955887700 1 -- start start 2023-09-21T00:17:42.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.485+0000 7f7955887700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79500ccbf0 0x7f79501f2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:42.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.485+0000 7f7955887700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79500ceeb0 0x7f7950159450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:42.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.485+0000 7f7955887700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f795015b730 0x7f79500b21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:42.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.485+0000 7f7955887700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79500c54b0 con 0x7f795015b730 2023-09-21T00:17:42.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.485+0000 7f7955887700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79500c5790 con 0x7f79500ceeb0 2023-09-21T00:17:42.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.485+0000 7f7955887700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79500c5a70 con 0x7f79500ccbf0 2023-09-21T00:17:42.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.485+0000 7f794f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f795015b730 0x7f79500b21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:42.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.485+0000 7f794f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f795015b730 0x7f79500b21c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52050/0 (socket says 172.21.15.59:52050) 2023-09-21T00:17:42.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.485+0000 7f794f7fe700 1 -- 172.21.15.59:0/579387734 learned_addr learned my addr 172.21.15.59:0/579387734 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:42.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.485+0000 7f794effd700 1 --2- 172.21.15.59:0/579387734 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79500ccbf0 0x7f79501f2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:42.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.485+0000 7f794f7fe700 1 -- 172.21.15.59:0/579387734 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79500ccbf0 msgr2=0x7f79501f2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:42.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.485+0000 7f794f7fe700 1 --2- 172.21.15.59:0/579387734 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79500ccbf0 0x7f79501f2b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:42.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.485+0000 7f794e7fc700 1 --2- 172.21.15.59:0/579387734 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79500ceeb0 0x7f7950159450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:42.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.485+0000 7f794f7fe700 1 -- 172.21.15.59:0/579387734 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79500ceeb0 msgr2=0x7f7950159450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:42.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.485+0000 7f794f7fe700 1 --2- 172.21.15.59:0/579387734 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79500ceeb0 0x7f7950159450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:42.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.485+0000 7f794f7fe700 1 -- 172.21.15.59:0/579387734 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7940009430 con 0x7f795015b730 2023-09-21T00:17:42.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.485+0000 7f794e7fc700 1 --2- 172.21.15.59:0/579387734 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79500ceeb0 0x7f7950159450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:17:42.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.485+0000 7f794f7fe700 1 --2- 172.21.15.59:0/579387734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f795015b730 0x7f79500b21c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f794800cba0 tx=0x7f794800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:42.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.486+0000 7f7937fff700 1 -- 172.21.15.59:0/579387734 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794800ab80 con 0x7f795015b730 2023-09-21T00:17:42.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.486+0000 7f7937fff700 1 -- 172.21.15.59:0/579387734 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794800ad00 con 0x7f795015b730 2023-09-21T00:17:42.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.486+0000 7f7955887700 1 -- 172.21.15.59:0/579387734 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79500c5d50 con 0x7f795015b730 2023-09-21T00:17:42.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.486+0000 7f7937fff700 1 -- 172.21.15.59:0/579387734 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7948007310 con 0x7f795015b730 2023-09-21T00:17:42.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.486+0000 7f7955887700 1 -- 172.21.15.59:0/579387734 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79500c8e60 con 0x7f795015b730 2023-09-21T00:17:42.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.488+0000 7f7937fff700 1 -- 172.21.15.59:0/579387734 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f7948007470 con 0x7f795015b730 2023-09-21T00:17:42.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.488+0000 7f7937fff700 1 --2- 172.21.15.59:0/579387734 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f793c06ae00 0x7f793c06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:42.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.488+0000 7f7937fff700 1 -- 172.21.15.59:0/579387734 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7948089590 con 0x7f795015b730 2023-09-21T00:17:42.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.488+0000 7f794effd700 1 --2- 172.21.15.59:0/579387734 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f793c06ae00 0x7f793c06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:42.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.489+0000 7f794effd700 1 --2- 172.21.15.59:0/579387734 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f793c06ae00 0x7f793c06d2c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7940009b70 tx=0x7f7940008070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:42.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.490+0000 7f7961a4bb80 1 Processor -- start 2023-09-21T00:17:42.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.490+0000 7f7961a4bb80 1 -- start start 2023-09-21T00:17:42.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.491+0000 7f7961a4bb80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55743dc66620 0x55743dc38e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:42.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.491+0000 7f7961a4bb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55743dc78040 0x55743dc66a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:42.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.491+0000 7f7961a4bb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55743dc627f0 0x55743dc3bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:42.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.491+0000 7f7961a4bb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55743dbb0c50 con 0x55743dc627f0 2023-09-21T00:17:42.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.491+0000 7f7961a4bb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55743db94c20 con 0x55743dc78040 2023-09-21T00:17:42.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.491+0000 7f7961a4bb80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x55743db92540 con 0x55743dc66620 2023-09-21T00:17:42.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.491+0000 7f794f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55743dc627f0 0x55743dc3bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:42.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.491+0000 7f794f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55743dc627f0 0x55743dc3bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52058/0 (socket says 172.21.15.59:52058) 2023-09-21T00:17:42.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.491+0000 7f794f7fe700 1 -- 172.21.15.59:0/3335739166 learned_addr learned my addr 172.21.15.59:0/3335739166 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:42.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.491+0000 7f794effd700 1 --2- 172.21.15.59:0/3335739166 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55743dc66620 0x55743dc38e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:42.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.491+0000 7f794e7fc700 1 --2- 172.21.15.59:0/3335739166 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55743dc78040 0x55743dc66a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:42.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.491+0000 7f794f7fe700 1 -- 172.21.15.59:0/3335739166 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55743dc66620 msgr2=0x55743dc38e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:42.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.491+0000 7f794f7fe700 1 --2- 172.21.15.59:0/3335739166 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55743dc66620 0x55743dc38e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:42.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.491+0000 7f794f7fe700 1 -- 172.21.15.59:0/3335739166 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55743dc78040 msgr2=0x55743dc66a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:42.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.491+0000 7f794f7fe700 1 --2- 172.21.15.59:0/3335739166 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55743dc78040 0x55743dc66a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:42.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.491+0000 7f794f7fe700 1 -- 172.21.15.59:0/3335739166 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55743da0c5e0 con 0x55743dc627f0 2023-09-21T00:17:42.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.491+0000 7f794f7fe700 1 --2- 172.21.15.59:0/3335739166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55743dc627f0 0x55743dc3bfe0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7948087800 tx=0x7f7948054500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=192208832e321bf2 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:42.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.491+0000 7f79357fa700 1 -- 172.21.15.59:0/3335739166 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7948058110 con 0x55743dc627f0 2023-09-21T00:17:42.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.491+0000 7f79357fa700 1 -- 172.21.15.59:0/3335739166 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794805bf40 con 0x55743dc627f0 2023-09-21T00:17:42.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.491+0000 7f79357fa700 1 -- 172.21.15.59:0/3335739166 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79480600f0 con 0x55743dc627f0 2023-09-21T00:17:42.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.492+0000 7f7961a4bb80 1 -- 172.21.15.59:0/3335739166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55743dc627f0 msgr2=0x55743dc3bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:42.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.492+0000 7f7961a4bb80 1 --2- 172.21.15.59:0/3335739166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55743dc627f0 0x55743dc3bfe0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7948087800 tx=0x7f7948054500 comp rx=0 tx=0).stop 2023-09-21T00:17:42.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.492+0000 7f7961a4bb80 1 -- 172.21.15.59:0/3335739166 shutdown_connections 2023-09-21T00:17:42.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.492+0000 7f7961a4bb80 1 --2- 172.21.15.59:0/3335739166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55743dc627f0 0x55743dc3bfe0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:42.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.492+0000 7f7961a4bb80 1 --2- 172.21.15.59:0/3335739166 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55743dc66620 0x55743dc38e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:42.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.492+0000 7f7961a4bb80 1 --2- 172.21.15.59:0/3335739166 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55743dc78040 0x55743dc66a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:42.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.492+0000 7f7961a4bb80 1 -- 172.21.15.59:0/3335739166 >> 172.21.15.59:0/3335739166 conn(0x55743db68fb0 msgr2=0x55743dc81430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:42.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.492+0000 7f7961a4bb80 1 -- 172.21.15.59:0/3335739166 shutdown_connections 2023-09-21T00:17:42.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.492+0000 7f7961a4bb80 1 -- 172.21.15.59:0/3335739166 wait complete. 2023-09-21T00:17:42.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.493+0000 7f7961a4bb80 1 -- start start 2023-09-21T00:17:42.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.493+0000 7f7961a4bb80 1 Processor -- start 2023-09-21T00:17:42.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.493+0000 7f7961a4bb80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55743dc627f0 0x55743dc5c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:42.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.494+0000 7f7961a4bb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55743dc66620 0x55743dc84f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:42.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.494+0000 7f7961a4bb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55743dc78040 0x55743dc85460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:42.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.494+0000 7f7961a4bb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55743db8de30 con 0x55743dc78040 2023-09-21T00:17:42.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.494+0000 7f7961a4bb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55743db2a6f0 con 0x55743dc66620 2023-09-21T00:17:42.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.494+0000 7f7961a4bb80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x55743db2a390 con 0x55743dc627f0 2023-09-21T00:17:42.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.494+0000 7f7961a4bb80 10 client.0 _ll_register_callbacks cb 0x55743da74a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T00:17:42.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.494+0000 7f794f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55743dc78040 0x55743dc85460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:42.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.494+0000 7f794f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55743dc78040 0x55743dc85460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52064/0 (socket says 172.21.15.59:52064) 2023-09-21T00:17:42.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.494+0000 7f794f7fe700 1 -- 172.21.15.59:0/2612966965 learned_addr learned my addr 172.21.15.59:0/2612966965 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:42.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.494+0000 7f794effd700 1 --2- 172.21.15.59:0/2612966965 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55743dc627f0 0x55743dc5c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:42.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.494+0000 7f794f7fe700 1 -- 172.21.15.59:0/2612966965 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55743dc627f0 msgr2=0x55743dc5c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:42.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.494+0000 7f794f7fe700 1 --2- 172.21.15.59:0/2612966965 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55743dc627f0 0x55743dc5c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:42.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.494+0000 7f794f7fe700 1 -- 172.21.15.59:0/2612966965 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55743dc66620 msgr2=0x55743dc84f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:42.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.494+0000 7f794e7fc700 1 --2- 172.21.15.59:0/2612966965 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55743dc66620 0x55743dc84f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:42.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.494+0000 7f794f7fe700 1 --2- 172.21.15.59:0/2612966965 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55743dc66620 0x55743dc84f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:42.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.494+0000 7f794f7fe700 1 -- 172.21.15.59:0/2612966965 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79500c8e60 con 0x55743dc78040 2023-09-21T00:17:42.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.494+0000 7f794effd700 1 --2- 172.21.15.59:0/2612966965 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55743dc627f0 0x55743dc5c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:17:42.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.494+0000 7f794f7fe700 1 --2- 172.21.15.59:0/2612966965 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55743dc78040 0x55743dc85460 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f794805fbc0 tx=0x7f7948001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=466fd98818a6c829 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:42.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.494+0000 7f792e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-09-21T00:17:42.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.494+0000 7f792e7fc700 1 -- 172.21.15.59:0/2612966965 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7948086070 con 0x55743dc78040 2023-09-21T00:17:42.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.494+0000 7f792e7fc700 1 -- 172.21.15.59:0/2612966965 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f794805b070 con 0x55743dc78040 2023-09-21T00:17:42.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.494+0000 7f7961a4bb80 1 -- 172.21.15.59:0/2612966965 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55743db4db40 con 0x55743dc78040 2023-09-21T00:17:42.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.494+0000 7f792e7fc700 1 -- 172.21.15.59:0/2612966965 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7948001c30 con 0x55743dc78040 2023-09-21T00:17:42.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.494+0000 7f7961a4bb80 10 client.4788 fetch_fsmap learned FSMap version 8 2023-09-21T00:17:42.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.494+0000 7f7961a4bb80 1 -- 172.21.15.59:0/2612966965 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55743d9b8d90 con 0x55743dc78040 2023-09-21T00:17:42.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.494+0000 7f792e7fc700 1 -- 172.21.15.59:0/2612966965 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55743db4db40 con 0x55743dc78040 2023-09-21T00:17:42.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.495+0000 7f792e7fc700 1 -- 172.21.15.59:0/2612966965 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 8) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f794805fc60 con 0x55743dc78040 2023-09-21T00:17:42.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.495+0000 7f7961a4bb80 10 client.4788 fetch_fsmap finished waiting for FSMap version 8 2023-09-21T00:17:42.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.495+0000 7f7961a4bb80 10 client.4788 resolve_mds: resolved name 'b' to daemon mds.b 2023-09-21T00:17:42.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.495+0000 7f7961a4bb80 20 client.4788 populate_metadata read hostname 'smithi059' 2023-09-21T00:17:42.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.495+0000 7f7961a4bb80 1 --2- 172.21.15.59:0/2612966965 >> [v2:172.21.15.83:6835/792952552,v1:172.21.15.83:6837/792952552] conn(0x55743dc82f10 0x55743dc832f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:42.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.495+0000 7f7961a4bb80 4 client.4788 mds_command: new command op to 4299 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T00:17:42.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.495+0000 7f7961a4bb80 1 -- 172.21.15.59:0/2612966965 --> [v2:172.21.15.83:6835/792952552,v1:172.21.15.83:6837/792952552] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55743dc0b060 con 0x55743dc82f10 2023-09-21T00:17:42.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.495+0000 7f794effd700 1 --2- 172.21.15.59:0/2612966965 >> [v2:172.21.15.83:6835/792952552,v1:172.21.15.83:6837/792952552] conn(0x55743dc82f10 0x55743dc832f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:42.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.495+0000 7f792e7fc700 10 client.4788 ms_handle_connect on v2:172.21.15.83:6835/792952552 2023-09-21T00:17:42.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.495+0000 7f794effd700 1 --2- 172.21.15.59:0/2612966965 >> [v2:172.21.15.83:6835/792952552,v1:172.21.15.83:6837/792952552] conn(0x55743dc82f10 0x55743dc832f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f697cea6f6a6cbf server_cookie=bc36c8dc70a1b37d in_seq=0 out_seq=0 2023-09-21T00:17:42.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.496+0000 7f792e7fc700 1 -- 172.21.15.59:0/2612966965 <== mds.0 v2:172.21.15.83:6835/792952552 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55743dc0b060 con 0x55743dc82f10 2023-09-21T00:17:42.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.496+0000 7f792e7fc700 10 client.4788 handle_command_reply: tid=0 2023-09-21T00:17:42.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.496+0000 7f7961a4bb80 1 client.4788 shutdown 2023-09-21T00:17:42.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.496+0000 7f7961a4bb80 1 -- 172.21.15.59:0/2612966965 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55743dc78040 msgr2=0x55743dc85460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:42.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.496+0000 7f7961a4bb80 1 --2- 172.21.15.59:0/2612966965 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55743dc78040 0x55743dc85460 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f794805fbc0 tx=0x7f7948001250 comp rx=0 tx=0).stop 2023-09-21T00:17:42.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.496+0000 7f7961a4bb80 1 -- 172.21.15.59:0/2612966965 shutdown_connections 2023-09-21T00:17:42.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.496+0000 7f7961a4bb80 1 --2- 172.21.15.59:0/2612966965 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55743dc78040 0x55743dc85460 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:42.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.496+0000 7f7961a4bb80 1 --2- 172.21.15.59:0/2612966965 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55743dc627f0 0x55743dc5c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:42.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.496+0000 7f7961a4bb80 1 --2- 172.21.15.59:0/2612966965 >> [v2:172.21.15.83:6835/792952552,v1:172.21.15.83:6837/792952552] conn(0x55743dc82f10 0x55743dc832f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:42.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.496+0000 7f7961a4bb80 1 --2- 172.21.15.59:0/2612966965 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55743dc66620 0x55743dc84f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:42.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.496+0000 7f792e7fc700 0 client.4788 ms_handle_reset on v2:172.21.15.83:6835/792952552 2023-09-21T00:17:42.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.496+0000 7f7961a4bb80 1 -- 172.21.15.59:0/2612966965 >> 172.21.15.59:0/2612966965 conn(0x55743db68fb0 msgr2=0x55743dc36d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:42.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.496+0000 7f7961a4bb80 1 -- 172.21.15.59:0/2612966965 shutdown_connections 2023-09-21T00:17:42.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.496+0000 7f7961a4bb80 1 -- 172.21.15.59:0/2612966965 wait complete. 2023-09-21T00:17:42.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.496+0000 7f7961a4bb80 20 client.4788 trim_cache size 0 max 16384 2023-09-21T00:17:42.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.514+0000 7f7961a4bb80 1 Processor -- start 2023-09-21T00:17:42.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.514+0000 7f7961a4bb80 1 -- start start 2023-09-21T00:17:42.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.515+0000 7f7961a4bb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55743dc627f0 0x55743dc63780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:42.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.515+0000 7f7961a4bb80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55743dc66620 0x55743dc84da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:42.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.515+0000 7f7961a4bb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55743dc78040 0x55743dc852e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:42.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.515+0000 7f7961a4bb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55743dc39110 con 0x55743dc78040 2023-09-21T00:17:42.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.515+0000 7f7961a4bb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55743dc3d4c0 con 0x55743dc627f0 2023-09-21T00:17:42.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.515+0000 7f7961a4bb80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x55743da0e8d0 con 0x55743dc66620 2023-09-21T00:17:42.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.515+0000 7f794f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55743dc78040 0x55743dc852e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:42.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.515+0000 7f794f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55743dc78040 0x55743dc852e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52072/0 (socket says 172.21.15.59:52072) 2023-09-21T00:17:42.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.515+0000 7f794f7fe700 1 -- 172.21.15.59:0/4214635240 learned_addr learned my addr 172.21.15.59:0/4214635240 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:42.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.515+0000 7f794e7fc700 1 --2- 172.21.15.59:0/4214635240 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55743dc66620 0x55743dc84da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:42.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.515+0000 7f794effd700 1 --2- 172.21.15.59:0/4214635240 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55743dc627f0 0x55743dc63780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:42.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.515+0000 7f794f7fe700 1 -- 172.21.15.59:0/4214635240 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55743dc66620 msgr2=0x55743dc84da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:42.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.515+0000 7f794f7fe700 1 --2- 172.21.15.59:0/4214635240 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55743dc66620 0x55743dc84da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:42.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.515+0000 7f794f7fe700 1 -- 172.21.15.59:0/4214635240 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55743dc627f0 msgr2=0x55743dc63780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:42.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.515+0000 7f794f7fe700 1 --2- 172.21.15.59:0/4214635240 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55743dc627f0 0x55743dc63780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:42.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.515+0000 7f794f7fe700 1 -- 172.21.15.59:0/4214635240 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55743d9a1c10 con 0x55743dc78040 2023-09-21T00:17:42.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.515+0000 7f794f7fe700 1 --2- 172.21.15.59:0/4214635240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55743dc78040 0x55743dc852e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f794800cb70 tx=0x7f7948086000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c749b502d2f1f721 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:42.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.515+0000 7f7935ffb700 1 -- 172.21.15.59:0/4214635240 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7948001c30 con 0x55743dc78040 2023-09-21T00:17:42.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.515+0000 7f7935ffb700 1 -- 172.21.15.59:0/4214635240 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79480600f0 con 0x55743dc78040 2023-09-21T00:17:42.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.516+0000 7f7935ffb700 1 -- 172.21.15.59:0/4214635240 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79480892e0 con 0x55743dc78040 2023-09-21T00:17:42.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.516+0000 7f7961a4bb80 1 -- 172.21.15.59:0/4214635240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55743dc78040 msgr2=0x55743dc852e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:42.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.516+0000 7f7961a4bb80 1 --2- 172.21.15.59:0/4214635240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55743dc78040 0x55743dc852e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f794800cb70 tx=0x7f7948086000 comp rx=0 tx=0).stop 2023-09-21T00:17:42.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.516+0000 7f7961a4bb80 1 -- 172.21.15.59:0/4214635240 shutdown_connections 2023-09-21T00:17:42.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.516+0000 7f7961a4bb80 1 --2- 172.21.15.59:0/4214635240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55743dc78040 0x55743dc852e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:42.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.516+0000 7f7961a4bb80 1 --2- 172.21.15.59:0/4214635240 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55743dc627f0 0x55743dc63780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:42.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.516+0000 7f7961a4bb80 1 --2- 172.21.15.59:0/4214635240 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55743dc66620 0x55743dc84da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:42.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.516+0000 7f7961a4bb80 1 -- 172.21.15.59:0/4214635240 >> 172.21.15.59:0/4214635240 conn(0x55743db68fb0 msgr2=0x55743dc32f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:42.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.516+0000 7f7961a4bb80 1 -- 172.21.15.59:0/4214635240 shutdown_connections 2023-09-21T00:17:42.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.516+0000 7f7961a4bb80 1 -- 172.21.15.59:0/4214635240 wait complete. 2023-09-21T00:17:42.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.517+0000 7f7961a4bb80 1 -- start start 2023-09-21T00:17:42.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.517+0000 7f7961a4bb80 1 Processor -- start 2023-09-21T00:17:42.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.517+0000 7f7961a4bb80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55743dc627f0 0x55743dc695e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:42.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.518+0000 7f7961a4bb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55743dc66620 0x55743dc69b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:42.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.518+0000 7f7961a4bb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55743dc78040 0x55743dc99ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:42.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.518+0000 7f7961a4bb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55743dc81c30 con 0x55743dc66620 2023-09-21T00:17:42.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.518+0000 7f7961a4bb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55743dc59330 con 0x55743dc78040 2023-09-21T00:17:42.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.518+0000 7f7961a4bb80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x55743dc60960 con 0x55743dc627f0 2023-09-21T00:17:42.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.518+0000 7f7961a4bb80 10 client.0 _ll_register_callbacks cb 0x55743da74a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T00:17:42.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.518+0000 7f794e7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55743dc66620 0x55743dc69b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:42.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.518+0000 7f794e7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55743dc66620 0x55743dc69b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52076/0 (socket says 172.21.15.59:52076) 2023-09-21T00:17:42.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.518+0000 7f794e7fc700 1 -- 172.21.15.59:0/2406601954 learned_addr learned my addr 172.21.15.59:0/2406601954 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:42.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.518+0000 7f794effd700 1 --2- 172.21.15.59:0/2406601954 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55743dc627f0 0x55743dc695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:42.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.518+0000 7f794f7fe700 1 --2- 172.21.15.59:0/2406601954 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55743dc78040 0x55743dc99ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:42.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.518+0000 7f794e7fc700 1 -- 172.21.15.59:0/2406601954 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55743dc627f0 msgr2=0x55743dc695e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:42.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.518+0000 7f794e7fc700 1 --2- 172.21.15.59:0/2406601954 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55743dc627f0 0x55743dc695e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:42.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.518+0000 7f794e7fc700 1 -- 172.21.15.59:0/2406601954 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55743dc78040 msgr2=0x55743dc99ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:42.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.518+0000 7f794e7fc700 1 --2- 172.21.15.59:0/2406601954 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55743dc78040 0x55743dc99ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:42.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.518+0000 7f794e7fc700 1 -- 172.21.15.59:0/2406601954 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55743d9b8d90 con 0x55743dc66620 2023-09-21T00:17:42.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.518+0000 7f794f7fe700 1 --2- 172.21.15.59:0/2406601954 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55743dc78040 0x55743dc99ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:17:42.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.518+0000 7f794e7fc700 1 --2- 172.21.15.59:0/2406601954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55743dc66620 0x55743dc69b20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7944014340 tx=0x7f7944014700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40d0ecc6a58f4df6 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:42.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.518+0000 7f792e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-09-21T00:17:42.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.518+0000 7f792e7fc700 1 -- 172.21.15.59:0/2406601954 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7944005110 con 0x55743dc66620 2023-09-21T00:17:42.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.518+0000 7f792e7fc700 1 -- 172.21.15.59:0/2406601954 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7944005270 con 0x55743dc66620 2023-09-21T00:17:42.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.518+0000 7f7961a4bb80 1 -- 172.21.15.59:0/2406601954 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f794805bf40 con 0x55743dc66620 2023-09-21T00:17:42.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.518+0000 7f792e7fc700 1 -- 172.21.15.59:0/2406601954 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7944005430 con 0x55743dc66620 2023-09-21T00:17:42.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.518+0000 7f7961a4bb80 10 client.4794 fetch_fsmap learned FSMap version 8 2023-09-21T00:17:42.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.518+0000 7f7961a4bb80 1 -- 172.21.15.59:0/2406601954 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55743d9df200 con 0x55743dc66620 2023-09-21T00:17:42.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.519+0000 7f792e7fc700 1 -- 172.21.15.59:0/2406601954 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794805bf40 con 0x55743dc66620 2023-09-21T00:17:42.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.519+0000 7f792e7fc700 1 -- 172.21.15.59:0/2406601954 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 8) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f7944006860 con 0x55743dc66620 2023-09-21T00:17:42.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.519+0000 7f7961a4bb80 10 client.4794 fetch_fsmap finished waiting for FSMap version 8 2023-09-21T00:17:42.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.519+0000 7f7961a4bb80 10 client.4794 resolve_mds: resolved name 'b' to daemon mds.b 2023-09-21T00:17:42.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.519+0000 7f7961a4bb80 20 client.4794 populate_metadata read hostname 'smithi059' 2023-09-21T00:17:42.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.519+0000 7f7961a4bb80 1 --2- 172.21.15.59:0/2406601954 >> [v2:172.21.15.83:6835/792952552,v1:172.21.15.83:6837/792952552] conn(0x55743dc9a440 0x55743dc58190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:42.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.519+0000 7f7961a4bb80 4 client.4794 mds_command: new command op to 4299 tid=0[{"prefix": "status"}] 2023-09-21T00:17:42.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.519+0000 7f7961a4bb80 1 -- 172.21.15.59:0/2406601954 --> [v2:172.21.15.83:6835/792952552,v1:172.21.15.83:6837/792952552] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55743db86e10 con 0x55743dc9a440 2023-09-21T00:17:42.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.519+0000 7f794effd700 1 --2- 172.21.15.59:0/2406601954 >> [v2:172.21.15.83:6835/792952552,v1:172.21.15.83:6837/792952552] conn(0x55743dc9a440 0x55743dc58190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:42.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.519+0000 7f792e7fc700 10 client.4794 ms_handle_connect on v2:172.21.15.83:6835/792952552 2023-09-21T00:17:42.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.519+0000 7f794effd700 1 --2- 172.21.15.59:0/2406601954 >> [v2:172.21.15.83:6835/792952552,v1:172.21.15.83:6837/792952552] conn(0x55743dc9a440 0x55743dc58190 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43ab9c32e08a4a1b server_cookie=b019c76c9882ecb0 in_seq=0 out_seq=0 2023-09-21T00:17:42.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.519+0000 7f792e7fc700 1 -- 172.21.15.59:0/2406601954 <== mds.0 v2:172.21.15.83:6835/792952552 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55743db86e10 con 0x55743dc9a440 2023-09-21T00:17:42.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.519+0000 7f792e7fc700 10 client.4794 handle_command_reply: tid=0 2023-09-21T00:17:42.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.519+0000 7f7961a4bb80 1 client.4794 shutdown 2023-09-21T00:17:42.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.519+0000 7f7961a4bb80 1 -- 172.21.15.59:0/2406601954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55743dc66620 msgr2=0x55743dc69b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:42.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.519+0000 7f7961a4bb80 1 --2- 172.21.15.59:0/2406601954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55743dc66620 0x55743dc69b20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7944014340 tx=0x7f7944014700 comp rx=0 tx=0).stop 2023-09-21T00:17:42.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.520+0000 7f7961a4bb80 1 -- 172.21.15.59:0/2406601954 shutdown_connections 2023-09-21T00:17:42.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.520+0000 7f7961a4bb80 1 --2- 172.21.15.59:0/2406601954 >> [v2:172.21.15.83:6835/792952552,v1:172.21.15.83:6837/792952552] conn(0x55743dc9a440 0x55743dc58190 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:42.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.520+0000 7f7961a4bb80 1 --2- 172.21.15.59:0/2406601954 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55743dc78040 0x55743dc99ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:42.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.520+0000 7f7961a4bb80 1 --2- 172.21.15.59:0/2406601954 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55743dc627f0 0x55743dc695e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:42.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.520+0000 7f792e7fc700 0 client.4794 ms_handle_reset on v2:172.21.15.83:6835/792952552 2023-09-21T00:17:42.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.520+0000 7f7961a4bb80 1 --2- 172.21.15.59:0/2406601954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55743dc66620 0x55743dc69b20 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:42.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.520+0000 7f7961a4bb80 1 -- 172.21.15.59:0/2406601954 >> 172.21.15.59:0/2406601954 conn(0x55743db68fb0 msgr2=0x55743dc80810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:42.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.520+0000 7f7961a4bb80 1 -- 172.21.15.59:0/2406601954 shutdown_connections 2023-09-21T00:17:42.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.520+0000 7f7961a4bb80 1 -- 172.21.15.59:0/2406601954 wait complete. 2023-09-21T00:17:42.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.520+0000 7f7961a4bb80 20 client.4794 trim_cache size 0 max 16384 2023-09-21T00:17:42.547 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-09-21T00:17:42.548 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "dd69925c-6e25-42fe-880b-2f60fc6f384b", 2023-09-21T00:17:42.548 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 0, 2023-09-21T00:17:42.548 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 4299, 2023-09-21T00:17:42.548 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2023-09-21T00:17:42.548 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2023-09-21T00:17:42.549 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2023-09-21T00:17:42.549 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 35.587364039999997, 2023-09-21T00:17:42.549 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 8, 2023-09-21T00:17:42.549 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 24, 2023-09-21T00:17:42.549 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 24, 2023-09-21T00:17:42.550 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 40.805386210999998 2023-09-21T00:17:42.550 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-09-21T00:17:42.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.520+0000 7f7955887700 1 -- 172.21.15.59:0/579387734 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f793c06ae00 msgr2=0x7f793c06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:42.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.520+0000 7f7955887700 1 --2- 172.21.15.59:0/579387734 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f793c06ae00 0x7f793c06d2c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7940009b70 tx=0x7f7940008070 comp rx=0 tx=0).stop 2023-09-21T00:17:42.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.520+0000 7f7955887700 1 -- 172.21.15.59:0/579387734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f795015b730 msgr2=0x7f79500b21c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:42.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.520+0000 7f7955887700 1 --2- 172.21.15.59:0/579387734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f795015b730 0x7f79500b21c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f794800cba0 tx=0x7f794800cf60 comp rx=0 tx=0).stop 2023-09-21T00:17:42.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.520+0000 7f7955887700 1 -- 172.21.15.59:0/579387734 shutdown_connections 2023-09-21T00:17:42.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.520+0000 7f7955887700 1 --2- 172.21.15.59:0/579387734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f795015b730 0x7f79500b21c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:42.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.520+0000 7f7955887700 1 --2- 172.21.15.59:0/579387734 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f793c06ae00 0x7f793c06d2c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:42.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.520+0000 7f7955887700 1 --2- 172.21.15.59:0/579387734 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f79500ccbf0 0x7f79501f2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:42.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.520+0000 7f7955887700 1 --2- 172.21.15.59:0/579387734 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79500ceeb0 0x7f7950159450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:42.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.520+0000 7f7955887700 1 -- 172.21.15.59:0/579387734 >> 172.21.15.59:0/579387734 conn(0x7f79500d1160 msgr2=0x7f79500cf690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:42.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.520+0000 7f7955887700 1 -- 172.21.15.59:0/579387734 shutdown_connections 2023-09-21T00:17:42.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:42.520+0000 7f7955887700 1 -- 172.21.15.59:0/579387734 wait complete. 2023-09-21T00:17:42.555 INFO:teuthology.run_tasks:Running task kclient... 2023-09-21T00:17:42.568 INFO:tasks.kclient:Mounting kernel clients... 2023-09-21T00:17:42.569 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-09-21T00:17:42.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:42.569 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2023-09-21T00:17:42.587 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-09-21T00:17:42.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:42.588 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-09-21T00:17:42.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:42.665 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link delete ceph-brx 2023-09-21T00:17:42.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:42.777 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2023-09-21T00:17:42.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:42.795 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link delete ceph-brx 2023-09-21T00:17:42.863 INFO:teuthology.orchestra.run.smithi059.stderr:Cannot find device "ceph-brx" 2023-09-21T00:17:42.864 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-21T00:17:42.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:42.865 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2023-09-21T00:17:42.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:42.887 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link delete ceph-brx 2023-09-21T00:17:42.961 INFO:teuthology.orchestra.run.smithi083.stderr:Cannot find device "ceph-brx" 2023-09-21T00:17:42.962 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-21T00:17:42.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:42.963 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2023-09-21T00:17:43.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:43.022 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link delete ceph-brx 2023-09-21T00:17:43.093 INFO:teuthology.orchestra.run.smithi083.stderr:Cannot find device "ceph-brx" 2023-09-21T00:17:43.094 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-21T00:17:43.095 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-09-21T00:17:43.095 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-09-21T00:17:43.096 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-21T00:17:43.096 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-21T00:17:43.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.223+0000 7ff355660700 1 Processor -- start 2023-09-21T00:17:43.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.223+0000 7ff355660700 1 -- start start 2023-09-21T00:17:43.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.224+0000 7ff355660700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff35015d690 0x7ff3500d1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:43.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.224+0000 7ff355660700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff3500b5630 0x7ff3500b65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:43.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.224+0000 7ff355660700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3500d1ee0 con 0x7ff3500d1a60 2023-09-21T00:17:43.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.224+0000 7ff355660700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3500d21c0 con 0x7ff3500b5630 2023-09-21T00:17:43.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.224+0000 7ff355660700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3500d24a0 con 0x7ff35015d690 2023-09-21T00:17:43.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.224+0000 7ff34f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff3500b5630 0x7ff3500b65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:43.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.224+0000 7ff34f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff3500b5630 0x7ff3500b65d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52082/0 (socket says 172.21.15.59:52082) 2023-09-21T00:17:43.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.224+0000 7ff34f7fe700 1 -- 172.21.15.59:0/3920230991 learned_addr learned my addr 172.21.15.59:0/3920230991 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:43.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.224+0000 7ff34effd700 1 --2- 172.21.15.59:0/3920230991 >> v2:172.21.15.83:3300/0 conn(0x7ff35015d690 0x7ff3500d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:43.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.224+0000 7ff34f7fe700 1 -- 172.21.15.59:0/3920230991 >> v2:172.21.15.83:3300/0 conn(0x7ff35015d690 msgr2=0x7ff3500d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:43.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.224+0000 7ff34f7fe700 1 --2- 172.21.15.59:0/3920230991 >> v2:172.21.15.83:3300/0 conn(0x7ff35015d690 0x7ff3500d1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:43.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.224+0000 7ff34f7fe700 1 -- 172.21.15.59:0/3920230991 >> v1:172.21.15.83:6789/0 conn(0x7ff3500d1a60 legacy=0x7ff3500b4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:43.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.225+0000 7ff34f7fe700 1 -- 172.21.15.59:0/3920230991 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3500d2780 con 0x7ff3500b5630 2023-09-21T00:17:43.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.225+0000 7ff34effd700 1 --2- 172.21.15.59:0/3920230991 >> v2:172.21.15.83:3300/0 conn(0x7ff35015d690 0x7ff3500d1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:17:43.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.225+0000 7ff34f7fe700 1 --2- 172.21.15.59:0/3920230991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3500b5630 0x7ff3500b65d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff35006c950 tx=0x7ff34800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eeaa0457fd85324 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:43.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.225+0000 7ff34dffb700 1 -- 172.21.15.59:0/3920230991 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34800e070 con 0x7ff3500b5630 2023-09-21T00:17:43.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.225+0000 7ff34dffb700 1 -- 172.21.15.59:0/3920230991 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff348003a20 con 0x7ff3500b5630 2023-09-21T00:17:43.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.225+0000 7ff34dffb700 1 -- 172.21.15.59:0/3920230991 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff348003dd0 con 0x7ff3500b5630 2023-09-21T00:17:43.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.225+0000 7ff355660700 1 -- 172.21.15.59:0/3920230991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3500b5630 msgr2=0x7ff3500b65d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:43.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.225+0000 7ff355660700 1 --2- 172.21.15.59:0/3920230991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3500b5630 0x7ff3500b65d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff35006c950 tx=0x7ff34800b330 comp rx=0 tx=0).stop 2023-09-21T00:17:43.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.225+0000 7ff355660700 1 -- 172.21.15.59:0/3920230991 shutdown_connections 2023-09-21T00:17:43.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.225+0000 7ff355660700 1 --2- 172.21.15.59:0/3920230991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3500b5630 0x7ff3500b65d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:43.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.225+0000 7ff355660700 1 --2- 172.21.15.59:0/3920230991 >> v2:172.21.15.83:3300/0 conn(0x7ff35015d690 0x7ff3500d1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:43.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.225+0000 7ff355660700 1 -- 172.21.15.59:0/3920230991 >> 172.21.15.59:0/3920230991 conn(0x7ff350072560 msgr2=0x7ff3500cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:43.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.225+0000 7ff355660700 1 -- 172.21.15.59:0/3920230991 shutdown_connections 2023-09-21T00:17:43.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.225+0000 7ff355660700 1 -- 172.21.15.59:0/3920230991 wait complete. 2023-09-21T00:17:43.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.227+0000 7ff355660700 1 Processor -- start 2023-09-21T00:17:43.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.227+0000 7ff355660700 1 -- start start 2023-09-21T00:17:43.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.227+0000 7ff355660700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3500b5630 0x7ff35014e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:43.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.227+0000 7ff355660700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3500d1a60 0x7ff35015f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:43.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.227+0000 7ff355660700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff35015d690 0x7ff35015f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:43.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.227+0000 7ff355660700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3500c6fd0 con 0x7ff3500d1a60 2023-09-21T00:17:43.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.228+0000 7ff355660700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3500c7550 con 0x7ff3500b5630 2023-09-21T00:17:43.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.228+0000 7ff355660700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3500c9990 con 0x7ff35015d690 2023-09-21T00:17:43.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.228+0000 7ff34e7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3500d1a60 0x7ff35015f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:43.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.228+0000 7ff34e7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3500d1a60 0x7ff35015f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52090/0 (socket says 172.21.15.59:52090) 2023-09-21T00:17:43.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.228+0000 7ff34e7fc700 1 -- 172.21.15.59:0/1061584292 learned_addr learned my addr 172.21.15.59:0/1061584292 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:43.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.228+0000 7ff34effd700 1 --2- 172.21.15.59:0/1061584292 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3500b5630 0x7ff35014e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:43.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.228+0000 7ff34f7fe700 1 --2- 172.21.15.59:0/1061584292 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff35015d690 0x7ff35015f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:43.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.228+0000 7ff34e7fc700 1 -- 172.21.15.59:0/1061584292 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff35015d690 msgr2=0x7ff35015f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:43.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.228+0000 7ff34e7fc700 1 --2- 172.21.15.59:0/1061584292 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff35015d690 0x7ff35015f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:43.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.228+0000 7ff34e7fc700 1 -- 172.21.15.59:0/1061584292 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3500b5630 msgr2=0x7ff35014e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:43.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.228+0000 7ff34e7fc700 1 --2- 172.21.15.59:0/1061584292 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3500b5630 0x7ff35014e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:43.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.228+0000 7ff34e7fc700 1 -- 172.21.15.59:0/1061584292 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff348009b30 con 0x7ff3500d1a60 2023-09-21T00:17:43.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.228+0000 7ff34e7fc700 1 --2- 172.21.15.59:0/1061584292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3500d1a60 0x7ff35015f050 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff34400c4a0 tx=0x7ff34400c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:43.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.228+0000 7ff3377fe700 1 -- 172.21.15.59:0/1061584292 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff344011790 con 0x7ff3500d1a60 2023-09-21T00:17:43.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.228+0000 7ff3377fe700 1 -- 172.21.15.59:0/1061584292 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3440118f0 con 0x7ff3500d1a60 2023-09-21T00:17:43.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.228+0000 7ff3377fe700 1 -- 172.21.15.59:0/1061584292 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff344011ca0 con 0x7ff3500d1a60 2023-09-21T00:17:43.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.228+0000 7ff355660700 1 -- 172.21.15.59:0/1061584292 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3500c9c70 con 0x7ff3500d1a60 2023-09-21T00:17:43.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.228+0000 7ff355660700 1 -- 172.21.15.59:0/1061584292 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff35014eb90 con 0x7ff3500d1a60 2023-09-21T00:17:43.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.229+0000 7ff355660700 1 -- 172.21.15.59:0/1061584292 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3500c9e60 con 0x7ff3500d1a60 2023-09-21T00:17:43.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.230+0000 7ff3377fe700 1 -- 172.21.15.59:0/1061584292 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7ff34401c460 con 0x7ff3500d1a60 2023-09-21T00:17:43.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.230+0000 7ff3377fe700 1 --2- 172.21.15.59:0/1061584292 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ff33c06ae00 0x7ff33c06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:43.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.230+0000 7ff3377fe700 1 -- 172.21.15.59:0/1061584292 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff344089520 con 0x7ff3500d1a60 2023-09-21T00:17:43.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.230+0000 7ff34effd700 1 --2- 172.21.15.59:0/1061584292 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ff33c06ae00 0x7ff33c06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:43.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.231+0000 7ff34effd700 1 --2- 172.21.15.59:0/1061584292 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ff33c06ae00 0x7ff33c06d2c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff340006fd0 tx=0x7ff340008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:43.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.235+0000 7ff3377fe700 1 -- 172.21.15.59:0/1061584292 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7ff344054350 con 0x7ff3500d1a60 2023-09-21T00:17:43.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.478+0000 7ff355660700 1 -- 172.21.15.59:0/1061584292 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff350067e50 con 0x7ff3500d1a60 2023-09-21T00:17:43.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.479+0000 7ff3377fe700 1 -- 172.21.15.59:0/1061584292 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7ff344057970 con 0x7ff3500d1a60 2023-09-21T00:17:43.480 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-09-21T00:17:43.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.480+0000 7ff355660700 1 -- 172.21.15.59:0/1061584292 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ff33c06ae00 msgr2=0x7ff33c06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:43.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.480+0000 7ff355660700 1 --2- 172.21.15.59:0/1061584292 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ff33c06ae00 0x7ff33c06d2c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff340006fd0 tx=0x7ff340008040 comp rx=0 tx=0).stop 2023-09-21T00:17:43.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.480+0000 7ff355660700 1 -- 172.21.15.59:0/1061584292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3500d1a60 msgr2=0x7ff35015f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:43.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.480+0000 7ff355660700 1 --2- 172.21.15.59:0/1061584292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3500d1a60 0x7ff35015f050 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff34400c4a0 tx=0x7ff34400c7b0 comp rx=0 tx=0).stop 2023-09-21T00:17:43.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.480+0000 7ff355660700 1 -- 172.21.15.59:0/1061584292 shutdown_connections 2023-09-21T00:17:43.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.480+0000 7ff355660700 1 --2- 172.21.15.59:0/1061584292 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ff33c06ae00 0x7ff33c06d2c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:43.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.480+0000 7ff355660700 1 --2- 172.21.15.59:0/1061584292 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff35015d690 0x7ff35015f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:43.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.480+0000 7ff355660700 1 --2- 172.21.15.59:0/1061584292 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3500b5630 0x7ff35014e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:43.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.480+0000 7ff355660700 1 --2- 172.21.15.59:0/1061584292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3500d1a60 0x7ff35015f050 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:43.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.480+0000 7ff355660700 1 -- 172.21.15.59:0/1061584292 >> 172.21.15.59:0/1061584292 conn(0x7ff350072560 msgr2=0x7ff35015c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:43.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.481+0000 7ff355660700 1 -- 172.21.15.59:0/1061584292 shutdown_connections 2023-09-21T00:17:43.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:43.481+0000 7ff355660700 1 -- 172.21.15.59:0/1061584292 wait complete. 2023-09-21T00:17:43.494 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-21T00:17:43.494 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-21T00:17:43.494 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2023-09-21T00:17:43.495 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-21T00:17:43.495 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-21T00:17:43.495 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-21T00:17:43.496 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-21T00:17:43.496 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-21T00:17:43.496 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-21T00:17:43.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:43.497 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2023-09-21T00:17:43.514 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-21T00:17:43.517 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-21T00:17:43.517 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2023-09-21T00:17:43.517 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-09-21T00:17:43.517 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2023-09-21T00:17:43.518 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-09-21T00:17:43.518 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-21T00:17:43.518 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2023-09-21T00:17:43.518 INFO:teuthology.orchestra.run.smithi059.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-21T00:17:43.519 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2023-09-21T00:17:43.519 INFO:teuthology.orchestra.run.smithi059.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-21T00:17:43.519 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2023-09-21T00:17:43.519 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-09-21T00:17:43.519 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 42376sec preferred_lft 42376sec 2023-09-21T00:17:43.520 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2023-09-21T00:17:43.520 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-09-21T00:17:43.520 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-21T00:17:43.520 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2023-09-21T00:17:43.521 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-09-21T00:17:43.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:43.522 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-09-21T00:17:43.522 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-09-21T00:17:43.522 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link add name ceph-brx type bridge 2023-09-21T00:17:43.522 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip addr flush dev ceph-brx 2023-09-21T00:17:43.523 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set ceph-brx up 2023-09-21T00:17:43.523 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-09-21T00:17:43.523 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-09-21T00:17:43.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:43.634 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-21T00:17:43.662 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-09-21T00:17:43.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:43.663 DEBUG:teuthology.orchestra.run.smithi059:> route 2023-09-21T00:17:43.724 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2023-09-21T00:17:43.724 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-21T00:17:43.724 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-09-21T00:17:43.724 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-09-21T00:17:43.725 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-21T00:17:43.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:43.725 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-09-21T00:17:43.726 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-09-21T00:17:43.726 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-09-21T00:17:43.726 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-09-21T00:17:43.727 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-09-21T00:17:43.727 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-09-21T00:17:43.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:43.833 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2023-09-21T00:17:43.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:43.850 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list-id 2023-09-21T00:17:43.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:43.907 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-09-21T00:17:43.907 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-09-21T00:17:43.908 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-21T00:17:43.908 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-09-21T00:17:43.908 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-09-21T00:17:44.003 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-09-21T00:17:44.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:44.004 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-09-21T00:17:44.004 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-09-21T00:17:44.004 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-09-21T00:17:44.005 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-09-21T00:17:44.005 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-09-21T00:17:44.005 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-09-21T00:17:44.006 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-09-21T00:17:44.006 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-09-21T00:17:44.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:44.211 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-09-21T00:17:44.211 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-09-21T00:17:44.211 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2023-09-21T00:17:44.212 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set dev brx.0 master ceph-brx 2023-09-21T00:17:44.212 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-09-21T00:17:44.338 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-21T00:17:44.338 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-09-21T00:17:44.361 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-09-21T00:17:44.362 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-21T00:17:44.362 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-09-21T00:17:44.418 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-21T00:17:44.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:44.419 DEBUG:teuthology.orchestra.run.smithi059:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-21T00:17:44.505 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-21T00:17:44.506 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-21T00:17:44.506 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-09-21T00:17:44.647 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-21T00:17:44.647 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-21T00:17:44.647 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-09-21T00:17:44.648 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-09-21T00:17:44.648 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-21T00:17:44.720 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-21T00:17:44.720 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-21T00:17:44.721 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-09-21T00:17:44.721 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-09-21T00:17:44.721 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-21T00:17:44.721 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:6789,172.21.15.83:6789,172.21.15.83:6790" 2023-09-21T00:17:44.722 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.59:6789,172.21.15.83:6789,172.21.15.83:6790:/ 2023-09-21T00:17:44.722 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=dd69925c-6e25-42fe-880b-2f60fc6f384b" will pass to kernel 2023-09-21T00:17:44.723 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-21T00:17:44.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:44.724 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-09-21T00:17:44.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:44.754 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-21T00:17:44.827 INFO:teuthology.orchestra.run.smithi059.stdout:client4807 2023-09-21T00:17:44.827 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-21T00:17:44.828 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-21T00:17:44.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:44.884 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-21T00:17:44.958 INFO:teuthology.orchestra.run.smithi059.stdout:client4807 2023-09-21T00:17:44.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:44.959 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-21T00:17:45.032 INFO:teuthology.orchestra.run.smithi059.stdout:client4807 2023-09-21T00:17:45.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:45.033 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/dd69925c-6e25-42fe-880b-2f60fc6f384b.client4807/status') 2023-09-21T00:17:45.113 INFO:teuthology.orchestra.run.smithi059.stdout:instance: client.4807 (3)172.21.15.59:0/2215528 2023-09-21T00:17:45.113 INFO:teuthology.orchestra.run.smithi059.stdout:blocklisted: false 2023-09-21T00:17:45.114 INFO:teuthology.orchestra.run.smithi059.stderr:0+1 records in 2023-09-21T00:17:45.114 INFO:teuthology.orchestra.run.smithi059.stderr:0+1 records out 2023-09-21T00:17:45.114 INFO:teuthology.orchestra.run.smithi059.stderr:67 bytes copied, 2.7336e-05 s, 2.5 MB/s 2023-09-21T00:17:45.115 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-09-21T00:17:45.115 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-09-21T00:17:45.116 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-09-21T00:17:45.116 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-21T00:17:45.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.279+0000 7f56584f7700 1 Processor -- start 2023-09-21T00:17:45.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.279+0000 7f56584f7700 1 -- start start 2023-09-21T00:17:45.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.280+0000 7f56584f7700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f565015b480 0x7f565006f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:45.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.280+0000 7f56584f7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f56500708f0 0x7f56500b44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:45.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.280+0000 7f56584f7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56500b4030 con 0x7f56500d0820 2023-09-21T00:17:45.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.280+0000 7f56584f7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56500cb8d0 con 0x7f56500708f0 2023-09-21T00:17:45.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.280+0000 7f56584f7700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56500cbb40 con 0x7f565015b480 2023-09-21T00:17:45.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.280+0000 7f5656a94700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f56500708f0 0x7f56500b44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:45.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.280+0000 7f5655a92700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f56500d0820 0x7f56500701e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57668/0 (socket says 172.21.15.59:57668) 2023-09-21T00:17:45.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.280+0000 7f5655a92700 1 -- 172.21.15.59:0/776961871 learned_addr learned my addr 172.21.15.59:0/776961871 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:45.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.280+0000 7f5656293700 1 --2- 172.21.15.59:0/776961871 >> v2:172.21.15.83:3300/0 conn(0x7f565015b480 0x7f565006f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:45.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.280+0000 7f5656a94700 1 -- 172.21.15.59:0/776961871 >> v2:172.21.15.83:3300/0 conn(0x7f565015b480 msgr2=0x7f565006f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:45.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.280+0000 7f5656a94700 1 --2- 172.21.15.59:0/776961871 >> v2:172.21.15.83:3300/0 conn(0x7f565015b480 0x7f565006f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:45.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.280+0000 7f5656a94700 1 -- 172.21.15.59:0/776961871 >> v1:172.21.15.59:6789/0 conn(0x7f56500d0820 legacy=0x7f56500701e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:45.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.280+0000 7f5656a94700 1 -- 172.21.15.59:0/776961871 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56500cbe20 con 0x7f56500708f0 2023-09-21T00:17:45.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.280+0000 7f5656a94700 1 --2- 172.21.15.59:0/776961871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56500708f0 0x7f56500b44c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f56500cdbc0 tx=0x7f564800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c26eb4aade28d2 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:45.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.281+0000 7f5655291700 1 -- 172.21.15.59:0/776961871 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564800e070 con 0x7f56500708f0 2023-09-21T00:17:45.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.281+0000 7f5655291700 1 -- 172.21.15.59:0/776961871 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564800bbd0 con 0x7f56500708f0 2023-09-21T00:17:45.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.281+0000 7f5655291700 1 -- 172.21.15.59:0/776961871 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5648012430 con 0x7f56500708f0 2023-09-21T00:17:45.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.281+0000 7f56584f7700 1 -- 172.21.15.59:0/776961871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56500708f0 msgr2=0x7f56500b44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:45.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.281+0000 7f56584f7700 1 --2- 172.21.15.59:0/776961871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56500708f0 0x7f56500b44c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f56500cdbc0 tx=0x7f564800b330 comp rx=0 tx=0).stop 2023-09-21T00:17:45.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.281+0000 7f56584f7700 1 -- 172.21.15.59:0/776961871 shutdown_connections 2023-09-21T00:17:45.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.281+0000 7f56584f7700 1 --2- 172.21.15.59:0/776961871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56500708f0 0x7f56500b44c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:45.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.281+0000 7f56584f7700 1 --2- 172.21.15.59:0/776961871 >> v2:172.21.15.83:3300/0 conn(0x7f565015b480 0x7f565006f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:45.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.281+0000 7f56584f7700 1 -- 172.21.15.59:0/776961871 >> 172.21.15.59:0/776961871 conn(0x7f56500d11e0 msgr2=0x7f56500d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:45.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.281+0000 7f56584f7700 1 -- 172.21.15.59:0/776961871 shutdown_connections 2023-09-21T00:17:45.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.281+0000 7f56584f7700 1 -- 172.21.15.59:0/776961871 wait complete. 2023-09-21T00:17:45.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.282+0000 7f56584f7700 1 Processor -- start 2023-09-21T00:17:45.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.283+0000 7f56584f7700 1 -- start start 2023-09-21T00:17:45.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.283+0000 7f56584f7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56500708f0 0x7f56500ca590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:45.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.283+0000 7f56584f7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56500d0820 0x7f5650157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:45.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.283+0000 7f56584f7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f565015b480 0x7f56500cf620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:45.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.283+0000 7f56584f7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56500c9250 con 0x7f56500d0820 2023-09-21T00:17:45.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.283+0000 7f56584f7700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56500c94f0 con 0x7f565015b480 2023-09-21T00:17:45.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.283+0000 7f56584f7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56500c97d0 con 0x7f56500708f0 2023-09-21T00:17:45.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.283+0000 7f5655a92700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56500d0820 0x7f5650157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:45.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.283+0000 7f5655a92700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56500d0820 0x7f5650157690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52108/0 (socket says 172.21.15.59:52108) 2023-09-21T00:17:45.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.283+0000 7f5655a92700 1 -- 172.21.15.59:0/3346965579 learned_addr learned my addr 172.21.15.59:0/3346965579 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:45.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.284+0000 7f5656293700 1 --2- 172.21.15.59:0/3346965579 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56500708f0 0x7f56500ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:45.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.284+0000 7f5656a94700 1 --2- 172.21.15.59:0/3346965579 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f565015b480 0x7f56500cf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:45.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.284+0000 7f5655a92700 1 -- 172.21.15.59:0/3346965579 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56500708f0 msgr2=0x7f56500ca590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:45.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.284+0000 7f5655a92700 1 --2- 172.21.15.59:0/3346965579 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56500708f0 0x7f56500ca590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:45.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.284+0000 7f5655a92700 1 -- 172.21.15.59:0/3346965579 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f565015b480 msgr2=0x7f56500cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:45.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.284+0000 7f5655a92700 1 --2- 172.21.15.59:0/3346965579 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f565015b480 0x7f56500cf620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:45.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.284+0000 7f5655a92700 1 -- 172.21.15.59:0/3346965579 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5648009a70 con 0x7f56500d0820 2023-09-21T00:17:45.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.284+0000 7f5655a92700 1 --2- 172.21.15.59:0/3346965579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56500d0820 0x7f5650157690 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f564000c480 tx=0x7f564000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:45.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.284+0000 7f5646ffd700 1 -- 172.21.15.59:0/3346965579 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5640005d70 con 0x7f56500d0820 2023-09-21T00:17:45.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.284+0000 7f5646ffd700 1 -- 172.21.15.59:0/3346965579 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56400070d0 con 0x7f56500d0820 2023-09-21T00:17:45.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.284+0000 7f56584f7700 1 -- 172.21.15.59:0/3346965579 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f565015b9e0 con 0x7f56500d0820 2023-09-21T00:17:45.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.284+0000 7f5646ffd700 1 -- 172.21.15.59:0/3346965579 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5640007440 con 0x7f56500d0820 2023-09-21T00:17:45.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.284+0000 7f56584f7700 1 -- 172.21.15.59:0/3346965579 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56500c9d90 con 0x7f56500d0820 2023-09-21T00:17:45.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.285+0000 7f56584f7700 1 -- 172.21.15.59:0/3346965579 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5650067e50 con 0x7f56500d0820 2023-09-21T00:17:45.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.285+0000 7f5646ffd700 1 -- 172.21.15.59:0/3346965579 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f56400075a0 con 0x7f56500d0820 2023-09-21T00:17:45.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.286+0000 7f5646ffd700 1 --2- 172.21.15.59:0/3346965579 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f563406ae00 0x7f563406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:45.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.286+0000 7f5646ffd700 1 -- 172.21.15.59:0/3346965579 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5640088be0 con 0x7f56500d0820 2023-09-21T00:17:45.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.286+0000 7f5656293700 1 --2- 172.21.15.59:0/3346965579 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f563406ae00 0x7f563406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:45.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.287+0000 7f5656293700 1 --2- 172.21.15.59:0/3346965579 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f563406ae00 0x7f563406d2c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f56501590f0 tx=0x7f564c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:45.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.290+0000 7f5646ffd700 1 -- 172.21.15.59:0/3346965579 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f5640053b50 con 0x7f56500d0820 2023-09-21T00:17:45.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.539+0000 7f56584f7700 1 -- 172.21.15.59:0/3346965579 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f565006f5e0 con 0x7f56500d0820 2023-09-21T00:17:45.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.540+0000 7f5646ffd700 1 -- 172.21.15.59:0/3346965579 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f5640017070 con 0x7f56500d0820 2023-09-21T00:17:45.541 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-09-21T00:17:45.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.542+0000 7f56584f7700 1 -- 172.21.15.59:0/3346965579 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f563406ae00 msgr2=0x7f563406d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:45.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.542+0000 7f56584f7700 1 --2- 172.21.15.59:0/3346965579 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f563406ae00 0x7f563406d2c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f56501590f0 tx=0x7f564c008040 comp rx=0 tx=0).stop 2023-09-21T00:17:45.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.542+0000 7f56584f7700 1 -- 172.21.15.59:0/3346965579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56500d0820 msgr2=0x7f5650157690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:45.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.542+0000 7f56584f7700 1 --2- 172.21.15.59:0/3346965579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56500d0820 0x7f5650157690 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f564000c480 tx=0x7f564000c840 comp rx=0 tx=0).stop 2023-09-21T00:17:45.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.542+0000 7f56584f7700 1 -- 172.21.15.59:0/3346965579 shutdown_connections 2023-09-21T00:17:45.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.542+0000 7f56584f7700 1 --2- 172.21.15.59:0/3346965579 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f565015b480 0x7f56500cf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:45.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.542+0000 7f56584f7700 1 --2- 172.21.15.59:0/3346965579 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f563406ae00 0x7f563406d2c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:45.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.542+0000 7f56584f7700 1 --2- 172.21.15.59:0/3346965579 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56500708f0 0x7f56500ca590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:45.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.542+0000 7f56584f7700 1 --2- 172.21.15.59:0/3346965579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56500d0820 0x7f5650157690 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:45.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.542+0000 7f56584f7700 1 -- 172.21.15.59:0/3346965579 >> 172.21.15.59:0/3346965579 conn(0x7f56500d11e0 msgr2=0x7f56500b2430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:45.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.542+0000 7f56584f7700 1 -- 172.21.15.59:0/3346965579 shutdown_connections 2023-09-21T00:17:45.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:45.542+0000 7f56584f7700 1 -- 172.21.15.59:0/3346965579 wait complete. 2023-09-21T00:17:45.555 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-21T00:17:45.555 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-21T00:17:45.556 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2023-09-21T00:17:45.556 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-09-21T00:17:45.556 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-09-21T00:17:45.556 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-21T00:17:45.557 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-21T00:17:45.557 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-21T00:17:45.557 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-09-21T00:17:45.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:45.558 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2023-09-21T00:17:45.576 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-21T00:17:45.576 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-21T00:17:45.576 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2023-09-21T00:17:45.577 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-09-21T00:17:45.577 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2023-09-21T00:17:45.577 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-09-21T00:17:45.577 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-21T00:17:45.577 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2023-09-21T00:17:45.578 INFO:teuthology.orchestra.run.smithi059.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-21T00:17:45.578 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2023-09-21T00:17:45.578 INFO:teuthology.orchestra.run.smithi059.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-21T00:17:45.578 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2023-09-21T00:17:45.578 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-09-21T00:17:45.579 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 42374sec preferred_lft 42374sec 2023-09-21T00:17:45.579 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2023-09-21T00:17:45.579 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-09-21T00:17:45.579 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-21T00:17:45.579 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2023-09-21T00:17:45.579 INFO:teuthology.orchestra.run.smithi059.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-21T00:17:45.580 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 86:97:cb:1d:6b:91 brd ff:ff:ff:ff:ff:ff 2023-09-21T00:17:45.580 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-21T00:17:45.580 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-09-21T00:17:45.580 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::d8c6:8cff:fe74:f12b/64 scope link 2023-09-21T00:17:45.580 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-09-21T00:17:45.581 INFO:teuthology.orchestra.run.smithi059.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-21T00:17:45.581 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 86:97:cb:1d:6b:91 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-21T00:17:45.581 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::8497:cbff:fe1d:6b91/64 scope link 2023-09-21T00:17:45.581 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-09-21T00:17:45.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:45.583 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-21T00:17:45.643 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-09-21T00:17:45.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:45.644 DEBUG:teuthology.orchestra.run.smithi059:> route 2023-09-21T00:17:45.703 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2023-09-21T00:17:45.703 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-21T00:17:45.703 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-09-21T00:17:45.704 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-09-21T00:17:45.704 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-21T00:17:45.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:45.705 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-09-21T00:17:45.705 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-09-21T00:17:45.705 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-09-21T00:17:45.706 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-09-21T00:17:45.706 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-09-21T00:17:45.706 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-09-21T00:17:45.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:45.811 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2023-09-21T00:17:45.829 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-21T00:17:45.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:45.830 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list-id 2023-09-21T00:17:45.886 INFO:teuthology.orchestra.run.smithi059.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-09-21T00:17:45.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:45.887 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-09-21T00:17:45.887 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-09-21T00:17:45.888 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-21T00:17:45.888 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-09-21T00:17:45.888 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-09-21T00:17:45.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:45.983 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-09-21T00:17:46.022 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-21T00:17:46.022 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-21T00:17:46.022 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2023-09-21T00:17:46.022 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-09-21T00:17:46.023 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2023-09-21T00:17:46.023 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-09-21T00:17:46.023 INFO:teuthology.orchestra.run.smithi059.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-21T00:17:46.023 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 32:fe:8a:8c:9b:59 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-09-21T00:17:46.023 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-09-21T00:17:46.024 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-09-21T00:17:46.024 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::30fe:8aff:fe8c:9b59/64 scope link tentative 2023-09-21T00:17:46.024 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-09-21T00:17:46.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:46.036 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-09-21T00:17:46.115 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-21T00:17:46.116 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-21T00:17:46.116 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2023-09-21T00:17:46.116 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-09-21T00:17:46.116 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2023-09-21T00:17:46.117 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-09-21T00:17:46.117 INFO:teuthology.orchestra.run.smithi059.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-21T00:17:46.117 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 32:fe:8a:8c:9b:59 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-09-21T00:17:46.117 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-09-21T00:17:46.117 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-09-21T00:17:46.118 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::30fe:8aff:fe8c:9b59/64 scope link tentative 2023-09-21T00:17:46.118 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-09-21T00:17:46.130 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-09-21T00:17:46.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:46.131 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-09-21T00:17:46.131 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-09-21T00:17:46.131 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-09-21T00:17:46.132 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-09-21T00:17:46.132 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-09-21T00:17:46.132 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-09-21T00:17:46.133 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-09-21T00:17:46.133 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-09-21T00:17:46.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:46.378 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-09-21T00:17:46.378 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-09-21T00:17:46.379 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.1 up 2023-09-21T00:17:46.379 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set dev brx.1 master ceph-brx 2023-09-21T00:17:46.379 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-09-21T00:17:46.494 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-21T00:17:46.495 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-09-21T00:17:46.517 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-09-21T00:17:46.518 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-21T00:17:46.518 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-09-21T00:17:46.574 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-21T00:17:46.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:46.575 DEBUG:teuthology.orchestra.run.smithi059:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-09-21T00:17:46.661 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-09-21T00:17:46.662 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-09-21T00:17:46.662 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-09-21T00:17:46.670 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-09-21T00:17:46.670 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-09-21T00:17:46.670 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-09-21T00:17:46.671 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-09-21T00:17:46.671 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-21T00:17:46.743 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-09-21T00:17:46.744 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-09-21T00:17:46.744 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-09-21T00:17:46.744 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-09-21T00:17:46.744 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-21T00:17:46.745 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:6789,172.21.15.83:6789,172.21.15.83:6790" 2023-09-21T00:17:46.745 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.59:6789,172.21.15.83:6789,172.21.15.83:6790:/ 2023-09-21T00:17:46.745 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=dd69925c-6e25-42fe-880b-2f60fc6f384b" will pass to kernel 2023-09-21T00:17:46.746 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-21T00:17:46.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:46.747 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-09-21T00:17:46.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:46.774 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-21T00:17:46.847 INFO:teuthology.orchestra.run.smithi059.stdout:client4640 2023-09-21T00:17:46.847 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-21T00:17:46.848 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-21T00:17:46.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:46.905 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-21T00:17:46.978 INFO:teuthology.orchestra.run.smithi059.stdout:client4640 2023-09-21T00:17:46.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:46.979 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-21T00:17:47.052 INFO:teuthology.orchestra.run.smithi059.stdout:client4640 2023-09-21T00:17:47.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:47.053 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/dd69925c-6e25-42fe-880b-2f60fc6f384b.client4640/status') 2023-09-21T00:17:47.134 INFO:teuthology.orchestra.run.smithi059.stdout:instance: client.4640 (3)172.21.15.59:0/2368510170 2023-09-21T00:17:47.135 INFO:teuthology.orchestra.run.smithi059.stdout:blocklisted: false 2023-09-21T00:17:47.136 INFO:teuthology.orchestra.run.smithi059.stderr:0+1 records in 2023-09-21T00:17:47.136 INFO:teuthology.orchestra.run.smithi059.stderr:0+1 records out 2023-09-21T00:17:47.136 INFO:teuthology.orchestra.run.smithi059.stderr:70 bytes copied, 2.7801e-05 s, 2.5 MB/s 2023-09-21T00:17:47.136 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-09-21T00:17:47.137 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-09-21T00:17:47.137 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-09-21T00:17:47.137 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-21T00:17:47.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.301+0000 7f914d5c3700 1 Processor -- start 2023-09-21T00:17:47.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.301+0000 7f914d5c3700 1 -- start start 2023-09-21T00:17:47.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.302+0000 7f914d5c3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f914815d7e0 0x7f91480cf120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:47.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.302+0000 7f914d5c3700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f91480d11b0 0x7f91480b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:47.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.302+0000 7f914d5c3700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91480d1720 con 0x7f91480cf660 2023-09-21T00:17:47.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.302+0000 7f914d5c3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91480ced00 con 0x7f914815d7e0 2023-09-21T00:17:47.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.302+0000 7f914d5c3700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91480ce360 con 0x7f91480d11b0 2023-09-21T00:17:47.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.302+0000 7f9146ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f914815d7e0 0x7f91480cf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:47.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.302+0000 7f9146ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f914815d7e0 0x7f91480cf120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52118/0 (socket says 172.21.15.59:52118) 2023-09-21T00:17:47.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.302+0000 7f9146ffd700 1 -- 172.21.15.59:0/3859741859 learned_addr learned my addr 172.21.15.59:0/3859741859 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:47.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.302+0000 7f91467fc700 1 --2- 172.21.15.59:0/3859741859 >> v2:172.21.15.83:3300/0 conn(0x7f91480d11b0 0x7f91480b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:47.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.302+0000 7f9146ffd700 1 -- 172.21.15.59:0/3859741859 >> v2:172.21.15.83:3300/0 conn(0x7f91480d11b0 msgr2=0x7f91480b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:47.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.302+0000 7f9146ffd700 1 --2- 172.21.15.59:0/3859741859 >> v2:172.21.15.83:3300/0 conn(0x7f91480d11b0 0x7f91480b2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:47.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.302+0000 7f9146ffd700 1 -- 172.21.15.59:0/3859741859 >> v1:172.21.15.83:6789/0 conn(0x7f91480cf660 legacy=0x7f91480d1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:47.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.302+0000 7f9146ffd700 1 -- 172.21.15.59:0/3859741859 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91480ce640 con 0x7f914815d7e0 2023-09-21T00:17:47.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.302+0000 7f91467fc700 1 --2- 172.21.15.59:0/3859741859 >> v2:172.21.15.83:3300/0 conn(0x7f91480d11b0 0x7f91480b2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:17:47.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.302+0000 7f9146ffd700 1 --2- 172.21.15.59:0/3859741859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f914815d7e0 0x7f91480cf120 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f91480ca450 tx=0x7f913c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e520e77b91fad95d server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:47.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.303+0000 7f9145ffb700 1 -- 172.21.15.59:0/3859741859 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c005e30 con 0x7f914815d7e0 2023-09-21T00:17:47.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.303+0000 7f9145ffb700 1 -- 172.21.15.59:0/3859741859 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913c006030 con 0x7f914815d7e0 2023-09-21T00:17:47.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.303+0000 7f9145ffb700 1 -- 172.21.15.59:0/3859741859 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c0063e0 con 0x7f914815d7e0 2023-09-21T00:17:47.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.303+0000 7f914d5c3700 1 -- 172.21.15.59:0/3859741859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f914815d7e0 msgr2=0x7f91480cf120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:47.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.303+0000 7f914d5c3700 1 --2- 172.21.15.59:0/3859741859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f914815d7e0 0x7f91480cf120 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f91480ca450 tx=0x7f913c009bd0 comp rx=0 tx=0).stop 2023-09-21T00:17:47.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.303+0000 7f914d5c3700 1 -- 172.21.15.59:0/3859741859 shutdown_connections 2023-09-21T00:17:47.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.303+0000 7f914d5c3700 1 --2- 172.21.15.59:0/3859741859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f914815d7e0 0x7f91480cf120 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:47.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.303+0000 7f914d5c3700 1 --2- 172.21.15.59:0/3859741859 >> v2:172.21.15.83:3300/0 conn(0x7f91480d11b0 0x7f91480b2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:47.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.303+0000 7f914d5c3700 1 -- 172.21.15.59:0/3859741859 >> 172.21.15.59:0/3859741859 conn(0x7f914809c740 msgr2=0x7f91480d33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:47.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.303+0000 7f914d5c3700 1 -- 172.21.15.59:0/3859741859 shutdown_connections 2023-09-21T00:17:47.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.303+0000 7f914d5c3700 1 -- 172.21.15.59:0/3859741859 wait complete. 2023-09-21T00:17:47.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.305+0000 7f914d5c3700 1 Processor -- start 2023-09-21T00:17:47.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.305+0000 7f914d5c3700 1 -- start start 2023-09-21T00:17:47.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.305+0000 7f914d5c3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91480cf660 0x7f91480b66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:47.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.305+0000 7f914d5c3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91480d11b0 0x7f914814a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:47.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.305+0000 7f914d5c3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f914815d7e0 0x7f91480b3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:47.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.305+0000 7f914d5c3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91480ca4a0 con 0x7f91480cf660 2023-09-21T00:17:47.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.305+0000 7f914d5c3700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91480cd630 con 0x7f91480d11b0 2023-09-21T00:17:47.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.305+0000 7f914d5c3700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91480ca6f0 con 0x7f914815d7e0 2023-09-21T00:17:47.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.305+0000 7f9146ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91480cf660 0x7f91480b66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:47.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.305+0000 7f9146ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91480cf660 0x7f91480b66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52124/0 (socket says 172.21.15.59:52124) 2023-09-21T00:17:47.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.305+0000 7f9146ffd700 1 -- 172.21.15.59:0/1342760700 learned_addr learned my addr 172.21.15.59:0/1342760700 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:47.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.306+0000 7f91467fc700 1 --2- 172.21.15.59:0/1342760700 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91480d11b0 0x7f914814a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:47.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.306+0000 7f91477fe700 1 --2- 172.21.15.59:0/1342760700 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f914815d7e0 0x7f91480b3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:47.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.306+0000 7f9146ffd700 1 -- 172.21.15.59:0/1342760700 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f914815d7e0 msgr2=0x7f91480b3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:47.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.306+0000 7f9146ffd700 1 --2- 172.21.15.59:0/1342760700 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f914815d7e0 0x7f91480b3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:47.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.306+0000 7f9146ffd700 1 -- 172.21.15.59:0/1342760700 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91480d11b0 msgr2=0x7f914814a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:47.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.306+0000 7f9146ffd700 1 --2- 172.21.15.59:0/1342760700 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91480d11b0 0x7f914814a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:47.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.306+0000 7f9146ffd700 1 -- 172.21.15.59:0/1342760700 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f913c009500 con 0x7f91480cf660 2023-09-21T00:17:47.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.306+0000 7f91467fc700 1 --2- 172.21.15.59:0/1342760700 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91480d11b0 0x7f914814a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:17:47.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.306+0000 7f9146ffd700 1 --2- 172.21.15.59:0/1342760700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91480cf660 0x7f91480b66e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f913c013040 tx=0x7f913c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:47.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.306+0000 7f912f7fe700 1 -- 172.21.15.59:0/1342760700 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c004250 con 0x7f91480cf660 2023-09-21T00:17:47.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.306+0000 7f912f7fe700 1 -- 172.21.15.59:0/1342760700 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913c0043f0 con 0x7f91480cf660 2023-09-21T00:17:47.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.306+0000 7f912f7fe700 1 -- 172.21.15.59:0/1342760700 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c0038e0 con 0x7f91480cf660 2023-09-21T00:17:47.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.306+0000 7f914d5c3700 1 -- 172.21.15.59:0/1342760700 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91480ca9d0 con 0x7f91480cf660 2023-09-21T00:17:47.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.306+0000 7f914d5c3700 1 -- 172.21.15.59:0/1342760700 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91480b44f0 con 0x7f91480cf660 2023-09-21T00:17:47.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.307+0000 7f914d5c3700 1 -- 172.21.15.59:0/1342760700 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91480b2ba0 con 0x7f91480cf660 2023-09-21T00:17:47.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.308+0000 7f912f7fe700 1 -- 172.21.15.59:0/1342760700 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f913c022070 con 0x7f91480cf660 2023-09-21T00:17:47.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.308+0000 7f912f7fe700 1 --2- 172.21.15.59:0/1342760700 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f913406ae00 0x7f913406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:47.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.308+0000 7f912f7fe700 1 -- 172.21.15.59:0/1342760700 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f913c08b110 con 0x7f91480cf660 2023-09-21T00:17:47.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.308+0000 7f91467fc700 1 --2- 172.21.15.59:0/1342760700 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f913406ae00 0x7f913406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:47.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.309+0000 7f91467fc700 1 --2- 172.21.15.59:0/1342760700 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f913406ae00 0x7f913406d2c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9148150e30 tx=0x7f9138008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:47.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.313+0000 7f912f7fe700 1 -- 172.21.15.59:0/1342760700 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f913c055fd0 con 0x7f91480cf660 2023-09-21T00:17:47.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.558+0000 7f914d5c3700 1 -- 172.21.15.59:0/1342760700 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9148067e50 con 0x7f91480cf660 2023-09-21T00:17:47.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.559+0000 7f912f7fe700 1 -- 172.21.15.59:0/1342760700 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f913c0595f0 con 0x7f91480cf660 2023-09-21T00:17:47.560 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-09-21T00:17:47.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.560+0000 7f914d5c3700 1 -- 172.21.15.59:0/1342760700 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f913406ae00 msgr2=0x7f913406d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:47.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.560+0000 7f914d5c3700 1 --2- 172.21.15.59:0/1342760700 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f913406ae00 0x7f913406d2c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9148150e30 tx=0x7f9138008040 comp rx=0 tx=0).stop 2023-09-21T00:17:47.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.560+0000 7f914d5c3700 1 -- 172.21.15.59:0/1342760700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91480cf660 msgr2=0x7f91480b66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:47.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.560+0000 7f914d5c3700 1 --2- 172.21.15.59:0/1342760700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91480cf660 0x7f91480b66e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f913c013040 tx=0x7f913c004750 comp rx=0 tx=0).stop 2023-09-21T00:17:47.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.561+0000 7f914d5c3700 1 -- 172.21.15.59:0/1342760700 shutdown_connections 2023-09-21T00:17:47.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.561+0000 7f914d5c3700 1 --2- 172.21.15.59:0/1342760700 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f913406ae00 0x7f913406d2c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:47.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.561+0000 7f914d5c3700 1 --2- 172.21.15.59:0/1342760700 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f914815d7e0 0x7f91480b3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:47.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.561+0000 7f914d5c3700 1 --2- 172.21.15.59:0/1342760700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91480cf660 0x7f91480b66e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:47.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.561+0000 7f914d5c3700 1 --2- 172.21.15.59:0/1342760700 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91480d11b0 0x7f914814a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:47.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.561+0000 7f914d5c3700 1 -- 172.21.15.59:0/1342760700 >> 172.21.15.59:0/1342760700 conn(0x7f914809c740 msgr2=0x7f91480d1940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:47.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.561+0000 7f914d5c3700 1 -- 172.21.15.59:0/1342760700 shutdown_connections 2023-09-21T00:17:47.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:47.561+0000 7f914d5c3700 1 -- 172.21.15.59:0/1342760700 wait complete. 2023-09-21T00:17:47.574 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-21T00:17:47.574 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-21T00:17:47.574 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi083.front.sepia.ceph.com 2023-09-21T00:17:47.575 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-09-21T00:17:47.575 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-09-21T00:17:47.575 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-21T00:17:47.576 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-21T00:17:47.576 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-21T00:17:47.576 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-21T00:17:47.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:47.577 DEBUG:teuthology.orchestra.run.smithi083:> ip addr 2023-09-21T00:17:47.598 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-21T00:17:47.598 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-21T00:17:47.598 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2023-09-21T00:17:47.598 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-09-21T00:17:47.599 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2023-09-21T00:17:47.599 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-09-21T00:17:47.599 INFO:teuthology.orchestra.run.smithi083.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-21T00:17:47.599 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1e brd ff:ff:ff:ff:ff:ff 2023-09-21T00:17:47.600 INFO:teuthology.orchestra.run.smithi083.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-21T00:17:47.600 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1f brd ff:ff:ff:ff:ff:ff 2023-09-21T00:17:47.600 INFO:teuthology.orchestra.run.smithi083.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-21T00:17:47.600 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:90 brd ff:ff:ff:ff:ff:ff 2023-09-21T00:17:47.600 INFO:teuthology.orchestra.run.smithi083.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-21T00:17:47.601 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:91 brd ff:ff:ff:ff:ff:ff 2023-09-21T00:17:47.601 INFO:teuthology.orchestra.run.smithi083.stdout: inet 172.21.15.83/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-21T00:17:47.601 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft 42386sec preferred_lft 42386sec 2023-09-21T00:17:47.602 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::121b:7135:3b7e:4f8c/64 scope link noprefixroute 2023-09-21T00:17:47.602 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-09-21T00:17:47.602 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-09-21T00:17:47.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:47.603 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-09-21T00:17:47.603 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-09-21T00:17:47.604 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link add name ceph-brx type bridge 2023-09-21T00:17:47.604 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip addr flush dev ceph-brx 2023-09-21T00:17:47.604 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set ceph-brx up 2023-09-21T00:17:47.605 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-09-21T00:17:47.605 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-09-21T00:17:47.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:47.781 DEBUG:teuthology.orchestra.run.smithi083:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-21T00:17:47.810 INFO:teuthology.orchestra.run.smithi083.stdout:1 2023-09-21T00:17:47.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:47.811 DEBUG:teuthology.orchestra.run.smithi083:> route 2023-09-21T00:17:47.879 INFO:teuthology.orchestra.run.smithi083.stdout:Kernel IP routing table 2023-09-21T00:17:47.879 INFO:teuthology.orchestra.run.smithi083.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-21T00:17:47.880 INFO:teuthology.orchestra.run.smithi083.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-21T00:17:47.880 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-21T00:17:47.880 INFO:teuthology.orchestra.run.smithi083.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-21T00:17:47.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:47.881 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-09-21T00:17:47.881 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-09-21T00:17:47.881 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-21T00:17:47.881 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-21T00:17:47.882 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-21T00:17:47.882 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-09-21T00:17:48.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:48.123 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2023-09-21T00:17:48.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:48.141 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list-id 2023-09-21T00:17:48.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:48.198 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-09-21T00:17:48.198 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-09-21T00:17:48.199 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-21T00:17:48.199 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-09-21T00:17:48.199 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-09-21T00:17:48.291 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-09-21T00:17:48.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:48.292 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-09-21T00:17:48.292 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-09-21T00:17:48.293 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-09-21T00:17:48.293 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-09-21T00:17:48.293 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-09-21T00:17:48.294 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-09-21T00:17:48.294 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-09-21T00:17:48.294 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-09-21T00:17:48.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:48.504 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-09-21T00:17:48.504 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-09-21T00:17:48.504 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set brx.0 up 2023-09-21T00:17:48.504 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set dev brx.0 master ceph-brx 2023-09-21T00:17:48.505 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-09-21T00:17:48.602 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-21T00:17:48.603 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-09-21T00:17:48.623 INFO:teuthology.orchestra.run.smithi083.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-09-21T00:17:48.623 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-21T00:17:48.624 DEBUG:teuthology.orchestra.run.smithi083:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-09-21T00:17:48.680 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-21T00:17:48.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:48.680 DEBUG:teuthology.orchestra.run.smithi083:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-21T00:17:48.775 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-21T00:17:48.775 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-21T00:17:48.776 INFO:teuthology.orchestra.run.smithi083.stdout:invalid new device string format 2023-09-21T00:17:48.881 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-21T00:17:48.882 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-21T00:17:48.882 INFO:teuthology.orchestra.run.smithi083.stdout:invalid new device string format 2023-09-21T00:17:48.882 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-09-21T00:17:48.882 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-21T00:17:48.906 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-09-21T00:17:48.906 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-09-21T00:17:48.906 INFO:teuthology.orchestra.run.smithi083.stdout:invalid new device string format 2023-09-21T00:17:48.906 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-09-21T00:17:48.907 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-21T00:17:48.907 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.59:6789,172.21.15.83:6789,172.21.15.83:6790" 2023-09-21T00:17:48.907 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.59:6789,172.21.15.83:6789,172.21.15.83:6790:/ 2023-09-21T00:17:48.907 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=dd69925c-6e25-42fe-880b-2f60fc6f384b" will pass to kernel 2023-09-21T00:17:48.909 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-21T00:17:48.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:48.910 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-09-21T00:17:48.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:48.941 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-21T00:17:49.012 INFO:teuthology.orchestra.run.smithi083.stdout:client4819 2023-09-21T00:17:49.012 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-09-21T00:17:49.013 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-21T00:17:49.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:49.070 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-21T00:17:49.142 INFO:teuthology.orchestra.run.smithi083.stdout:client4819 2023-09-21T00:17:49.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:49.143 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-21T00:17:49.214 INFO:teuthology.orchestra.run.smithi083.stdout:client4819 2023-09-21T00:17:49.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:49.215 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/dd69925c-6e25-42fe-880b-2f60fc6f384b.client4819/status') 2023-09-21T00:17:49.294 INFO:teuthology.orchestra.run.smithi083.stdout:instance: client.4819 (3)192.168.0.1:0/4019717082 2023-09-21T00:17:49.295 INFO:teuthology.orchestra.run.smithi083.stdout:blocklisted: false 2023-09-21T00:17:49.296 INFO:teuthology.orchestra.run.smithi083.stderr:0+1 records in 2023-09-21T00:17:49.296 INFO:teuthology.orchestra.run.smithi083.stderr:0+1 records out 2023-09-21T00:17:49.296 INFO:teuthology.orchestra.run.smithi083.stderr:69 bytes copied, 2.8774e-05 s, 2.4 MB/s 2023-09-21T00:17:49.297 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-09-21T00:17:49.297 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-09-21T00:17:49.297 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-09-21T00:17:49.298 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-21T00:17:49.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.437+0000 7f17125c9700 1 Processor -- start 2023-09-21T00:17:49.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.437+0000 7f17125c9700 1 -- start start 2023-09-21T00:17:49.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.437+0000 7f17125c9700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f170c143ce0 0x7f170c161280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:49.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.437+0000 7f17125c9700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f170c0cedb0 0x7f170c0cf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:49.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.437+0000 7f17125c9700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f170c0cf740 con 0x7f170c15d690 2023-09-21T00:17:49.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.437+0000 7f17125c9700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f170c071220 con 0x7f170c0cedb0 2023-09-21T00:17:49.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.437+0000 7f17125c9700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f170c162170 con 0x7f170c143ce0 2023-09-21T00:17:49.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.438+0000 7f170b7fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f170c143ce0 0x7f170c161280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:49.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.438+0000 7f1710b66700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f170c0cedb0 0x7f170c0cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:49.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.438+0000 7f1710b66700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f170c0cedb0 0x7f170c0cf200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.59:38254/0 (socket says 172.21.15.59:38254) 2023-09-21T00:17:49.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.438+0000 7f170b7fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f170c143ce0 0x7f170c161280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.59:52752/0 (socket says 172.21.15.59:52752) 2023-09-21T00:17:49.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.438+0000 7f170bfff700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f170c15d690 0x7f170c070b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.59:48202/0 (socket says 172.21.15.59:48202) 2023-09-21T00:17:49.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.438+0000 7f1710b66700 1 -- 172.21.15.59:0/19643738 learned_addr learned my addr 172.21.15.59:0/19643738 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:49.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.438+0000 7f170b7fe700 1 -- 172.21.15.59:0/19643738 >> v2:172.21.15.83:3300/0 conn(0x7f170c0cedb0 msgr2=0x7f170c0cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:49.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.438+0000 7f170b7fe700 1 --2- 172.21.15.59:0/19643738 >> v2:172.21.15.83:3300/0 conn(0x7f170c0cedb0 0x7f170c0cf200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:49.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.438+0000 7f170b7fe700 1 -- 172.21.15.59:0/19643738 >> v1:172.21.15.83:6789/0 conn(0x7f170c15d690 legacy=0x7f170c070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:49.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.438+0000 7f170b7fe700 1 -- 172.21.15.59:0/19643738 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f170c161bb0 con 0x7f170c143ce0 2023-09-21T00:17:49.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.438+0000 7f170affd700 1 -- 172.21.15.59:0/19643738 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2000027386 0 0) 0x7f16fc001110 con 0x7f170c15d690 2023-09-21T00:17:49.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.438+0000 7f1710b66700 1 --2- 172.21.15.59:0/19643738 >> v2:172.21.15.83:3300/0 conn(0x7f170c0cedb0 0x7f170c0cf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T00:17:49.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.438+0000 7f170b7fe700 1 --2- 172.21.15.59:0/19643738 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f170c143ce0 0x7f170c161280 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1700009840 tx=0x7f1700009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6c5a825fa31dc3f server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:49.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.439+0000 7f170affd700 1 -- 172.21.15.59:0/19643738 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1700011830 con 0x7f170c143ce0 2023-09-21T00:17:49.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.439+0000 7f170affd700 1 -- 172.21.15.59:0/19643738 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1700011990 con 0x7f170c143ce0 2023-09-21T00:17:49.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.439+0000 7f170affd700 1 -- 172.21.15.59:0/19643738 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1700011d20 con 0x7f170c143ce0 2023-09-21T00:17:49.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.439+0000 7f17125c9700 1 -- 172.21.15.59:0/19643738 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f170c143ce0 msgr2=0x7f170c161280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:49.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.439+0000 7f17125c9700 1 --2- 172.21.15.59:0/19643738 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f170c143ce0 0x7f170c161280 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1700009840 tx=0x7f1700009b50 comp rx=0 tx=0).stop 2023-09-21T00:17:49.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.439+0000 7f17125c9700 1 -- 172.21.15.59:0/19643738 shutdown_connections 2023-09-21T00:17:49.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.439+0000 7f17125c9700 1 --2- 172.21.15.59:0/19643738 >> v2:172.21.15.83:3300/0 conn(0x7f170c0cedb0 0x7f170c0cf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:49.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.439+0000 7f17125c9700 1 --2- 172.21.15.59:0/19643738 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f170c143ce0 0x7f170c161280 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:49.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.439+0000 7f17125c9700 1 -- 172.21.15.59:0/19643738 >> 172.21.15.59:0/19643738 conn(0x7f170c0d11e0 msgr2=0x7f170c0d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:49.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.439+0000 7f17125c9700 1 -- 172.21.15.59:0/19643738 shutdown_connections 2023-09-21T00:17:49.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.439+0000 7f17125c9700 1 -- 172.21.15.59:0/19643738 wait complete. 2023-09-21T00:17:49.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.440+0000 7f17125c9700 1 Processor -- start 2023-09-21T00:17:49.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.441+0000 7f17125c9700 1 -- start start 2023-09-21T00:17:49.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.441+0000 7f17125c9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f170c0cedb0 0x7f170c0c6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:49.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.442+0000 7f17125c9700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f170c143ce0 0x7f170c145130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:49.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.442+0000 7f17125c9700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f170c15d690 0x7f170c145670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:49.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.442+0000 7f17125c9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170c1f42e0 con 0x7f170c0cedb0 2023-09-21T00:17:49.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.442+0000 7f17125c9700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170c0c7970 con 0x7f170c15d690 2023-09-21T00:17:49.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.442+0000 7f17125c9700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f170c1f4530 con 0x7f170c143ce0 2023-09-21T00:17:49.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.442+0000 7f170bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f170c0cedb0 0x7f170c0c6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:49.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.442+0000 7f170bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f170c0cedb0 0x7f170c0c6f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52140/0 (socket says 172.21.15.59:52140) 2023-09-21T00:17:49.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.442+0000 7f170bfff700 1 -- 172.21.15.59:0/1008016321 learned_addr learned my addr 172.21.15.59:0/1008016321 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:49.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.442+0000 7f170b7fe700 1 --2- 172.21.15.59:0/1008016321 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f170c143ce0 0x7f170c145130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:49.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.442+0000 7f1710b66700 1 --2- 172.21.15.59:0/1008016321 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f170c15d690 0x7f170c145670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:49.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.442+0000 7f170bfff700 1 -- 172.21.15.59:0/1008016321 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f170c143ce0 msgr2=0x7f170c145130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:49.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.442+0000 7f170bfff700 1 --2- 172.21.15.59:0/1008016321 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f170c143ce0 0x7f170c145130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:49.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.442+0000 7f170bfff700 1 -- 172.21.15.59:0/1008016321 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f170c15d690 msgr2=0x7f170c145670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:49.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.442+0000 7f170bfff700 1 --2- 172.21.15.59:0/1008016321 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f170c15d690 0x7f170c145670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:49.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.442+0000 7f170bfff700 1 -- 172.21.15.59:0/1008016321 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1704009b30 con 0x7f170c0cedb0 2023-09-21T00:17:49.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.442+0000 7f170bfff700 1 --2- 172.21.15.59:0/1008016321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f170c0cedb0 0x7f170c0c6f90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f16fc00c730 tx=0x7f16fc00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:49.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.442+0000 7f1708ff9700 1 -- 172.21.15.59:0/1008016321 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16fc004c80 con 0x7f170c0cedb0 2023-09-21T00:17:49.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.442+0000 7f1708ff9700 1 -- 172.21.15.59:0/1008016321 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16fc004e00 con 0x7f170c0cedb0 2023-09-21T00:17:49.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.442+0000 7f17125c9700 1 -- 172.21.15.59:0/1008016321 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17000094a0 con 0x7f170c0cedb0 2023-09-21T00:17:49.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.443+0000 7f1708ff9700 1 -- 172.21.15.59:0/1008016321 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16fc007310 con 0x7f170c0cedb0 2023-09-21T00:17:49.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.443+0000 7f17125c9700 1 -- 172.21.15.59:0/1008016321 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f170c1f4af0 con 0x7f170c0cedb0 2023-09-21T00:17:49.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.443+0000 7f17125c9700 1 -- 172.21.15.59:0/1008016321 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f170c067e50 con 0x7f170c0cedb0 2023-09-21T00:17:49.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.444+0000 7f1708ff9700 1 -- 172.21.15.59:0/1008016321 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f16fc007470 con 0x7f170c0cedb0 2023-09-21T00:17:49.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.444+0000 7f1708ff9700 1 --2- 172.21.15.59:0/1008016321 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f16f806ae00 0x7f16f806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:49.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.444+0000 7f1708ff9700 1 -- 172.21.15.59:0/1008016321 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f16fc089390 con 0x7f170c0cedb0 2023-09-21T00:17:49.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.445+0000 7f170b7fe700 1 --2- 172.21.15.59:0/1008016321 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f16f806ae00 0x7f16f806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:49.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.445+0000 7f170b7fe700 1 --2- 172.21.15.59:0/1008016321 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f16f806ae00 0x7f16f806d2c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f17000090b0 tx=0x7f170001c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:49.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.449+0000 7f1708ff9700 1 -- 172.21.15.59:0/1008016321 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f16fc054130 con 0x7f170c0cedb0 2023-09-21T00:17:49.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.693+0000 7f17125c9700 1 -- 172.21.15.59:0/1008016321 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f170c0cf740 con 0x7f170c0cedb0 2023-09-21T00:17:49.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.694+0000 7f1708ff9700 1 -- 172.21.15.59:0/1008016321 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f170c0cf740 con 0x7f170c0cedb0 2023-09-21T00:17:49.695 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-09-21T00:17:49.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.696+0000 7f17125c9700 1 -- 172.21.15.59:0/1008016321 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f16f806ae00 msgr2=0x7f16f806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:49.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.696+0000 7f17125c9700 1 --2- 172.21.15.59:0/1008016321 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f16f806ae00 0x7f16f806d2c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f17000090b0 tx=0x7f170001c040 comp rx=0 tx=0).stop 2023-09-21T00:17:49.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.696+0000 7f17125c9700 1 -- 172.21.15.59:0/1008016321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f170c0cedb0 msgr2=0x7f170c0c6f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:49.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.696+0000 7f17125c9700 1 --2- 172.21.15.59:0/1008016321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f170c0cedb0 0x7f170c0c6f90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f16fc00c730 tx=0x7f16fc00ca40 comp rx=0 tx=0).stop 2023-09-21T00:17:49.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.696+0000 7f17125c9700 1 -- 172.21.15.59:0/1008016321 shutdown_connections 2023-09-21T00:17:49.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.696+0000 7f17125c9700 1 --2- 172.21.15.59:0/1008016321 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f170c15d690 0x7f170c145670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:49.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.696+0000 7f17125c9700 1 --2- 172.21.15.59:0/1008016321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f170c0cedb0 0x7f170c0c6f90 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:49.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.696+0000 7f17125c9700 1 --2- 172.21.15.59:0/1008016321 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f16f806ae00 0x7f16f806d2c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:49.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.696+0000 7f17125c9700 1 --2- 172.21.15.59:0/1008016321 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f170c143ce0 0x7f170c145130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:49.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.696+0000 7f17125c9700 1 -- 172.21.15.59:0/1008016321 >> 172.21.15.59:0/1008016321 conn(0x7f170c0d11e0 msgr2=0x7f170c06d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:49.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.696+0000 7f17125c9700 1 -- 172.21.15.59:0/1008016321 shutdown_connections 2023-09-21T00:17:49.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:49.696+0000 7f17125c9700 1 -- 172.21.15.59:0/1008016321 wait complete. 2023-09-21T00:17:49.709 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-21T00:17:49.709 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-21T00:17:49.709 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi083.front.sepia.ceph.com 2023-09-21T00:17:49.710 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-09-21T00:17:49.710 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-09-21T00:17:49.710 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-21T00:17:49.710 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-21T00:17:49.711 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-21T00:17:49.711 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-09-21T00:17:49.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:49.712 DEBUG:teuthology.orchestra.run.smithi083:> ip addr 2023-09-21T00:17:49.730 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-21T00:17:49.730 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-21T00:17:49.731 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2023-09-21T00:17:49.731 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-09-21T00:17:49.731 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2023-09-21T00:17:49.731 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-09-21T00:17:49.731 INFO:teuthology.orchestra.run.smithi083.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-21T00:17:49.732 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1e brd ff:ff:ff:ff:ff:ff 2023-09-21T00:17:49.732 INFO:teuthology.orchestra.run.smithi083.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-21T00:17:49.732 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1f brd ff:ff:ff:ff:ff:ff 2023-09-21T00:17:49.732 INFO:teuthology.orchestra.run.smithi083.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-21T00:17:49.732 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:90 brd ff:ff:ff:ff:ff:ff 2023-09-21T00:17:49.733 INFO:teuthology.orchestra.run.smithi083.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-21T00:17:49.733 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:91 brd ff:ff:ff:ff:ff:ff 2023-09-21T00:17:49.733 INFO:teuthology.orchestra.run.smithi083.stdout: inet 172.21.15.83/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-21T00:17:49.733 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft 42384sec preferred_lft 42384sec 2023-09-21T00:17:49.733 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::121b:7135:3b7e:4f8c/64 scope link noprefixroute 2023-09-21T00:17:49.734 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-09-21T00:17:49.734 INFO:teuthology.orchestra.run.smithi083.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-21T00:17:49.734 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 66:fd:89:1e:48:6e brd ff:ff:ff:ff:ff:ff 2023-09-21T00:17:49.734 INFO:teuthology.orchestra.run.smithi083.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-21T00:17:49.735 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-09-21T00:17:49.735 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::9c9a:c7ff:fe11:8905/64 scope link 2023-09-21T00:17:49.735 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-09-21T00:17:49.735 INFO:teuthology.orchestra.run.smithi083.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-21T00:17:49.735 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 66:fd:89:1e:48:6e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-21T00:17:49.736 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::64fd:89ff:fe1e:486e/64 scope link tentative 2023-09-21T00:17:49.736 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-09-21T00:17:49.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:49.736 DEBUG:teuthology.orchestra.run.smithi083:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-21T00:17:49.798 INFO:teuthology.orchestra.run.smithi083.stdout:1 2023-09-21T00:17:49.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:49.800 DEBUG:teuthology.orchestra.run.smithi083:> route 2023-09-21T00:17:49.858 INFO:teuthology.orchestra.run.smithi083.stdout:Kernel IP routing table 2023-09-21T00:17:49.859 INFO:teuthology.orchestra.run.smithi083.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-21T00:17:49.859 INFO:teuthology.orchestra.run.smithi083.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-21T00:17:49.859 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-21T00:17:49.859 INFO:teuthology.orchestra.run.smithi083.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-21T00:17:49.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:49.861 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-09-21T00:17:49.861 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-09-21T00:17:49.861 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-21T00:17:49.862 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-21T00:17:49.862 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-21T00:17:49.862 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-09-21T00:17:49.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:49.967 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2023-09-21T00:17:49.984 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-09-21T00:17:49.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:49.985 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list-id 2023-09-21T00:17:50.040 INFO:teuthology.orchestra.run.smithi083.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-09-21T00:17:50.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:50.041 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-09-21T00:17:50.041 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-09-21T00:17:50.041 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-21T00:17:50.042 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-09-21T00:17:50.042 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-09-21T00:17:50.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:50.139 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-09-21T00:17:50.179 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-21T00:17:50.179 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-21T00:17:50.179 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2023-09-21T00:17:50.180 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-09-21T00:17:50.180 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2023-09-21T00:17:50.180 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-09-21T00:17:50.180 INFO:teuthology.orchestra.run.smithi083.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-21T00:17:50.180 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether d2:a0:7c:62:23:d4 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-09-21T00:17:50.181 INFO:teuthology.orchestra.run.smithi083.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-09-21T00:17:50.181 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-09-21T00:17:50.181 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::d0a0:7cff:fe62:23d4/64 scope link tentative 2023-09-21T00:17:50.181 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-09-21T00:17:50.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:50.196 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-09-21T00:17:50.270 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-21T00:17:50.270 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-21T00:17:50.270 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2023-09-21T00:17:50.271 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-09-21T00:17:50.271 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2023-09-21T00:17:50.271 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-09-21T00:17:50.271 INFO:teuthology.orchestra.run.smithi083.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-21T00:17:50.271 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether d2:a0:7c:62:23:d4 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-09-21T00:17:50.271 INFO:teuthology.orchestra.run.smithi083.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-09-21T00:17:50.272 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-09-21T00:17:50.272 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::d0a0:7cff:fe62:23d4/64 scope link tentative 2023-09-21T00:17:50.272 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2023-09-21T00:17:50.287 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-09-21T00:17:50.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:50.288 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-09-21T00:17:50.288 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-09-21T00:17:50.288 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-09-21T00:17:50.289 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-09-21T00:17:50.289 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-09-21T00:17:50.289 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-09-21T00:17:50.290 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-09-21T00:17:50.290 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-09-21T00:17:50.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:50.544 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2023-09-21T00:17:50.544 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2023-09-21T00:17:50.544 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set brx.1 up 2023-09-21T00:17:50.545 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set dev brx.1 master ceph-brx 2023-09-21T00:17:50.545 DEBUG:teuthology.orchestra.run.smithi083:> ') 2023-09-21T00:17:50.675 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-21T00:17:50.675 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-09-21T00:17:50.692 INFO:teuthology.orchestra.run.smithi083.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-09-21T00:17:50.692 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-21T00:17:50.692 DEBUG:teuthology.orchestra.run.smithi083:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-09-21T00:17:50.748 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-21T00:17:50.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:50.749 DEBUG:teuthology.orchestra.run.smithi083:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-09-21T00:17:50.832 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-09-21T00:17:50.833 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-09-21T00:17:50.833 INFO:teuthology.orchestra.run.smithi083.stdout:invalid new device string format 2023-09-21T00:17:50.841 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-09-21T00:17:50.842 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-09-21T00:17:50.842 INFO:teuthology.orchestra.run.smithi083.stdout:invalid new device string format 2023-09-21T00:17:50.842 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-09-21T00:17:50.842 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-21T00:17:50.866 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-09-21T00:17:50.866 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-09-21T00:17:50.867 INFO:teuthology.orchestra.run.smithi083.stdout:invalid new device string format 2023-09-21T00:17:50.867 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-09-21T00:17:50.867 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-21T00:17:50.867 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.59:6789,172.21.15.83:6789,172.21.15.83:6790" 2023-09-21T00:17:50.868 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.59:6789,172.21.15.83:6789,172.21.15.83:6790:/ 2023-09-21T00:17:50.868 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=dd69925c-6e25-42fe-880b-2f60fc6f384b" will pass to kernel 2023-09-21T00:17:50.870 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-21T00:17:50.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:50.870 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-09-21T00:17:50.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:50.901 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-21T00:17:50.972 INFO:teuthology.orchestra.run.smithi083.stdout:client4652 2023-09-21T00:17:50.973 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-09-21T00:17:50.973 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-21T00:17:51.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:51.031 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-21T00:17:51.102 INFO:teuthology.orchestra.run.smithi083.stdout:client4652 2023-09-21T00:17:51.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:51.103 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-21T00:17:51.174 INFO:teuthology.orchestra.run.smithi083.stdout:client4652 2023-09-21T00:17:51.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:17:51.175 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/dd69925c-6e25-42fe-880b-2f60fc6f384b.client4652/status') 2023-09-21T00:17:51.254 INFO:teuthology.orchestra.run.smithi083.stdout:instance: client.4652 (3)192.168.0.2:0/3324285099 2023-09-21T00:17:51.255 INFO:teuthology.orchestra.run.smithi083.stdout:blocklisted: false 2023-09-21T00:17:51.255 INFO:teuthology.orchestra.run.smithi083.stderr:0+1 records in 2023-09-21T00:17:51.256 INFO:teuthology.orchestra.run.smithi083.stderr:0+1 records out 2023-09-21T00:17:51.256 INFO:teuthology.orchestra.run.smithi083.stderr:69 bytes copied, 2.0315e-05 s, 3.4 MB/s 2023-09-21T00:17:51.256 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-09-21T00:17:51.275 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T00:17:51.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.415+0000 7f24af981700 1 Processor -- start 2023-09-21T00:17:51.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.415+0000 7f24af981700 1 -- start start 2023-09-21T00:17:51.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.416+0000 7f24af981700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f24a8159a80 0x7f24a8071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:51.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.416+0000 7f24af981700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f24a80c9870 0x7f24a806c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:51.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.416+0000 7f24af981700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24a815e2f0 con 0x7f24a80cc530 2023-09-21T00:17:51.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.416+0000 7f24af981700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24a80cb060 con 0x7f24a80c9870 2023-09-21T00:17:51.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.416+0000 7f24af981700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a8070fe0 con 0x7f24a8159a80 2023-09-21T00:17:51.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.417+0000 7f24adf1e700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f24a80cc530 0x7f24a80ccdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57722/0 (socket says 172.21.15.59:57722) 2023-09-21T00:17:51.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.417+0000 7f24adf1e700 1 -- 172.21.15.59:0/1294175077 learned_addr learned my addr 172.21.15.59:0/1294175077 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:51.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.417+0000 7f24ad71d700 1 --2- 172.21.15.59:0/1294175077 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f24a8159a80 0x7f24a8071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:51.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.417+0000 7f24acf1c700 1 --2- 172.21.15.59:0/1294175077 >> v2:172.21.15.83:3300/0 conn(0x7f24a80c9870 0x7f24a806c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:51.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.417+0000 7f249ffff700 1 -- 172.21.15.59:0/1294175077 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2056500997 0 0) 0x7f24a815e2f0 con 0x7f24a80cc530 2023-09-21T00:17:51.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.417+0000 7f249ffff700 1 -- 172.21.15.59:0/1294175077 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24940046c0 con 0x7f24a80cc530 2023-09-21T00:17:51.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.417+0000 7f249ffff700 1 -- 172.21.15.59:0/1294175077 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1268747606 0 0) 0x7f24940046c0 con 0x7f24a80cc530 2023-09-21T00:17:51.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.417+0000 7f249ffff700 1 -- 172.21.15.59:0/1294175077 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f24a8159a80 msgr2=0x7f24a8071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:51.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.417+0000 7f249ffff700 1 --2- 172.21.15.59:0/1294175077 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f24a8159a80 0x7f24a8071ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:51.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.417+0000 7f249ffff700 1 -- 172.21.15.59:0/1294175077 >> v2:172.21.15.83:3300/0 conn(0x7f24a80c9870 msgr2=0x7f24a806c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:51.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.417+0000 7f249ffff700 1 --2- 172.21.15.59:0/1294175077 >> v2:172.21.15.83:3300/0 conn(0x7f24a80c9870 0x7f24a806c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:51.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.417+0000 7f249ffff700 1 -- 172.21.15.59:0/1294175077 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a80712c0 con 0x7f24a80cc530 2023-09-21T00:17:51.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.417+0000 7f249ffff700 1 -- 172.21.15.59:0/1294175077 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 710825841 0 0) 0x7f24a00019f0 con 0x7f24a80cc530 2023-09-21T00:17:51.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.417+0000 7f249ffff700 1 -- 172.21.15.59:0/1294175077 >> v1:172.21.15.59:6789/0 conn(0x7f24a80cc530 legacy=0x7f24a80ccdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:51.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.417+0000 7f249ffff700 1 --2- 172.21.15.59:0/1294175077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2494004b80 0x7f2494004fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:51.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.417+0000 7f249ffff700 1 --2- 172.21.15.59:0/1294175077 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f24a8159a80 0x7f2494005960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:51.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.417+0000 7f249ffff700 1 --2- 172.21.15.59:0/1294175077 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2494005ea0 0x7f2494006320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:51.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.417+0000 7f249ffff700 1 -- 172.21.15.59:0/1294175077 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a8070fe0 con 0x7f2494004b80 2023-09-21T00:17:51.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.417+0000 7f249ffff700 1 -- 172.21.15.59:0/1294175077 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249400cb20 con 0x7f2494005ea0 2023-09-21T00:17:51.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.417+0000 7f249ffff700 1 -- 172.21.15.59:0/1294175077 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f249400ccb0 con 0x7f24a8159a80 2023-09-21T00:17:51.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.417+0000 7f24adf1e700 1 --2- 172.21.15.59:0/1294175077 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2494005ea0 0x7f2494006320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:51.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.417+0000 7f24acf1c700 1 --2- 172.21.15.59:0/1294175077 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f24a8159a80 0x7f2494005960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:51.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.417+0000 7f24ad71d700 1 --2- 172.21.15.59:0/1294175077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2494004b80 0x7f2494004fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:51.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.418+0000 7f24adf1e700 1 -- 172.21.15.59:0/1294175077 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f24a8159a80 msgr2=0x7f2494005960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:51.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.418+0000 7f24adf1e700 1 --2- 172.21.15.59:0/1294175077 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f24a8159a80 0x7f2494005960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:51.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.418+0000 7f24adf1e700 1 -- 172.21.15.59:0/1294175077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2494004b80 msgr2=0x7f2494004fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:51.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.418+0000 7f24adf1e700 1 --2- 172.21.15.59:0/1294175077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2494004b80 0x7f2494004fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:51.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.418+0000 7f24adf1e700 1 -- 172.21.15.59:0/1294175077 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24940046c0 con 0x7f2494005ea0 2023-09-21T00:17:51.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.418+0000 7f24adf1e700 1 --2- 172.21.15.59:0/1294175077 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2494005ea0 0x7f2494006320 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f24a000a8d0 tx=0x7f2494006990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24befbf2da229496 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:51.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.418+0000 7f249ffff700 1 -- 172.21.15.59:0/1294175077 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a000a340 con 0x7f2494005ea0 2023-09-21T00:17:51.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.418+0000 7f249ffff700 1 -- 172.21.15.59:0/1294175077 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a0012600 con 0x7f2494005ea0 2023-09-21T00:17:51.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.418+0000 7f249ffff700 1 -- 172.21.15.59:0/1294175077 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a00129b0 con 0x7f2494005ea0 2023-09-21T00:17:51.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.418+0000 7f24af981700 1 -- 172.21.15.59:0/1294175077 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2494005ea0 msgr2=0x7f2494006320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:51.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.419+0000 7f24af981700 1 --2- 172.21.15.59:0/1294175077 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2494005ea0 0x7f2494006320 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f24a000a8d0 tx=0x7f2494006990 comp rx=0 tx=0).stop 2023-09-21T00:17:51.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.419+0000 7f24adf1e700 1 -- 172.21.15.59:0/1294175077 reap_dead start 2023-09-21T00:17:51.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.419+0000 7f24af981700 1 -- 172.21.15.59:0/1294175077 shutdown_connections 2023-09-21T00:17:51.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.419+0000 7f24af981700 1 -- 172.21.15.59:0/1294175077 >> 172.21.15.59:0/1294175077 conn(0x7f24a80b0d70 msgr2=0x7f24a80b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:51.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.419+0000 7f24af981700 1 -- 172.21.15.59:0/1294175077 shutdown_connections 2023-09-21T00:17:51.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.419+0000 7f24af981700 1 -- 172.21.15.59:0/1294175077 wait complete. 2023-09-21T00:17:51.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.420+0000 7f24af981700 1 Processor -- start 2023-09-21T00:17:51.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.420+0000 7f24af981700 1 -- start start 2023-09-21T00:17:51.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.421+0000 7f24af981700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2494005ea0 0x7f24a8150bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:51.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.421+0000 7f24af981700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f24a81518e0 0x7f24a80b3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:51.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.421+0000 7f24af981700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24a80b3c50 0x7f24a80c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:51.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.421+0000 7f24af981700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a80c3f70 con 0x7f24a80b3c50 2023-09-21T00:17:51.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.421+0000 7f24af981700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a80b4120 con 0x7f2494005ea0 2023-09-21T00:17:51.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.421+0000 7f24af981700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a80c41c0 con 0x7f24a81518e0 2023-09-21T00:17:51.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.422+0000 7f24adf1e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24a80b3c50 0x7f24a80c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:51.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.422+0000 7f24adf1e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24a80b3c50 0x7f24a80c62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52164/0 (socket says 172.21.15.59:52164) 2023-09-21T00:17:51.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.422+0000 7f24adf1e700 1 -- 172.21.15.59:0/1501707632 learned_addr learned my addr 172.21.15.59:0/1501707632 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:51.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.422+0000 7f24acf1c700 1 --2- 172.21.15.59:0/1501707632 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f24a81518e0 0x7f24a80b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:51.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.422+0000 7f24ad71d700 1 --2- 172.21.15.59:0/1501707632 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2494005ea0 0x7f24a8150bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:51.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.422+0000 7f24adf1e700 1 -- 172.21.15.59:0/1501707632 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f24a81518e0 msgr2=0x7f24a80b3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:51.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.422+0000 7f24adf1e700 1 --2- 172.21.15.59:0/1501707632 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f24a81518e0 0x7f24a80b3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:51.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.422+0000 7f24adf1e700 1 -- 172.21.15.59:0/1501707632 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2494005ea0 msgr2=0x7f24a8150bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:51.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.422+0000 7f24adf1e700 1 --2- 172.21.15.59:0/1501707632 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2494005ea0 0x7f24a8150bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:51.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.422+0000 7f24adf1e700 1 -- 172.21.15.59:0/1501707632 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a80c44a0 con 0x7f24a80b3c50 2023-09-21T00:17:51.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.422+0000 7f24ad71d700 1 --2- 172.21.15.59:0/1501707632 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2494005ea0 0x7f24a8150bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:17:51.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.422+0000 7f24adf1e700 1 --2- 172.21.15.59:0/1501707632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24a80b3c50 0x7f24a80c62f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f24a0012000 tx=0x7f24a0001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:51.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.422+0000 7f249dffb700 1 -- 172.21.15.59:0/1501707632 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a000a340 con 0x7f24a80b3c50 2023-09-21T00:17:51.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.422+0000 7f249dffb700 1 -- 172.21.15.59:0/1501707632 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a00019c0 con 0x7f24a80b3c50 2023-09-21T00:17:51.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.422+0000 7f249dffb700 1 -- 172.21.15.59:0/1501707632 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a001e620 con 0x7f24a80b3c50 2023-09-21T00:17:51.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.422+0000 7f24af981700 1 -- 172.21.15.59:0/1501707632 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24a80c4780 con 0x7f24a80b3c50 2023-09-21T00:17:51.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.422+0000 7f24af981700 1 -- 172.21.15.59:0/1501707632 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a80c6a10 con 0x7f24a80b3c50 2023-09-21T00:17:51.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.423+0000 7f24af981700 1 -- 172.21.15.59:0/1501707632 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24a80c4970 con 0x7f24a80b3c50 2023-09-21T00:17:51.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.424+0000 7f249dffb700 1 -- 172.21.15.59:0/1501707632 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f24a0019030 con 0x7f24a80b3c50 2023-09-21T00:17:51.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.424+0000 7f249dffb700 1 --2- 172.21.15.59:0/1501707632 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f248c06ae00 0x7f248c06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:51.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.424+0000 7f249dffb700 1 -- 172.21.15.59:0/1501707632 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f24a008b7b0 con 0x7f24a80b3c50 2023-09-21T00:17:51.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.424+0000 7f24ad71d700 1 --2- 172.21.15.59:0/1501707632 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f248c06ae00 0x7f248c06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:51.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.425+0000 7f24ad71d700 1 --2- 172.21.15.59:0/1501707632 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f248c06ae00 0x7f248c06d2c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2498009be0 tx=0x7f2498008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:51.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.429+0000 7f249dffb700 1 -- 172.21.15.59:0/1501707632 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f24a00564b0 con 0x7f24a80b3c50 2023-09-21T00:17:51.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.632+0000 7f24af981700 1 -- 172.21.15.59:0/1501707632 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f24a8067e50 con 0x7f24a80b3c50 2023-09-21T00:17:51.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.633+0000 7f249dffb700 1 -- 172.21.15.59:0/1501707632 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18792 (secure 0 0 0) 0x7f24a0059ad0 con 0x7f24a80b3c50 2023-09-21T00:17:51.635 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:17:51.635 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":26,"fsid":"dd69925c-6e25-42fe-880b-2f60fc6f384b","created":"2023-09-21T00:16:43.074489+0000","modified":"2023-09-21T00:17:50.090179+0000","last_up_change":"2023-09-21T00:16:54.740101+0000","last_in_change":"2023-09-21T00:16:45.987089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T00:16:54.796248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-21T00:17:04.167102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-21T00:17:05.313188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-21T00:17:08.977609+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d4b18344-74c0-4f75-920b-7a9247e48914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6809","nonce":2418314235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6811","nonce":2418314235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6815","nonce":2418314235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6813","nonce":2418314235}]},"public_addr":"172.21.15.59:6809/2418314235","cluster_addr":"172.21.15.59:6811/2418314235","heartbeat_back_addr":"172.21.15.59:6815/2418314235","heartbeat_front_addr":"172.21.15.59:6813/2418314235","state":["exists","up"]},{"osd":1,"uuid":"80940d50-a248-4e64-a282-7ffcdad790ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6801","nonce":869668251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6803","nonce":869668251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6807","nonce":869668251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6805","nonce":869668251}]},"public_addr":"172.21.15.59:6801/869668251","cluster_addr":"172.21.15.59:6803/869668251","heartbeat_back_addr":"172.21.15.59:6807/869668251","heartbeat_front_addr":"172.21.15.59:6805/869668251","state":["exists","up"]},{"osd":2,"uuid":"55f2eceb-c54a-4879-a6ce-968c1c548b5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6817","nonce":372517778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6819","nonce":372517778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6823","nonce":372517778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6821","nonce":372517778}]},"public_addr":"172.21.15.59:6817/372517778","cluster_addr":"172.21.15.59:6819/372517778","heartbeat_back_addr":"172.21.15.59:6823/372517778","heartbeat_front_addr":"172.21.15.59:6821/372517778","state":["exists","up"]},{"osd":3,"uuid":"92b89cd0-869c-49b9-a9f9-97ac8423f304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6825","nonce":575188498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6827","nonce":575188498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6831","nonce":575188498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6829","nonce":575188498}]},"public_addr":"172.21.15.59:6825/575188498","cluster_addr":"172.21.15.59:6827/575188498","heartbeat_back_addr":"172.21.15.59:6831/575188498","heartbeat_front_addr":"172.21.15.59:6829/575188498","state":["exists","up"]},{"osd":4,"uuid":"25b80e94-e0e6-403d-b69f-61542f289637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6803","nonce":1741219098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6805","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6807","nonce":1741219098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6815","nonce":1741219098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6811","nonce":1741219098}]},"public_addr":"172.21.15.83:6803/1741219098","cluster_addr":"172.21.15.83:6807/1741219098","heartbeat_back_addr":"172.21.15.83:6815/1741219098","heartbeat_front_addr":"172.21.15.83:6811/1741219098","state":["exists","up"]},{"osd":5,"uuid":"5498d9ab-1086-4796-a199-9051e6dfea91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6817","nonce":156730565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6819","nonce":156730565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6823","nonce":156730565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6821","nonce":156730565}]},"public_addr":"172.21.15.83:6817/156730565","cluster_addr":"172.21.15.83:6819/156730565","heartbeat_back_addr":"172.21.15.83:6823/156730565","heartbeat_front_addr":"172.21.15.83:6821/156730565","state":["exists","up"]},{"osd":6,"uuid":"cfd810c0-5015-4d60-9a75-7efc93a32e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6801","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6800","nonce":1337723778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6806","nonce":1337723778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6814","nonce":1337723778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6810","nonce":1337723778}]},"public_addr":"172.21.15.83:6800/1337723778","cluster_addr":"172.21.15.83:6806/1337723778","heartbeat_back_addr":"172.21.15.83:6814/1337723778","heartbeat_front_addr":"172.21.15.83:6810/1337723778","state":["exists","up"]},{"osd":7,"uuid":"e992c8fa-0a3d-4b3c-85b5-2c511223dee4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6825","nonce":4204859272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6827","nonce":4204859272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6831","nonce":4204859272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6829","nonce":4204859272}]},"public_addr":"172.21.15.83:6825/4204859272","cluster_addr":"172.21.15.83:6827/4204859272","heartbeat_back_addr":"172.21.15.83:6831/4204859272","heartbeat_front_addr":"172.21.15.83:6829/4204859272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.156498+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.882707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.093978+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.158565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.173933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.888606+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.135525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.149712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":3,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.34","mappings":[{"from":4,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":6}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T00:17:51.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.635+0000 7f24af981700 1 -- 172.21.15.59:0/1501707632 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f248c06ae00 msgr2=0x7f248c06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:51.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.635+0000 7f24af981700 1 --2- 172.21.15.59:0/1501707632 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f248c06ae00 0x7f248c06d2c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2498009be0 tx=0x7f2498008040 comp rx=0 tx=0).stop 2023-09-21T00:17:51.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.635+0000 7f24af981700 1 -- 172.21.15.59:0/1501707632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24a80b3c50 msgr2=0x7f24a80c62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:51.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.635+0000 7f24af981700 1 --2- 172.21.15.59:0/1501707632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24a80b3c50 0x7f24a80c62f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f24a0012000 tx=0x7f24a0001360 comp rx=0 tx=0).stop 2023-09-21T00:17:51.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.635+0000 7f24af981700 1 -- 172.21.15.59:0/1501707632 shutdown_connections 2023-09-21T00:17:51.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.635+0000 7f24af981700 1 --2- 172.21.15.59:0/1501707632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24a80b3c50 0x7f24a80c62f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:51.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.635+0000 7f24af981700 1 --2- 172.21.15.59:0/1501707632 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2494005ea0 0x7f24a8150bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:51.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.635+0000 7f24af981700 1 --2- 172.21.15.59:0/1501707632 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f248c06ae00 0x7f248c06d2c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:51.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.635+0000 7f24af981700 1 --2- 172.21.15.59:0/1501707632 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f24a81518e0 0x7f24a80b3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:51.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.635+0000 7f24af981700 1 -- 172.21.15.59:0/1501707632 >> 172.21.15.59:0/1501707632 conn(0x7f24a80b0d70 msgr2=0x7f24a80aecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:51.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.636+0000 7f24af981700 1 -- 172.21.15.59:0/1501707632 shutdown_connections 2023-09-21T00:17:51.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.636+0000 7f24af981700 1 -- 172.21.15.59:0/1501707632 wait complete. 2023-09-21T00:17:51.649 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-21T00:16:54.796248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-21T00:17:04.167102+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-21T00:17:05.313188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-21T00:17:08.977609+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-21T00:17:51.650 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-21T00:17:51.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.777+0000 7f3a7f247700 1 Processor -- start 2023-09-21T00:17:51.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.777+0000 7f3a7f247700 1 -- start start 2023-09-21T00:17:51.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.777+0000 7f3a7f247700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3a780d0820 0x7f3a7806f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:51.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.777+0000 7f3a7f247700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3a780708f0 0x7f3a780b44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:51.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.777+0000 7f3a7f247700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a780b4030 con 0x7f3a7815b480 2023-09-21T00:17:51.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.777+0000 7f3a7f247700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a780cb8d0 con 0x7f3a780d0820 2023-09-21T00:17:51.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.777+0000 7f3a7f247700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a780cbb40 con 0x7f3a780708f0 2023-09-21T00:17:51.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.778+0000 7f3a7cfe3700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3a7815b480 0x7f3a780701e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57738/0 (socket says 172.21.15.59:57738) 2023-09-21T00:17:51.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.778+0000 7f3a7cfe3700 1 -- 172.21.15.59:0/3842066625 learned_addr learned my addr 172.21.15.59:0/3842066625 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:51.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.778+0000 7f3a77fff700 1 --2- 172.21.15.59:0/3842066625 >> v2:172.21.15.59:3300/0 conn(0x7f3a780d0820 0x7f3a7806f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:51.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.778+0000 7f3a7d7e4700 1 --2- 172.21.15.59:0/3842066625 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3a780708f0 0x7f3a780b44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:51.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.778+0000 7f3a77fff700 1 -- 172.21.15.59:0/3842066625 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3a780708f0 msgr2=0x7f3a780b44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:51.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.778+0000 7f3a77fff700 1 --2- 172.21.15.59:0/3842066625 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3a780708f0 0x7f3a780b44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:51.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.778+0000 7f3a77fff700 1 -- 172.21.15.59:0/3842066625 >> v1:172.21.15.59:6789/0 conn(0x7f3a7815b480 legacy=0x7f3a780701e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:51.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.778+0000 7f3a77fff700 1 -- 172.21.15.59:0/3842066625 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a780cbe20 con 0x7f3a780d0820 2023-09-21T00:17:51.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.778+0000 7f3a77fff700 1 --2- 172.21.15.59:0/3842066625 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a780d0820 0x7f3a7806f400 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3a64009840 tx=0x7f3a64009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=403ee9ebc3e46912 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:51.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.778+0000 7f3a777fe700 1 -- 172.21.15.59:0/3842066625 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a64011830 con 0x7f3a780d0820 2023-09-21T00:17:51.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.778+0000 7f3a777fe700 1 -- 172.21.15.59:0/3842066625 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a64011990 con 0x7f3a780d0820 2023-09-21T00:17:51.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.778+0000 7f3a777fe700 1 -- 172.21.15.59:0/3842066625 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a64011d20 con 0x7f3a780d0820 2023-09-21T00:17:51.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.779+0000 7f3a7f247700 1 -- 172.21.15.59:0/3842066625 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a780d0820 msgr2=0x7f3a7806f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:51.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.779+0000 7f3a7f247700 1 --2- 172.21.15.59:0/3842066625 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a780d0820 0x7f3a7806f400 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3a64009840 tx=0x7f3a64009b50 comp rx=0 tx=0).stop 2023-09-21T00:17:51.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.779+0000 7f3a7f247700 1 -- 172.21.15.59:0/3842066625 shutdown_connections 2023-09-21T00:17:51.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.779+0000 7f3a7f247700 1 --2- 172.21.15.59:0/3842066625 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3a780708f0 0x7f3a780b44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:51.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.779+0000 7f3a7f247700 1 --2- 172.21.15.59:0/3842066625 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a780d0820 0x7f3a7806f400 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:51.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.779+0000 7f3a7f247700 1 -- 172.21.15.59:0/3842066625 >> 172.21.15.59:0/3842066625 conn(0x7f3a780d11e0 msgr2=0x7f3a780d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:51.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.779+0000 7f3a7f247700 1 -- 172.21.15.59:0/3842066625 shutdown_connections 2023-09-21T00:17:51.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.779+0000 7f3a7f247700 1 -- 172.21.15.59:0/3842066625 wait complete. 2023-09-21T00:17:51.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.780+0000 7f3a7f247700 1 Processor -- start 2023-09-21T00:17:51.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.781+0000 7f3a7f247700 1 -- start start 2023-09-21T00:17:51.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.782+0000 7f3a7f247700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a780708f0 0x7f3a780b2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:51.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.782+0000 7f3a7f247700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a780d0820 0x7f3a781f3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:51.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.782+0000 7f3a7f247700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3a7815b480 0x7f3a780b07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:51.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.782+0000 7f3a7f247700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a780b30f0 con 0x7f3a780d0820 2023-09-21T00:17:51.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.782+0000 7f3a7f247700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a780b33d0 con 0x7f3a780708f0 2023-09-21T00:17:51.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.782+0000 7f3a7f247700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a780b36b0 con 0x7f3a7815b480 2023-09-21T00:17:51.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.782+0000 7f3a77fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a780d0820 0x7f3a781f3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:51.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.782+0000 7f3a77fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a780d0820 0x7f3a781f3780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52178/0 (socket says 172.21.15.59:52178) 2023-09-21T00:17:51.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.782+0000 7f3a77fff700 1 -- 172.21.15.59:0/1639041492 learned_addr learned my addr 172.21.15.59:0/1639041492 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:51.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.782+0000 7f3a7d7e4700 1 --2- 172.21.15.59:0/1639041492 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3a7815b480 0x7f3a780b07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:51.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.782+0000 7f3a7cfe3700 1 --2- 172.21.15.59:0/1639041492 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a780708f0 0x7f3a780b2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:51.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.782+0000 7f3a77fff700 1 -- 172.21.15.59:0/1639041492 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3a7815b480 msgr2=0x7f3a780b07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:51.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.782+0000 7f3a77fff700 1 --2- 172.21.15.59:0/1639041492 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3a7815b480 0x7f3a780b07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:51.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.782+0000 7f3a77fff700 1 -- 172.21.15.59:0/1639041492 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a780708f0 msgr2=0x7f3a780b2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:51.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.782+0000 7f3a77fff700 1 --2- 172.21.15.59:0/1639041492 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a780708f0 0x7f3a780b2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:51.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.782+0000 7f3a77fff700 1 -- 172.21.15.59:0/1639041492 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a640094a0 con 0x7f3a780d0820 2023-09-21T00:17:51.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.782+0000 7f3a7cfe3700 1 --2- 172.21.15.59:0/1639041492 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a780708f0 0x7f3a780b2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:17:51.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.782+0000 7f3a77fff700 1 --2- 172.21.15.59:0/1639041492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a780d0820 0x7f3a781f3780 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3a64009b90 tx=0x7f3a64004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:51.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.782+0000 7f3a757fa700 1 -- 172.21.15.59:0/1639041492 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a640036a0 con 0x7f3a780d0820 2023-09-21T00:17:51.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.782+0000 7f3a757fa700 1 -- 172.21.15.59:0/1639041492 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a6401f070 con 0x7f3a780d0820 2023-09-21T00:17:51.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.782+0000 7f3a7f247700 1 -- 172.21.15.59:0/1639041492 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a7815b9e0 con 0x7f3a780d0820 2023-09-21T00:17:51.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.782+0000 7f3a757fa700 1 -- 172.21.15.59:0/1639041492 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a64003a40 con 0x7f3a780d0820 2023-09-21T00:17:51.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.782+0000 7f3a7f247700 1 -- 172.21.15.59:0/1639041492 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a780c93a0 con 0x7f3a780d0820 2023-09-21T00:17:51.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.783+0000 7f3a7f247700 1 -- 172.21.15.59:0/1639041492 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a78067e50 con 0x7f3a780d0820 2023-09-21T00:17:51.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.784+0000 7f3a757fa700 1 -- 172.21.15.59:0/1639041492 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f3a64003ba0 con 0x7f3a780d0820 2023-09-21T00:17:51.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.784+0000 7f3a757fa700 1 --2- 172.21.15.59:0/1639041492 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f3a5c06ae00 0x7f3a5c06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:51.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.784+0000 7f3a757fa700 1 -- 172.21.15.59:0/1639041492 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f3a64021070 con 0x7f3a780d0820 2023-09-21T00:17:51.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.784+0000 7f3a7cfe3700 1 --2- 172.21.15.59:0/1639041492 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f3a5c06ae00 0x7f3a5c06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:51.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.785+0000 7f3a7cfe3700 1 --2- 172.21.15.59:0/1639041492 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f3a5c06ae00 0x7f3a5c06d2c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c007fd0 tx=0x7f3a6c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:51.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.789+0000 7f3a757fa700 1 -- 172.21.15.59:0/1639041492 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f3a64055fa0 con 0x7f3a780d0820 2023-09-21T00:17:51.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.988+0000 7f3a7f247700 1 -- 172.21.15.59:0/1639041492 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3a780c9560 con 0x7f3a780d0820 2023-09-21T00:17:51.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.989+0000 7f3a757fa700 1 -- 172.21.15.59:0/1639041492 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3a640595c0 con 0x7f3a780d0820 2023-09-21T00:17:51.990 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-09-21T00:17:51.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.991+0000 7f3a7f247700 1 -- 172.21.15.59:0/1639041492 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f3a5c06ae00 msgr2=0x7f3a5c06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:51.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.991+0000 7f3a7f247700 1 --2- 172.21.15.59:0/1639041492 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f3a5c06ae00 0x7f3a5c06d2c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c007fd0 tx=0x7f3a6c009040 comp rx=0 tx=0).stop 2023-09-21T00:17:51.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.991+0000 7f3a7f247700 1 -- 172.21.15.59:0/1639041492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a780d0820 msgr2=0x7f3a781f3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:51.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.991+0000 7f3a7f247700 1 --2- 172.21.15.59:0/1639041492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a780d0820 0x7f3a781f3780 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3a64009b90 tx=0x7f3a64004750 comp rx=0 tx=0).stop 2023-09-21T00:17:51.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.991+0000 7f3a7f247700 1 -- 172.21.15.59:0/1639041492 shutdown_connections 2023-09-21T00:17:51.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.991+0000 7f3a7f247700 1 --2- 172.21.15.59:0/1639041492 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f3a5c06ae00 0x7f3a5c06d2c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:51.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.991+0000 7f3a7f247700 1 --2- 172.21.15.59:0/1639041492 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3a7815b480 0x7f3a780b07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:51.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.991+0000 7f3a7f247700 1 --2- 172.21.15.59:0/1639041492 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a780708f0 0x7f3a780b2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:51.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.991+0000 7f3a7f247700 1 --2- 172.21.15.59:0/1639041492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a780d0820 0x7f3a781f3780 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:51.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.991+0000 7f3a7f247700 1 -- 172.21.15.59:0/1639041492 >> 172.21.15.59:0/1639041492 conn(0x7f3a780d11e0 msgr2=0x7f3a7815cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:51.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.991+0000 7f3a7f247700 1 -- 172.21.15.59:0/1639041492 shutdown_connections 2023-09-21T00:17:51.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:51.991+0000 7f3a7f247700 1 -- 172.21.15.59:0/1639041492 wait complete. 2023-09-21T00:17:52.004 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-21T00:17:52.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.132+0000 7f6575af8700 1 Processor -- start 2023-09-21T00:17:52.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.132+0000 7f6575af8700 1 -- start start 2023-09-21T00:17:52.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.133+0000 7f6575af8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f657015d690 0x7f65700d1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:52.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.133+0000 7f6575af8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f65700d1a60 0x7f65700b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:52.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.133+0000 7f6575af8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65700d1ee0 con 0x7f65700d2f80 2023-09-21T00:17:52.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.133+0000 7f6575af8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65700d21c0 con 0x7f65700d1a60 2023-09-21T00:17:52.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.133+0000 7f6575af8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65700d24a0 con 0x7f657015d690 2023-09-21T00:17:52.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.133+0000 7f656effd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f65700d1a60 0x7f65700b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:52.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.133+0000 7f656ffff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f65700d2f80 0x7f657006b740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57756/0 (socket says 172.21.15.59:57756) 2023-09-21T00:17:52.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.133+0000 7f656ffff700 1 -- 172.21.15.59:0/98988217 learned_addr learned my addr 172.21.15.59:0/98988217 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:52.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.133+0000 7f656f7fe700 1 --2- 172.21.15.59:0/98988217 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f657015d690 0x7f65700d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:52.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.133+0000 7f656effd700 1 -- 172.21.15.59:0/98988217 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f657015d690 msgr2=0x7f65700d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:52.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.133+0000 7f656effd700 1 --2- 172.21.15.59:0/98988217 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f657015d690 0x7f65700d1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:52.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.133+0000 7f656effd700 1 -- 172.21.15.59:0/98988217 >> v1:172.21.15.59:6789/0 conn(0x7f65700d2f80 legacy=0x7f657006b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:52.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.133+0000 7f656effd700 1 -- 172.21.15.59:0/98988217 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65700d2780 con 0x7f65700d1a60 2023-09-21T00:17:52.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.133+0000 7f656e7fc700 1 -- 172.21.15.59:0/98988217 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2203356210 0 0) 0x7f65700d1ee0 con 0x7f65700d2f80 2023-09-21T00:17:52.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.133+0000 7f656f7fe700 1 --2- 172.21.15.59:0/98988217 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f657015d690 0x7f65700d1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:17:52.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.134+0000 7f656effd700 1 --2- 172.21.15.59:0/98988217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65700d1a60 0x7f65700b4f20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6560009840 tx=0x7f6560009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76acd65b3fa88aed server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:52.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.134+0000 7f656e7fc700 1 -- 172.21.15.59:0/98988217 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6560011830 con 0x7f65700d1a60 2023-09-21T00:17:52.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.134+0000 7f656e7fc700 1 -- 172.21.15.59:0/98988217 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6560011990 con 0x7f65700d1a60 2023-09-21T00:17:52.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.134+0000 7f656e7fc700 1 -- 172.21.15.59:0/98988217 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6560011d20 con 0x7f65700d1a60 2023-09-21T00:17:52.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.134+0000 7f6575af8700 1 -- 172.21.15.59:0/98988217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65700d1a60 msgr2=0x7f65700b4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:52.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.134+0000 7f6575af8700 1 --2- 172.21.15.59:0/98988217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65700d1a60 0x7f65700b4f20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6560009840 tx=0x7f6560009b50 comp rx=0 tx=0).stop 2023-09-21T00:17:52.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.134+0000 7f6575af8700 1 -- 172.21.15.59:0/98988217 shutdown_connections 2023-09-21T00:17:52.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.134+0000 7f6575af8700 1 --2- 172.21.15.59:0/98988217 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f657015d690 0x7f65700d1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:52.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.134+0000 7f6575af8700 1 --2- 172.21.15.59:0/98988217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65700d1a60 0x7f65700b4f20 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:52.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.134+0000 7f6575af8700 1 -- 172.21.15.59:0/98988217 >> 172.21.15.59:0/98988217 conn(0x7f6570072560 msgr2=0x7f65700cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:52.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.134+0000 7f6575af8700 1 -- 172.21.15.59:0/98988217 shutdown_connections 2023-09-21T00:17:52.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.134+0000 7f6575af8700 1 -- 172.21.15.59:0/98988217 wait complete. 2023-09-21T00:17:52.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.135+0000 7f6575af8700 1 Processor -- start 2023-09-21T00:17:52.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.136+0000 7f6575af8700 1 -- start start 2023-09-21T00:17:52.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.136+0000 7f6575af8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65700d1a60 0x7f6570159540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:52.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.136+0000 7f6575af8700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65700d2f80 0x7f65701f5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:52.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.136+0000 7f6575af8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f657015d690 0x7f65700c7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:52.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.136+0000 7f6575af8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6570159a80 con 0x7f65700d1a60 2023-09-21T00:17:52.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.136+0000 7f6575af8700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6570156b50 con 0x7f65700d2f80 2023-09-21T00:17:52.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.136+0000 7f6575af8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65701f5990 con 0x7f657015d690 2023-09-21T00:17:52.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.137+0000 7f656f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65700d1a60 0x7f6570159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:52.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.137+0000 7f656f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65700d1a60 0x7f6570159540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52190/0 (socket says 172.21.15.59:52190) 2023-09-21T00:17:52.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.137+0000 7f656f7fe700 1 -- 172.21.15.59:0/2289571767 learned_addr learned my addr 172.21.15.59:0/2289571767 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:52.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.137+0000 7f656ffff700 1 --2- 172.21.15.59:0/2289571767 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f657015d690 0x7f65700c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:52.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.137+0000 7f656effd700 1 --2- 172.21.15.59:0/2289571767 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65700d2f80 0x7f65701f5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:52.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.137+0000 7f656f7fe700 1 -- 172.21.15.59:0/2289571767 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f657015d690 msgr2=0x7f65700c7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:52.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.137+0000 7f656f7fe700 1 --2- 172.21.15.59:0/2289571767 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f657015d690 0x7f65700c7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:52.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.137+0000 7f656f7fe700 1 -- 172.21.15.59:0/2289571767 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65700d2f80 msgr2=0x7f65701f5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:52.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.137+0000 7f656f7fe700 1 --2- 172.21.15.59:0/2289571767 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65700d2f80 0x7f65701f5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:52.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.137+0000 7f656f7fe700 1 -- 172.21.15.59:0/2289571767 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65600094a0 con 0x7f65700d1a60 2023-09-21T00:17:52.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.137+0000 7f656f7fe700 1 --2- 172.21.15.59:0/2289571767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65700d1a60 0x7f6570159540 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f655800e810 tx=0x7f655800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:52.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.137+0000 7f6567fff700 1 -- 172.21.15.59:0/2289571767 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655800c020 con 0x7f65700d1a60 2023-09-21T00:17:52.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.137+0000 7f6567fff700 1 -- 172.21.15.59:0/2289571767 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6558004250 con 0x7f65700d1a60 2023-09-21T00:17:52.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.137+0000 7f6575af8700 1 -- 172.21.15.59:0/2289571767 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6570155f40 con 0x7f65700d1a60 2023-09-21T00:17:52.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.137+0000 7f6567fff700 1 -- 172.21.15.59:0/2289571767 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65580036a0 con 0x7f65700d1a60 2023-09-21T00:17:52.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.137+0000 7f6575af8700 1 -- 172.21.15.59:0/2289571767 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6570156500 con 0x7f65700d1a60 2023-09-21T00:17:52.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.138+0000 7f6575af8700 1 -- 172.21.15.59:0/2289571767 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6570067e50 con 0x7f65700d1a60 2023-09-21T00:17:52.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.139+0000 7f6567fff700 1 -- 172.21.15.59:0/2289571767 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f6558003800 con 0x7f65700d1a60 2023-09-21T00:17:52.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.139+0000 7f6567fff700 1 --2- 172.21.15.59:0/2289571767 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f655006ae00 0x7f655006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:52.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.139+0000 7f6567fff700 1 -- 172.21.15.59:0/2289571767 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f65580894c0 con 0x7f65700d1a60 2023-09-21T00:17:52.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.139+0000 7f656effd700 1 --2- 172.21.15.59:0/2289571767 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f655006ae00 0x7f655006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:52.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.140+0000 7f656effd700 1 --2- 172.21.15.59:0/2289571767 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f655006ae00 0x7f655006d2c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6560009840 tx=0x7f6560008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:52.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.143+0000 7f6567fff700 1 -- 172.21.15.59:0/2289571767 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f65580541d0 con 0x7f65700d1a60 2023-09-21T00:17:52.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.341+0000 7f6575af8700 1 -- 172.21.15.59:0/2289571767 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f657015c0a0 con 0x7f65700d1a60 2023-09-21T00:17:52.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.342+0000 7f6567fff700 1 -- 172.21.15.59:0/2289571767 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f65580577f0 con 0x7f65700d1a60 2023-09-21T00:17:52.343 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-09-21T00:17:52.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.343+0000 7f6575af8700 1 -- 172.21.15.59:0/2289571767 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f655006ae00 msgr2=0x7f655006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:52.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.343+0000 7f6575af8700 1 --2- 172.21.15.59:0/2289571767 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f655006ae00 0x7f655006d2c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6560009840 tx=0x7f6560008030 comp rx=0 tx=0).stop 2023-09-21T00:17:52.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.343+0000 7f6575af8700 1 -- 172.21.15.59:0/2289571767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65700d1a60 msgr2=0x7f6570159540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:52.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.343+0000 7f6575af8700 1 --2- 172.21.15.59:0/2289571767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65700d1a60 0x7f6570159540 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f655800e810 tx=0x7f655800ebd0 comp rx=0 tx=0).stop 2023-09-21T00:17:52.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.344+0000 7f6575af8700 1 -- 172.21.15.59:0/2289571767 shutdown_connections 2023-09-21T00:17:52.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.344+0000 7f6575af8700 1 --2- 172.21.15.59:0/2289571767 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f655006ae00 0x7f655006d2c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:52.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.344+0000 7f6575af8700 1 --2- 172.21.15.59:0/2289571767 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f657015d690 0x7f65700c7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:52.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.344+0000 7f6575af8700 1 --2- 172.21.15.59:0/2289571767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65700d1a60 0x7f6570159540 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:52.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.344+0000 7f6575af8700 1 --2- 172.21.15.59:0/2289571767 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65700d2f80 0x7f65701f5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:52.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.344+0000 7f6575af8700 1 -- 172.21.15.59:0/2289571767 >> 172.21.15.59:0/2289571767 conn(0x7f6570072560 msgr2=0x7f65701546d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:52.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.344+0000 7f6575af8700 1 -- 172.21.15.59:0/2289571767 shutdown_connections 2023-09-21T00:17:52.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.344+0000 7f6575af8700 1 -- 172.21.15.59:0/2289571767 wait complete. 2023-09-21T00:17:52.357 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-21T00:17:52.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.484+0000 7ffa78b82700 1 Processor -- start 2023-09-21T00:17:52.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.484+0000 7ffa78b82700 1 -- start start 2023-09-21T00:17:52.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.485+0000 7ffa78b82700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa7415b480 0x7ffa7406f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:52.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.485+0000 7ffa78b82700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ffa740d0820 0x7ffa740701e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:52.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.485+0000 7ffa78b82700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffa74070720 0x7ffa740cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:52.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.485+0000 7ffa78b82700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa74070b90 con 0x7ffa74070720 2023-09-21T00:17:52.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.485+0000 7ffa78b82700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa740b4030 con 0x7ffa740d0820 2023-09-21T00:17:52.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.485+0000 7ffa78b82700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa740cb8d0 con 0x7ffa7415b480 2023-09-21T00:17:52.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.485+0000 7ffa72d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffa74070720 0x7ffa740cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:52.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.485+0000 7ffa72d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffa74070720 0x7ffa740cedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52202/0 (socket says 172.21.15.59:52202) 2023-09-21T00:17:52.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.485+0000 7ffa72d9d700 1 -- 172.21.15.59:0/3375176723 learned_addr learned my addr 172.21.15.59:0/3375176723 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:52.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.485+0000 7ffa71d9b700 1 --2- 172.21.15.59:0/3375176723 >> v2:172.21.15.83:3300/0 conn(0x7ffa740d0820 0x7ffa740701e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:52.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.485+0000 7ffa7259c700 1 --2- 172.21.15.59:0/3375176723 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa7415b480 0x7ffa7406f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:52.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.486+0000 7ffa72d9d700 1 -- 172.21.15.59:0/3375176723 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa7415b480 msgr2=0x7ffa7406f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:52.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.486+0000 7ffa72d9d700 1 --2- 172.21.15.59:0/3375176723 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa7415b480 0x7ffa7406f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:52.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.486+0000 7ffa72d9d700 1 -- 172.21.15.59:0/3375176723 >> v2:172.21.15.83:3300/0 conn(0x7ffa740d0820 msgr2=0x7ffa740701e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:52.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.486+0000 7ffa72d9d700 1 --2- 172.21.15.59:0/3375176723 >> v2:172.21.15.83:3300/0 conn(0x7ffa740d0820 0x7ffa740701e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:52.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.486+0000 7ffa72d9d700 1 -- 172.21.15.59:0/3375176723 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa740cbb40 con 0x7ffa74070720 2023-09-21T00:17:52.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.486+0000 7ffa7259c700 1 --2- 172.21.15.59:0/3375176723 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa7415b480 0x7ffa7406f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:17:52.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.486+0000 7ffa72d9d700 1 --2- 172.21.15.59:0/3375176723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa74070720 0x7ffa740cedb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ffa740b3dd0 tx=0x7ffa6c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc3ffc8328c9c20 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:52.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.486+0000 7ffa7159a700 1 -- 172.21.15.59:0/3375176723 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c00e070 con 0x7ffa74070720 2023-09-21T00:17:52.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.486+0000 7ffa7159a700 1 -- 172.21.15.59:0/3375176723 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6c00b910 con 0x7ffa74070720 2023-09-21T00:17:52.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.486+0000 7ffa7159a700 1 -- 172.21.15.59:0/3375176723 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c00bcc0 con 0x7ffa74070720 2023-09-21T00:17:52.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.486+0000 7ffa78b82700 1 -- 172.21.15.59:0/3375176723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa74070720 msgr2=0x7ffa740cedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:52.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.486+0000 7ffa78b82700 1 --2- 172.21.15.59:0/3375176723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa74070720 0x7ffa740cedb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ffa740b3dd0 tx=0x7ffa6c00b330 comp rx=0 tx=0).stop 2023-09-21T00:17:52.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.487+0000 7ffa78b82700 1 -- 172.21.15.59:0/3375176723 shutdown_connections 2023-09-21T00:17:52.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.487+0000 7ffa78b82700 1 --2- 172.21.15.59:0/3375176723 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa7415b480 0x7ffa7406f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:52.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.487+0000 7ffa78b82700 1 --2- 172.21.15.59:0/3375176723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa74070720 0x7ffa740cedb0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:52.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.487+0000 7ffa78b82700 1 --2- 172.21.15.59:0/3375176723 >> v2:172.21.15.83:3300/0 conn(0x7ffa740d0820 0x7ffa740701e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:52.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.487+0000 7ffa78b82700 1 -- 172.21.15.59:0/3375176723 >> 172.21.15.59:0/3375176723 conn(0x7ffa740d11e0 msgr2=0x7ffa740d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:52.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.487+0000 7ffa78b82700 1 -- 172.21.15.59:0/3375176723 shutdown_connections 2023-09-21T00:17:52.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.487+0000 7ffa78b82700 1 -- 172.21.15.59:0/3375176723 wait complete. 2023-09-21T00:17:52.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.488+0000 7ffa78b82700 1 Processor -- start 2023-09-21T00:17:52.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.488+0000 7ffa78b82700 1 -- start start 2023-09-21T00:17:52.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.489+0000 7ffa78b82700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa74070720 0x7ffa740afdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:52.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.489+0000 7ffa78b82700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa740d0820 0x7ffa74159940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:52.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.489+0000 7ffa78b82700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa7415b480 0x7ffa74157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:52.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.489+0000 7ffa78b82700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa741e6b50 con 0x7ffa74070720 2023-09-21T00:17:52.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.489+0000 7ffa78b82700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa741e62f0 con 0x7ffa740d0820 2023-09-21T00:17:52.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.489+0000 7ffa78b82700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa741e6590 con 0x7ffa7415b480 2023-09-21T00:17:52.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.489+0000 7ffa7259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa74070720 0x7ffa740afdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:52.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.489+0000 7ffa7259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa74070720 0x7ffa740afdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52204/0 (socket says 172.21.15.59:52204) 2023-09-21T00:17:52.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.489+0000 7ffa7259c700 1 -- 172.21.15.59:0/2106199251 learned_addr learned my addr 172.21.15.59:0/2106199251 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:52.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.489+0000 7ffa71d9b700 1 --2- 172.21.15.59:0/2106199251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa740d0820 0x7ffa74159940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:52.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.489+0000 7ffa72d9d700 1 --2- 172.21.15.59:0/2106199251 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa7415b480 0x7ffa74157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:52.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.489+0000 7ffa7259c700 1 -- 172.21.15.59:0/2106199251 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa7415b480 msgr2=0x7ffa74157120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:52.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.489+0000 7ffa7259c700 1 --2- 172.21.15.59:0/2106199251 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa7415b480 0x7ffa74157120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:52.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.489+0000 7ffa7259c700 1 -- 172.21.15.59:0/2106199251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa740d0820 msgr2=0x7ffa74159940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:52.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.489+0000 7ffa7259c700 1 --2- 172.21.15.59:0/2106199251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa740d0820 0x7ffa74159940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:52.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.489+0000 7ffa7259c700 1 -- 172.21.15.59:0/2106199251 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa6c009b30 con 0x7ffa74070720 2023-09-21T00:17:52.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.489+0000 7ffa71d9b700 1 --2- 172.21.15.59:0/2106199251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa740d0820 0x7ffa74159940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:17:52.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.489+0000 7ffa7259c700 1 --2- 172.21.15.59:0/2106199251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa74070720 0x7ffa740afdf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ffa6400e810 tx=0x7ffa6400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:52.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.490+0000 7ffa6affd700 1 -- 172.21.15.59:0/2106199251 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa64004230 con 0x7ffa74070720 2023-09-21T00:17:52.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.490+0000 7ffa6affd700 1 -- 172.21.15.59:0/2106199251 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa64004390 con 0x7ffa74070720 2023-09-21T00:17:52.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.490+0000 7ffa78b82700 1 -- 172.21.15.59:0/2106199251 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa741e6870 con 0x7ffa74070720 2023-09-21T00:17:52.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.490+0000 7ffa6affd700 1 -- 172.21.15.59:0/2106199251 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa640036a0 con 0x7ffa74070720 2023-09-21T00:17:52.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.490+0000 7ffa78b82700 1 -- 172.21.15.59:0/2106199251 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa741e4a00 con 0x7ffa74070720 2023-09-21T00:17:52.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.491+0000 7ffa78b82700 1 -- 172.21.15.59:0/2106199251 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa74067e50 con 0x7ffa74070720 2023-09-21T00:17:52.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.491+0000 7ffa6affd700 1 -- 172.21.15.59:0/2106199251 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7ffa64003800 con 0x7ffa74070720 2023-09-21T00:17:52.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.492+0000 7ffa6affd700 1 --2- 172.21.15.59:0/2106199251 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ffa5406ae00 0x7ffa5406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:52.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.492+0000 7ffa6affd700 1 -- 172.21.15.59:0/2106199251 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7ffa640893e0 con 0x7ffa74070720 2023-09-21T00:17:52.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.492+0000 7ffa71d9b700 1 --2- 172.21.15.59:0/2106199251 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ffa5406ae00 0x7ffa5406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:52.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.492+0000 7ffa71d9b700 1 --2- 172.21.15.59:0/2106199251 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ffa5406ae00 0x7ffa5406d2c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c009ae0 tx=0x7ffa5c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:52.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.496+0000 7ffa6affd700 1 -- 172.21.15.59:0/2106199251 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7ffa64054180 con 0x7ffa74070720 2023-09-21T00:17:52.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.695+0000 7ffa78b82700 1 -- 172.21.15.59:0/2106199251 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffa740b1300 con 0x7ffa74070720 2023-09-21T00:17:52.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.696+0000 7ffa6affd700 1 -- 172.21.15.59:0/2106199251 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffa640577a0 con 0x7ffa74070720 2023-09-21T00:17:52.697 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-09-21T00:17:52.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.698+0000 7ffa78b82700 1 -- 172.21.15.59:0/2106199251 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ffa5406ae00 msgr2=0x7ffa5406d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:52.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.698+0000 7ffa78b82700 1 --2- 172.21.15.59:0/2106199251 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ffa5406ae00 0x7ffa5406d2c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c009ae0 tx=0x7ffa5c008040 comp rx=0 tx=0).stop 2023-09-21T00:17:52.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.698+0000 7ffa78b82700 1 -- 172.21.15.59:0/2106199251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa74070720 msgr2=0x7ffa740afdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:52.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.698+0000 7ffa78b82700 1 --2- 172.21.15.59:0/2106199251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa74070720 0x7ffa740afdf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ffa6400e810 tx=0x7ffa6400ebd0 comp rx=0 tx=0).stop 2023-09-21T00:17:52.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.698+0000 7ffa78b82700 1 -- 172.21.15.59:0/2106199251 shutdown_connections 2023-09-21T00:17:52.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.698+0000 7ffa78b82700 1 --2- 172.21.15.59:0/2106199251 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ffa5406ae00 0x7ffa5406d2c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:52.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.698+0000 7ffa78b82700 1 --2- 172.21.15.59:0/2106199251 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffa7415b480 0x7ffa74157120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:52.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.698+0000 7ffa78b82700 1 --2- 172.21.15.59:0/2106199251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa74070720 0x7ffa740afdf0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:52.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.698+0000 7ffa78b82700 1 --2- 172.21.15.59:0/2106199251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffa740d0820 0x7ffa74159940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:52.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.698+0000 7ffa78b82700 1 -- 172.21.15.59:0/2106199251 >> 172.21.15.59:0/2106199251 conn(0x7ffa740d11e0 msgr2=0x7ffa7415a690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:52.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.698+0000 7ffa78b82700 1 -- 172.21.15.59:0/2106199251 shutdown_connections 2023-09-21T00:17:52.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.698+0000 7ffa78b82700 1 -- 172.21.15.59:0/2106199251 wait complete. 2023-09-21T00:17:52.711 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-21T00:17:52.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.838+0000 7f48ac783700 1 Processor -- start 2023-09-21T00:17:52.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.838+0000 7f48ac783700 1 -- start start 2023-09-21T00:17:52.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.839+0000 7f48ac783700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f48a415a230 0x7f48a415e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:52.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.839+0000 7f48ac783700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f48a4071d90 0x7f48a406eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:52.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.839+0000 7f48ac783700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48a40cb1c0 con 0x7f48a40ca790 2023-09-21T00:17:52.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.839+0000 7f48ac783700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48a40cb780 con 0x7f48a415a230 2023-09-21T00:17:52.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.839+0000 7f48ac783700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a40cb4a0 con 0x7f48a4071d90 2023-09-21T00:17:52.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.839+0000 7f48aa51f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f48a415a230 0x7f48a415e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:52.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.839+0000 7f48aa51f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f48a415a230 0x7f48a415e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52212/0 (socket says 172.21.15.59:52212) 2023-09-21T00:17:52.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.839+0000 7f48aa51f700 1 -- 172.21.15.59:0/703865040 learned_addr learned my addr 172.21.15.59:0/703865040 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:52.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.839+0000 7f48aad20700 1 --2- 172.21.15.59:0/703865040 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f48a4071d90 0x7f48a406eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:52.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.839+0000 7f48aa51f700 1 -- 172.21.15.59:0/703865040 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f48a4071d90 msgr2=0x7f48a406eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:52.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.839+0000 7f48aa51f700 1 --2- 172.21.15.59:0/703865040 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f48a4071d90 0x7f48a406eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:52.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.839+0000 7f48aa51f700 1 -- 172.21.15.59:0/703865040 >> v1:172.21.15.83:6789/0 conn(0x7f48a40ca790 legacy=0x7f48a4071680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:52.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.839+0000 7f48aa51f700 1 -- 172.21.15.59:0/703865040 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a415e0b0 con 0x7f48a415a230 2023-09-21T00:17:52.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.839+0000 7f48aad20700 1 --2- 172.21.15.59:0/703865040 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f48a4071d90 0x7f48a406eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:17:52.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.839+0000 7f48aa51f700 1 --2- 172.21.15.59:0/703865040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48a415a230 0x7f48a415e8b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f48a000bb90 tx=0x7f48a000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff785962ee8b57cd server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:52.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.840+0000 7f48a951d700 1 -- 172.21.15.59:0/703865040 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a000dd50 con 0x7f48a415a230 2023-09-21T00:17:52.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.840+0000 7f48a951d700 1 -- 172.21.15.59:0/703865040 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a0010470 con 0x7f48a415a230 2023-09-21T00:17:52.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.840+0000 7f48a951d700 1 -- 172.21.15.59:0/703865040 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a0010800 con 0x7f48a415a230 2023-09-21T00:17:52.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.840+0000 7f48ac783700 1 -- 172.21.15.59:0/703865040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48a415a230 msgr2=0x7f48a415e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:52.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.840+0000 7f48ac783700 1 --2- 172.21.15.59:0/703865040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48a415a230 0x7f48a415e8b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f48a000bb90 tx=0x7f48a000bea0 comp rx=0 tx=0).stop 2023-09-21T00:17:52.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.840+0000 7f48ac783700 1 -- 172.21.15.59:0/703865040 shutdown_connections 2023-09-21T00:17:52.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.840+0000 7f48ac783700 1 --2- 172.21.15.59:0/703865040 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f48a4071d90 0x7f48a406eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:52.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.840+0000 7f48ac783700 1 --2- 172.21.15.59:0/703865040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48a415a230 0x7f48a415e8b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:52.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.840+0000 7f48ac783700 1 -- 172.21.15.59:0/703865040 >> 172.21.15.59:0/703865040 conn(0x7f48a40d0140 msgr2=0x7f48a40d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:52.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.840+0000 7f48ac783700 1 -- 172.21.15.59:0/703865040 shutdown_connections 2023-09-21T00:17:52.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.840+0000 7f48ac783700 1 -- 172.21.15.59:0/703865040 wait complete. 2023-09-21T00:17:52.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.842+0000 7f48ac783700 1 Processor -- start 2023-09-21T00:17:52.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.842+0000 7f48ac783700 1 -- start start 2023-09-21T00:17:52.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.843+0000 7f48ac783700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48a4071d90 0x7f48a4157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:52.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.843+0000 7f48ac783700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f48a40ca790 0x7f48a415d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:52.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.843+0000 7f48ac783700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48a415a230 0x7f48a40b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:52.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.843+0000 7f48ac783700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a40b5a70 con 0x7f48a415a230 2023-09-21T00:17:52.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.843+0000 7f48ac783700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a40b3830 con 0x7f48a4071d90 2023-09-21T00:17:52.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.843+0000 7f48ac783700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a415d5e0 con 0x7f48a40ca790 2023-09-21T00:17:52.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.843+0000 7f48aad20700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48a415a230 0x7f48a40b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:52.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.843+0000 7f48aad20700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48a415a230 0x7f48a40b3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52222/0 (socket says 172.21.15.59:52222) 2023-09-21T00:17:52.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.843+0000 7f48aad20700 1 -- 172.21.15.59:0/1760527093 learned_addr learned my addr 172.21.15.59:0/1760527093 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:52.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.843+0000 7f48aa51f700 1 --2- 172.21.15.59:0/1760527093 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48a4071d90 0x7f48a4157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:52.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.843+0000 7f48a9d1e700 1 --2- 172.21.15.59:0/1760527093 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f48a40ca790 0x7f48a415d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:52.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.843+0000 7f48aad20700 1 -- 172.21.15.59:0/1760527093 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f48a40ca790 msgr2=0x7f48a415d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:52.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.843+0000 7f48aad20700 1 --2- 172.21.15.59:0/1760527093 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f48a40ca790 0x7f48a415d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:52.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.843+0000 7f48aad20700 1 -- 172.21.15.59:0/1760527093 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48a4071d90 msgr2=0x7f48a4157720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:52.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.843+0000 7f48aad20700 1 --2- 172.21.15.59:0/1760527093 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48a4071d90 0x7f48a4157720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:52.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.843+0000 7f48aad20700 1 -- 172.21.15.59:0/1760527093 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a000b7f0 con 0x7f48a415a230 2023-09-21T00:17:52.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.843+0000 7f48aad20700 1 --2- 172.21.15.59:0/1760527093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48a415a230 0x7f48a40b3cc0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f489c007ef0 tx=0x7f489c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:52.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.843+0000 7f489affd700 1 -- 172.21.15.59:0/1760527093 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c00dd80 con 0x7f48a415a230 2023-09-21T00:17:52.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.844+0000 7f489affd700 1 -- 172.21.15.59:0/1760527093 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489c00f040 con 0x7f48a415a230 2023-09-21T00:17:52.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.844+0000 7f48ac783700 1 -- 172.21.15.59:0/1760527093 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48a40b2f00 con 0x7f48a415a230 2023-09-21T00:17:52.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.844+0000 7f489affd700 1 -- 172.21.15.59:0/1760527093 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c003c60 con 0x7f48a415a230 2023-09-21T00:17:52.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.844+0000 7f48ac783700 1 -- 172.21.15.59:0/1760527093 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48a40b34c0 con 0x7f48a415a230 2023-09-21T00:17:52.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.845+0000 7f48ac783700 1 -- 172.21.15.59:0/1760527093 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48a415e340 con 0x7f48a415a230 2023-09-21T00:17:52.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.845+0000 7f489affd700 1 -- 172.21.15.59:0/1760527093 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f489c004030 con 0x7f48a415a230 2023-09-21T00:17:52.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.845+0000 7f489affd700 1 --2- 172.21.15.59:0/1760527093 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f488806ae00 0x7f488806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:52.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.846+0000 7f489affd700 1 -- 172.21.15.59:0/1760527093 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f489c089a10 con 0x7f48a415a230 2023-09-21T00:17:52.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.846+0000 7f48aa51f700 1 --2- 172.21.15.59:0/1760527093 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f488806ae00 0x7f488806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:52.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.846+0000 7f48aa51f700 1 --2- 172.21.15.59:0/1760527093 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f488806ae00 0x7f488806d2c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f48a000bee0 tx=0x7f48a0013000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:52.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:52.850+0000 7f489affd700 1 -- 172.21.15.59:0/1760527093 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f489c054730 con 0x7f48a415a230 2023-09-21T00:17:53.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.049+0000 7f48ac783700 1 -- 172.21.15.59:0/1760527093 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f48a4067e50 con 0x7f48a415a230 2023-09-21T00:17:53.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.050+0000 7f489affd700 1 -- 172.21.15.59:0/1760527093 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f489c057d50 con 0x7f48a415a230 2023-09-21T00:17:53.051 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-09-21T00:17:53.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.052+0000 7f48ac783700 1 -- 172.21.15.59:0/1760527093 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f488806ae00 msgr2=0x7f488806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:53.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.052+0000 7f48ac783700 1 --2- 172.21.15.59:0/1760527093 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f488806ae00 0x7f488806d2c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f48a000bee0 tx=0x7f48a0013000 comp rx=0 tx=0).stop 2023-09-21T00:17:53.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.052+0000 7f48ac783700 1 -- 172.21.15.59:0/1760527093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48a415a230 msgr2=0x7f48a40b3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:53.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.052+0000 7f48ac783700 1 --2- 172.21.15.59:0/1760527093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48a415a230 0x7f48a40b3cc0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f489c007ef0 tx=0x7f489c00d3b0 comp rx=0 tx=0).stop 2023-09-21T00:17:53.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.052+0000 7f48ac783700 1 -- 172.21.15.59:0/1760527093 shutdown_connections 2023-09-21T00:17:53.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.052+0000 7f48ac783700 1 --2- 172.21.15.59:0/1760527093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48a415a230 0x7f48a40b3cc0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:53.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.052+0000 7f48ac783700 1 --2- 172.21.15.59:0/1760527093 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48a4071d90 0x7f48a4157720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:53.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.052+0000 7f48ac783700 1 --2- 172.21.15.59:0/1760527093 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f488806ae00 0x7f488806d2c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:53.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.052+0000 7f48ac783700 1 --2- 172.21.15.59:0/1760527093 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f48a40ca790 0x7f48a415d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:53.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.052+0000 7f48ac783700 1 -- 172.21.15.59:0/1760527093 >> 172.21.15.59:0/1760527093 conn(0x7f48a40d0140 msgr2=0x7f48a406f800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:53.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.052+0000 7f48ac783700 1 -- 172.21.15.59:0/1760527093 shutdown_connections 2023-09-21T00:17:53.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.052+0000 7f48ac783700 1 -- 172.21.15.59:0/1760527093 wait complete. 2023-09-21T00:17:53.065 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T00:17:53.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.190+0000 7fd69bfe7700 1 Processor -- start 2023-09-21T00:17:53.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.191+0000 7fd69bfe7700 1 -- start start 2023-09-21T00:17:53.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.191+0000 7fd69bfe7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd694159a80 0x7fd694071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:53.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.191+0000 7fd69bfe7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd6940c9870 0x7fd69406c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:53.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.191+0000 7fd69bfe7700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd6940cc530 0x7fd69406cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:53.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.191+0000 7fd69bfe7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6940cb060 con 0x7fd6940c9870 2023-09-21T00:17:53.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.191+0000 7fd69bfe7700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd69415e2f0 con 0x7fd6940cc530 2023-09-21T00:17:53.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.191+0000 7fd69bfe7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd694070fe0 con 0x7fd694159a80 2023-09-21T00:17:53.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.191+0000 7fd699582700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd6940c9870 0x7fd69406c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:53.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.191+0000 7fd699582700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd6940c9870 0x7fd69406c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52226/0 (socket says 172.21.15.59:52226) 2023-09-21T00:17:53.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.192+0000 7fd699582700 1 -- 172.21.15.59:0/4192681923 learned_addr learned my addr 172.21.15.59:0/4192681923 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:53.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.192+0000 7fd699d83700 1 --2- 172.21.15.59:0/4192681923 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd694159a80 0x7fd694071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:53.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.192+0000 7fd69a584700 1 --2- 172.21.15.59:0/4192681923 >> v2:172.21.15.83:3300/0 conn(0x7fd6940cc530 0x7fd69406cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:53.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.192+0000 7fd699582700 1 -- 172.21.15.59:0/4192681923 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd694159a80 msgr2=0x7fd694071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:53.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.192+0000 7fd699582700 1 --2- 172.21.15.59:0/4192681923 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd694159a80 0x7fd694071ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:53.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.192+0000 7fd699582700 1 -- 172.21.15.59:0/4192681923 >> v2:172.21.15.83:3300/0 conn(0x7fd6940cc530 msgr2=0x7fd69406cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:53.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.192+0000 7fd699582700 1 --2- 172.21.15.59:0/4192681923 >> v2:172.21.15.83:3300/0 conn(0x7fd6940cc530 0x7fd69406cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:53.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.192+0000 7fd699582700 1 -- 172.21.15.59:0/4192681923 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6940712c0 con 0x7fd6940c9870 2023-09-21T00:17:53.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.192+0000 7fd699582700 1 --2- 172.21.15.59:0/4192681923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6940c9870 0x7fd69406c650 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd694072b00 tx=0x7fd69000be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7339d16164dd291f server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:53.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.192+0000 7fd698d81700 1 -- 172.21.15.59:0/4192681923 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69000db60 con 0x7fd6940c9870 2023-09-21T00:17:53.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.192+0000 7fd698d81700 1 -- 172.21.15.59:0/4192681923 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd69000dcc0 con 0x7fd6940c9870 2023-09-21T00:17:53.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.192+0000 7fd698d81700 1 -- 172.21.15.59:0/4192681923 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd690017630 con 0x7fd6940c9870 2023-09-21T00:17:53.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.193+0000 7fd69bfe7700 1 -- 172.21.15.59:0/4192681923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6940c9870 msgr2=0x7fd69406c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:53.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.193+0000 7fd69bfe7700 1 --2- 172.21.15.59:0/4192681923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6940c9870 0x7fd69406c650 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd694072b00 tx=0x7fd69000be70 comp rx=0 tx=0).stop 2023-09-21T00:17:53.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.193+0000 7fd69bfe7700 1 -- 172.21.15.59:0/4192681923 shutdown_connections 2023-09-21T00:17:53.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.193+0000 7fd69bfe7700 1 --2- 172.21.15.59:0/4192681923 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd694159a80 0x7fd694071ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:53.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.193+0000 7fd69bfe7700 1 --2- 172.21.15.59:0/4192681923 >> v2:172.21.15.83:3300/0 conn(0x7fd6940cc530 0x7fd69406cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:53.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.193+0000 7fd69bfe7700 1 --2- 172.21.15.59:0/4192681923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6940c9870 0x7fd69406c650 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:53.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.193+0000 7fd69bfe7700 1 -- 172.21.15.59:0/4192681923 >> 172.21.15.59:0/4192681923 conn(0x7fd6940b0d70 msgr2=0x7fd6940b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:53.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.193+0000 7fd69bfe7700 1 -- 172.21.15.59:0/4192681923 shutdown_connections 2023-09-21T00:17:53.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.193+0000 7fd69bfe7700 1 -- 172.21.15.59:0/4192681923 wait complete. 2023-09-21T00:17:53.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.194+0000 7fd69bfe7700 1 Processor -- start 2023-09-21T00:17:53.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.194+0000 7fd69bfe7700 1 -- start start 2023-09-21T00:17:53.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.195+0000 7fd69bfe7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd6940c9870 0x7fd6940c7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:53.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.195+0000 7fd69bfe7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6940cc530 0x7fd6940c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:53.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.195+0000 7fd69bfe7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd694159a80 0x7fd6941f2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:53.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.195+0000 7fd69bfe7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6940adff0 con 0x7fd6940cc530 2023-09-21T00:17:53.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.195+0000 7fd69bfe7700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6940ad370 con 0x7fd694159a80 2023-09-21T00:17:53.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.195+0000 7fd69bfe7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6940ad650 con 0x7fd6940c9870 2023-09-21T00:17:53.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.195+0000 7fd699582700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6940cc530 0x7fd6940c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:53.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.195+0000 7fd699582700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6940cc530 0x7fd6940c7d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52234/0 (socket says 172.21.15.59:52234) 2023-09-21T00:17:53.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.195+0000 7fd699582700 1 -- 172.21.15.59:0/2673324910 learned_addr learned my addr 172.21.15.59:0/2673324910 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:53.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.195+0000 7fd699d83700 1 --2- 172.21.15.59:0/2673324910 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd6940c9870 0x7fd6940c7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:53.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.195+0000 7fd69a584700 1 --2- 172.21.15.59:0/2673324910 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd694159a80 0x7fd6941f2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:53.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.195+0000 7fd699582700 1 -- 172.21.15.59:0/2673324910 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd6940c9870 msgr2=0x7fd6940c7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:53.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.195+0000 7fd699582700 1 --2- 172.21.15.59:0/2673324910 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd6940c9870 0x7fd6940c7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:53.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.195+0000 7fd699582700 1 -- 172.21.15.59:0/2673324910 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd694159a80 msgr2=0x7fd6941f2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:53.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.195+0000 7fd699582700 1 --2- 172.21.15.59:0/2673324910 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd694159a80 0x7fd6941f2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:53.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.195+0000 7fd699582700 1 -- 172.21.15.59:0/2673324910 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd69000b7f0 con 0x7fd6940cc530 2023-09-21T00:17:53.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.195+0000 7fd699d83700 1 --2- 172.21.15.59:0/2673324910 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd6940c9870 0x7fd6940c7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:17:53.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.195+0000 7fd69a584700 1 --2- 172.21.15.59:0/2673324910 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd694159a80 0x7fd6941f2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:17:53.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.195+0000 7fd699582700 1 --2- 172.21.15.59:0/2673324910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6940cc530 0x7fd6940c7d80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd690019040 tx=0x7fd690004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:53.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.196+0000 7fd68a7fc700 1 -- 172.21.15.59:0/2673324910 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd690009070 con 0x7fd6940cc530 2023-09-21T00:17:53.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.196+0000 7fd68a7fc700 1 -- 172.21.15.59:0/2673324910 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd69000a040 con 0x7fd6940cc530 2023-09-21T00:17:53.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.196+0000 7fd69bfe7700 1 -- 172.21.15.59:0/2673324910 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6940ad930 con 0x7fd6940cc530 2023-09-21T00:17:53.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.196+0000 7fd68a7fc700 1 -- 172.21.15.59:0/2673324910 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6900044b0 con 0x7fd6940cc530 2023-09-21T00:17:53.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.196+0000 7fd69bfe7700 1 -- 172.21.15.59:0/2673324910 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6940c77d0 con 0x7fd6940cc530 2023-09-21T00:17:53.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.196+0000 7fd69bfe7700 1 -- 172.21.15.59:0/2673324910 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6940c7960 con 0x7fd6940cc530 2023-09-21T00:17:53.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.197+0000 7fd68a7fc700 1 -- 172.21.15.59:0/2673324910 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fd690015070 con 0x7fd6940cc530 2023-09-21T00:17:53.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.197+0000 7fd68a7fc700 1 --2- 172.21.15.59:0/2673324910 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd67806ae00 0x7fd67806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:53.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.197+0000 7fd68a7fc700 1 -- 172.21.15.59:0/2673324910 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fd69008acd0 con 0x7fd6940cc530 2023-09-21T00:17:53.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.198+0000 7fd699d83700 1 --2- 172.21.15.59:0/2673324910 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd67806ae00 0x7fd67806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:53.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.198+0000 7fd699d83700 1 --2- 172.21.15.59:0/2673324910 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd67806ae00 0x7fd67806d2c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd684009b10 tx=0x7fd684008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:53.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.202+0000 7fd68a7fc700 1 -- 172.21.15.59:0/2673324910 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fd690055b20 con 0x7fd6940cc530 2023-09-21T00:17:53.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.402+0000 7fd69bfe7700 1 -- 172.21.15.59:0/2673324910 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6940ae130 con 0x7fd6940cc530 2023-09-21T00:17:53.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.404+0000 7fd68a7fc700 1 -- 172.21.15.59:0/2673324910 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18792 (secure 0 0 0) 0x7fd6940ae130 con 0x7fd6940cc530 2023-09-21T00:17:53.405 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:17:53.405 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":26,"fsid":"dd69925c-6e25-42fe-880b-2f60fc6f384b","created":"2023-09-21T00:16:43.074489+0000","modified":"2023-09-21T00:17:50.090179+0000","last_up_change":"2023-09-21T00:16:54.740101+0000","last_in_change":"2023-09-21T00:16:45.987089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T00:16:54.796248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-21T00:17:04.167102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-21T00:17:05.313188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-21T00:17:08.977609+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d4b18344-74c0-4f75-920b-7a9247e48914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6809","nonce":2418314235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6811","nonce":2418314235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6815","nonce":2418314235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6813","nonce":2418314235}]},"public_addr":"172.21.15.59:6809/2418314235","cluster_addr":"172.21.15.59:6811/2418314235","heartbeat_back_addr":"172.21.15.59:6815/2418314235","heartbeat_front_addr":"172.21.15.59:6813/2418314235","state":["exists","up"]},{"osd":1,"uuid":"80940d50-a248-4e64-a282-7ffcdad790ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6801","nonce":869668251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6803","nonce":869668251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6807","nonce":869668251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6805","nonce":869668251}]},"public_addr":"172.21.15.59:6801/869668251","cluster_addr":"172.21.15.59:6803/869668251","heartbeat_back_addr":"172.21.15.59:6807/869668251","heartbeat_front_addr":"172.21.15.59:6805/869668251","state":["exists","up"]},{"osd":2,"uuid":"55f2eceb-c54a-4879-a6ce-968c1c548b5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6817","nonce":372517778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6819","nonce":372517778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6823","nonce":372517778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6821","nonce":372517778}]},"public_addr":"172.21.15.59:6817/372517778","cluster_addr":"172.21.15.59:6819/372517778","heartbeat_back_addr":"172.21.15.59:6823/372517778","heartbeat_front_addr":"172.21.15.59:6821/372517778","state":["exists","up"]},{"osd":3,"uuid":"92b89cd0-869c-49b9-a9f9-97ac8423f304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6825","nonce":575188498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6827","nonce":575188498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6831","nonce":575188498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6829","nonce":575188498}]},"public_addr":"172.21.15.59:6825/575188498","cluster_addr":"172.21.15.59:6827/575188498","heartbeat_back_addr":"172.21.15.59:6831/575188498","heartbeat_front_addr":"172.21.15.59:6829/575188498","state":["exists","up"]},{"osd":4,"uuid":"25b80e94-e0e6-403d-b69f-61542f289637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6803","nonce":1741219098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6805","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6807","nonce":1741219098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6815","nonce":1741219098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6811","nonce":1741219098}]},"public_addr":"172.21.15.83:6803/1741219098","cluster_addr":"172.21.15.83:6807/1741219098","heartbeat_back_addr":"172.21.15.83:6815/1741219098","heartbeat_front_addr":"172.21.15.83:6811/1741219098","state":["exists","up"]},{"osd":5,"uuid":"5498d9ab-1086-4796-a199-9051e6dfea91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6817","nonce":156730565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6819","nonce":156730565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6823","nonce":156730565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6821","nonce":156730565}]},"public_addr":"172.21.15.83:6817/156730565","cluster_addr":"172.21.15.83:6819/156730565","heartbeat_back_addr":"172.21.15.83:6823/156730565","heartbeat_front_addr":"172.21.15.83:6821/156730565","state":["exists","up"]},{"osd":6,"uuid":"cfd810c0-5015-4d60-9a75-7efc93a32e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6801","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6800","nonce":1337723778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6806","nonce":1337723778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6814","nonce":1337723778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6810","nonce":1337723778}]},"public_addr":"172.21.15.83:6800/1337723778","cluster_addr":"172.21.15.83:6806/1337723778","heartbeat_back_addr":"172.21.15.83:6814/1337723778","heartbeat_front_addr":"172.21.15.83:6810/1337723778","state":["exists","up"]},{"osd":7,"uuid":"e992c8fa-0a3d-4b3c-85b5-2c511223dee4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6825","nonce":4204859272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6827","nonce":4204859272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6831","nonce":4204859272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6829","nonce":4204859272}]},"public_addr":"172.21.15.83:6825/4204859272","cluster_addr":"172.21.15.83:6827/4204859272","heartbeat_back_addr":"172.21.15.83:6831/4204859272","heartbeat_front_addr":"172.21.15.83:6829/4204859272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.156498+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.882707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.093978+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.158565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.173933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.888606+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.135525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.149712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":3,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.34","mappings":[{"from":4,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":6}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T00:17:53.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.406+0000 7fd69bfe7700 1 -- 172.21.15.59:0/2673324910 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd67806ae00 msgr2=0x7fd67806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:53.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.406+0000 7fd69bfe7700 1 --2- 172.21.15.59:0/2673324910 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd67806ae00 0x7fd67806d2c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd684009b10 tx=0x7fd684008040 comp rx=0 tx=0).stop 2023-09-21T00:17:53.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.406+0000 7fd69bfe7700 1 -- 172.21.15.59:0/2673324910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6940cc530 msgr2=0x7fd6940c7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:53.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.406+0000 7fd69bfe7700 1 --2- 172.21.15.59:0/2673324910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6940cc530 0x7fd6940c7d80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd690019040 tx=0x7fd690004750 comp rx=0 tx=0).stop 2023-09-21T00:17:53.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.406+0000 7fd69bfe7700 1 -- 172.21.15.59:0/2673324910 shutdown_connections 2023-09-21T00:17:53.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.406+0000 7fd69bfe7700 1 --2- 172.21.15.59:0/2673324910 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd694159a80 0x7fd6941f2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:53.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.406+0000 7fd69bfe7700 1 --2- 172.21.15.59:0/2673324910 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd67806ae00 0x7fd67806d2c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:53.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.406+0000 7fd69bfe7700 1 --2- 172.21.15.59:0/2673324910 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd6940c9870 0x7fd6940c7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:53.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.406+0000 7fd69bfe7700 1 --2- 172.21.15.59:0/2673324910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6940cc530 0x7fd6940c7d80 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:53.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.406+0000 7fd69bfe7700 1 -- 172.21.15.59:0/2673324910 >> 172.21.15.59:0/2673324910 conn(0x7fd6940b0d70 msgr2=0x7fd6940b0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:53.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.406+0000 7fd69bfe7700 1 -- 172.21.15.59:0/2673324910 shutdown_connections 2023-09-21T00:17:53.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.406+0000 7fd69bfe7700 1 -- 172.21.15.59:0/2673324910 wait complete. 2023-09-21T00:17:53.419 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-21T00:16:54.796248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-21T00:17:04.167102+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-21T00:17:05.313188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-21T00:17:08.977609+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-21T00:17:53.420 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-21T00:17:53.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.547+0000 7f58404f7700 1 Processor -- start 2023-09-21T00:17:53.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.547+0000 7f58404f7700 1 -- start start 2023-09-21T00:17:53.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.548+0000 7f58404f7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f58380ceee0 0x7f58380cf360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:53.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.548+0000 7f58404f7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f583806a780 0x7f583806ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:53.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.548+0000 7f58404f7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f583806ef90 con 0x7f5838144d40 2023-09-21T00:17:53.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.548+0000 7f58404f7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f583806b150 con 0x7f58380ceee0 2023-09-21T00:17:53.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.548+0000 7f58404f7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5838145120 con 0x7f583806a780 2023-09-21T00:17:53.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.549+0000 7f583da92700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f58380ceee0 0x7f58380cf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:53.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.549+0000 7f583da92700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f58380ceee0 0x7f58380cf360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52240/0 (socket says 172.21.15.59:52240) 2023-09-21T00:17:53.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.549+0000 7f583da92700 1 -- 172.21.15.59:0/1956610528 learned_addr learned my addr 172.21.15.59:0/1956610528 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:53.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.549+0000 7f583e293700 1 --1- 172.21.15.59:0/1956610528 >> v1:172.21.15.59:6789/0 conn(0x7f5838144d40 0x7f58380716e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57808/0 (socket says 172.21.15.59:57808) 2023-09-21T00:17:53.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.549+0000 7f583ea94700 1 --2- 172.21.15.59:0/1956610528 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f583806a780 0x7f583806ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:53.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.549+0000 7f583da92700 1 -- 172.21.15.59:0/1956610528 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f583806a780 msgr2=0x7f583806ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:53.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.549+0000 7f583da92700 1 --2- 172.21.15.59:0/1956610528 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f583806a780 0x7f583806ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:53.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.549+0000 7f583d291700 1 -- 172.21.15.59:0/1956610528 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1279777272 0 0) 0x7f583806ef90 con 0x7f5838144d40 2023-09-21T00:17:53.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.549+0000 7f583da92700 1 -- 172.21.15.59:0/1956610528 >> v1:172.21.15.59:6789/0 conn(0x7f5838144d40 legacy=0x7f58380716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:53.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.549+0000 7f583da92700 1 -- 172.21.15.59:0/1956610528 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58380cff80 con 0x7f58380ceee0 2023-09-21T00:17:53.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.549+0000 7f583ea94700 1 --2- 172.21.15.59:0/1956610528 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f583806a780 0x7f583806ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:17:53.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.549+0000 7f583da92700 1 --2- 172.21.15.59:0/1956610528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58380ceee0 0x7f58380cf360 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5834009920 tx=0x7f5834009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70c1e3b04f90de6d server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:53.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.549+0000 7f583d291700 1 -- 172.21.15.59:0/1956610528 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583400ba20 con 0x7f58380ceee0 2023-09-21T00:17:53.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.549+0000 7f583d291700 1 -- 172.21.15.59:0/1956610528 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f583400bb80 con 0x7f58380ceee0 2023-09-21T00:17:53.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.549+0000 7f583d291700 1 -- 172.21.15.59:0/1956610528 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5834009e70 con 0x7f58380ceee0 2023-09-21T00:17:53.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.550+0000 7f58404f7700 1 -- 172.21.15.59:0/1956610528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58380ceee0 msgr2=0x7f58380cf360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:53.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.550+0000 7f58404f7700 1 --2- 172.21.15.59:0/1956610528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58380ceee0 0x7f58380cf360 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5834009920 tx=0x7f5834009c30 comp rx=0 tx=0).stop 2023-09-21T00:17:53.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.550+0000 7f58404f7700 1 -- 172.21.15.59:0/1956610528 shutdown_connections 2023-09-21T00:17:53.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.550+0000 7f58404f7700 1 --2- 172.21.15.59:0/1956610528 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f583806a780 0x7f583806ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:53.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.550+0000 7f58404f7700 1 --2- 172.21.15.59:0/1956610528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58380ceee0 0x7f58380cf360 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:53.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.550+0000 7f58404f7700 1 -- 172.21.15.59:0/1956610528 >> 172.21.15.59:0/1956610528 conn(0x7f58380b1d80 msgr2=0x7f58380b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:53.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.550+0000 7f58404f7700 1 -- 172.21.15.59:0/1956610528 shutdown_connections 2023-09-21T00:17:53.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.550+0000 7f58404f7700 1 -- 172.21.15.59:0/1956610528 wait complete. 2023-09-21T00:17:53.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.551+0000 7f58404f7700 1 Processor -- start 2023-09-21T00:17:53.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.551+0000 7f58404f7700 1 -- start start 2023-09-21T00:17:53.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.552+0000 7f58404f7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f583806a780 0x7f58381f3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:53.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.552+0000 7f58404f7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58380ceee0 0x7f58380cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:53.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.552+0000 7f58404f7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5838144d40 0x7f58380ca620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:53.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.552+0000 7f58404f7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58380b32b0 con 0x7f58380ceee0 2023-09-21T00:17:53.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.552+0000 7f58404f7700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58381f3a70 con 0x7f5838144d40 2023-09-21T00:17:53.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.552+0000 7f58404f7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58380b4600 con 0x7f583806a780 2023-09-21T00:17:53.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.552+0000 7f583da92700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58380ceee0 0x7f58380cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:53.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.552+0000 7f583da92700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58380ceee0 0x7f58380cb3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52246/0 (socket says 172.21.15.59:52246) 2023-09-21T00:17:53.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.552+0000 7f583da92700 1 -- 172.21.15.59:0/1854525776 learned_addr learned my addr 172.21.15.59:0/1854525776 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:53.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.552+0000 7f583e293700 1 --2- 172.21.15.59:0/1854525776 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f583806a780 0x7f58381f3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:53.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.552+0000 7f583ea94700 1 --2- 172.21.15.59:0/1854525776 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5838144d40 0x7f58380ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:53.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.552+0000 7f583da92700 1 -- 172.21.15.59:0/1854525776 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f583806a780 msgr2=0x7f58381f3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:53.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.552+0000 7f583da92700 1 --2- 172.21.15.59:0/1854525776 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f583806a780 0x7f58381f3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:53.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.552+0000 7f583da92700 1 -- 172.21.15.59:0/1854525776 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5838144d40 msgr2=0x7f58380ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:53.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.552+0000 7f583da92700 1 --2- 172.21.15.59:0/1854525776 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5838144d40 0x7f58380ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:53.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.552+0000 7f583da92700 1 -- 172.21.15.59:0/1854525776 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5834009550 con 0x7f58380ceee0 2023-09-21T00:17:53.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.552+0000 7f583da92700 1 --2- 172.21.15.59:0/1854525776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58380ceee0 0x7f58380cb3a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5834014040 tx=0x7f5834004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:53.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.553+0000 7f582effd700 1 -- 172.21.15.59:0/1854525776 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5834011930 con 0x7f58380ceee0 2023-09-21T00:17:53.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.553+0000 7f582effd700 1 -- 172.21.15.59:0/1854525776 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f583401e070 con 0x7f58380ceee0 2023-09-21T00:17:53.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.553+0000 7f58404f7700 1 -- 172.21.15.59:0/1854525776 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58380cb8e0 con 0x7f58380ceee0 2023-09-21T00:17:53.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.553+0000 7f582effd700 1 -- 172.21.15.59:0/1854525776 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5834011cd0 con 0x7f58380ceee0 2023-09-21T00:17:53.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.553+0000 7f58404f7700 1 -- 172.21.15.59:0/1854525776 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58381f6940 con 0x7f58380ceee0 2023-09-21T00:17:53.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.554+0000 7f58404f7700 1 -- 172.21.15.59:0/1854525776 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58380b3460 con 0x7f58380ceee0 2023-09-21T00:17:53.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.554+0000 7f582effd700 1 -- 172.21.15.59:0/1854525776 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f583402d450 con 0x7f58380ceee0 2023-09-21T00:17:53.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.555+0000 7f582effd700 1 --2- 172.21.15.59:0/1854525776 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f581c06ae00 0x7f581c06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:53.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.555+0000 7f582effd700 1 -- 172.21.15.59:0/1854525776 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f583408a8d0 con 0x7f58380ceee0 2023-09-21T00:17:53.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.555+0000 7f583e293700 1 --2- 172.21.15.59:0/1854525776 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f581c06ae00 0x7f581c06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:53.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.555+0000 7f583e293700 1 --2- 172.21.15.59:0/1854525776 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f581c06ae00 0x7f581c06d2c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5828000f60 tx=0x7f5828007e70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:53.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.559+0000 7f582effd700 1 -- 172.21.15.59:0/1854525776 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f58380b3460 con 0x7f58380ceee0 2023-09-21T00:17:53.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.761+0000 7f58404f7700 1 -- 172.21.15.59:0/1854525776 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f58380b3460 con 0x7f58380ceee0 2023-09-21T00:17:53.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.761+0000 7f582effd700 1 -- 172.21.15.59:0/1854525776 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f58380b3460 con 0x7f58380ceee0 2023-09-21T00:17:53.763 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-09-21T00:17:53.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.763+0000 7f58404f7700 1 -- 172.21.15.59:0/1854525776 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f581c06ae00 msgr2=0x7f581c06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:53.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.763+0000 7f58404f7700 1 --2- 172.21.15.59:0/1854525776 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f581c06ae00 0x7f581c06d2c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5828000f60 tx=0x7f5828007e70 comp rx=0 tx=0).stop 2023-09-21T00:17:53.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.763+0000 7f58404f7700 1 -- 172.21.15.59:0/1854525776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58380ceee0 msgr2=0x7f58380cb3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:53.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.763+0000 7f58404f7700 1 --2- 172.21.15.59:0/1854525776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58380ceee0 0x7f58380cb3a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5834014040 tx=0x7f5834004750 comp rx=0 tx=0).stop 2023-09-21T00:17:53.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.763+0000 7f58404f7700 1 -- 172.21.15.59:0/1854525776 shutdown_connections 2023-09-21T00:17:53.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.763+0000 7f58404f7700 1 --2- 172.21.15.59:0/1854525776 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5838144d40 0x7f58380ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:53.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.763+0000 7f58404f7700 1 --2- 172.21.15.59:0/1854525776 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f581c06ae00 0x7f581c06d2c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:53.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.763+0000 7f58404f7700 1 --2- 172.21.15.59:0/1854525776 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f583806a780 0x7f58381f3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:53.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.763+0000 7f58404f7700 1 --2- 172.21.15.59:0/1854525776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58380ceee0 0x7f58380cb3a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:53.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.763+0000 7f58404f7700 1 -- 172.21.15.59:0/1854525776 >> 172.21.15.59:0/1854525776 conn(0x7f58380b1d80 msgr2=0x7f58380b0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:53.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.763+0000 7f58404f7700 1 -- 172.21.15.59:0/1854525776 shutdown_connections 2023-09-21T00:17:53.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.763+0000 7f58404f7700 1 -- 172.21.15.59:0/1854525776 wait complete. 2023-09-21T00:17:53.777 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-21T00:17:53.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.904+0000 7f56714ee700 1 Processor -- start 2023-09-21T00:17:53.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.904+0000 7f56714ee700 1 -- start start 2023-09-21T00:17:53.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.905+0000 7f56714ee700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f566c0caaa0 0x7f566c1651e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:53.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.905+0000 7f56714ee700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f566c071dc0 con 0x7f566c15e9b0 2023-09-21T00:17:53.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.905+0000 7f56714ee700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f566c0720a0 con 0x7f566c15e5d0 2023-09-21T00:17:53.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.905+0000 7f56714ee700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f566c15ee30 con 0x7f566c0caaa0 2023-09-21T00:17:53.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.905+0000 7f566b7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f566c0caaa0 0x7f566c1651e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:53.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.905+0000 7f566a7fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f566c15e9b0 0x7f566c0cb9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57822/0 (socket says 172.21.15.59:57822) 2023-09-21T00:17:53.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.905+0000 7f566a7fc700 1 -- 172.21.15.59:0/2633172985 learned_addr learned my addr 172.21.15.59:0/2633172985 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:53.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.905+0000 7f566b7fe700 1 -- 172.21.15.59:0/2633172985 >> v1:172.21.15.83:6789/0 conn(0x7f566c15e5d0 legacy=0x7f566c071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:53.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.905+0000 7f566b7fe700 1 -- 172.21.15.59:0/2633172985 >> v1:172.21.15.59:6789/0 conn(0x7f566c15e9b0 legacy=0x7f566c0cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:53.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.905+0000 7f5669ffb700 1 -- 172.21.15.59:0/2633172985 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3346807561 0 0) 0x7f566c071dc0 con 0x7f566c15e9b0 2023-09-21T00:17:53.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.905+0000 7f566b7fe700 1 -- 172.21.15.59:0/2633172985 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f566c072380 con 0x7f566c0caaa0 2023-09-21T00:17:53.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.905+0000 7f566b7fe700 1 --2- 172.21.15.59:0/2633172985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f566c0caaa0 0x7f566c1651e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5664009d90 tx=0x7f566400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46786204f8f63354 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:53.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.906+0000 7f5669ffb700 1 -- 172.21.15.59:0/2633172985 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566400e070 con 0x7f566c0caaa0 2023-09-21T00:17:53.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.906+0000 7f5669ffb700 1 -- 172.21.15.59:0/2633172985 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566400bb90 con 0x7f566c0caaa0 2023-09-21T00:17:53.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.906+0000 7f5669ffb700 1 -- 172.21.15.59:0/2633172985 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5664003a20 con 0x7f566c0caaa0 2023-09-21T00:17:53.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.906+0000 7f56714ee700 1 -- 172.21.15.59:0/2633172985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f566c0caaa0 msgr2=0x7f566c1651e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:53.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.906+0000 7f56714ee700 1 --2- 172.21.15.59:0/2633172985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f566c0caaa0 0x7f566c1651e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5664009d90 tx=0x7f566400b330 comp rx=0 tx=0).stop 2023-09-21T00:17:53.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.906+0000 7f56714ee700 1 -- 172.21.15.59:0/2633172985 shutdown_connections 2023-09-21T00:17:53.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.906+0000 7f56714ee700 1 --2- 172.21.15.59:0/2633172985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f566c0caaa0 0x7f566c1651e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:53.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.906+0000 7f56714ee700 1 -- 172.21.15.59:0/2633172985 >> 172.21.15.59:0/2633172985 conn(0x7f566c0b0d70 msgr2=0x7f566c0b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:53.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.906+0000 7f56714ee700 1 -- 172.21.15.59:0/2633172985 shutdown_connections 2023-09-21T00:17:53.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.906+0000 7f56714ee700 1 -- 172.21.15.59:0/2633172985 wait complete. 2023-09-21T00:17:53.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.908+0000 7f56714ee700 1 Processor -- start 2023-09-21T00:17:53.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.908+0000 7f56714ee700 1 -- start start 2023-09-21T00:17:53.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.908+0000 7f56714ee700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f566c0caaa0 0x7f566c156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:53.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.908+0000 7f56714ee700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f566c15e5d0 0x7f566c15b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:53.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.908+0000 7f56714ee700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f566c15e9b0 0x7f566c0c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:53.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.908+0000 7f56714ee700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566c0b2300 con 0x7f566c0caaa0 2023-09-21T00:17:53.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.908+0000 7f56714ee700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566c15bd40 con 0x7f566c15e5d0 2023-09-21T00:17:53.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.908+0000 7f56714ee700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f566c15c020 con 0x7f566c15e9b0 2023-09-21T00:17:53.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.908+0000 7f566affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f566c0caaa0 0x7f566c156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:53.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.908+0000 7f566affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f566c0caaa0 0x7f566c156bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52258/0 (socket says 172.21.15.59:52258) 2023-09-21T00:17:53.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.908+0000 7f566affd700 1 -- 172.21.15.59:0/2681141048 learned_addr learned my addr 172.21.15.59:0/2681141048 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:53.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.909+0000 7f566b7fe700 1 --2- 172.21.15.59:0/2681141048 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f566c15e9b0 0x7f566c0c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:53.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.909+0000 7f566a7fc700 1 --2- 172.21.15.59:0/2681141048 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f566c15e5d0 0x7f566c15b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:53.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.909+0000 7f566affd700 1 -- 172.21.15.59:0/2681141048 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f566c15e9b0 msgr2=0x7f566c0c4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:53.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.909+0000 7f566affd700 1 --2- 172.21.15.59:0/2681141048 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f566c15e9b0 0x7f566c0c4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:53.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.909+0000 7f566affd700 1 -- 172.21.15.59:0/2681141048 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f566c15e5d0 msgr2=0x7f566c15b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:53.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.909+0000 7f566affd700 1 --2- 172.21.15.59:0/2681141048 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f566c15e5d0 0x7f566c15b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:53.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.909+0000 7f566affd700 1 -- 172.21.15.59:0/2681141048 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5664009a70 con 0x7f566c0caaa0 2023-09-21T00:17:53.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.909+0000 7f566a7fc700 1 --2- 172.21.15.59:0/2681141048 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f566c15e5d0 0x7f566c15b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:17:53.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.909+0000 7f566affd700 1 --2- 172.21.15.59:0/2681141048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f566c0caaa0 0x7f566c156bb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f566000c4d0 tx=0x7f566000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:53.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.909+0000 7f56537fe700 1 -- 172.21.15.59:0/2681141048 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5660011790 con 0x7f566c0caaa0 2023-09-21T00:17:53.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.909+0000 7f56537fe700 1 -- 172.21.15.59:0/2681141048 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56600118f0 con 0x7f566c0caaa0 2023-09-21T00:17:53.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.909+0000 7f56714ee700 1 -- 172.21.15.59:0/2681141048 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f566c15c300 con 0x7f566c0caaa0 2023-09-21T00:17:53.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.909+0000 7f56537fe700 1 -- 172.21.15.59:0/2681141048 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5660011ca0 con 0x7f566c0caaa0 2023-09-21T00:17:53.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.909+0000 7f56714ee700 1 -- 172.21.15.59:0/2681141048 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f566c1570f0 con 0x7f566c0caaa0 2023-09-21T00:17:53.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.910+0000 7f56714ee700 1 -- 172.21.15.59:0/2681141048 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f566c0b2450 con 0x7f566c0caaa0 2023-09-21T00:17:53.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.911+0000 7f56537fe700 1 -- 172.21.15.59:0/2681141048 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f566001c460 con 0x7f566c0caaa0 2023-09-21T00:17:53.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.911+0000 7f56537fe700 1 --2- 172.21.15.59:0/2681141048 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f565806ae00 0x7f565806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:53.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.911+0000 7f56537fe700 1 -- 172.21.15.59:0/2681141048 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f56600896b0 con 0x7f566c0caaa0 2023-09-21T00:17:53.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.911+0000 7f566a7fc700 1 --2- 172.21.15.59:0/2681141048 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f565806ae00 0x7f565806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:53.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.912+0000 7f566a7fc700 1 --2- 172.21.15.59:0/2681141048 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f565806ae00 0x7f565806d2c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f566c0b4fa0 tx=0x7f565c007ca0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:53.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:53.916+0000 7f56537fe700 1 -- 172.21.15.59:0/2681141048 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f566c0b2450 con 0x7f566c0caaa0 2023-09-21T00:17:54.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.116+0000 7f56714ee700 1 -- 172.21.15.59:0/2681141048 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f566c0b2450 con 0x7f566c0caaa0 2023-09-21T00:17:54.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.116+0000 7f56537fe700 1 -- 172.21.15.59:0/2681141048 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f566c0b2450 con 0x7f566c0caaa0 2023-09-21T00:17:54.117 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-09-21T00:17:54.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.118+0000 7f56714ee700 1 -- 172.21.15.59:0/2681141048 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f565806ae00 msgr2=0x7f565806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:54.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.118+0000 7f56714ee700 1 --2- 172.21.15.59:0/2681141048 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f565806ae00 0x7f565806d2c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f566c0b4fa0 tx=0x7f565c007ca0 comp rx=0 tx=0).stop 2023-09-21T00:17:54.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.118+0000 7f56714ee700 1 -- 172.21.15.59:0/2681141048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f566c0caaa0 msgr2=0x7f566c156bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:54.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.118+0000 7f56714ee700 1 --2- 172.21.15.59:0/2681141048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f566c0caaa0 0x7f566c156bb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f566000c4d0 tx=0x7f566000c7e0 comp rx=0 tx=0).stop 2023-09-21T00:17:54.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.118+0000 7f56714ee700 1 -- 172.21.15.59:0/2681141048 shutdown_connections 2023-09-21T00:17:54.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.118+0000 7f56714ee700 1 --2- 172.21.15.59:0/2681141048 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f565806ae00 0x7f565806d2c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:54.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.118+0000 7f56714ee700 1 --2- 172.21.15.59:0/2681141048 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f566c15e9b0 0x7f566c0c4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:54.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.118+0000 7f56714ee700 1 --2- 172.21.15.59:0/2681141048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f566c0caaa0 0x7f566c156bb0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:54.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.118+0000 7f56714ee700 1 --2- 172.21.15.59:0/2681141048 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f566c15e5d0 0x7f566c15b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:54.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.118+0000 7f56714ee700 1 -- 172.21.15.59:0/2681141048 >> 172.21.15.59:0/2681141048 conn(0x7f566c0b0d70 msgr2=0x7f566c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:54.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.118+0000 7f56714ee700 1 -- 172.21.15.59:0/2681141048 shutdown_connections 2023-09-21T00:17:54.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.118+0000 7f56714ee700 1 -- 172.21.15.59:0/2681141048 wait complete. 2023-09-21T00:17:54.132 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-21T00:17:54.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.259+0000 7f156ed09700 1 Processor -- start 2023-09-21T00:17:54.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.259+0000 7f156ed09700 1 -- start start 2023-09-21T00:17:54.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.260+0000 7f156ed09700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1568157d50 0x7f1568071680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:54.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.260+0000 7f156ed09700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f156815af60 0x7f1568071bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:54.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.260+0000 7f156ed09700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f156815b580 con 0x7f156815eac0 2023-09-21T00:17:54.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.260+0000 7f156ed09700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f156815b860 con 0x7f1568157d50 2023-09-21T00:17:54.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.260+0000 7f156ed09700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15680cc860 con 0x7f156815af60 2023-09-21T00:17:54.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.260+0000 7f156caa5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1568157d50 0x7f1568071680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:54.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.260+0000 7f156caa5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1568157d50 0x7f1568071680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52266/0 (socket says 172.21.15.59:52266) 2023-09-21T00:17:54.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.260+0000 7f156caa5700 1 -- 172.21.15.59:0/2323222303 learned_addr learned my addr 172.21.15.59:0/2323222303 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:54.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.260+0000 7f156d2a6700 1 --2- 172.21.15.59:0/2323222303 >> v2:172.21.15.83:3300/0 conn(0x7f156815af60 0x7f1568071bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:54.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.260+0000 7f156caa5700 1 -- 172.21.15.59:0/2323222303 >> v2:172.21.15.83:3300/0 conn(0x7f156815af60 msgr2=0x7f1568071bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:54.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.260+0000 7f156caa5700 1 --2- 172.21.15.59:0/2323222303 >> v2:172.21.15.83:3300/0 conn(0x7f156815af60 0x7f1568071bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:54.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.260+0000 7f156caa5700 1 -- 172.21.15.59:0/2323222303 >> v1:172.21.15.83:6789/0 conn(0x7f156815eac0 legacy=0x7f156815a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:54.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.260+0000 7f156caa5700 1 -- 172.21.15.59:0/2323222303 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f156815dfe0 con 0x7f1568157d50 2023-09-21T00:17:54.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.260+0000 7f156caa5700 1 --2- 172.21.15.59:0/2323222303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1568157d50 0x7f1568071680 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f15680cffd0 tx=0x7f155c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59d3a2c14379c21 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:54.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.260+0000 7f15677fe700 1 -- 172.21.15.59:0/2323222303 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c004230 con 0x7f1568157d50 2023-09-21T00:17:54.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.260+0000 7f15677fe700 1 -- 172.21.15.59:0/2323222303 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155c004390 con 0x7f1568157d50 2023-09-21T00:17:54.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.260+0000 7f15677fe700 1 -- 172.21.15.59:0/2323222303 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c0036a0 con 0x7f1568157d50 2023-09-21T00:17:54.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.261+0000 7f156ed09700 1 -- 172.21.15.59:0/2323222303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1568157d50 msgr2=0x7f1568071680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:54.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.261+0000 7f156ed09700 1 --2- 172.21.15.59:0/2323222303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1568157d50 0x7f1568071680 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f15680cffd0 tx=0x7f155c009bd0 comp rx=0 tx=0).stop 2023-09-21T00:17:54.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.261+0000 7f156ed09700 1 -- 172.21.15.59:0/2323222303 shutdown_connections 2023-09-21T00:17:54.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.261+0000 7f156ed09700 1 --2- 172.21.15.59:0/2323222303 >> v2:172.21.15.83:3300/0 conn(0x7f156815af60 0x7f1568071bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:54.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.261+0000 7f156ed09700 1 --2- 172.21.15.59:0/2323222303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1568157d50 0x7f1568071680 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:54.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.261+0000 7f156ed09700 1 -- 172.21.15.59:0/2323222303 >> 172.21.15.59:0/2323222303 conn(0x7f15680d0120 msgr2=0x7f15680d0530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:54.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.261+0000 7f156ed09700 1 -- 172.21.15.59:0/2323222303 shutdown_connections 2023-09-21T00:17:54.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.261+0000 7f156ed09700 1 -- 172.21.15.59:0/2323222303 wait complete. 2023-09-21T00:17:54.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.262+0000 7f156ed09700 1 Processor -- start 2023-09-21T00:17:54.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.262+0000 7f156ed09700 1 -- start start 2023-09-21T00:17:54.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.263+0000 7f156ed09700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1568157d50 0x7f156814b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:54.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.263+0000 7f156ed09700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f156815af60 0x7f156814be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:54.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.263+0000 7f156ed09700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f156815eac0 0x7f156815c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:54.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.263+0000 7f156ed09700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156815b9a0 con 0x7f156815af60 2023-09-21T00:17:54.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.263+0000 7f156ed09700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156814bbe0 con 0x7f1568157d50 2023-09-21T00:17:54.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.263+0000 7f156ed09700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f156815bc40 con 0x7f156815eac0 2023-09-21T00:17:54.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.263+0000 7f1567fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f156815af60 0x7f156814be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:54.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.263+0000 7f1567fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f156815af60 0x7f156814be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52274/0 (socket says 172.21.15.59:52274) 2023-09-21T00:17:54.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.263+0000 7f1567fff700 1 -- 172.21.15.59:0/3268869863 learned_addr learned my addr 172.21.15.59:0/3268869863 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:54.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.263+0000 7f156caa5700 1 --2- 172.21.15.59:0/3268869863 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1568157d50 0x7f156814b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:54.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.263+0000 7f156d2a6700 1 --2- 172.21.15.59:0/3268869863 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f156815eac0 0x7f156815c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:54.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.264+0000 7f1567fff700 1 -- 172.21.15.59:0/3268869863 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f156815eac0 msgr2=0x7f156815c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:54.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.264+0000 7f1567fff700 1 --2- 172.21.15.59:0/3268869863 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f156815eac0 0x7f156815c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:54.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.264+0000 7f1567fff700 1 -- 172.21.15.59:0/3268869863 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1568157d50 msgr2=0x7f156814b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:54.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.264+0000 7f1567fff700 1 --2- 172.21.15.59:0/3268869863 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1568157d50 0x7f156814b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:54.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.264+0000 7f1567fff700 1 -- 172.21.15.59:0/3268869863 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f155c009550 con 0x7f156815af60 2023-09-21T00:17:54.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.264+0000 7f156d2a6700 1 --2- 172.21.15.59:0/3268869863 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f156815eac0 0x7f156815c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:17:54.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.264+0000 7f156caa5700 1 --2- 172.21.15.59:0/3268869863 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1568157d50 0x7f156814b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:17:54.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.264+0000 7f1567fff700 1 --2- 172.21.15.59:0/3268869863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f156815af60 0x7f156814be20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f155400c4d0 tx=0x7f155400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:54.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.264+0000 7f15657fa700 1 -- 172.21.15.59:0/3268869863 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1554011790 con 0x7f156815af60 2023-09-21T00:17:54.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.264+0000 7f15657fa700 1 -- 172.21.15.59:0/3268869863 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15540118f0 con 0x7f156815af60 2023-09-21T00:17:54.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.264+0000 7f156ed09700 1 -- 172.21.15.59:0/3268869863 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f156815bf20 con 0x7f156815af60 2023-09-21T00:17:54.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.264+0000 7f15657fa700 1 -- 172.21.15.59:0/3268869863 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1554011ca0 con 0x7f156815af60 2023-09-21T00:17:54.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.264+0000 7f156ed09700 1 -- 172.21.15.59:0/3268869863 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f156815c4e0 con 0x7f156815af60 2023-09-21T00:17:54.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.265+0000 7f156ed09700 1 -- 172.21.15.59:0/3268869863 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f156815c670 con 0x7f156815af60 2023-09-21T00:17:54.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.265+0000 7f15657fa700 1 -- 172.21.15.59:0/3268869863 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f155401c460 con 0x7f156815af60 2023-09-21T00:17:54.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.266+0000 7f15657fa700 1 --2- 172.21.15.59:0/3268869863 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f154c06ae00 0x7f154c06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:54.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.266+0000 7f15657fa700 1 -- 172.21.15.59:0/3268869863 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f1554089710 con 0x7f156815af60 2023-09-21T00:17:54.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.266+0000 7f156caa5700 1 --2- 172.21.15.59:0/3268869863 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f154c06ae00 0x7f154c06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:54.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.266+0000 7f156caa5700 1 --2- 172.21.15.59:0/3268869863 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f154c06ae00 0x7f154c06d2c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f155c009130 tx=0x7f155c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:54.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.270+0000 7f15657fa700 1 -- 172.21.15.59:0/3268869863 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f15540544b0 con 0x7f156815af60 2023-09-21T00:17:54.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.471+0000 7f156ed09700 1 -- 172.21.15.59:0/3268869863 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1568067e50 con 0x7f156815af60 2023-09-21T00:17:54.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.471+0000 7f15657fa700 1 -- 172.21.15.59:0/3268869863 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1554057ad0 con 0x7f156815af60 2023-09-21T00:17:54.472 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-09-21T00:17:54.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.473+0000 7f156ed09700 1 -- 172.21.15.59:0/3268869863 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f154c06ae00 msgr2=0x7f154c06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:54.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.473+0000 7f156ed09700 1 --2- 172.21.15.59:0/3268869863 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f154c06ae00 0x7f154c06d2c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f155c009130 tx=0x7f155c008030 comp rx=0 tx=0).stop 2023-09-21T00:17:54.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.473+0000 7f156ed09700 1 -- 172.21.15.59:0/3268869863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f156815af60 msgr2=0x7f156814be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:54.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.473+0000 7f156ed09700 1 --2- 172.21.15.59:0/3268869863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f156815af60 0x7f156814be20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f155400c4d0 tx=0x7f155400c890 comp rx=0 tx=0).stop 2023-09-21T00:17:54.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.473+0000 7f156ed09700 1 -- 172.21.15.59:0/3268869863 shutdown_connections 2023-09-21T00:17:54.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.473+0000 7f156ed09700 1 --2- 172.21.15.59:0/3268869863 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f154c06ae00 0x7f154c06d2c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:54.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.473+0000 7f156ed09700 1 --2- 172.21.15.59:0/3268869863 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f156815eac0 0x7f156815c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:54.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.473+0000 7f156ed09700 1 --2- 172.21.15.59:0/3268869863 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1568157d50 0x7f156814b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:54.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.473+0000 7f156ed09700 1 --2- 172.21.15.59:0/3268869863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f156815af60 0x7f156814be20 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:54.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.473+0000 7f156ed09700 1 -- 172.21.15.59:0/3268869863 >> 172.21.15.59:0/3268869863 conn(0x7f15680d0120 msgr2=0x7f1568158b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:54.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.473+0000 7f156ed09700 1 -- 172.21.15.59:0/3268869863 shutdown_connections 2023-09-21T00:17:54.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.473+0000 7f156ed09700 1 -- 172.21.15.59:0/3268869863 wait complete. 2023-09-21T00:17:54.486 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-21T00:17:54.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.614+0000 7f70d5c7e700 1 Processor -- start 2023-09-21T00:17:54.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.614+0000 7f70d5c7e700 1 -- start start 2023-09-21T00:17:54.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.614+0000 7f70d5c7e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f70d015b550 0x7f70d015e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:54.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.614+0000 7f70d5c7e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70d015ed50 con 0x7f70d0070de0 2023-09-21T00:17:54.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.615+0000 7f70d5c7e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70d00b2b10 con 0x7f70d00cb210 2023-09-21T00:17:54.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.615+0000 7f70d5c7e700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70d00cc120 con 0x7f70d015b550 2023-09-21T00:17:54.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.615+0000 7f70cffff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f70d0070de0 0x7f70d00b4200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57852/0 (socket says 172.21.15.59:57852) 2023-09-21T00:17:54.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.615+0000 7f70cffff700 1 -- 172.21.15.59:0/108499680 learned_addr learned my addr 172.21.15.59:0/108499680 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:54.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.615+0000 7f70ceffd700 1 --2- 172.21.15.59:0/108499680 >> v2:172.21.15.83:3300/0 conn(0x7f70d015b550 0x7f70d015e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:54.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.615+0000 7f70ce7fc700 1 -- 172.21.15.59:0/108499680 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1029165639 0 0) 0x7f70c80014e0 con 0x7f70d0070de0 2023-09-21T00:17:54.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.615+0000 7f70ce7fc700 1 -- 172.21.15.59:0/108499680 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70b80035b0 con 0x7f70d0070de0 2023-09-21T00:17:54.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.615+0000 7f70ce7fc700 1 -- 172.21.15.59:0/108499680 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 509878725 0 0) 0x7f70d00b2b10 con 0x7f70d00cb210 2023-09-21T00:17:54.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.615+0000 7f70ce7fc700 1 -- 172.21.15.59:0/108499680 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70c80014e0 con 0x7f70d00cb210 2023-09-21T00:17:54.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.615+0000 7f70ce7fc700 1 -- 172.21.15.59:0/108499680 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3607637712 0 0) 0x7f70b80035b0 con 0x7f70d0070de0 2023-09-21T00:17:54.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.615+0000 7f70ce7fc700 1 -- 172.21.15.59:0/108499680 >> v2:172.21.15.83:3300/0 conn(0x7f70d015b550 msgr2=0x7f70d015e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:54.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.615+0000 7f70ce7fc700 1 --2- 172.21.15.59:0/108499680 >> v2:172.21.15.83:3300/0 conn(0x7f70d015b550 0x7f70d015e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:54.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.615+0000 7f70ce7fc700 1 -- 172.21.15.59:0/108499680 >> v1:172.21.15.83:6789/0 conn(0x7f70d00cb210 legacy=0x7f70d00cb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:54.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.615+0000 7f70ce7fc700 1 -- 172.21.15.59:0/108499680 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d00cbe40 con 0x7f70d0070de0 2023-09-21T00:17:54.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.615+0000 7f70ce7fc700 1 -- 172.21.15.59:0/108499680 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 710825841 0 0) 0x7f70c8001bd0 con 0x7f70d0070de0 2023-09-21T00:17:54.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.615+0000 7f70ceffd700 1 --2- 172.21.15.59:0/108499680 >> v2:172.21.15.83:3300/0 conn(0x7f70d015b550 0x7f70d015e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T00:17:54.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.615+0000 7f70ce7fc700 1 -- 172.21.15.59:0/108499680 >> v1:172.21.15.59:6789/0 conn(0x7f70d0070de0 legacy=0x7f70d00b4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:54.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.615+0000 7f70ce7fc700 1 --2- 172.21.15.59:0/108499680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70b8003b90 0x7f70b8003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:54.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.615+0000 7f70ce7fc700 1 --2- 172.21.15.59:0/108499680 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70b8004850 0x7f70b8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:54.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.615+0000 7f70ce7fc700 1 --2- 172.21.15.59:0/108499680 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f70b8005210 0x7f70b800dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:54.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.615+0000 7f70ce7fc700 1 -- 172.21.15.59:0/108499680 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d00cc120 con 0x7f70b8003b90 2023-09-21T00:17:54.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.615+0000 7f70ce7fc700 1 -- 172.21.15.59:0/108499680 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b800e2a0 con 0x7f70b8004850 2023-09-21T00:17:54.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.615+0000 7f70ce7fc700 1 -- 172.21.15.59:0/108499680 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b800e460 con 0x7f70b8005210 2023-09-21T00:17:54.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.615+0000 7f70cf7fe700 1 --2- 172.21.15.59:0/108499680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70b8003b90 0x7f70b8003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:54.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.616+0000 7f70ceffd700 1 --2- 172.21.15.59:0/108499680 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70b8004850 0x7f70b8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:54.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.616+0000 7f70cffff700 1 --2- 172.21.15.59:0/108499680 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f70b8005210 0x7f70b800dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:54.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.616+0000 7f70cf7fe700 1 -- 172.21.15.59:0/108499680 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f70b8005210 msgr2=0x7f70b800dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:54.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.616+0000 7f70cf7fe700 1 --2- 172.21.15.59:0/108499680 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f70b8005210 0x7f70b800dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:54.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.616+0000 7f70cf7fe700 1 -- 172.21.15.59:0/108499680 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70b8004850 msgr2=0x7f70b8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:54.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.616+0000 7f70cf7fe700 1 --2- 172.21.15.59:0/108499680 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70b8004850 0x7f70b8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:54.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.616+0000 7f70cf7fe700 1 -- 172.21.15.59:0/108499680 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b80035b0 con 0x7f70b8003b90 2023-09-21T00:17:54.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.616+0000 7f70ceffd700 1 --2- 172.21.15.59:0/108499680 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70b8004850 0x7f70b8004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:17:54.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.616+0000 7f70cffff700 1 -- 172.21.15.59:0/108499680 reap_dead start 2023-09-21T00:17:54.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.616+0000 7f70cf7fe700 1 --2- 172.21.15.59:0/108499680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70b8003b90 0x7f70b8003f90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f70c4001940 tx=0x7f70b8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24d2e1d38e852ab5 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:54.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.616+0000 7f70ce7fc700 1 -- 172.21.15.59:0/108499680 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c4001430 con 0x7f70b8003b90 2023-09-21T00:17:54.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.616+0000 7f70ce7fc700 1 -- 172.21.15.59:0/108499680 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c4001d70 con 0x7f70b8003b90 2023-09-21T00:17:54.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.616+0000 7f70ce7fc700 1 -- 172.21.15.59:0/108499680 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c4005530 con 0x7f70b8003b90 2023-09-21T00:17:54.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.616+0000 7f70d5c7e700 1 -- 172.21.15.59:0/108499680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70b8003b90 msgr2=0x7f70b8003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:54.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.616+0000 7f70d5c7e700 1 --2- 172.21.15.59:0/108499680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70b8003b90 0x7f70b8003f90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f70c4001940 tx=0x7f70b8005880 comp rx=0 tx=0).stop 2023-09-21T00:17:54.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.617+0000 7f70d5c7e700 1 -- 172.21.15.59:0/108499680 shutdown_connections 2023-09-21T00:17:54.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.617+0000 7f70d5c7e700 1 --2- 172.21.15.59:0/108499680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70b8003b90 0x7f70b8003f90 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:54.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.617+0000 7f70d5c7e700 1 -- 172.21.15.59:0/108499680 >> 172.21.15.59:0/108499680 conn(0x7f70d006a780 msgr2=0x7f70d006ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:54.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.617+0000 7f70d5c7e700 1 -- 172.21.15.59:0/108499680 shutdown_connections 2023-09-21T00:17:54.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.617+0000 7f70d5c7e700 1 -- 172.21.15.59:0/108499680 wait complete. 2023-09-21T00:17:54.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.618+0000 7f70d5c7e700 1 Processor -- start 2023-09-21T00:17:54.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.618+0000 7f70d5c7e700 1 -- start start 2023-09-21T00:17:54.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.619+0000 7f70d5c7e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70b8003b90 0x7f70d00b4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:54.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.619+0000 7f70d5c7e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70d0159070 0x7f70d01594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:54.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.619+0000 7f70d5c7e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f70d01f2d30 0x7f70d01f31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:54.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.619+0000 7f70d5c7e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d0144b60 con 0x7f70d0159070 2023-09-21T00:17:54.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.619+0000 7f70d5c7e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d01f6320 con 0x7f70b8003b90 2023-09-21T00:17:54.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.619+0000 7f70d5c7e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d0159a10 con 0x7f70d01f2d30 2023-09-21T00:17:54.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.619+0000 7f70ceffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70d0159070 0x7f70d01594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:54.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.619+0000 7f70ceffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70d0159070 0x7f70d01594d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52294/0 (socket says 172.21.15.59:52294) 2023-09-21T00:17:54.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.619+0000 7f70ceffd700 1 -- 172.21.15.59:0/184648149 learned_addr learned my addr 172.21.15.59:0/184648149 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:54.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.619+0000 7f70cf7fe700 1 --2- 172.21.15.59:0/184648149 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70b8003b90 0x7f70d00b4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:54.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.619+0000 7f70cffff700 1 --2- 172.21.15.59:0/184648149 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f70d01f2d30 0x7f70d01f31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:54.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.619+0000 7f70ceffd700 1 -- 172.21.15.59:0/184648149 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f70d01f2d30 msgr2=0x7f70d01f31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:54.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.619+0000 7f70ceffd700 1 --2- 172.21.15.59:0/184648149 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f70d01f2d30 0x7f70d01f31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:54.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.619+0000 7f70ceffd700 1 -- 172.21.15.59:0/184648149 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70b8003b90 msgr2=0x7f70d00b4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:54.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.619+0000 7f70ceffd700 1 --2- 172.21.15.59:0/184648149 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70b8003b90 0x7f70d00b4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:54.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.619+0000 7f70ceffd700 1 -- 172.21.15.59:0/184648149 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d01f6b80 con 0x7f70d0159070 2023-09-21T00:17:54.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.619+0000 7f70cf7fe700 1 --2- 172.21.15.59:0/184648149 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70b8003b90 0x7f70d00b4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:17:54.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.619+0000 7f70ceffd700 1 --2- 172.21.15.59:0/184648149 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70d0159070 0x7f70d01594d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f70c0011830 tx=0x7f70c0011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:54.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.619+0000 7f70b7fff700 1 -- 172.21.15.59:0/184648149 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c0015870 con 0x7f70d0159070 2023-09-21T00:17:54.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.619+0000 7f70b7fff700 1 -- 172.21.15.59:0/184648149 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c00159d0 con 0x7f70d0159070 2023-09-21T00:17:54.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.619+0000 7f70d5c7e700 1 -- 172.21.15.59:0/184648149 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70d01f3ab0 con 0x7f70d0159070 2023-09-21T00:17:54.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.619+0000 7f70b7fff700 1 -- 172.21.15.59:0/184648149 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c0015d60 con 0x7f70d0159070 2023-09-21T00:17:54.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.620+0000 7f70d5c7e700 1 -- 172.21.15.59:0/184648149 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d01f6810 con 0x7f70d0159070 2023-09-21T00:17:54.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.621+0000 7f70d5c7e700 1 -- 172.21.15.59:0/184648149 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70d01f6d10 con 0x7f70d0159070 2023-09-21T00:17:54.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.621+0000 7f70b7fff700 1 -- 172.21.15.59:0/184648149 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f70c001d400 con 0x7f70d0159070 2023-09-21T00:17:54.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.621+0000 7f70b7fff700 1 --2- 172.21.15.59:0/184648149 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f70bc06ae00 0x7f70bc06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:54.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.621+0000 7f70b7fff700 1 -- 172.21.15.59:0/184648149 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f70c008a0f0 con 0x7f70d0159070 2023-09-21T00:17:54.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.621+0000 7f70cf7fe700 1 --2- 172.21.15.59:0/184648149 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f70bc06ae00 0x7f70bc06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:54.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.622+0000 7f70cf7fe700 1 --2- 172.21.15.59:0/184648149 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f70bc06ae00 0x7f70bc06d2c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f70c4015040 tx=0x7f70c400a000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:54.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.626+0000 7f70b7fff700 1 -- 172.21.15.59:0/184648149 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f70c0054e90 con 0x7f70d0159070 2023-09-21T00:17:54.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.822+0000 7f70d5c7e700 1 -- 172.21.15.59:0/184648149 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f70d0067e50 con 0x7f70d0159070 2023-09-21T00:17:54.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.823+0000 7f70b7fff700 1 -- 172.21.15.59:0/184648149 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f70c00584b0 con 0x7f70d0159070 2023-09-21T00:17:54.826 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-09-21T00:17:54.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.825+0000 7f70d5c7e700 1 -- 172.21.15.59:0/184648149 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f70bc06ae00 msgr2=0x7f70bc06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:54.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.825+0000 7f70d5c7e700 1 --2- 172.21.15.59:0/184648149 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f70bc06ae00 0x7f70bc06d2c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f70c4015040 tx=0x7f70c400a000 comp rx=0 tx=0).stop 2023-09-21T00:17:54.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.825+0000 7f70d5c7e700 1 -- 172.21.15.59:0/184648149 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70d0159070 msgr2=0x7f70d01594d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:54.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.825+0000 7f70d5c7e700 1 --2- 172.21.15.59:0/184648149 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70d0159070 0x7f70d01594d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f70c0011830 tx=0x7f70c0011bf0 comp rx=0 tx=0).stop 2023-09-21T00:17:54.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.825+0000 7f70d5c7e700 1 -- 172.21.15.59:0/184648149 shutdown_connections 2023-09-21T00:17:54.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.825+0000 7f70d5c7e700 1 --2- 172.21.15.59:0/184648149 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f70bc06ae00 0x7f70bc06d2c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:54.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.825+0000 7f70d5c7e700 1 --2- 172.21.15.59:0/184648149 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f70d01f2d30 0x7f70d01f31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:54.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.825+0000 7f70d5c7e700 1 --2- 172.21.15.59:0/184648149 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70b8003b90 0x7f70d00b4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:54.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.825+0000 7f70d5c7e700 1 --2- 172.21.15.59:0/184648149 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70d0159070 0x7f70d01594d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:54.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.825+0000 7f70d5c7e700 1 -- 172.21.15.59:0/184648149 >> 172.21.15.59:0/184648149 conn(0x7f70d006a780 msgr2=0x7f70d015d290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:54.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.825+0000 7f70d5c7e700 1 -- 172.21.15.59:0/184648149 shutdown_connections 2023-09-21T00:17:54.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.825+0000 7f70d5c7e700 1 -- 172.21.15.59:0/184648149 wait complete. 2023-09-21T00:17:54.838 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T00:17:54.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.963+0000 7f0db94e8700 1 Processor -- start 2023-09-21T00:17:54.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.963+0000 7f0db94e8700 1 -- start start 2023-09-21T00:17:54.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.964+0000 7f0db94e8700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0db40ce420 0x7f0db40cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:54.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.964+0000 7f0db94e8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0db406a780 0x7f0db406abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:54.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.964+0000 7f0db94e8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db406b110 con 0x7f0db415b2b0 2023-09-21T00:17:54.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.964+0000 7f0db94e8700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db40ce250 con 0x7f0db40ce420 2023-09-21T00:17:54.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.964+0000 7f0db94e8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db41618a0 con 0x7f0db406a780 2023-09-21T00:17:54.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.964+0000 7f0db2ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0db415b2b0 0x7f0db4161190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57868/0 (socket says 172.21.15.59:57868) 2023-09-21T00:17:54.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.964+0000 7f0db2ffd700 1 -- 172.21.15.59:0/3194094658 learned_addr learned my addr 172.21.15.59:0/3194094658 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:54.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.965+0000 7f0db1ffb700 1 -- 172.21.15.59:0/3194094658 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1738259639 0 0) 0x7f0da4001110 con 0x7f0db415b2b0 2023-09-21T00:17:54.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.965+0000 7f0db37fe700 1 --2- 172.21.15.59:0/3194094658 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0db406a780 0x7f0db406abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:54.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.965+0000 7f0db1ffb700 1 -- 172.21.15.59:0/3194094658 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0da00035b0 con 0x7f0db415b2b0 2023-09-21T00:17:54.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.965+0000 7f0db27fc700 1 --2- 172.21.15.59:0/3194094658 >> v2:172.21.15.83:3300/0 conn(0x7f0db40ce420 0x7f0db40cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:54.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.965+0000 7f0db1ffb700 1 -- 172.21.15.59:0/3194094658 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2803046401 0 0) 0x7f0da00035b0 con 0x7f0db415b2b0 2023-09-21T00:17:54.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.965+0000 7f0db1ffb700 1 -- 172.21.15.59:0/3194094658 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0db406a780 msgr2=0x7f0db406abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:54.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.965+0000 7f0db1ffb700 1 --2- 172.21.15.59:0/3194094658 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0db406a780 0x7f0db406abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:54.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.965+0000 7f0db1ffb700 1 -- 172.21.15.59:0/3194094658 >> v2:172.21.15.83:3300/0 conn(0x7f0db40ce420 msgr2=0x7f0db40cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:54.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.965+0000 7f0db1ffb700 1 --2- 172.21.15.59:0/3194094658 >> v2:172.21.15.83:3300/0 conn(0x7f0db40ce420 0x7f0db40cdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:54.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.965+0000 7f0db1ffb700 1 -- 172.21.15.59:0/3194094658 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db40cfee0 con 0x7f0db415b2b0 2023-09-21T00:17:54.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.965+0000 7f0db1ffb700 1 -- 172.21.15.59:0/3194094658 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 710825841 0 0) 0x7f0da4001800 con 0x7f0db415b2b0 2023-09-21T00:17:54.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.965+0000 7f0db1ffb700 1 -- 172.21.15.59:0/3194094658 >> v1:172.21.15.59:6789/0 conn(0x7f0db415b2b0 legacy=0x7f0db4161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:54.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.965+0000 7f0db1ffb700 1 --2- 172.21.15.59:0/3194094658 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0db406a780 0x7f0da0003a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:54.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.965+0000 7f0db1ffb700 1 --2- 172.21.15.59:0/3194094658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0da0004040 0x7f0da0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:54.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.965+0000 7f0db1ffb700 1 --2- 172.21.15.59:0/3194094658 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0da0004d90 0x7f0da0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:54.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.965+0000 7f0db1ffb700 1 -- 172.21.15.59:0/3194094658 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db41618a0 con 0x7f0da0004040 2023-09-21T00:17:54.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.965+0000 7f0db1ffb700 1 -- 172.21.15.59:0/3194094658 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da000ba10 con 0x7f0da0004d90 2023-09-21T00:17:54.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.965+0000 7f0db1ffb700 1 -- 172.21.15.59:0/3194094658 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da000bbd0 con 0x7f0db406a780 2023-09-21T00:17:54.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.965+0000 7f0db27fc700 1 --2- 172.21.15.59:0/3194094658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0da0004040 0x7f0da0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:54.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.965+0000 7f0db2ffd700 1 --2- 172.21.15.59:0/3194094658 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0db406a780 0x7f0da0003a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:54.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.965+0000 7f0db37fe700 1 --2- 172.21.15.59:0/3194094658 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0da0004d90 0x7f0da0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:54.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.966+0000 7f0db27fc700 1 -- 172.21.15.59:0/3194094658 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0db406a780 msgr2=0x7f0da0003a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:54.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.966+0000 7f0db27fc700 1 --2- 172.21.15.59:0/3194094658 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0db406a780 0x7f0da0003a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:54.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.966+0000 7f0db27fc700 1 -- 172.21.15.59:0/3194094658 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0da0004d90 msgr2=0x7f0da0005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:54.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.966+0000 7f0db27fc700 1 --2- 172.21.15.59:0/3194094658 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0da0004d90 0x7f0da0005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:54.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.966+0000 7f0db27fc700 1 -- 172.21.15.59:0/3194094658 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da00035b0 con 0x7f0da0004040 2023-09-21T00:17:54.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.966+0000 7f0db27fc700 1 --2- 172.21.15.59:0/3194094658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0da0004040 0x7f0da0004850 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c009b30 tx=0x7f0da0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0755e48712fd12f server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:54.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.966+0000 7f0db1ffb700 1 -- 172.21.15.59:0/3194094658 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c00e6c0 con 0x7f0da0004040 2023-09-21T00:17:54.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.966+0000 7f0db1ffb700 1 -- 172.21.15.59:0/3194094658 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9c00e820 con 0x7f0da0004040 2023-09-21T00:17:54.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.966+0000 7f0db1ffb700 1 -- 172.21.15.59:0/3194094658 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c00eb90 con 0x7f0da0004040 2023-09-21T00:17:54.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.966+0000 7f0db94e8700 1 -- 172.21.15.59:0/3194094658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0da0004040 msgr2=0x7f0da0004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:54.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.966+0000 7f0db94e8700 1 --2- 172.21.15.59:0/3194094658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0da0004040 0x7f0da0004850 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c009b30 tx=0x7f0da0005880 comp rx=0 tx=0).stop 2023-09-21T00:17:54.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.966+0000 7f0db37fe700 1 -- 172.21.15.59:0/3194094658 reap_dead start 2023-09-21T00:17:54.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.966+0000 7f0db94e8700 1 -- 172.21.15.59:0/3194094658 shutdown_connections 2023-09-21T00:17:54.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.966+0000 7f0db94e8700 1 -- 172.21.15.59:0/3194094658 >> 172.21.15.59:0/3194094658 conn(0x7f0db40d0140 msgr2=0x7f0db40d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:54.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.966+0000 7f0db94e8700 1 -- 172.21.15.59:0/3194094658 shutdown_connections 2023-09-21T00:17:54.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.966+0000 7f0db94e8700 1 -- 172.21.15.59:0/3194094658 wait complete. 2023-09-21T00:17:54.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.968+0000 7f0db94e8700 1 Processor -- start 2023-09-21T00:17:54.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.968+0000 7f0db94e8700 1 -- start start 2023-09-21T00:17:54.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.969+0000 7f0db94e8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0da0004040 0x7f0db414c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:54.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.969+0000 7f0db94e8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0db414cc70 0x7f0db415fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:54.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.969+0000 7f0db94e8700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0db4160320 0x7f0db41f3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:54.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.969+0000 7f0db94e8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db4160900 con 0x7f0da0004040 2023-09-21T00:17:54.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.969+0000 7f0db94e8700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db4160be0 con 0x7f0db4160320 2023-09-21T00:17:54.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.969+0000 7f0db94e8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db4160ec0 con 0x7f0db414cc70 2023-09-21T00:17:54.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.969+0000 7f0db2ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0da0004040 0x7f0db414c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:54.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.969+0000 7f0db2ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0da0004040 0x7f0db414c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52312/0 (socket says 172.21.15.59:52312) 2023-09-21T00:17:54.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.969+0000 7f0db2ffd700 1 -- 172.21.15.59:0/1815578525 learned_addr learned my addr 172.21.15.59:0/1815578525 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:54.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.969+0000 7f0db27fc700 1 --2- 172.21.15.59:0/1815578525 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0db414cc70 0x7f0db415fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:54.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.969+0000 7f0db37fe700 1 --2- 172.21.15.59:0/1815578525 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0db4160320 0x7f0db41f3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:54.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.969+0000 7f0db2ffd700 1 -- 172.21.15.59:0/1815578525 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0db414cc70 msgr2=0x7f0db415fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:54.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.969+0000 7f0db2ffd700 1 --2- 172.21.15.59:0/1815578525 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0db414cc70 0x7f0db415fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:54.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.969+0000 7f0db2ffd700 1 -- 172.21.15.59:0/1815578525 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0db4160320 msgr2=0x7f0db41f3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:54.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.969+0000 7f0db2ffd700 1 --2- 172.21.15.59:0/1815578525 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0db4160320 0x7f0db41f3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:54.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.969+0000 7f0db2ffd700 1 -- 172.21.15.59:0/1815578525 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db415e0d0 con 0x7f0da0004040 2023-09-21T00:17:54.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.969+0000 7f0db2ffd700 1 --2- 172.21.15.59:0/1815578525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0da0004040 0x7f0db414c730 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0da4007fa0 tx=0x7f0da4007340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:54.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.969+0000 7f0dab7fe700 1 -- 172.21.15.59:0/1815578525 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da4011640 con 0x7f0da0004040 2023-09-21T00:17:54.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.969+0000 7f0dab7fe700 1 -- 172.21.15.59:0/1815578525 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da40117a0 con 0x7f0da0004040 2023-09-21T00:17:54.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.969+0000 7f0dab7fe700 1 -- 172.21.15.59:0/1815578525 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da4011b30 con 0x7f0da0004040 2023-09-21T00:17:54.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.969+0000 7f0db94e8700 1 -- 172.21.15.59:0/1815578525 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db415e3b0 con 0x7f0da0004040 2023-09-21T00:17:54.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.970+0000 7f0db94e8700 1 -- 172.21.15.59:0/1815578525 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db41f3950 con 0x7f0da0004040 2023-09-21T00:17:54.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.970+0000 7f0db94e8700 1 -- 172.21.15.59:0/1815578525 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db4067e50 con 0x7f0da0004040 2023-09-21T00:17:54.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.971+0000 7f0dab7fe700 1 -- 172.21.15.59:0/1815578525 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f0da4011c90 con 0x7f0da0004040 2023-09-21T00:17:54.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.971+0000 7f0dab7fe700 1 --2- 172.21.15.59:0/1815578525 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f0d9406ae00 0x7f0d9406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:54.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.971+0000 7f0dab7fe700 1 -- 172.21.15.59:0/1815578525 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f0da4089810 con 0x7f0da0004040 2023-09-21T00:17:54.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.972+0000 7f0db27fc700 1 --2- 172.21.15.59:0/1815578525 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f0d9406ae00 0x7f0d9406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:54.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.972+0000 7f0db27fc700 1 --2- 172.21.15.59:0/1815578525 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f0d9406ae00 0x7f0d9406d2c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c0090b0 tx=0x7f0d9c01f040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:54.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:54.976+0000 7f0dab7fe700 1 -- 172.21.15.59:0/1815578525 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f0da4054480 con 0x7f0da0004040 2023-09-21T00:17:55.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.177+0000 7f0db94e8700 1 -- 172.21.15.59:0/1815578525 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0db406b110 con 0x7f0da0004040 2023-09-21T00:17:55.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.178+0000 7f0dab7fe700 1 -- 172.21.15.59:0/1815578525 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18792 (secure 0 0 0) 0x7f0db406b110 con 0x7f0da0004040 2023-09-21T00:17:55.179 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:17:55.180 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":26,"fsid":"dd69925c-6e25-42fe-880b-2f60fc6f384b","created":"2023-09-21T00:16:43.074489+0000","modified":"2023-09-21T00:17:50.090179+0000","last_up_change":"2023-09-21T00:16:54.740101+0000","last_in_change":"2023-09-21T00:16:45.987089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T00:16:54.796248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-21T00:17:04.167102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-21T00:17:05.313188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-21T00:17:08.977609+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d4b18344-74c0-4f75-920b-7a9247e48914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6809","nonce":2418314235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6811","nonce":2418314235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6815","nonce":2418314235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6813","nonce":2418314235}]},"public_addr":"172.21.15.59:6809/2418314235","cluster_addr":"172.21.15.59:6811/2418314235","heartbeat_back_addr":"172.21.15.59:6815/2418314235","heartbeat_front_addr":"172.21.15.59:6813/2418314235","state":["exists","up"]},{"osd":1,"uuid":"80940d50-a248-4e64-a282-7ffcdad790ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6801","nonce":869668251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6803","nonce":869668251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6807","nonce":869668251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6805","nonce":869668251}]},"public_addr":"172.21.15.59:6801/869668251","cluster_addr":"172.21.15.59:6803/869668251","heartbeat_back_addr":"172.21.15.59:6807/869668251","heartbeat_front_addr":"172.21.15.59:6805/869668251","state":["exists","up"]},{"osd":2,"uuid":"55f2eceb-c54a-4879-a6ce-968c1c548b5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6817","nonce":372517778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6819","nonce":372517778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6823","nonce":372517778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6821","nonce":372517778}]},"public_addr":"172.21.15.59:6817/372517778","cluster_addr":"172.21.15.59:6819/372517778","heartbeat_back_addr":"172.21.15.59:6823/372517778","heartbeat_front_addr":"172.21.15.59:6821/372517778","state":["exists","up"]},{"osd":3,"uuid":"92b89cd0-869c-49b9-a9f9-97ac8423f304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6825","nonce":575188498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6827","nonce":575188498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6831","nonce":575188498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6829","nonce":575188498}]},"public_addr":"172.21.15.59:6825/575188498","cluster_addr":"172.21.15.59:6827/575188498","heartbeat_back_addr":"172.21.15.59:6831/575188498","heartbeat_front_addr":"172.21.15.59:6829/575188498","state":["exists","up"]},{"osd":4,"uuid":"25b80e94-e0e6-403d-b69f-61542f289637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6803","nonce":1741219098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6805","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6807","nonce":1741219098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6815","nonce":1741219098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6811","nonce":1741219098}]},"public_addr":"172.21.15.83:6803/1741219098","cluster_addr":"172.21.15.83:6807/1741219098","heartbeat_back_addr":"172.21.15.83:6815/1741219098","heartbeat_front_addr":"172.21.15.83:6811/1741219098","state":["exists","up"]},{"osd":5,"uuid":"5498d9ab-1086-4796-a199-9051e6dfea91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6817","nonce":156730565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6819","nonce":156730565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6823","nonce":156730565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6821","nonce":156730565}]},"public_addr":"172.21.15.83:6817/156730565","cluster_addr":"172.21.15.83:6819/156730565","heartbeat_back_addr":"172.21.15.83:6823/156730565","heartbeat_front_addr":"172.21.15.83:6821/156730565","state":["exists","up"]},{"osd":6,"uuid":"cfd810c0-5015-4d60-9a75-7efc93a32e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6801","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6800","nonce":1337723778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6806","nonce":1337723778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6814","nonce":1337723778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6810","nonce":1337723778}]},"public_addr":"172.21.15.83:6800/1337723778","cluster_addr":"172.21.15.83:6806/1337723778","heartbeat_back_addr":"172.21.15.83:6814/1337723778","heartbeat_front_addr":"172.21.15.83:6810/1337723778","state":["exists","up"]},{"osd":7,"uuid":"e992c8fa-0a3d-4b3c-85b5-2c511223dee4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6825","nonce":4204859272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6827","nonce":4204859272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6831","nonce":4204859272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6829","nonce":4204859272}]},"public_addr":"172.21.15.83:6825/4204859272","cluster_addr":"172.21.15.83:6827/4204859272","heartbeat_back_addr":"172.21.15.83:6831/4204859272","heartbeat_front_addr":"172.21.15.83:6829/4204859272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.156498+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.882707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.093978+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.158565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.173933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.888606+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.135525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.149712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":3,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.34","mappings":[{"from":4,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":6}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T00:17:55.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.180+0000 7f0db94e8700 1 -- 172.21.15.59:0/1815578525 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f0d9406ae00 msgr2=0x7f0d9406d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:55.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.180+0000 7f0db94e8700 1 --2- 172.21.15.59:0/1815578525 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f0d9406ae00 0x7f0d9406d2c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c0090b0 tx=0x7f0d9c01f040 comp rx=0 tx=0).stop 2023-09-21T00:17:55.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.180+0000 7f0db94e8700 1 -- 172.21.15.59:0/1815578525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0da0004040 msgr2=0x7f0db414c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:55.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.180+0000 7f0db94e8700 1 --2- 172.21.15.59:0/1815578525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0da0004040 0x7f0db414c730 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0da4007fa0 tx=0x7f0da4007340 comp rx=0 tx=0).stop 2023-09-21T00:17:55.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.180+0000 7f0db94e8700 1 -- 172.21.15.59:0/1815578525 shutdown_connections 2023-09-21T00:17:55.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.180+0000 7f0db94e8700 1 --2- 172.21.15.59:0/1815578525 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0db4160320 0x7f0db41f3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:55.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.180+0000 7f0db94e8700 1 --2- 172.21.15.59:0/1815578525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0da0004040 0x7f0db414c730 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:55.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.180+0000 7f0db94e8700 1 --2- 172.21.15.59:0/1815578525 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f0d9406ae00 0x7f0d9406d2c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:55.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.180+0000 7f0db94e8700 1 --2- 172.21.15.59:0/1815578525 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0db414cc70 0x7f0db415fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:55.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.180+0000 7f0db94e8700 1 -- 172.21.15.59:0/1815578525 >> 172.21.15.59:0/1815578525 conn(0x7f0db40d0140 msgr2=0x7f0db415a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:55.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.180+0000 7f0db94e8700 1 -- 172.21.15.59:0/1815578525 shutdown_connections 2023-09-21T00:17:55.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.180+0000 7f0db94e8700 1 -- 172.21.15.59:0/1815578525 wait complete. 2023-09-21T00:17:55.194 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-21T00:16:54.796248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-21T00:17:04.167102+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-21T00:17:05.313188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-21T00:17:08.977609+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-21T00:17:55.195 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-21T00:17:55.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.323+0000 7f4c586f5700 1 Processor -- start 2023-09-21T00:17:55.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.323+0000 7f4c586f5700 1 -- start start 2023-09-21T00:17:55.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.324+0000 7f4c586f5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4c5015b2b0 0x7f4c500cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:55.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.324+0000 7f4c586f5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c5006a780 0x7f4c5006abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:55.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.324+0000 7f4c586f5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c5006b110 con 0x7f4c500ce420 2023-09-21T00:17:55.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.324+0000 7f4c586f5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c500ce250 con 0x7f4c5015b2b0 2023-09-21T00:17:55.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.324+0000 7f4c586f5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c501618a0 con 0x7f4c5006a780 2023-09-21T00:17:55.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.324+0000 7f4c56491700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4c5015b2b0 0x7f4c500cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:55.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.324+0000 7f4c56491700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4c5015b2b0 0x7f4c500cdd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52320/0 (socket says 172.21.15.59:52320) 2023-09-21T00:17:55.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.324+0000 7f4c55c90700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4c500ce420 0x7f4c50161190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57888/0 (socket says 172.21.15.59:57888) 2023-09-21T00:17:55.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.324+0000 7f4c56491700 1 -- 172.21.15.59:0/133392175 learned_addr learned my addr 172.21.15.59:0/133392175 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:55.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.324+0000 7f4c56c92700 1 --2- 172.21.15.59:0/133392175 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c5006a780 0x7f4c5006abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:55.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.324+0000 7f4c56491700 1 -- 172.21.15.59:0/133392175 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c5006a780 msgr2=0x7f4c5006abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:55.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.324+0000 7f4c56491700 1 --2- 172.21.15.59:0/133392175 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c5006a780 0x7f4c5006abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:55.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.324+0000 7f4c56491700 1 -- 172.21.15.59:0/133392175 >> v1:172.21.15.59:6789/0 conn(0x7f4c500ce420 legacy=0x7f4c50161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:55.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.324+0000 7f4c56491700 1 -- 172.21.15.59:0/133392175 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c500cfee0 con 0x7f4c5015b2b0 2023-09-21T00:17:55.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.324+0000 7f4c5548f700 1 -- 172.21.15.59:0/133392175 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3981766692 0 0) 0x7f4c4c001110 con 0x7f4c500ce420 2023-09-21T00:17:55.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.324+0000 7f4c56c92700 1 --2- 172.21.15.59:0/133392175 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c5006a780 0x7f4c5006abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:17:55.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.325+0000 7f4c56491700 1 --2- 172.21.15.59:0/133392175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c5015b2b0 0x7f4c500cdd10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4c400098f0 tx=0x7f4c40009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2da89da6fb6ab968 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:55.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.325+0000 7f4c5548f700 1 -- 172.21.15.59:0/133392175 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4000b8a0 con 0x7f4c5015b2b0 2023-09-21T00:17:55.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.325+0000 7f4c5548f700 1 -- 172.21.15.59:0/133392175 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c4000ba00 con 0x7f4c5015b2b0 2023-09-21T00:17:55.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.325+0000 7f4c5548f700 1 -- 172.21.15.59:0/133392175 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4000bd90 con 0x7f4c5015b2b0 2023-09-21T00:17:55.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.325+0000 7f4c586f5700 1 -- 172.21.15.59:0/133392175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c5015b2b0 msgr2=0x7f4c500cdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:55.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.325+0000 7f4c586f5700 1 --2- 172.21.15.59:0/133392175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c5015b2b0 0x7f4c500cdd10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4c400098f0 tx=0x7f4c40009c00 comp rx=0 tx=0).stop 2023-09-21T00:17:55.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.325+0000 7f4c586f5700 1 -- 172.21.15.59:0/133392175 shutdown_connections 2023-09-21T00:17:55.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.325+0000 7f4c586f5700 1 --2- 172.21.15.59:0/133392175 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c5006a780 0x7f4c5006abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:55.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.325+0000 7f4c586f5700 1 --2- 172.21.15.59:0/133392175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c5015b2b0 0x7f4c500cdd10 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:55.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.325+0000 7f4c586f5700 1 -- 172.21.15.59:0/133392175 >> 172.21.15.59:0/133392175 conn(0x7f4c500d0140 msgr2=0x7f4c500d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:55.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.325+0000 7f4c586f5700 1 -- 172.21.15.59:0/133392175 shutdown_connections 2023-09-21T00:17:55.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.325+0000 7f4c586f5700 1 -- 172.21.15.59:0/133392175 wait complete. 2023-09-21T00:17:55.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.327+0000 7f4c586f5700 1 Processor -- start 2023-09-21T00:17:55.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.327+0000 7f4c586f5700 1 -- start start 2023-09-21T00:17:55.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.327+0000 7f4c586f5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c5006a780 0x7f4c50160b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:55.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.327+0000 7f4c586f5700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c500ce420 0x7f4c5015f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:55.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.327+0000 7f4c586f5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c5015b2b0 0x7f4c5015fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:55.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.327+0000 7f4c586f5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c500c49e0 con 0x7f4c5015b2b0 2023-09-21T00:17:55.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.327+0000 7f4c586f5700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c50160130 con 0x7f4c5006a780 2023-09-21T00:17:55.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.327+0000 7f4c586f5700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c500c3e10 con 0x7f4c500ce420 2023-09-21T00:17:55.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.327+0000 7f4c56c92700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c5015b2b0 0x7f4c5015fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:55.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.327+0000 7f4c56c92700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c5015b2b0 0x7f4c5015fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52328/0 (socket says 172.21.15.59:52328) 2023-09-21T00:17:55.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.327+0000 7f4c56c92700 1 -- 172.21.15.59:0/3989940039 learned_addr learned my addr 172.21.15.59:0/3989940039 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:55.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.327+0000 7f4c56491700 1 --2- 172.21.15.59:0/3989940039 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c5006a780 0x7f4c50160b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:55.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.328+0000 7f4c55c90700 1 --2- 172.21.15.59:0/3989940039 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c500ce420 0x7f4c5015f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:55.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.328+0000 7f4c56c92700 1 -- 172.21.15.59:0/3989940039 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c500ce420 msgr2=0x7f4c5015f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:55.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.328+0000 7f4c56c92700 1 --2- 172.21.15.59:0/3989940039 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c500ce420 0x7f4c5015f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:55.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.328+0000 7f4c56c92700 1 -- 172.21.15.59:0/3989940039 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c5006a780 msgr2=0x7f4c50160b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:55.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.328+0000 7f4c56c92700 1 --2- 172.21.15.59:0/3989940039 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c5006a780 0x7f4c50160b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:55.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.328+0000 7f4c56c92700 1 -- 172.21.15.59:0/3989940039 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c40009550 con 0x7f4c5015b2b0 2023-09-21T00:17:55.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.328+0000 7f4c56491700 1 --2- 172.21.15.59:0/3989940039 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c5006a780 0x7f4c50160b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:17:55.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.328+0000 7f4c56c92700 1 --2- 172.21.15.59:0/3989940039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c5015b2b0 0x7f4c5015fbf0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4c4800cf20 tx=0x7f4c4800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:55.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.328+0000 7f4c46ffd700 1 -- 172.21.15.59:0/3989940039 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4800ae80 con 0x7f4c5015b2b0 2023-09-21T00:17:55.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.328+0000 7f4c46ffd700 1 -- 172.21.15.59:0/3989940039 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c48015440 con 0x7f4c5015b2b0 2023-09-21T00:17:55.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.328+0000 7f4c586f5700 1 -- 172.21.15.59:0/3989940039 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c50161080 con 0x7f4c5015b2b0 2023-09-21T00:17:55.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.328+0000 7f4c46ffd700 1 -- 172.21.15.59:0/3989940039 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c480157d0 con 0x7f4c5015b2b0 2023-09-21T00:17:55.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.328+0000 7f4c586f5700 1 -- 172.21.15.59:0/3989940039 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c500c4390 con 0x7f4c5015b2b0 2023-09-21T00:17:55.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.329+0000 7f4c586f5700 1 -- 172.21.15.59:0/3989940039 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c500c4b90 con 0x7f4c5015b2b0 2023-09-21T00:17:55.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.330+0000 7f4c46ffd700 1 -- 172.21.15.59:0/3989940039 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f4c4800d430 con 0x7f4c5015b2b0 2023-09-21T00:17:55.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.330+0000 7f4c46ffd700 1 --2- 172.21.15.59:0/3989940039 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f4c3406ae00 0x7f4c3406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:55.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.330+0000 7f4c46ffd700 1 -- 172.21.15.59:0/3989940039 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f4c48089ed0 con 0x7f4c5015b2b0 2023-09-21T00:17:55.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.330+0000 7f4c56491700 1 --2- 172.21.15.59:0/3989940039 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f4c3406ae00 0x7f4c3406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:55.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.331+0000 7f4c56491700 1 --2- 172.21.15.59:0/3989940039 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f4c3406ae00 0x7f4c3406d2c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4c40014040 tx=0x7f4c40008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:55.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.334+0000 7f4c46ffd700 1 -- 172.21.15.59:0/3989940039 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f4c500c4b90 con 0x7f4c5015b2b0 2023-09-21T00:17:55.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.532+0000 7f4c586f5700 1 -- 172.21.15.59:0/3989940039 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4c500c4b90 con 0x7f4c5015b2b0 2023-09-21T00:17:55.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.533+0000 7f4c46ffd700 1 -- 172.21.15.59:0/3989940039 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4c500c4b90 con 0x7f4c5015b2b0 2023-09-21T00:17:55.534 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-09-21T00:17:55.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.535+0000 7f4c586f5700 1 -- 172.21.15.59:0/3989940039 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f4c3406ae00 msgr2=0x7f4c3406d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:55.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.535+0000 7f4c586f5700 1 --2- 172.21.15.59:0/3989940039 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f4c3406ae00 0x7f4c3406d2c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4c40014040 tx=0x7f4c40008030 comp rx=0 tx=0).stop 2023-09-21T00:17:55.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.535+0000 7f4c586f5700 1 -- 172.21.15.59:0/3989940039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c5015b2b0 msgr2=0x7f4c5015fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:55.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.535+0000 7f4c586f5700 1 --2- 172.21.15.59:0/3989940039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c5015b2b0 0x7f4c5015fbf0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4c4800cf20 tx=0x7f4c4800a340 comp rx=0 tx=0).stop 2023-09-21T00:17:55.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.535+0000 7f4c586f5700 1 -- 172.21.15.59:0/3989940039 shutdown_connections 2023-09-21T00:17:55.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.535+0000 7f4c586f5700 1 --2- 172.21.15.59:0/3989940039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c5015b2b0 0x7f4c5015fbf0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:55.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.535+0000 7f4c586f5700 1 --2- 172.21.15.59:0/3989940039 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c5006a780 0x7f4c50160b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:55.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.535+0000 7f4c586f5700 1 --2- 172.21.15.59:0/3989940039 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f4c3406ae00 0x7f4c3406d2c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:55.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.535+0000 7f4c586f5700 1 --2- 172.21.15.59:0/3989940039 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c500ce420 0x7f4c5015f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:55.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.535+0000 7f4c586f5700 1 -- 172.21.15.59:0/3989940039 >> 172.21.15.59:0/3989940039 conn(0x7f4c500d0140 msgr2=0x7f4c5006f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:55.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.535+0000 7f4c586f5700 1 -- 172.21.15.59:0/3989940039 shutdown_connections 2023-09-21T00:17:55.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.535+0000 7f4c586f5700 1 -- 172.21.15.59:0/3989940039 wait complete. 2023-09-21T00:17:55.548 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-21T00:17:55.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.676+0000 7f52e1833700 1 Processor -- start 2023-09-21T00:17:55.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.676+0000 7f52e1833700 1 -- start start 2023-09-21T00:17:55.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.677+0000 7f52e1833700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f52dc15d6c0 0x7f52dc0d1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:55.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.677+0000 7f52e1833700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f52dc0b5640 0x7f52dc0b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:55.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.677+0000 7f52e1833700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52dc0d1ea0 con 0x7f52dc0b9200 2023-09-21T00:17:55.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.677+0000 7f52e1833700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52dc0d2180 con 0x7f52dc0b5640 2023-09-21T00:17:55.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.677+0000 7f52e1833700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc0d2460 con 0x7f52dc15d6c0 2023-09-21T00:17:55.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.677+0000 7f52da7fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f52dc0b9200 0x7f52dc0b4f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57902/0 (socket says 172.21.15.59:57902) 2023-09-21T00:17:55.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.677+0000 7f52da7fc700 1 -- 172.21.15.59:0/1182438873 learned_addr learned my addr 172.21.15.59:0/1182438873 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:55.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.677+0000 7f52daffd700 1 --2- 172.21.15.59:0/1182438873 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f52dc15d6c0 0x7f52dc0d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:55.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.677+0000 7f52db7fe700 1 --2- 172.21.15.59:0/1182438873 >> v2:172.21.15.83:3300/0 conn(0x7f52dc0b5640 0x7f52dc0b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:55.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.677+0000 7f52d9ffb700 1 -- 172.21.15.59:0/1182438873 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 773768489 0 0) 0x7f52dc0d1ea0 con 0x7f52dc0b9200 2023-09-21T00:17:55.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.677+0000 7f52d9ffb700 1 -- 172.21.15.59:0/1182438873 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52c40035b0 con 0x7f52dc0b9200 2023-09-21T00:17:55.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.677+0000 7f52d9ffb700 1 -- 172.21.15.59:0/1182438873 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2557335194 0 0) 0x7f52c40035b0 con 0x7f52dc0b9200 2023-09-21T00:17:55.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.677+0000 7f52d9ffb700 1 -- 172.21.15.59:0/1182438873 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f52dc15d6c0 msgr2=0x7f52dc0d1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:55.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.677+0000 7f52d9ffb700 1 --2- 172.21.15.59:0/1182438873 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f52dc15d6c0 0x7f52dc0d1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:55.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.677+0000 7f52d9ffb700 1 -- 172.21.15.59:0/1182438873 >> v2:172.21.15.83:3300/0 conn(0x7f52dc0b5640 msgr2=0x7f52dc0b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:55.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.677+0000 7f52d9ffb700 1 --2- 172.21.15.59:0/1182438873 >> v2:172.21.15.83:3300/0 conn(0x7f52dc0b5640 0x7f52dc0b65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:55.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.677+0000 7f52d9ffb700 1 -- 172.21.15.59:0/1182438873 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52dc0d2740 con 0x7f52dc0b9200 2023-09-21T00:17:55.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.677+0000 7f52d9ffb700 1 -- 172.21.15.59:0/1182438873 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 710825841 0 0) 0x7f52cc001670 con 0x7f52dc0b9200 2023-09-21T00:17:55.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.677+0000 7f52d9ffb700 1 -- 172.21.15.59:0/1182438873 >> v1:172.21.15.59:6789/0 conn(0x7f52dc0b9200 legacy=0x7f52dc0b4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:55.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.677+0000 7f52d9ffb700 1 --2- 172.21.15.59:0/1182438873 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52c4003a00 0x7f52c4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:55.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.677+0000 7f52d9ffb700 1 --2- 172.21.15.59:0/1182438873 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f52dc15d6c0 0x7f52c4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:55.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.678+0000 7f52d9ffb700 1 --2- 172.21.15.59:0/1182438873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52c4004d90 0x7f52c4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:55.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.678+0000 7f52d9ffb700 1 -- 172.21.15.59:0/1182438873 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc0d2180 con 0x7f52c4004d90 2023-09-21T00:17:55.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.678+0000 7f52d9ffb700 1 -- 172.21.15.59:0/1182438873 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc0d2460 con 0x7f52c4003a00 2023-09-21T00:17:55.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.678+0000 7f52d9ffb700 1 -- 172.21.15.59:0/1182438873 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c400ba10 con 0x7f52dc15d6c0 2023-09-21T00:17:55.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.678+0000 7f52db7fe700 1 --2- 172.21.15.59:0/1182438873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52c4004d90 0x7f52c4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:55.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.678+0000 7f52daffd700 1 --2- 172.21.15.59:0/1182438873 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52c4003a00 0x7f52c4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:55.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.678+0000 7f52da7fc700 1 --2- 172.21.15.59:0/1182438873 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f52dc15d6c0 0x7f52c4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:55.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.678+0000 7f52db7fe700 1 -- 172.21.15.59:0/1182438873 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f52dc15d6c0 msgr2=0x7f52c4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:55.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.678+0000 7f52db7fe700 1 --2- 172.21.15.59:0/1182438873 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f52dc15d6c0 0x7f52c4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:55.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.678+0000 7f52db7fe700 1 -- 172.21.15.59:0/1182438873 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52c4003a00 msgr2=0x7f52c4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:55.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.678+0000 7f52db7fe700 1 --2- 172.21.15.59:0/1182438873 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52c4003a00 0x7f52c4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:55.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.678+0000 7f52db7fe700 1 -- 172.21.15.59:0/1182438873 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c40035b0 con 0x7f52c4004d90 2023-09-21T00:17:55.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.678+0000 7f52db7fe700 1 --2- 172.21.15.59:0/1182438873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52c4004d90 0x7f52c4005210 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f52d4009f90 tx=0x7f52c4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4ce581ddac09feb server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:55.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.678+0000 7f52d9ffb700 1 -- 172.21.15.59:0/1182438873 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d400ec30 con 0x7f52c4004d90 2023-09-21T00:17:55.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.678+0000 7f52d9ffb700 1 -- 172.21.15.59:0/1182438873 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d400f040 con 0x7f52c4004d90 2023-09-21T00:17:55.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.678+0000 7f52d9ffb700 1 -- 172.21.15.59:0/1182438873 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d4014480 con 0x7f52c4004d90 2023-09-21T00:17:55.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.679+0000 7f52e1833700 1 -- 172.21.15.59:0/1182438873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52c4004d90 msgr2=0x7f52c4005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:55.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.679+0000 7f52e1833700 1 --2- 172.21.15.59:0/1182438873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52c4004d90 0x7f52c4005210 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f52d4009f90 tx=0x7f52c4005880 comp rx=0 tx=0).stop 2023-09-21T00:17:55.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.679+0000 7f52db7fe700 1 -- 172.21.15.59:0/1182438873 reap_dead start 2023-09-21T00:17:55.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.679+0000 7f52e1833700 1 -- 172.21.15.59:0/1182438873 shutdown_connections 2023-09-21T00:17:55.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.679+0000 7f52e1833700 1 -- 172.21.15.59:0/1182438873 >> 172.21.15.59:0/1182438873 conn(0x7f52dc0724b0 msgr2=0x7f52dc0cff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:55.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.679+0000 7f52e1833700 1 -- 172.21.15.59:0/1182438873 shutdown_connections 2023-09-21T00:17:55.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.679+0000 7f52e1833700 1 -- 172.21.15.59:0/1182438873 wait complete. 2023-09-21T00:17:55.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.680+0000 7f52e1833700 1 Processor -- start 2023-09-21T00:17:55.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.680+0000 7f52e1833700 1 -- start start 2023-09-21T00:17:55.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.681+0000 7f52e1833700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f52dc152940 0x7f52dc15f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:55.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.681+0000 7f52e1833700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52dc15e860 0x7f52dc0c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:55.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.681+0000 7f52e1833700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52dc0c9610 0x7f52dc1f2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:55.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.681+0000 7f52e1833700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc0c8030 con 0x7f52dc15e860 2023-09-21T00:17:55.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.681+0000 7f52e1833700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc0c8310 con 0x7f52dc0c9610 2023-09-21T00:17:55.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.681+0000 7f52e1833700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc0c85f0 con 0x7f52dc152940 2023-09-21T00:17:55.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.681+0000 7f52da7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52dc15e860 0x7f52dc0c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:55.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.681+0000 7f52da7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52dc15e860 0x7f52dc0c90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52348/0 (socket says 172.21.15.59:52348) 2023-09-21T00:17:55.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.681+0000 7f52da7fc700 1 -- 172.21.15.59:0/65761243 learned_addr learned my addr 172.21.15.59:0/65761243 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:55.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.681+0000 7f52db7fe700 1 --2- 172.21.15.59:0/65761243 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52dc0c9610 0x7f52dc1f2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:55.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.681+0000 7f52daffd700 1 --2- 172.21.15.59:0/65761243 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f52dc152940 0x7f52dc15f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:55.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.681+0000 7f52da7fc700 1 -- 172.21.15.59:0/65761243 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f52dc152940 msgr2=0x7f52dc15f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:55.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.681+0000 7f52da7fc700 1 --2- 172.21.15.59:0/65761243 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f52dc152940 0x7f52dc15f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:55.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.681+0000 7f52da7fc700 1 -- 172.21.15.59:0/65761243 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52dc0c9610 msgr2=0x7f52dc1f2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:55.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.681+0000 7f52da7fc700 1 --2- 172.21.15.59:0/65761243 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52dc0c9610 0x7f52dc1f2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:55.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.681+0000 7f52da7fc700 1 -- 172.21.15.59:0/65761243 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52dc0c88d0 con 0x7f52dc15e860 2023-09-21T00:17:55.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.681+0000 7f52daffd700 1 --2- 172.21.15.59:0/65761243 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f52dc152940 0x7f52dc15f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:17:55.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.682+0000 7f52da7fc700 1 --2- 172.21.15.59:0/65761243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52dc15e860 0x7f52dc0c90d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f52cc0017a0 tx=0x7f52cc0076a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:55.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.682+0000 7f52c3fff700 1 -- 172.21.15.59:0/65761243 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52cc00f8d0 con 0x7f52dc15e860 2023-09-21T00:17:55.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.682+0000 7f52c3fff700 1 -- 172.21.15.59:0/65761243 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52cc00fa30 con 0x7f52dc15e860 2023-09-21T00:17:55.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.682+0000 7f52c3fff700 1 -- 172.21.15.59:0/65761243 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52cc00fde0 con 0x7f52dc15e860 2023-09-21T00:17:55.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.682+0000 7f52e1833700 1 -- 172.21.15.59:0/65761243 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52dc0c8bb0 con 0x7f52dc15e860 2023-09-21T00:17:55.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.682+0000 7f52e1833700 1 -- 172.21.15.59:0/65761243 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52dc152d20 con 0x7f52dc15e860 2023-09-21T00:17:55.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.683+0000 7f52e1833700 1 -- 172.21.15.59:0/65761243 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52dc152f40 con 0x7f52dc15e860 2023-09-21T00:17:55.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.683+0000 7f52c3fff700 1 -- 172.21.15.59:0/65761243 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f52cc01d460 con 0x7f52dc15e860 2023-09-21T00:17:55.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.684+0000 7f52c3fff700 1 --2- 172.21.15.59:0/65761243 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f52c806ae00 0x7f52c806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:55.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.684+0000 7f52c3fff700 1 -- 172.21.15.59:0/65761243 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f52cc089a70 con 0x7f52dc15e860 2023-09-21T00:17:55.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.684+0000 7f52daffd700 1 --2- 172.21.15.59:0/65761243 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f52c806ae00 0x7f52c806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:55.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.684+0000 7f52daffd700 1 --2- 172.21.15.59:0/65761243 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f52c806ae00 0x7f52c806d2c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f52d0009ae0 tx=0x7f52d0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:55.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.688+0000 7f52c3fff700 1 -- 172.21.15.59:0/65761243 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f52cc054780 con 0x7f52dc15e860 2023-09-21T00:17:55.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.889+0000 7f52e1833700 1 -- 172.21.15.59:0/65761243 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f52dc0c8da0 con 0x7f52dc15e860 2023-09-21T00:17:55.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.889+0000 7f52c3fff700 1 -- 172.21.15.59:0/65761243 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f52cc057da0 con 0x7f52dc15e860 2023-09-21T00:17:55.891 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-09-21T00:17:55.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.891+0000 7f52e1833700 1 -- 172.21.15.59:0/65761243 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f52c806ae00 msgr2=0x7f52c806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:55.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.891+0000 7f52e1833700 1 --2- 172.21.15.59:0/65761243 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f52c806ae00 0x7f52c806d2c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f52d0009ae0 tx=0x7f52d0008040 comp rx=0 tx=0).stop 2023-09-21T00:17:55.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.891+0000 7f52e1833700 1 -- 172.21.15.59:0/65761243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52dc15e860 msgr2=0x7f52dc0c90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:55.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.891+0000 7f52e1833700 1 --2- 172.21.15.59:0/65761243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52dc15e860 0x7f52dc0c90d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f52cc0017a0 tx=0x7f52cc0076a0 comp rx=0 tx=0).stop 2023-09-21T00:17:55.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.892+0000 7f52e1833700 1 -- 172.21.15.59:0/65761243 shutdown_connections 2023-09-21T00:17:55.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.892+0000 7f52e1833700 1 --2- 172.21.15.59:0/65761243 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52dc0c9610 0x7f52dc1f2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:55.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.892+0000 7f52e1833700 1 --2- 172.21.15.59:0/65761243 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f52c806ae00 0x7f52c806d2c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:55.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.892+0000 7f52e1833700 1 --2- 172.21.15.59:0/65761243 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f52dc152940 0x7f52dc15f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:55.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.892+0000 7f52e1833700 1 --2- 172.21.15.59:0/65761243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52dc15e860 0x7f52dc0c90d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:55.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.892+0000 7f52e1833700 1 -- 172.21.15.59:0/65761243 >> 172.21.15.59:0/65761243 conn(0x7f52dc0724b0 msgr2=0x7f52dc0d1320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:55.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.892+0000 7f52e1833700 1 -- 172.21.15.59:0/65761243 shutdown_connections 2023-09-21T00:17:55.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:55.892+0000 7f52e1833700 1 -- 172.21.15.59:0/65761243 wait complete. 2023-09-21T00:17:55.905 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-21T00:17:56.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.032+0000 7f30de4e3700 1 Processor -- start 2023-09-21T00:17:56.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.033+0000 7f30de4e3700 1 -- start start 2023-09-21T00:17:56.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.033+0000 7f30de4e3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f30d80b3fe0 0x7f30d80ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:56.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.033+0000 7f30de4e3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30d815ef30 con 0x7f30d815a470 2023-09-21T00:17:56.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.033+0000 7f30de4e3700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30d80b3b50 con 0x7f30d80b4d90 2023-09-21T00:17:56.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.033+0000 7f30de4e3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30d80b3220 con 0x7f30d80b3fe0 2023-09-21T00:17:56.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.034+0000 7f30dca80700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f30d80b3fe0 0x7f30d80ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:56.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.034+0000 7f30dca80700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f30d80b3fe0 0x7f30d80ce4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52358/0 (socket says 172.21.15.59:52358) 2023-09-21T00:17:56.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.034+0000 7f30dca80700 1 -- 172.21.15.59:0/3938245267 learned_addr learned my addr 172.21.15.59:0/3938245267 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:56.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.034+0000 7f30d7fff700 1 --1- 172.21.15.59:0/3938245267 >> v1:172.21.15.59:6789/0 conn(0x7f30d815a470 0x7f30d80b4680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57922/0 (socket says 172.21.15.59:57922) 2023-09-21T00:17:56.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.034+0000 7f30dca80700 1 -- 172.21.15.59:0/3938245267 >> v1:172.21.15.83:6789/0 conn(0x7f30d80b4d90 legacy=0x7f30d80cdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:56.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.034+0000 7f30dca80700 1 -- 172.21.15.59:0/3938245267 >> v1:172.21.15.59:6789/0 conn(0x7f30d815a470 legacy=0x7f30d80b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:56.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.034+0000 7f30dca80700 1 -- 172.21.15.59:0/3938245267 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d80b3500 con 0x7f30d80b3fe0 2023-09-21T00:17:56.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.034+0000 7f30dca80700 1 --2- 172.21.15.59:0/3938245267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30d80b3fe0 0x7f30d80ce4a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f30d0009e50 tx=0x7f30d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f9f32fd9b1e201b server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:56.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.034+0000 7f30d6ffd700 1 -- 172.21.15.59:0/3938245267 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d000e070 con 0x7f30d80b3fe0 2023-09-21T00:17:56.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.034+0000 7f30d6ffd700 1 -- 172.21.15.59:0/3938245267 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30d000b9c0 con 0x7f30d80b3fe0 2023-09-21T00:17:56.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.034+0000 7f30d6ffd700 1 -- 172.21.15.59:0/3938245267 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d000bd70 con 0x7f30d80b3fe0 2023-09-21T00:17:56.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.035+0000 7f30de4e3700 1 -- 172.21.15.59:0/3938245267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30d80b3fe0 msgr2=0x7f30d80ce4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:56.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.035+0000 7f30de4e3700 1 --2- 172.21.15.59:0/3938245267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30d80b3fe0 0x7f30d80ce4a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f30d0009e50 tx=0x7f30d000b330 comp rx=0 tx=0).stop 2023-09-21T00:17:56.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.035+0000 7f30de4e3700 1 -- 172.21.15.59:0/3938245267 shutdown_connections 2023-09-21T00:17:56.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.035+0000 7f30de4e3700 1 --2- 172.21.15.59:0/3938245267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30d80b3fe0 0x7f30d80ce4a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:56.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.035+0000 7f30de4e3700 1 -- 172.21.15.59:0/3938245267 >> 172.21.15.59:0/3938245267 conn(0x7f30d80b1d80 msgr2=0x7f30d80b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:56.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.035+0000 7f30de4e3700 1 -- 172.21.15.59:0/3938245267 shutdown_connections 2023-09-21T00:17:56.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.035+0000 7f30de4e3700 1 -- 172.21.15.59:0/3938245267 wait complete. 2023-09-21T00:17:56.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.036+0000 7f30de4e3700 1 Processor -- start 2023-09-21T00:17:56.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.036+0000 7f30de4e3700 1 -- start start 2023-09-21T00:17:56.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.037+0000 7f30de4e3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f30d80b3fe0 0x7f30d81f3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:56.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.037+0000 7f30de4e3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30d80b4d90 0x7f30d806b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:56.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.037+0000 7f30de4e3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30d815a470 0x7f30d80ad930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:56.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.037+0000 7f30de4e3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d806b6d0 con 0x7f30d80b4d90 2023-09-21T00:17:56.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.037+0000 7f30de4e3700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d815c940 con 0x7f30d815a470 2023-09-21T00:17:56.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.037+0000 7f30de4e3700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30d815bd30 con 0x7f30d80b3fe0 2023-09-21T00:17:56.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.037+0000 7f30d77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30d80b4d90 0x7f30d806b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:56.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.037+0000 7f30d77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30d80b4d90 0x7f30d806b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52362/0 (socket says 172.21.15.59:52362) 2023-09-21T00:17:56.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.037+0000 7f30d77fe700 1 -- 172.21.15.59:0/1165957169 learned_addr learned my addr 172.21.15.59:0/1165957169 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:56.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.037+0000 7f30d7fff700 1 --2- 172.21.15.59:0/1165957169 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f30d80b3fe0 0x7f30d81f3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:56.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.037+0000 7f30dca80700 1 --2- 172.21.15.59:0/1165957169 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30d815a470 0x7f30d80ad930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:56.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.037+0000 7f30d77fe700 1 -- 172.21.15.59:0/1165957169 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f30d80b3fe0 msgr2=0x7f30d81f3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:56.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.037+0000 7f30d77fe700 1 --2- 172.21.15.59:0/1165957169 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f30d80b3fe0 0x7f30d81f3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:56.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.037+0000 7f30d77fe700 1 -- 172.21.15.59:0/1165957169 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30d815a470 msgr2=0x7f30d80ad930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:56.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.037+0000 7f30d77fe700 1 --2- 172.21.15.59:0/1165957169 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30d815a470 0x7f30d80ad930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:56.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.037+0000 7f30d77fe700 1 -- 172.21.15.59:0/1165957169 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d0009b30 con 0x7f30d80b4d90 2023-09-21T00:17:56.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.037+0000 7f30d7fff700 1 --2- 172.21.15.59:0/1165957169 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f30d80b3fe0 0x7f30d81f3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:17:56.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.037+0000 7f30dca80700 1 --2- 172.21.15.59:0/1165957169 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30d815a470 0x7f30d80ad930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:17:56.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.038+0000 7f30d77fe700 1 --2- 172.21.15.59:0/1165957169 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30d80b4d90 0x7f30d806b190 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f30cc00c4e0 tx=0x7f30cc00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:56.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.038+0000 7f30d4ff9700 1 -- 172.21.15.59:0/1165957169 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30cc0052d0 con 0x7f30d80b4d90 2023-09-21T00:17:56.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.038+0000 7f30d4ff9700 1 -- 172.21.15.59:0/1165957169 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30cc005430 con 0x7f30d80b4d90 2023-09-21T00:17:56.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.038+0000 7f30de4e3700 1 -- 172.21.15.59:0/1165957169 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30d815c010 con 0x7f30d80b4d90 2023-09-21T00:17:56.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.038+0000 7f30d4ff9700 1 -- 172.21.15.59:0/1165957169 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30cc0038c0 con 0x7f30d80b4d90 2023-09-21T00:17:56.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.038+0000 7f30de4e3700 1 -- 172.21.15.59:0/1165957169 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30d815c5d0 con 0x7f30d80b4d90 2023-09-21T00:17:56.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.039+0000 7f30de4e3700 1 -- 172.21.15.59:0/1165957169 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30d815c790 con 0x7f30d80b4d90 2023-09-21T00:17:56.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.040+0000 7f30d4ff9700 1 -- 172.21.15.59:0/1165957169 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f30cc003a20 con 0x7f30d80b4d90 2023-09-21T00:17:56.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.040+0000 7f30d4ff9700 1 --2- 172.21.15.59:0/1165957169 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f30c406ae00 0x7f30c406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:56.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.040+0000 7f30d4ff9700 1 -- 172.21.15.59:0/1165957169 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f30cc088e30 con 0x7f30d80b4d90 2023-09-21T00:17:56.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.040+0000 7f30d7fff700 1 --2- 172.21.15.59:0/1165957169 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f30c406ae00 0x7f30c406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:56.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.041+0000 7f30d7fff700 1 --2- 172.21.15.59:0/1165957169 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f30c406ae00 0x7f30c406d2c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f30c8000f60 tx=0x7f30c8007df0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:56.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.044+0000 7f30d4ff9700 1 -- 172.21.15.59:0/1165957169 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f30cc053b40 con 0x7f30d80b4d90 2023-09-21T00:17:56.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.245+0000 7f30de4e3700 1 -- 172.21.15.59:0/1165957169 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f30d8067190 con 0x7f30d80b4d90 2023-09-21T00:17:56.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.245+0000 7f30d4ff9700 1 -- 172.21.15.59:0/1165957169 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f30cc0170a0 con 0x7f30d80b4d90 2023-09-21T00:17:56.247 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-09-21T00:17:56.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.247+0000 7f30de4e3700 1 -- 172.21.15.59:0/1165957169 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f30c406ae00 msgr2=0x7f30c406d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:56.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.247+0000 7f30de4e3700 1 --2- 172.21.15.59:0/1165957169 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f30c406ae00 0x7f30c406d2c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f30c8000f60 tx=0x7f30c8007df0 comp rx=0 tx=0).stop 2023-09-21T00:17:56.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.247+0000 7f30de4e3700 1 -- 172.21.15.59:0/1165957169 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30d80b4d90 msgr2=0x7f30d806b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:56.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.247+0000 7f30de4e3700 1 --2- 172.21.15.59:0/1165957169 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30d80b4d90 0x7f30d806b190 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f30cc00c4e0 tx=0x7f30cc00c8a0 comp rx=0 tx=0).stop 2023-09-21T00:17:56.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.247+0000 7f30de4e3700 1 -- 172.21.15.59:0/1165957169 shutdown_connections 2023-09-21T00:17:56.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.247+0000 7f30de4e3700 1 --2- 172.21.15.59:0/1165957169 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30d815a470 0x7f30d80ad930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:56.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.247+0000 7f30de4e3700 1 --2- 172.21.15.59:0/1165957169 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f30c406ae00 0x7f30c406d2c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:56.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.247+0000 7f30de4e3700 1 --2- 172.21.15.59:0/1165957169 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f30d80b3fe0 0x7f30d81f3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:56.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.247+0000 7f30de4e3700 1 --2- 172.21.15.59:0/1165957169 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30d80b4d90 0x7f30d806b190 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:56.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.247+0000 7f30de4e3700 1 -- 172.21.15.59:0/1165957169 >> 172.21.15.59:0/1165957169 conn(0x7f30d80b1d80 msgr2=0x7f30d80cdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:56.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.247+0000 7f30de4e3700 1 -- 172.21.15.59:0/1165957169 shutdown_connections 2023-09-21T00:17:56.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.247+0000 7f30de4e3700 1 -- 172.21.15.59:0/1165957169 wait complete. 2023-09-21T00:17:56.260 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-21T00:17:56.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.387+0000 7f8bc11f8700 1 Processor -- start 2023-09-21T00:17:56.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.387+0000 7f8bc11f8700 1 -- start start 2023-09-21T00:17:56.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.388+0000 7f8bc11f8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8bbc15b2b0 0x7f8bbc0cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:56.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.388+0000 7f8bc11f8700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f8bbc0ce420 0x7f8bbc161190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:56.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.388+0000 7f8bc11f8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8bbc06a780 0x7f8bbc06abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:56.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.388+0000 7f8bc11f8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bbc0ce250 con 0x7f8bbc15b2b0 2023-09-21T00:17:56.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.388+0000 7f8bc11f8700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bbc06b110 con 0x7f8bbc0ce420 2023-09-21T00:17:56.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.388+0000 7f8bc11f8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bbc0cfee0 con 0x7f8bbc06a780 2023-09-21T00:17:56.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.388+0000 7f8bbad9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8bbc15b2b0 0x7f8bbc0cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:56.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.388+0000 7f8bbad9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8bbc15b2b0 0x7f8bbc0cdd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52368/0 (socket says 172.21.15.59:52368) 2023-09-21T00:17:56.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.388+0000 7f8bbad9d700 1 -- 172.21.15.59:0/247300654 learned_addr learned my addr 172.21.15.59:0/247300654 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:56.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.388+0000 7f8bba59c700 1 --2- 172.21.15.59:0/247300654 >> v2:172.21.15.83:3300/0 conn(0x7f8bbc0ce420 0x7f8bbc161190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:56.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.388+0000 7f8bbb59e700 1 --2- 172.21.15.59:0/247300654 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8bbc06a780 0x7f8bbc06abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:56.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.388+0000 7f8bbad9d700 1 -- 172.21.15.59:0/247300654 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8bbc06a780 msgr2=0x7f8bbc06abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:56.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.388+0000 7f8bbad9d700 1 --2- 172.21.15.59:0/247300654 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8bbc06a780 0x7f8bbc06abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:56.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.388+0000 7f8bbad9d700 1 -- 172.21.15.59:0/247300654 >> v2:172.21.15.83:3300/0 conn(0x7f8bbc0ce420 msgr2=0x7f8bbc161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:56.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.388+0000 7f8bbad9d700 1 --2- 172.21.15.59:0/247300654 >> v2:172.21.15.83:3300/0 conn(0x7f8bbc0ce420 0x7f8bbc161190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:56.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.388+0000 7f8bbad9d700 1 -- 172.21.15.59:0/247300654 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bbc0ce900 con 0x7f8bbc15b2b0 2023-09-21T00:17:56.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.388+0000 7f8bbb59e700 1 --2- 172.21.15.59:0/247300654 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8bbc06a780 0x7f8bbc06abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:17:56.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.389+0000 7f8bbad9d700 1 --2- 172.21.15.59:0/247300654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bbc15b2b0 0x7f8bbc0cdd10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc072750 tx=0x7f8bb0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc187900e5014b6b server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:56.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.389+0000 7f8bb9d9b700 1 -- 172.21.15.59:0/247300654 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb000b870 con 0x7f8bbc15b2b0 2023-09-21T00:17:56.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.389+0000 7f8bb9d9b700 1 -- 172.21.15.59:0/247300654 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb000b9d0 con 0x7f8bbc15b2b0 2023-09-21T00:17:56.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.389+0000 7f8bb9d9b700 1 -- 172.21.15.59:0/247300654 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb000bd60 con 0x7f8bbc15b2b0 2023-09-21T00:17:56.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.389+0000 7f8bc11f8700 1 -- 172.21.15.59:0/247300654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bbc15b2b0 msgr2=0x7f8bbc0cdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:56.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.389+0000 7f8bc11f8700 1 --2- 172.21.15.59:0/247300654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bbc15b2b0 0x7f8bbc0cdd10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc072750 tx=0x7f8bb0009bd0 comp rx=0 tx=0).stop 2023-09-21T00:17:56.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.389+0000 7f8bc11f8700 1 -- 172.21.15.59:0/247300654 shutdown_connections 2023-09-21T00:17:56.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.389+0000 7f8bc11f8700 1 --2- 172.21.15.59:0/247300654 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8bbc06a780 0x7f8bbc06abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:56.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.389+0000 7f8bc11f8700 1 --2- 172.21.15.59:0/247300654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bbc15b2b0 0x7f8bbc0cdd10 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:56.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.389+0000 7f8bc11f8700 1 --2- 172.21.15.59:0/247300654 >> v2:172.21.15.83:3300/0 conn(0x7f8bbc0ce420 0x7f8bbc161190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:56.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.389+0000 7f8bc11f8700 1 -- 172.21.15.59:0/247300654 >> 172.21.15.59:0/247300654 conn(0x7f8bbc0d0140 msgr2=0x7f8bbc0d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:56.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.389+0000 7f8bc11f8700 1 -- 172.21.15.59:0/247300654 shutdown_connections 2023-09-21T00:17:56.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.389+0000 7f8bc11f8700 1 -- 172.21.15.59:0/247300654 wait complete. 2023-09-21T00:17:56.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.391+0000 7f8bc11f8700 1 Processor -- start 2023-09-21T00:17:56.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.391+0000 7f8bc11f8700 1 -- start start 2023-09-21T00:17:56.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.392+0000 7f8bc11f8700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8bbc06a780 0x7f8bbc1e7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:56.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.392+0000 7f8bc11f8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8bbc0ce420 0x7f8bbc15b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:56.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.392+0000 7f8bc11f8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bbc15b2b0 0x7f8bbc15bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:56.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.392+0000 7f8bc11f8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bbc1f3570 con 0x7f8bbc15b2b0 2023-09-21T00:17:56.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.392+0000 7f8bc11f8700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bbc1f3850 con 0x7f8bbc06a780 2023-09-21T00:17:56.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.392+0000 7f8bc11f8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bbc1f3b30 con 0x7f8bbc0ce420 2023-09-21T00:17:56.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.392+0000 7f8bbb59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bbc15b2b0 0x7f8bbc15bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:56.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.392+0000 7f8bbb59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bbc15b2b0 0x7f8bbc15bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52378/0 (socket says 172.21.15.59:52378) 2023-09-21T00:17:56.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.392+0000 7f8bbb59e700 1 -- 172.21.15.59:0/3937415114 learned_addr learned my addr 172.21.15.59:0/3937415114 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:56.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.393+0000 7f8bbad9d700 1 --2- 172.21.15.59:0/3937415114 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8bbc06a780 0x7f8bbc1e7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:56.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.393+0000 7f8bba59c700 1 --2- 172.21.15.59:0/3937415114 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8bbc0ce420 0x7f8bbc15b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:56.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.393+0000 7f8bbb59e700 1 -- 172.21.15.59:0/3937415114 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8bbc0ce420 msgr2=0x7f8bbc15b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:56.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.393+0000 7f8bbb59e700 1 --2- 172.21.15.59:0/3937415114 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8bbc0ce420 0x7f8bbc15b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:56.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.393+0000 7f8bbb59e700 1 -- 172.21.15.59:0/3937415114 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8bbc06a780 msgr2=0x7f8bbc1e7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:56.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.393+0000 7f8bbb59e700 1 --2- 172.21.15.59:0/3937415114 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8bbc06a780 0x7f8bbc1e7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:56.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.393+0000 7f8bbb59e700 1 -- 172.21.15.59:0/3937415114 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb0009550 con 0x7f8bbc15b2b0 2023-09-21T00:17:56.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.393+0000 7f8bba59c700 1 --2- 172.21.15.59:0/3937415114 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8bbc0ce420 0x7f8bbc15b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:17:56.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.393+0000 7f8bbb59e700 1 --2- 172.21.15.59:0/3937415114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bbc15b2b0 0x7f8bbc15bbd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8bb400cef0 tx=0x7f8bb400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:56.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.393+0000 7f8ba37fe700 1 -- 172.21.15.59:0/3937415114 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb400ad30 con 0x7f8bbc15b2b0 2023-09-21T00:17:56.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.393+0000 7f8ba37fe700 1 -- 172.21.15.59:0/3937415114 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb400ae90 con 0x7f8bbc15b2b0 2023-09-21T00:17:56.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.393+0000 7f8bc11f8700 1 -- 172.21.15.59:0/3937415114 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bbc1f3e10 con 0x7f8bbc15b2b0 2023-09-21T00:17:56.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.393+0000 7f8ba37fe700 1 -- 172.21.15.59:0/3937415114 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb4015680 con 0x7f8bbc15b2b0 2023-09-21T00:17:56.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.393+0000 7f8bc11f8700 1 -- 172.21.15.59:0/3937415114 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bbc158a10 con 0x7f8bbc15b2b0 2023-09-21T00:17:56.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.394+0000 7f8bc11f8700 1 -- 172.21.15.59:0/3937415114 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bbc067e50 con 0x7f8bbc15b2b0 2023-09-21T00:17:56.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.395+0000 7f8ba37fe700 1 -- 172.21.15.59:0/3937415114 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f8bb400d430 con 0x7f8bbc15b2b0 2023-09-21T00:17:56.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.395+0000 7f8ba37fe700 1 --2- 172.21.15.59:0/3937415114 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f8ba806ae00 0x7f8ba806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:56.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.395+0000 7f8ba37fe700 1 -- 172.21.15.59:0/3937415114 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f8bb4089ea0 con 0x7f8bbc15b2b0 2023-09-21T00:17:56.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.395+0000 7f8bbad9d700 1 --2- 172.21.15.59:0/3937415114 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f8ba806ae00 0x7f8ba806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:56.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.396+0000 7f8bbad9d700 1 --2- 172.21.15.59:0/3937415114 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f8ba806ae00 0x7f8ba806d2c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0014040 tx=0x7f8bb0008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:56.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.400+0000 7f8ba37fe700 1 -- 172.21.15.59:0/3937415114 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f8bb4054b30 con 0x7f8bbc15b2b0 2023-09-21T00:17:56.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.599+0000 7f8bc11f8700 1 -- 172.21.15.59:0/3937415114 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8bbc0d1020 con 0x7f8bbc15b2b0 2023-09-21T00:17:56.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.599+0000 7f8ba37fe700 1 -- 172.21.15.59:0/3937415114 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8bb401a020 con 0x7f8bbc15b2b0 2023-09-21T00:17:56.601 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-09-21T00:17:56.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.601+0000 7f8bc11f8700 1 -- 172.21.15.59:0/3937415114 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f8ba806ae00 msgr2=0x7f8ba806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:56.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.601+0000 7f8bc11f8700 1 --2- 172.21.15.59:0/3937415114 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f8ba806ae00 0x7f8ba806d2c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0014040 tx=0x7f8bb0008030 comp rx=0 tx=0).stop 2023-09-21T00:17:56.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.601+0000 7f8bc11f8700 1 -- 172.21.15.59:0/3937415114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bbc15b2b0 msgr2=0x7f8bbc15bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:56.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.601+0000 7f8bc11f8700 1 --2- 172.21.15.59:0/3937415114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bbc15b2b0 0x7f8bbc15bbd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8bb400cef0 tx=0x7f8bb400cf20 comp rx=0 tx=0).stop 2023-09-21T00:17:56.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.601+0000 7f8bc11f8700 1 -- 172.21.15.59:0/3937415114 shutdown_connections 2023-09-21T00:17:56.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.601+0000 7f8bc11f8700 1 --2- 172.21.15.59:0/3937415114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bbc15b2b0 0x7f8bbc15bbd0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:56.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.601+0000 7f8bc11f8700 1 --2- 172.21.15.59:0/3937415114 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8bbc06a780 0x7f8bbc1e7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:56.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.601+0000 7f8bc11f8700 1 --2- 172.21.15.59:0/3937415114 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f8ba806ae00 0x7f8ba806d2c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:56.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.601+0000 7f8bc11f8700 1 --2- 172.21.15.59:0/3937415114 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8bbc0ce420 0x7f8bbc15b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:56.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.601+0000 7f8bc11f8700 1 -- 172.21.15.59:0/3937415114 >> 172.21.15.59:0/3937415114 conn(0x7f8bbc0d0140 msgr2=0x7f8bbc0ac890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:56.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.601+0000 7f8bc11f8700 1 -- 172.21.15.59:0/3937415114 shutdown_connections 2023-09-21T00:17:56.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.601+0000 7f8bc11f8700 1 -- 172.21.15.59:0/3937415114 wait complete. 2023-09-21T00:17:56.614 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T00:17:56.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.738+0000 7f9bf8ad7700 1 Processor -- start 2023-09-21T00:17:56.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.738+0000 7f9bf8ad7700 1 -- start start 2023-09-21T00:17:56.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.739+0000 7f9bf8ad7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9bf40ca790 0x7f9bf4071680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:56.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.739+0000 7f9bf8ad7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9bf40cac20 0x7f9bf4071bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:56.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.739+0000 7f9bf8ad7700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bf40cb1c0 con 0x7f9bf415a230 2023-09-21T00:17:56.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.739+0000 7f9bf8ad7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bf40cb780 con 0x7f9bf40ca790 2023-09-21T00:17:56.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.739+0000 7f9bf8ad7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf40cb4a0 con 0x7f9bf40cac20 2023-09-21T00:17:56.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.739+0000 7f9bf1d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9bf40ca790 0x7f9bf4071680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:56.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.739+0000 7f9bf1d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9bf40ca790 0x7f9bf4071680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52384/0 (socket says 172.21.15.59:52384) 2023-09-21T00:17:56.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.739+0000 7f9bf1d9b700 1 -- 172.21.15.59:0/1760407816 learned_addr learned my addr 172.21.15.59:0/1760407816 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:56.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.739+0000 7f9bf2d9d700 1 --2- 172.21.15.59:0/1760407816 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9bf40cac20 0x7f9bf4071bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:56.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.739+0000 7f9bf1d9b700 1 -- 172.21.15.59:0/1760407816 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9bf40cac20 msgr2=0x7f9bf4071bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:56.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.739+0000 7f9bf1d9b700 1 --2- 172.21.15.59:0/1760407816 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9bf40cac20 0x7f9bf4071bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:56.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.739+0000 7f9bf1d9b700 1 -- 172.21.15.59:0/1760407816 >> v1:172.21.15.83:6789/0 conn(0x7f9bf415a230 legacy=0x7f9bf415e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:56.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.740+0000 7f9bf1d9b700 1 -- 172.21.15.59:0/1760407816 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf415e0b0 con 0x7f9bf40ca790 2023-09-21T00:17:56.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.740+0000 7f9bf1d9b700 1 --2- 172.21.15.59:0/1760407816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bf40ca790 0x7f9bf4071680 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9be40098f0 tx=0x7f9be4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73e655d05e803ee6 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:56.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.740+0000 7f9bf159a700 1 -- 172.21.15.59:0/1760407816 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be4011830 con 0x7f9bf40ca790 2023-09-21T00:17:56.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.740+0000 7f9bf159a700 1 -- 172.21.15.59:0/1760407816 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be4011990 con 0x7f9bf40ca790 2023-09-21T00:17:56.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.740+0000 7f9bf159a700 1 -- 172.21.15.59:0/1760407816 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be4011d20 con 0x7f9bf40ca790 2023-09-21T00:17:56.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.740+0000 7f9bf8ad7700 1 -- 172.21.15.59:0/1760407816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bf40ca790 msgr2=0x7f9bf4071680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:56.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.740+0000 7f9bf8ad7700 1 --2- 172.21.15.59:0/1760407816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bf40ca790 0x7f9bf4071680 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9be40098f0 tx=0x7f9be4009c00 comp rx=0 tx=0).stop 2023-09-21T00:17:56.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.740+0000 7f9bf8ad7700 1 -- 172.21.15.59:0/1760407816 shutdown_connections 2023-09-21T00:17:56.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.740+0000 7f9bf8ad7700 1 --2- 172.21.15.59:0/1760407816 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9bf40cac20 0x7f9bf4071bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:56.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.740+0000 7f9bf8ad7700 1 --2- 172.21.15.59:0/1760407816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bf40ca790 0x7f9bf4071680 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:56.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.740+0000 7f9bf8ad7700 1 -- 172.21.15.59:0/1760407816 >> 172.21.15.59:0/1760407816 conn(0x7f9bf40d0140 msgr2=0x7f9bf40d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:56.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.740+0000 7f9bf8ad7700 1 -- 172.21.15.59:0/1760407816 shutdown_connections 2023-09-21T00:17:56.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.740+0000 7f9bf8ad7700 1 -- 172.21.15.59:0/1760407816 wait complete. 2023-09-21T00:17:56.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.742+0000 7f9bf8ad7700 1 Processor -- start 2023-09-21T00:17:56.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.742+0000 7f9bf8ad7700 1 -- start start 2023-09-21T00:17:56.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.742+0000 7f9bf8ad7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9bf40ca790 0x7f9bf4156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:56.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.743+0000 7f9bf8ad7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bf40cac20 0x7f9bf406a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:56.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.743+0000 7f9bf8ad7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9bf415a230 0x7f9bf4071580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:56.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.743+0000 7f9bf8ad7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf406acc0 con 0x7f9bf40cac20 2023-09-21T00:17:56.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.743+0000 7f9bf8ad7700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf415d780 con 0x7f9bf415a230 2023-09-21T00:17:56.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.743+0000 7f9bf8ad7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf40c6de0 con 0x7f9bf40ca790 2023-09-21T00:17:56.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.743+0000 7f9bf1d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bf40cac20 0x7f9bf406a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:56.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.743+0000 7f9bf1d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bf40cac20 0x7f9bf406a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52390/0 (socket says 172.21.15.59:52390) 2023-09-21T00:17:56.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.743+0000 7f9bf1d9b700 1 -- 172.21.15.59:0/1485363392 learned_addr learned my addr 172.21.15.59:0/1485363392 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:56.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.743+0000 7f9bf259c700 1 --2- 172.21.15.59:0/1485363392 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9bf40ca790 0x7f9bf4156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:56.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.743+0000 7f9bf2d9d700 1 --2- 172.21.15.59:0/1485363392 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9bf415a230 0x7f9bf4071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:56.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.743+0000 7f9bf1d9b700 1 -- 172.21.15.59:0/1485363392 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9bf40ca790 msgr2=0x7f9bf4156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:56.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.743+0000 7f9bf1d9b700 1 --2- 172.21.15.59:0/1485363392 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9bf40ca790 0x7f9bf4156fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:56.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.743+0000 7f9bf1d9b700 1 -- 172.21.15.59:0/1485363392 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9bf415a230 msgr2=0x7f9bf4071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:56.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.743+0000 7f9bf1d9b700 1 --2- 172.21.15.59:0/1485363392 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9bf415a230 0x7f9bf4071580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:56.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.743+0000 7f9bf1d9b700 1 -- 172.21.15.59:0/1485363392 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be4009550 con 0x7f9bf40cac20 2023-09-21T00:17:56.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.743+0000 7f9bf1d9b700 1 --2- 172.21.15.59:0/1485363392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bf40cac20 0x7f9bf406a780 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9be4000c00 tx=0x7f9be4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:56.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.743+0000 7f9be2ffd700 1 -- 172.21.15.59:0/1485363392 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be4004570 con 0x7f9bf40cac20 2023-09-21T00:17:56.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.743+0000 7f9be2ffd700 1 -- 172.21.15.59:0/1485363392 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be401f070 con 0x7f9bf40cac20 2023-09-21T00:17:56.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.743+0000 7f9bf8ad7700 1 -- 172.21.15.59:0/1485363392 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bf415d1c0 con 0x7f9bf40cac20 2023-09-21T00:17:56.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.743+0000 7f9be2ffd700 1 -- 172.21.15.59:0/1485363392 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be40038c0 con 0x7f9bf40cac20 2023-09-21T00:17:56.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.743+0000 7f9bf8ad7700 1 -- 172.21.15.59:0/1485363392 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bf40a8630 con 0x7f9bf40cac20 2023-09-21T00:17:56.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.744+0000 7f9bf8ad7700 1 -- 172.21.15.59:0/1485363392 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bf415d020 con 0x7f9bf40cac20 2023-09-21T00:17:56.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.745+0000 7f9be2ffd700 1 -- 172.21.15.59:0/1485363392 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f9be4021030 con 0x7f9bf40cac20 2023-09-21T00:17:56.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.745+0000 7f9be2ffd700 1 --2- 172.21.15.59:0/1485363392 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f9bd406ae00 0x7f9bd406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:56.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.745+0000 7f9be2ffd700 1 -- 172.21.15.59:0/1485363392 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f9be408add0 con 0x7f9bf40cac20 2023-09-21T00:17:56.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.745+0000 7f9bf259c700 1 --2- 172.21.15.59:0/1485363392 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f9bd406ae00 0x7f9bd406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:56.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.746+0000 7f9bf259c700 1 --2- 172.21.15.59:0/1485363392 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f9bd406ae00 0x7f9bd406d2c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9bf41f3eb0 tx=0x7f9be8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:56.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.750+0000 7f9be2ffd700 1 -- 172.21.15.59:0/1485363392 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f9bf415d020 con 0x7f9bf40cac20 2023-09-21T00:17:56.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.950+0000 7f9bf8ad7700 1 -- 172.21.15.59:0/1485363392 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9bf415d020 con 0x7f9bf40cac20 2023-09-21T00:17:56.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.951+0000 7f9be2ffd700 1 -- 172.21.15.59:0/1485363392 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18792 (secure 0 0 0) 0x7f9bf415d020 con 0x7f9bf40cac20 2023-09-21T00:17:56.953 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:17:56.953 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":26,"fsid":"dd69925c-6e25-42fe-880b-2f60fc6f384b","created":"2023-09-21T00:16:43.074489+0000","modified":"2023-09-21T00:17:50.090179+0000","last_up_change":"2023-09-21T00:16:54.740101+0000","last_in_change":"2023-09-21T00:16:45.987089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T00:16:54.796248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-21T00:17:04.167102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-21T00:17:05.313188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-21T00:17:08.977609+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d4b18344-74c0-4f75-920b-7a9247e48914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6809","nonce":2418314235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6811","nonce":2418314235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6815","nonce":2418314235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6813","nonce":2418314235}]},"public_addr":"172.21.15.59:6809/2418314235","cluster_addr":"172.21.15.59:6811/2418314235","heartbeat_back_addr":"172.21.15.59:6815/2418314235","heartbeat_front_addr":"172.21.15.59:6813/2418314235","state":["exists","up"]},{"osd":1,"uuid":"80940d50-a248-4e64-a282-7ffcdad790ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6801","nonce":869668251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6803","nonce":869668251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6807","nonce":869668251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6805","nonce":869668251}]},"public_addr":"172.21.15.59:6801/869668251","cluster_addr":"172.21.15.59:6803/869668251","heartbeat_back_addr":"172.21.15.59:6807/869668251","heartbeat_front_addr":"172.21.15.59:6805/869668251","state":["exists","up"]},{"osd":2,"uuid":"55f2eceb-c54a-4879-a6ce-968c1c548b5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6817","nonce":372517778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6819","nonce":372517778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6823","nonce":372517778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6821","nonce":372517778}]},"public_addr":"172.21.15.59:6817/372517778","cluster_addr":"172.21.15.59:6819/372517778","heartbeat_back_addr":"172.21.15.59:6823/372517778","heartbeat_front_addr":"172.21.15.59:6821/372517778","state":["exists","up"]},{"osd":3,"uuid":"92b89cd0-869c-49b9-a9f9-97ac8423f304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6825","nonce":575188498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6827","nonce":575188498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6831","nonce":575188498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6829","nonce":575188498}]},"public_addr":"172.21.15.59:6825/575188498","cluster_addr":"172.21.15.59:6827/575188498","heartbeat_back_addr":"172.21.15.59:6831/575188498","heartbeat_front_addr":"172.21.15.59:6829/575188498","state":["exists","up"]},{"osd":4,"uuid":"25b80e94-e0e6-403d-b69f-61542f289637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6803","nonce":1741219098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6805","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6807","nonce":1741219098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6815","nonce":1741219098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6811","nonce":1741219098}]},"public_addr":"172.21.15.83:6803/1741219098","cluster_addr":"172.21.15.83:6807/1741219098","heartbeat_back_addr":"172.21.15.83:6815/1741219098","heartbeat_front_addr":"172.21.15.83:6811/1741219098","state":["exists","up"]},{"osd":5,"uuid":"5498d9ab-1086-4796-a199-9051e6dfea91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6817","nonce":156730565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6819","nonce":156730565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6823","nonce":156730565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6821","nonce":156730565}]},"public_addr":"172.21.15.83:6817/156730565","cluster_addr":"172.21.15.83:6819/156730565","heartbeat_back_addr":"172.21.15.83:6823/156730565","heartbeat_front_addr":"172.21.15.83:6821/156730565","state":["exists","up"]},{"osd":6,"uuid":"cfd810c0-5015-4d60-9a75-7efc93a32e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6801","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6800","nonce":1337723778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6806","nonce":1337723778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6814","nonce":1337723778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6810","nonce":1337723778}]},"public_addr":"172.21.15.83:6800/1337723778","cluster_addr":"172.21.15.83:6806/1337723778","heartbeat_back_addr":"172.21.15.83:6814/1337723778","heartbeat_front_addr":"172.21.15.83:6810/1337723778","state":["exists","up"]},{"osd":7,"uuid":"e992c8fa-0a3d-4b3c-85b5-2c511223dee4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6825","nonce":4204859272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6827","nonce":4204859272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6831","nonce":4204859272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6829","nonce":4204859272}]},"public_addr":"172.21.15.83:6825/4204859272","cluster_addr":"172.21.15.83:6827/4204859272","heartbeat_back_addr":"172.21.15.83:6831/4204859272","heartbeat_front_addr":"172.21.15.83:6829/4204859272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.156498+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.882707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.093978+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.158565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.173933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.888606+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.135525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.149712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":3,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.34","mappings":[{"from":4,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":6}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T00:17:56.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.954+0000 7f9bf8ad7700 1 -- 172.21.15.59:0/1485363392 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f9bd406ae00 msgr2=0x7f9bd406d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:56.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.954+0000 7f9bf8ad7700 1 --2- 172.21.15.59:0/1485363392 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f9bd406ae00 0x7f9bd406d2c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9bf41f3eb0 tx=0x7f9be8009040 comp rx=0 tx=0).stop 2023-09-21T00:17:56.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.954+0000 7f9bf8ad7700 1 -- 172.21.15.59:0/1485363392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bf40cac20 msgr2=0x7f9bf406a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:56.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.954+0000 7f9bf8ad7700 1 --2- 172.21.15.59:0/1485363392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bf40cac20 0x7f9bf406a780 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9be4000c00 tx=0x7f9be4004750 comp rx=0 tx=0).stop 2023-09-21T00:17:56.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.954+0000 7f9bf8ad7700 1 -- 172.21.15.59:0/1485363392 shutdown_connections 2023-09-21T00:17:56.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.954+0000 7f9bf8ad7700 1 --2- 172.21.15.59:0/1485363392 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9bf415a230 0x7f9bf4071580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:56.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.954+0000 7f9bf8ad7700 1 --2- 172.21.15.59:0/1485363392 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f9bd406ae00 0x7f9bd406d2c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:56.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.954+0000 7f9bf8ad7700 1 --2- 172.21.15.59:0/1485363392 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9bf40ca790 0x7f9bf4156fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:56.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.954+0000 7f9bf8ad7700 1 --2- 172.21.15.59:0/1485363392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bf40cac20 0x7f9bf406a780 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:56.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.954+0000 7f9bf8ad7700 1 -- 172.21.15.59:0/1485363392 >> 172.21.15.59:0/1485363392 conn(0x7f9bf40d0140 msgr2=0x7f9bf40b0880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:56.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.954+0000 7f9bf8ad7700 1 -- 172.21.15.59:0/1485363392 shutdown_connections 2023-09-21T00:17:56.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:56.954+0000 7f9bf8ad7700 1 -- 172.21.15.59:0/1485363392 wait complete. 2023-09-21T00:17:56.967 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-21T00:16:54.796248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-21T00:17:04.167102+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-21T00:17:05.313188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-21T00:17:08.977609+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-21T00:17:56.968 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-21T00:17:57.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.096+0000 7f27a4858700 1 Processor -- start 2023-09-21T00:17:57.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.096+0000 7f27a4858700 1 -- start start 2023-09-21T00:17:57.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.097+0000 7f27a4858700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f27a015a230 0x7f27a015e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:57.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.097+0000 7f27a4858700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f27a0071d90 0x7f27a006eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:57.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.097+0000 7f27a4858700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27a00cb1c0 con 0x7f27a00ca790 2023-09-21T00:17:57.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.097+0000 7f27a4858700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27a00cb780 con 0x7f27a0071d90 2023-09-21T00:17:57.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.097+0000 7f27a4858700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27a00cb4a0 con 0x7f27a015a230 2023-09-21T00:17:57.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.097+0000 7f279dd9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f27a00ca790 0x7f27a0071680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57964/0 (socket says 172.21.15.59:57964) 2023-09-21T00:17:57.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.097+0000 7f279dd9b700 1 -- 172.21.15.59:0/3451497062 learned_addr learned my addr 172.21.15.59:0/3451497062 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:57.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.097+0000 7f279ed9d700 1 --2- 172.21.15.59:0/3451497062 >> v2:172.21.15.59:3300/0 conn(0x7f27a0071d90 0x7f27a006eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:57.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.097+0000 7f279e59c700 1 --2- 172.21.15.59:0/3451497062 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f27a015a230 0x7f27a015e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:57.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.097+0000 7f279ed9d700 1 -- 172.21.15.59:0/3451497062 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f27a015a230 msgr2=0x7f27a015e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:57.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.097+0000 7f279ed9d700 1 --2- 172.21.15.59:0/3451497062 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f27a015a230 0x7f27a015e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:57.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.097+0000 7f279ed9d700 1 -- 172.21.15.59:0/3451497062 >> v1:172.21.15.59:6789/0 conn(0x7f27a00ca790 legacy=0x7f27a0071680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:57.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.097+0000 7f279ed9d700 1 -- 172.21.15.59:0/3451497062 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a015e0b0 con 0x7f27a0071d90 2023-09-21T00:17:57.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.097+0000 7f279d59a700 1 -- 172.21.15.59:0/3451497062 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 775385613 0 0) 0x7f27a00cb1c0 con 0x7f27a00ca790 2023-09-21T00:17:57.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.097+0000 7f279ed9d700 1 --2- 172.21.15.59:0/3451497062 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27a0071d90 0x7f27a006eaa0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2798009d90 tx=0x7f279800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acab69d720b85b74 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:57.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.097+0000 7f279d59a700 1 -- 172.21.15.59:0/3451497062 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f279800e070 con 0x7f27a0071d90 2023-09-21T00:17:57.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.097+0000 7f279d59a700 1 -- 172.21.15.59:0/3451497062 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f279800bbd0 con 0x7f27a0071d90 2023-09-21T00:17:57.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.097+0000 7f279d59a700 1 -- 172.21.15.59:0/3451497062 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2798012430 con 0x7f27a0071d90 2023-09-21T00:17:57.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.098+0000 7f27a4858700 1 -- 172.21.15.59:0/3451497062 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27a0071d90 msgr2=0x7f27a006eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:57.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.098+0000 7f27a4858700 1 --2- 172.21.15.59:0/3451497062 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27a0071d90 0x7f27a006eaa0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2798009d90 tx=0x7f279800b330 comp rx=0 tx=0).stop 2023-09-21T00:17:57.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.098+0000 7f27a4858700 1 -- 172.21.15.59:0/3451497062 shutdown_connections 2023-09-21T00:17:57.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.098+0000 7f27a4858700 1 --2- 172.21.15.59:0/3451497062 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27a0071d90 0x7f27a006eaa0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:57.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.098+0000 7f27a4858700 1 --2- 172.21.15.59:0/3451497062 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f27a015a230 0x7f27a015e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:57.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.098+0000 7f27a4858700 1 -- 172.21.15.59:0/3451497062 >> 172.21.15.59:0/3451497062 conn(0x7f27a00d0140 msgr2=0x7f27a00d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:57.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.098+0000 7f27a4858700 1 -- 172.21.15.59:0/3451497062 shutdown_connections 2023-09-21T00:17:57.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.098+0000 7f27a4858700 1 -- 172.21.15.59:0/3451497062 wait complete. 2023-09-21T00:17:57.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.100+0000 7f27a4858700 1 Processor -- start 2023-09-21T00:17:57.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.100+0000 7f27a4858700 1 -- start start 2023-09-21T00:17:57.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.100+0000 7f27a4858700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27a0071d90 0x7f27a00c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:57.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.100+0000 7f27a4858700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f27a00ca790 0x7f27a006ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:57.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.100+0000 7f27a4858700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27a015a230 0x7f27a015bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:57.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.100+0000 7f27a4858700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a00c6700 con 0x7f27a015a230 2023-09-21T00:17:57.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.100+0000 7f27a4858700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a00c5e60 con 0x7f27a0071d90 2023-09-21T00:17:57.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.100+0000 7f27a4858700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27a00c6140 con 0x7f27a00ca790 2023-09-21T00:17:57.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.100+0000 7f279ed9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27a015a230 0x7f27a015bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:57.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.100+0000 7f279ed9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27a015a230 0x7f27a015bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52406/0 (socket says 172.21.15.59:52406) 2023-09-21T00:17:57.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.100+0000 7f279ed9d700 1 -- 172.21.15.59:0/68005131 learned_addr learned my addr 172.21.15.59:0/68005131 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:57.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.101+0000 7f279dd9b700 1 --2- 172.21.15.59:0/68005131 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f27a00ca790 0x7f27a006ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:57.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.101+0000 7f279e59c700 1 --2- 172.21.15.59:0/68005131 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27a0071d90 0x7f27a00c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:57.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.101+0000 7f279ed9d700 1 -- 172.21.15.59:0/68005131 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f27a00ca790 msgr2=0x7f27a006ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:57.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.101+0000 7f279ed9d700 1 --2- 172.21.15.59:0/68005131 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f27a00ca790 0x7f27a006ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:57.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.101+0000 7f279ed9d700 1 -- 172.21.15.59:0/68005131 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27a0071d90 msgr2=0x7f27a00c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:57.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.101+0000 7f279ed9d700 1 --2- 172.21.15.59:0/68005131 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27a0071d90 0x7f27a00c9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:57.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.101+0000 7f279ed9d700 1 -- 172.21.15.59:0/68005131 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2798009a70 con 0x7f27a015a230 2023-09-21T00:17:57.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.101+0000 7f279e59c700 1 --2- 172.21.15.59:0/68005131 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27a0071d90 0x7f27a00c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:17:57.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.101+0000 7f279ed9d700 1 --2- 172.21.15.59:0/68005131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27a015a230 0x7f27a015bd50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f27a00d0e90 tx=0x7f2798004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:57.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.101+0000 7f278effd700 1 -- 172.21.15.59:0/68005131 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2798003ea0 con 0x7f27a015a230 2023-09-21T00:17:57.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.101+0000 7f278effd700 1 -- 172.21.15.59:0/68005131 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2798020070 con 0x7f27a015a230 2023-09-21T00:17:57.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.101+0000 7f27a4858700 1 -- 172.21.15.59:0/68005131 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27a00c6420 con 0x7f27a015a230 2023-09-21T00:17:57.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.101+0000 7f278effd700 1 -- 172.21.15.59:0/68005131 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2798004280 con 0x7f27a015a230 2023-09-21T00:17:57.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.101+0000 7f27a4858700 1 -- 172.21.15.59:0/68005131 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27a00c3ce0 con 0x7f27a015a230 2023-09-21T00:17:57.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.102+0000 7f27a4858700 1 -- 172.21.15.59:0/68005131 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27a0067e50 con 0x7f27a015a230 2023-09-21T00:17:57.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.102+0000 7f278effd700 1 -- 172.21.15.59:0/68005131 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f27980043e0 con 0x7f27a015a230 2023-09-21T00:17:57.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.103+0000 7f278effd700 1 --2- 172.21.15.59:0/68005131 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f278006ae00 0x7f278006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:57.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.103+0000 7f278effd700 1 -- 172.21.15.59:0/68005131 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f2798022070 con 0x7f27a015a230 2023-09-21T00:17:57.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.103+0000 7f279e59c700 1 --2- 172.21.15.59:0/68005131 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f278006ae00 0x7f278006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:57.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.104+0000 7f279e59c700 1 --2- 172.21.15.59:0/68005131 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f278006ae00 0x7f278006d2c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f279000a9b0 tx=0x7f2790008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:57.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.107+0000 7f278effd700 1 -- 172.21.15.59:0/68005131 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f27980568c0 con 0x7f27a015a230 2023-09-21T00:17:57.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.308+0000 7f27a4858700 1 -- 172.21.15.59:0/68005131 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f27a0070040 con 0x7f27a015a230 2023-09-21T00:17:57.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.308+0000 7f278effd700 1 -- 172.21.15.59:0/68005131 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f279801ae60 con 0x7f27a015a230 2023-09-21T00:17:57.310 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-09-21T00:17:57.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.310+0000 7f27a4858700 1 -- 172.21.15.59:0/68005131 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f278006ae00 msgr2=0x7f278006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:57.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.310+0000 7f27a4858700 1 --2- 172.21.15.59:0/68005131 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f278006ae00 0x7f278006d2c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f279000a9b0 tx=0x7f2790008040 comp rx=0 tx=0).stop 2023-09-21T00:17:57.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.310+0000 7f27a4858700 1 -- 172.21.15.59:0/68005131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27a015a230 msgr2=0x7f27a015bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:57.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.310+0000 7f27a4858700 1 --2- 172.21.15.59:0/68005131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27a015a230 0x7f27a015bd50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f27a00d0e90 tx=0x7f2798004ad0 comp rx=0 tx=0).stop 2023-09-21T00:17:57.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.310+0000 7f27a4858700 1 -- 172.21.15.59:0/68005131 shutdown_connections 2023-09-21T00:17:57.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.310+0000 7f27a4858700 1 --2- 172.21.15.59:0/68005131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27a015a230 0x7f27a015bd50 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:57.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.310+0000 7f27a4858700 1 --2- 172.21.15.59:0/68005131 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27a0071d90 0x7f27a00c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:57.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.310+0000 7f27a4858700 1 --2- 172.21.15.59:0/68005131 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f278006ae00 0x7f278006d2c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:57.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.310+0000 7f27a4858700 1 --2- 172.21.15.59:0/68005131 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f27a00ca790 0x7f27a006ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:57.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.310+0000 7f27a4858700 1 -- 172.21.15.59:0/68005131 >> 172.21.15.59:0/68005131 conn(0x7f27a00d0140 msgr2=0x7f27a0154160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:57.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.310+0000 7f27a4858700 1 -- 172.21.15.59:0/68005131 shutdown_connections 2023-09-21T00:17:57.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.310+0000 7f27a4858700 1 -- 172.21.15.59:0/68005131 wait complete. 2023-09-21T00:17:57.324 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-21T00:17:57.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.451+0000 7efdb9981700 1 Processor -- start 2023-09-21T00:17:57.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.451+0000 7efdb9981700 1 -- start start 2023-09-21T00:17:57.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.451+0000 7efdb9981700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efdb415d690 0x7efdb40d1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:57.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.452+0000 7efdb9981700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdb40d1ee0 con 0x7efdb40b5630 2023-09-21T00:17:57.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.452+0000 7efdb9981700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdb40d21c0 con 0x7efdb40d1a60 2023-09-21T00:17:57.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.452+0000 7efdb9981700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdb40d24a0 con 0x7efdb415d690 2023-09-21T00:17:57.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.452+0000 7efdb2ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efdb415d690 0x7efdb40d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:57.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.452+0000 7efdb37fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7efdb40b5630 0x7efdb40b65d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57982/0 (socket says 172.21.15.59:57982) 2023-09-21T00:17:57.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.452+0000 7efdb2ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efdb415d690 0x7efdb40d1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52410/0 (socket says 172.21.15.59:52410) 2023-09-21T00:17:57.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.452+0000 7efdb37fe700 1 -- 172.21.15.59:0/927731785 learned_addr learned my addr 172.21.15.59:0/927731785 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:57.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.452+0000 7efdb2ffd700 1 -- 172.21.15.59:0/927731785 >> v1:172.21.15.83:6789/0 conn(0x7efdb40d1a60 legacy=0x7efdb40b4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:57.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.452+0000 7efdb2ffd700 1 -- 172.21.15.59:0/927731785 >> v1:172.21.15.59:6789/0 conn(0x7efdb40b5630 legacy=0x7efdb40b65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:57.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.452+0000 7efdb2ffd700 1 -- 172.21.15.59:0/927731785 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb40d2780 con 0x7efdb415d690 2023-09-21T00:17:57.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.452+0000 7efdb1ffb700 1 -- 172.21.15.59:0/927731785 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3492371417 0 0) 0x7efdb40d1ee0 con 0x7efdb40b5630 2023-09-21T00:17:57.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.452+0000 7efdb2ffd700 1 --2- 172.21.15.59:0/927731785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efdb415d690 0x7efdb40d1520 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7efda8009840 tx=0x7efda8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aea401e068b923 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:57.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.452+0000 7efdb1ffb700 1 -- 172.21.15.59:0/927731785 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda8004230 con 0x7efdb415d690 2023-09-21T00:17:57.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.452+0000 7efdb1ffb700 1 -- 172.21.15.59:0/927731785 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda8004390 con 0x7efdb415d690 2023-09-21T00:17:57.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.452+0000 7efdb1ffb700 1 -- 172.21.15.59:0/927731785 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda80036a0 con 0x7efdb415d690 2023-09-21T00:17:57.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.453+0000 7efdb9981700 1 -- 172.21.15.59:0/927731785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efdb415d690 msgr2=0x7efdb40d1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:57.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.453+0000 7efdb9981700 1 --2- 172.21.15.59:0/927731785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efdb415d690 0x7efdb40d1520 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7efda8009840 tx=0x7efda8009b50 comp rx=0 tx=0).stop 2023-09-21T00:17:57.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.453+0000 7efdb9981700 1 -- 172.21.15.59:0/927731785 shutdown_connections 2023-09-21T00:17:57.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.453+0000 7efdb9981700 1 --2- 172.21.15.59:0/927731785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efdb415d690 0x7efdb40d1520 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:57.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.453+0000 7efdb9981700 1 -- 172.21.15.59:0/927731785 >> 172.21.15.59:0/927731785 conn(0x7efdb4072560 msgr2=0x7efdb40cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:57.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.453+0000 7efdb9981700 1 -- 172.21.15.59:0/927731785 shutdown_connections 2023-09-21T00:17:57.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.453+0000 7efdb9981700 1 -- 172.21.15.59:0/927731785 wait complete. 2023-09-21T00:17:57.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.454+0000 7efdb9981700 1 Processor -- start 2023-09-21T00:17:57.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.455+0000 7efdb9981700 1 -- start start 2023-09-21T00:17:57.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.456+0000 7efdb9981700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efdb40b5630 0x7efdb40c5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:57.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.456+0000 7efdb9981700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efdb40d1a60 0x7efdb4153a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:57.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.456+0000 7efdb9981700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efdb415d690 0x7efdb4153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:57.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.456+0000 7efdb9981700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb41e5800 con 0x7efdb40d1a60 2023-09-21T00:17:57.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.456+0000 7efdb9981700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb40c6430 con 0x7efdb415d690 2023-09-21T00:17:57.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.456+0000 7efdb9981700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb41e4c10 con 0x7efdb40b5630 2023-09-21T00:17:57.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.456+0000 7efdb27fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efdb40d1a60 0x7efdb4153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:57.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.456+0000 7efdb27fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efdb40d1a60 0x7efdb4153a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52418/0 (socket says 172.21.15.59:52418) 2023-09-21T00:17:57.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.456+0000 7efdb27fc700 1 -- 172.21.15.59:0/3206273531 learned_addr learned my addr 172.21.15.59:0/3206273531 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:57.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.456+0000 7efdb2ffd700 1 --2- 172.21.15.59:0/3206273531 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efdb40b5630 0x7efdb40c5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:57.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.456+0000 7efdb37fe700 1 --2- 172.21.15.59:0/3206273531 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efdb415d690 0x7efdb4153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:57.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.456+0000 7efdb27fc700 1 -- 172.21.15.59:0/3206273531 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efdb40b5630 msgr2=0x7efdb40c5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:57.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.456+0000 7efdb27fc700 1 --2- 172.21.15.59:0/3206273531 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efdb40b5630 0x7efdb40c5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:57.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.456+0000 7efdb27fc700 1 -- 172.21.15.59:0/3206273531 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efdb415d690 msgr2=0x7efdb4153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:57.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.456+0000 7efdb27fc700 1 --2- 172.21.15.59:0/3206273531 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efdb415d690 0x7efdb4153f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:57.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.456+0000 7efdb27fc700 1 -- 172.21.15.59:0/3206273531 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda80094a0 con 0x7efdb40d1a60 2023-09-21T00:17:57.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.456+0000 7efdb37fe700 1 --2- 172.21.15.59:0/3206273531 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efdb415d690 0x7efdb4153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:17:57.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.456+0000 7efdb27fc700 1 --2- 172.21.15.59:0/3206273531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efdb40d1a60 0x7efdb4153a00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7efda400c4a0 tx=0x7efda400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:57.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.456+0000 7efd9bfff700 1 -- 172.21.15.59:0/3206273531 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda4011790 con 0x7efdb40d1a60 2023-09-21T00:17:57.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.456+0000 7efd9bfff700 1 -- 172.21.15.59:0/3206273531 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda40118f0 con 0x7efdb40d1a60 2023-09-21T00:17:57.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.456+0000 7efd9bfff700 1 -- 172.21.15.59:0/3206273531 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda4011ca0 con 0x7efdb40d1a60 2023-09-21T00:17:57.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.457+0000 7efdb9981700 1 -- 172.21.15.59:0/3206273531 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb40c7300 con 0x7efdb40d1a60 2023-09-21T00:17:57.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.457+0000 7efdb9981700 1 -- 172.21.15.59:0/3206273531 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb41e5140 con 0x7efdb40d1a60 2023-09-21T00:17:57.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.457+0000 7efdb9981700 1 -- 172.21.15.59:0/3206273531 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdb4067e50 con 0x7efdb40d1a60 2023-09-21T00:17:57.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.458+0000 7efd9bfff700 1 -- 172.21.15.59:0/3206273531 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7efda401c460 con 0x7efdb40d1a60 2023-09-21T00:17:57.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.458+0000 7efd9bfff700 1 --2- 172.21.15.59:0/3206273531 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7efda006ae00 0x7efda006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:57.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.458+0000 7efd9bfff700 1 -- 172.21.15.59:0/3206273531 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7efda4089710 con 0x7efdb40d1a60 2023-09-21T00:17:57.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.459+0000 7efdb2ffd700 1 --2- 172.21.15.59:0/3206273531 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7efda006ae00 0x7efda006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:57.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.459+0000 7efdb2ffd700 1 --2- 172.21.15.59:0/3206273531 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7efda006ae00 0x7efda006d2c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efda80090b0 tx=0x7efda8008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:57.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.463+0000 7efd9bfff700 1 -- 172.21.15.59:0/3206273531 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7efda40544b0 con 0x7efdb40d1a60 2023-09-21T00:17:57.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.664+0000 7efdb9981700 1 -- 172.21.15.59:0/3206273531 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efdb40b53f0 con 0x7efdb40d1a60 2023-09-21T00:17:57.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.665+0000 7efd9bfff700 1 -- 172.21.15.59:0/3206273531 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7efda4057ad0 con 0x7efdb40d1a60 2023-09-21T00:17:57.667 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-09-21T00:17:57.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.666+0000 7efdb9981700 1 -- 172.21.15.59:0/3206273531 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7efda006ae00 msgr2=0x7efda006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:57.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.666+0000 7efdb9981700 1 --2- 172.21.15.59:0/3206273531 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7efda006ae00 0x7efda006d2c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efda80090b0 tx=0x7efda8008030 comp rx=0 tx=0).stop 2023-09-21T00:17:57.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.666+0000 7efdb9981700 1 -- 172.21.15.59:0/3206273531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efdb40d1a60 msgr2=0x7efdb4153a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:57.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.666+0000 7efdb9981700 1 --2- 172.21.15.59:0/3206273531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efdb40d1a60 0x7efdb4153a00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7efda400c4a0 tx=0x7efda400c860 comp rx=0 tx=0).stop 2023-09-21T00:17:57.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.666+0000 7efdb9981700 1 -- 172.21.15.59:0/3206273531 shutdown_connections 2023-09-21T00:17:57.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.666+0000 7efdb9981700 1 --2- 172.21.15.59:0/3206273531 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efdb415d690 0x7efdb4153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:57.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.666+0000 7efdb9981700 1 --2- 172.21.15.59:0/3206273531 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7efda006ae00 0x7efda006d2c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:57.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.666+0000 7efdb9981700 1 --2- 172.21.15.59:0/3206273531 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efdb40b5630 0x7efdb40c5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:57.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.666+0000 7efdb9981700 1 --2- 172.21.15.59:0/3206273531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efdb40d1a60 0x7efdb4153a00 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:57.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.666+0000 7efdb9981700 1 -- 172.21.15.59:0/3206273531 >> 172.21.15.59:0/3206273531 conn(0x7efdb4072560 msgr2=0x7efdb41547d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:57.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.667+0000 7efdb9981700 1 -- 172.21.15.59:0/3206273531 shutdown_connections 2023-09-21T00:17:57.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.667+0000 7efdb9981700 1 -- 172.21.15.59:0/3206273531 wait complete. 2023-09-21T00:17:57.680 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-21T00:17:57.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.806+0000 7f2bc5b79700 1 Processor -- start 2023-09-21T00:17:57.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.806+0000 7f2bc5b79700 1 -- start start 2023-09-21T00:17:57.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.807+0000 7f2bc5b79700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bc00ce420 0x7f2bc00cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:57.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.807+0000 7f2bc5b79700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2bc006a780 0x7f2bc006abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:57.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.807+0000 7f2bc5b79700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bc006b110 con 0x7f2bc015b2b0 2023-09-21T00:17:57.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.807+0000 7f2bc5b79700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bc00ce250 con 0x7f2bc006a780 2023-09-21T00:17:57.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.807+0000 7f2bc5b79700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc01618a0 con 0x7f2bc00ce420 2023-09-21T00:17:57.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.807+0000 7f2bbffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2bc006a780 0x7f2bc006abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:57.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.807+0000 7f2bbffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2bc006a780 0x7f2bc006abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52428/0 (socket says 172.21.15.59:52428) 2023-09-21T00:17:57.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.807+0000 7f2bbf7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2bc015b2b0 0x7f2bc0161190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57992/0 (socket says 172.21.15.59:57992) 2023-09-21T00:17:57.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.807+0000 7f2bbffff700 1 -- 172.21.15.59:0/3892729647 learned_addr learned my addr 172.21.15.59:0/3892729647 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:57.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.807+0000 7f2bbeffd700 1 --2- 172.21.15.59:0/3892729647 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bc00ce420 0x7f2bc00cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:57.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.808+0000 7f2bbffff700 1 -- 172.21.15.59:0/3892729647 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bc00ce420 msgr2=0x7f2bc00cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:57.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.808+0000 7f2bbffff700 1 --2- 172.21.15.59:0/3892729647 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bc00ce420 0x7f2bc00cdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:57.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.808+0000 7f2bbffff700 1 -- 172.21.15.59:0/3892729647 >> v1:172.21.15.59:6789/0 conn(0x7f2bc015b2b0 legacy=0x7f2bc0161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:57.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.808+0000 7f2bbffff700 1 -- 172.21.15.59:0/3892729647 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc00cfee0 con 0x7f2bc006a780 2023-09-21T00:17:57.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.808+0000 7f2bbffff700 1 --2- 172.21.15.59:0/3892729647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bc006a780 0x7f2bc006abd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2bb8009e50 tx=0x7f2bb800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=350705c0ebfa267b server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:57.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.808+0000 7f2bbe7fc700 1 -- 172.21.15.59:0/3892729647 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb800e070 con 0x7f2bc006a780 2023-09-21T00:17:57.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.808+0000 7f2bbe7fc700 1 -- 172.21.15.59:0/3892729647 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb800b9c0 con 0x7f2bc006a780 2023-09-21T00:17:57.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.808+0000 7f2bbe7fc700 1 -- 172.21.15.59:0/3892729647 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb800bd70 con 0x7f2bc006a780 2023-09-21T00:17:57.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.808+0000 7f2bc5b79700 1 -- 172.21.15.59:0/3892729647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bc006a780 msgr2=0x7f2bc006abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:57.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.808+0000 7f2bc5b79700 1 --2- 172.21.15.59:0/3892729647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bc006a780 0x7f2bc006abd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2bb8009e50 tx=0x7f2bb800b330 comp rx=0 tx=0).stop 2023-09-21T00:17:57.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.808+0000 7f2bc5b79700 1 -- 172.21.15.59:0/3892729647 shutdown_connections 2023-09-21T00:17:57.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.808+0000 7f2bc5b79700 1 --2- 172.21.15.59:0/3892729647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bc006a780 0x7f2bc006abd0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:57.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.808+0000 7f2bc5b79700 1 --2- 172.21.15.59:0/3892729647 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bc00ce420 0x7f2bc00cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:57.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.808+0000 7f2bc5b79700 1 -- 172.21.15.59:0/3892729647 >> 172.21.15.59:0/3892729647 conn(0x7f2bc00d0140 msgr2=0x7f2bc00d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:57.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.809+0000 7f2bc5b79700 1 -- 172.21.15.59:0/3892729647 shutdown_connections 2023-09-21T00:17:57.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.809+0000 7f2bc5b79700 1 -- 172.21.15.59:0/3892729647 wait complete. 2023-09-21T00:17:57.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.810+0000 7f2bc5b79700 1 Processor -- start 2023-09-21T00:17:57.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.810+0000 7f2bc5b79700 1 -- start start 2023-09-21T00:17:57.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.811+0000 7f2bc5b79700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bc006a780 0x7f2bc00c9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:57.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.811+0000 7f2bc5b79700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bc00ce420 0x7f2bc00adea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:57.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.811+0000 7f2bc5b79700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2bc015b2b0 0x7f2bc00ae3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:57.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.811+0000 7f2bc5b79700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc015e1e0 con 0x7f2bc00ce420 2023-09-21T00:17:57.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.811+0000 7f2bc5b79700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc00c5a90 con 0x7f2bc015b2b0 2023-09-21T00:17:57.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.811+0000 7f2bc5b79700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc00c49f0 con 0x7f2bc006a780 2023-09-21T00:17:57.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.811+0000 7f2bbeffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bc00ce420 0x7f2bc00adea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:57.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.811+0000 7f2bbeffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bc00ce420 0x7f2bc00adea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52432/0 (socket says 172.21.15.59:52432) 2023-09-21T00:17:57.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.811+0000 7f2bbeffd700 1 -- 172.21.15.59:0/1918926406 learned_addr learned my addr 172.21.15.59:0/1918926406 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:57.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.812+0000 7f2bbffff700 1 --2- 172.21.15.59:0/1918926406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2bc015b2b0 0x7f2bc00ae3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:57.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.812+0000 7f2bbf7fe700 1 --2- 172.21.15.59:0/1918926406 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bc006a780 0x7f2bc00c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:57.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.812+0000 7f2bbeffd700 1 -- 172.21.15.59:0/1918926406 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bc006a780 msgr2=0x7f2bc00c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:57.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.812+0000 7f2bbeffd700 1 --2- 172.21.15.59:0/1918926406 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bc006a780 0x7f2bc00c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:57.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.812+0000 7f2bbeffd700 1 -- 172.21.15.59:0/1918926406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2bc015b2b0 msgr2=0x7f2bc00ae3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:57.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.812+0000 7f2bbeffd700 1 --2- 172.21.15.59:0/1918926406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2bc015b2b0 0x7f2bc00ae3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:57.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.812+0000 7f2bbeffd700 1 -- 172.21.15.59:0/1918926406 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb8009b30 con 0x7f2bc00ce420 2023-09-21T00:17:57.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.812+0000 7f2bbeffd700 1 --2- 172.21.15.59:0/1918926406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bc00ce420 0x7f2bc00adea0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2bb000e810 tx=0x7f2bb000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:57.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.812+0000 7f2ba7fff700 1 -- 172.21.15.59:0/1918926406 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb0013610 con 0x7f2bc00ce420 2023-09-21T00:17:57.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.812+0000 7f2ba7fff700 1 -- 172.21.15.59:0/1918926406 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb0013770 con 0x7f2bc00ce420 2023-09-21T00:17:57.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.812+0000 7f2bc5b79700 1 -- 172.21.15.59:0/1918926406 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bc00c4cd0 con 0x7f2bc00ce420 2023-09-21T00:17:57.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.812+0000 7f2ba7fff700 1 -- 172.21.15.59:0/1918926406 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb0013b20 con 0x7f2bc00ce420 2023-09-21T00:17:57.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.812+0000 7f2bc5b79700 1 -- 172.21.15.59:0/1918926406 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bc00c5290 con 0x7f2bc00ce420 2023-09-21T00:17:57.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.813+0000 7f2bc5b79700 1 -- 172.21.15.59:0/1918926406 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bc00cb5f0 con 0x7f2bc00ce420 2023-09-21T00:17:57.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.814+0000 7f2ba7fff700 1 -- 172.21.15.59:0/1918926406 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f2bb0013c80 con 0x7f2bc00ce420 2023-09-21T00:17:57.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.814+0000 7f2ba7fff700 1 --2- 172.21.15.59:0/1918926406 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f2bac06ae00 0x7f2bac06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:57.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.814+0000 7f2ba7fff700 1 -- 172.21.15.59:0/1918926406 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f2bb0089600 con 0x7f2bc00ce420 2023-09-21T00:17:57.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.814+0000 7f2bbf7fe700 1 --2- 172.21.15.59:0/1918926406 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f2bac06ae00 0x7f2bac06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:57.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.815+0000 7f2bbf7fe700 1 --2- 172.21.15.59:0/1918926406 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f2bac06ae00 0x7f2bac06d2c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4000f60 tx=0x7f2bb4007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:57.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:57.818+0000 7f2ba7fff700 1 -- 172.21.15.59:0/1918926406 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f2bb0054320 con 0x7f2bc00ce420 2023-09-21T00:17:58.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.020+0000 7f2bc5b79700 1 -- 172.21.15.59:0/1918926406 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2bc0067e50 con 0x7f2bc00ce420 2023-09-21T00:17:58.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.020+0000 7f2ba7fff700 1 -- 172.21.15.59:0/1918926406 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2bb0057940 con 0x7f2bc00ce420 2023-09-21T00:17:58.022 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-09-21T00:17:58.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.022+0000 7f2bc5b79700 1 -- 172.21.15.59:0/1918926406 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f2bac06ae00 msgr2=0x7f2bac06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:58.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.022+0000 7f2bc5b79700 1 --2- 172.21.15.59:0/1918926406 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f2bac06ae00 0x7f2bac06d2c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4000f60 tx=0x7f2bb4007d30 comp rx=0 tx=0).stop 2023-09-21T00:17:58.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.022+0000 7f2bc5b79700 1 -- 172.21.15.59:0/1918926406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bc00ce420 msgr2=0x7f2bc00adea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:58.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.022+0000 7f2bc5b79700 1 --2- 172.21.15.59:0/1918926406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bc00ce420 0x7f2bc00adea0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2bb000e810 tx=0x7f2bb000ebd0 comp rx=0 tx=0).stop 2023-09-21T00:17:58.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.022+0000 7f2bc5b79700 1 -- 172.21.15.59:0/1918926406 shutdown_connections 2023-09-21T00:17:58.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.022+0000 7f2bc5b79700 1 --2- 172.21.15.59:0/1918926406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2bc015b2b0 0x7f2bc00ae3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:58.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.022+0000 7f2bc5b79700 1 --2- 172.21.15.59:0/1918926406 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f2bac06ae00 0x7f2bac06d2c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:58.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.022+0000 7f2bc5b79700 1 --2- 172.21.15.59:0/1918926406 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bc006a780 0x7f2bc00c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:58.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.022+0000 7f2bc5b79700 1 --2- 172.21.15.59:0/1918926406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bc00ce420 0x7f2bc00adea0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:58.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.022+0000 7f2bc5b79700 1 -- 172.21.15.59:0/1918926406 >> 172.21.15.59:0/1918926406 conn(0x7f2bc00d0140 msgr2=0x7f2bc015a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:58.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.023+0000 7f2bc5b79700 1 -- 172.21.15.59:0/1918926406 shutdown_connections 2023-09-21T00:17:58.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.023+0000 7f2bc5b79700 1 -- 172.21.15.59:0/1918926406 wait complete. 2023-09-21T00:17:58.037 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-21T00:17:58.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.164+0000 7f06c7881700 1 Processor -- start 2023-09-21T00:17:58.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.164+0000 7f06c7881700 1 -- start start 2023-09-21T00:17:58.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.165+0000 7f06c7881700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06c00af230 0x7f06c006a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:58.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.165+0000 7f06c7881700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c006b120 con 0x7f06c015d730 2023-09-21T00:17:58.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.165+0000 7f06c7881700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c00b31b0 con 0x7f06c006acc0 2023-09-21T00:17:58.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.165+0000 7f06c7881700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c015db10 con 0x7f06c00af230 2023-09-21T00:17:58.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.165+0000 7f06c561d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f06c015d730 0x7f06c0161b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58006/0 (socket says 172.21.15.59:58006) 2023-09-21T00:17:58.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.165+0000 7f06c561d700 1 -- 172.21.15.59:0/2969975041 learned_addr learned my addr 172.21.15.59:0/2969975041 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:58.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.165+0000 7f06c4e1c700 1 --2- 172.21.15.59:0/2969975041 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06c00af230 0x7f06c006a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:58.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.165+0000 7f06b7fff700 1 -- 172.21.15.59:0/2969975041 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3023055945 0 0) 0x7f06c006b120 con 0x7f06c015d730 2023-09-21T00:17:58.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.165+0000 7f06b7fff700 1 -- 172.21.15.59:0/2969975041 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06ac0035b0 con 0x7f06c015d730 2023-09-21T00:17:58.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.165+0000 7f06b7fff700 1 -- 172.21.15.59:0/2969975041 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1861348958 0 0) 0x7f06c00b31b0 con 0x7f06c006acc0 2023-09-21T00:17:58.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.165+0000 7f06b7fff700 1 -- 172.21.15.59:0/2969975041 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06c006b120 con 0x7f06c006acc0 2023-09-21T00:17:58.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.165+0000 7f06c4e1c700 1 -- 172.21.15.59:0/2969975041 >> v1:172.21.15.83:6789/0 conn(0x7f06c006acc0 legacy=0x7f06c00716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:58.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.165+0000 7f06c4e1c700 1 -- 172.21.15.59:0/2969975041 >> v1:172.21.15.59:6789/0 conn(0x7f06c015d730 legacy=0x7f06c0161b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:58.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.165+0000 7f06c4e1c700 1 -- 172.21.15.59:0/2969975041 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c00b3490 con 0x7f06c00af230 2023-09-21T00:17:58.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.166+0000 7f06c4e1c700 1 --2- 172.21.15.59:0/2969975041 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06c00af230 0x7f06c006a780 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f06b0009870 tx=0x7f06b0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64b7c48d26b4a750 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:58.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.166+0000 7f06b7fff700 1 -- 172.21.15.59:0/2969975041 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b0011830 con 0x7f06c00af230 2023-09-21T00:17:58.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.166+0000 7f06b7fff700 1 -- 172.21.15.59:0/2969975041 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b0011990 con 0x7f06c00af230 2023-09-21T00:17:58.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.166+0000 7f06b7fff700 1 -- 172.21.15.59:0/2969975041 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b0011d20 con 0x7f06c00af230 2023-09-21T00:17:58.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.166+0000 7f06c7881700 1 -- 172.21.15.59:0/2969975041 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06c00af230 msgr2=0x7f06c006a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:58.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.166+0000 7f06c7881700 1 --2- 172.21.15.59:0/2969975041 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06c00af230 0x7f06c006a780 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f06b0009870 tx=0x7f06b0009b80 comp rx=0 tx=0).stop 2023-09-21T00:17:58.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.166+0000 7f06c7881700 1 -- 172.21.15.59:0/2969975041 shutdown_connections 2023-09-21T00:17:58.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.166+0000 7f06c7881700 1 --2- 172.21.15.59:0/2969975041 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06c00af230 0x7f06c006a780 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:58.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.166+0000 7f06c7881700 1 -- 172.21.15.59:0/2969975041 >> 172.21.15.59:0/2969975041 conn(0x7f06c00b1d80 msgr2=0x7f06c00b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:58.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.166+0000 7f06c7881700 1 -- 172.21.15.59:0/2969975041 shutdown_connections 2023-09-21T00:17:58.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.166+0000 7f06c7881700 1 -- 172.21.15.59:0/2969975041 wait complete. 2023-09-21T00:17:58.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.168+0000 7f06c7881700 1 Processor -- start 2023-09-21T00:17:58.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.168+0000 7f06c7881700 1 -- start start 2023-09-21T00:17:58.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.168+0000 7f06c7881700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06c006acc0 0x7f06c0145c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:58.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.168+0000 7f06c7881700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06c00af230 0x7f06c0157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:58.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.168+0000 7f06c7881700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06c015d730 0x7f06c0158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:58.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.168+0000 7f06c7881700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c0150690 con 0x7f06c015d730 2023-09-21T00:17:58.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.168+0000 7f06c7881700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c0146170 con 0x7f06c00af230 2023-09-21T00:17:58.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.168+0000 7f06c7881700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c015a690 con 0x7f06c006acc0 2023-09-21T00:17:58.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.168+0000 7f06c5e1e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06c015d730 0x7f06c0158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:58.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.169+0000 7f06c5e1e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06c015d730 0x7f06c0158320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52448/0 (socket says 172.21.15.59:52448) 2023-09-21T00:17:58.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.169+0000 7f06c5e1e700 1 -- 172.21.15.59:0/3171349669 learned_addr learned my addr 172.21.15.59:0/3171349669 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:58.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.169+0000 7f06c561d700 1 --2- 172.21.15.59:0/3171349669 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06c006acc0 0x7f06c0145c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:58.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.169+0000 7f06c4e1c700 1 --2- 172.21.15.59:0/3171349669 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06c00af230 0x7f06c0157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:58.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.169+0000 7f06c5e1e700 1 -- 172.21.15.59:0/3171349669 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06c006acc0 msgr2=0x7f06c0145c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:58.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.169+0000 7f06c5e1e700 1 --2- 172.21.15.59:0/3171349669 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06c006acc0 0x7f06c0145c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:58.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.169+0000 7f06c5e1e700 1 -- 172.21.15.59:0/3171349669 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06c00af230 msgr2=0x7f06c0157de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:58.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.169+0000 7f06c5e1e700 1 --2- 172.21.15.59:0/3171349669 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06c00af230 0x7f06c0157de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:58.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.169+0000 7f06c5e1e700 1 -- 172.21.15.59:0/3171349669 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b00094a0 con 0x7f06c015d730 2023-09-21T00:17:58.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.169+0000 7f06c5e1e700 1 --2- 172.21.15.59:0/3171349669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06c015d730 0x7f06c0158320 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f06b800cc20 tx=0x7f06b800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:58.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.169+0000 7f06b5ffb700 1 -- 172.21.15.59:0/3171349669 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b800ac20 con 0x7f06c015d730 2023-09-21T00:17:58.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.169+0000 7f06b5ffb700 1 -- 172.21.15.59:0/3171349669 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b800ad80 con 0x7f06c015d730 2023-09-21T00:17:58.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.169+0000 7f06c7881700 1 -- 172.21.15.59:0/3171349669 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c015a970 con 0x7f06c015d730 2023-09-21T00:17:58.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.169+0000 7f06b5ffb700 1 -- 172.21.15.59:0/3171349669 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b8003c20 con 0x7f06c015d730 2023-09-21T00:17:58.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.169+0000 7f06c7881700 1 -- 172.21.15.59:0/3171349669 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c015af30 con 0x7f06c015d730 2023-09-21T00:17:58.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.170+0000 7f06c7881700 1 -- 172.21.15.59:0/3171349669 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c0150800 con 0x7f06c015d730 2023-09-21T00:17:58.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.171+0000 7f06b5ffb700 1 -- 172.21.15.59:0/3171349669 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f06b80050d0 con 0x7f06c015d730 2023-09-21T00:17:58.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.171+0000 7f06b5ffb700 1 --2- 172.21.15.59:0/3171349669 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f06a406ae00 0x7f06a406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:58.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.171+0000 7f06b5ffb700 1 -- 172.21.15.59:0/3171349669 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f06b8089af0 con 0x7f06c015d730 2023-09-21T00:17:58.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.172+0000 7f06c561d700 1 --2- 172.21.15.59:0/3171349669 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f06a406ae00 0x7f06a406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:58.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.172+0000 7f06c561d700 1 --2- 172.21.15.59:0/3171349669 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f06a406ae00 0x7f06a406d2c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f06bc0011e0 tx=0x7f06bc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:58.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.176+0000 7f06b5ffb700 1 -- 172.21.15.59:0/3171349669 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f06b8054800 con 0x7f06c015d730 2023-09-21T00:17:58.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.375+0000 7f06c7881700 1 -- 172.21.15.59:0/3171349669 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f06c0067e50 con 0x7f06c015d730 2023-09-21T00:17:58.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.375+0000 7f06b5ffb700 1 -- 172.21.15.59:0/3171349669 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f06b8057e20 con 0x7f06c015d730 2023-09-21T00:17:58.378 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-09-21T00:17:58.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.377+0000 7f06c7881700 1 -- 172.21.15.59:0/3171349669 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f06a406ae00 msgr2=0x7f06a406d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:58.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.377+0000 7f06c7881700 1 --2- 172.21.15.59:0/3171349669 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f06a406ae00 0x7f06a406d2c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f06bc0011e0 tx=0x7f06bc009040 comp rx=0 tx=0).stop 2023-09-21T00:17:58.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.377+0000 7f06c7881700 1 -- 172.21.15.59:0/3171349669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06c015d730 msgr2=0x7f06c0158320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:58.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.377+0000 7f06c7881700 1 --2- 172.21.15.59:0/3171349669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06c015d730 0x7f06c0158320 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f06b800cc20 tx=0x7f06b800a060 comp rx=0 tx=0).stop 2023-09-21T00:17:58.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.377+0000 7f06c7881700 1 -- 172.21.15.59:0/3171349669 shutdown_connections 2023-09-21T00:17:58.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.377+0000 7f06c7881700 1 --2- 172.21.15.59:0/3171349669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06c015d730 0x7f06c0158320 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:58.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.377+0000 7f06c7881700 1 --2- 172.21.15.59:0/3171349669 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f06a406ae00 0x7f06a406d2c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:58.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.377+0000 7f06c7881700 1 --2- 172.21.15.59:0/3171349669 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06c006acc0 0x7f06c0145c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:58.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.377+0000 7f06c7881700 1 --2- 172.21.15.59:0/3171349669 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06c00af230 0x7f06c0157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:58.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.377+0000 7f06c7881700 1 -- 172.21.15.59:0/3171349669 >> 172.21.15.59:0/3171349669 conn(0x7f06c00b1d80 msgr2=0x7f06c00adcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:58.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.378+0000 7f06c7881700 1 -- 172.21.15.59:0/3171349669 shutdown_connections 2023-09-21T00:17:58.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.378+0000 7f06c7881700 1 -- 172.21.15.59:0/3171349669 wait complete. 2023-09-21T00:17:58.405 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-09-21T00:17:58.406 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T00:17:58.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.529+0000 7f06b51f0700 1 Processor -- start 2023-09-21T00:17:58.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.529+0000 7f06b51f0700 1 -- start start 2023-09-21T00:17:58.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.530+0000 7f06b51f0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06b00d11b0 0x7f06b00b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:58.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.530+0000 7f06b51f0700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f06b00d3f00 0x7f06b00b3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:58.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.530+0000 7f06b51f0700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06b00d1720 con 0x7f06b015d7e0 2023-09-21T00:17:58.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.530+0000 7f06b51f0700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06b00ced00 con 0x7f06b00d3f00 2023-09-21T00:17:58.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.530+0000 7f06b51f0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06b00ce360 con 0x7f06b00d11b0 2023-09-21T00:17:58.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.530+0000 7f06ae59c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06b00d11b0 0x7f06b00b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:58.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.530+0000 7f06af59e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f06b00d3f00 0x7f06b00b3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:58.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.530+0000 7f06af59e700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f06b00d3f00 0x7f06b00b3270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.59:38572/0 (socket says 172.21.15.59:38572) 2023-09-21T00:17:58.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.530+0000 7f06ae59c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06b00d11b0 0x7f06b00b2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.59:53070/0 (socket says 172.21.15.59:53070) 2023-09-21T00:17:58.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.530+0000 7f06af59e700 1 -- 172.21.15.59:0/825544917 learned_addr learned my addr 172.21.15.59:0/825544917 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:58.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.531+0000 7f06af59e700 1 -- 172.21.15.59:0/825544917 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06b00d11b0 msgr2=0x7f06b00b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:58.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.531+0000 7f06af59e700 1 --2- 172.21.15.59:0/825544917 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06b00d11b0 0x7f06b00b2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:58.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.531+0000 7f06af59e700 1 -- 172.21.15.59:0/825544917 >> v1:172.21.15.83:6789/0 conn(0x7f06b015d7e0 legacy=0x7f06b00cf120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:58.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.531+0000 7f06add9b700 1 -- 172.21.15.59:0/825544917 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1539748956 0 0) 0x7f06b00d1720 con 0x7f06b015d7e0 2023-09-21T00:17:58.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.531+0000 7f06af59e700 1 -- 172.21.15.59:0/825544917 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b00ce640 con 0x7f06b00d3f00 2023-09-21T00:17:58.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.531+0000 7f06ae59c700 1 --2- 172.21.15.59:0/825544917 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06b00d11b0 0x7f06b00b2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T00:17:58.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.531+0000 7f06af59e700 1 --2- 172.21.15.59:0/825544917 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06b00d3f00 0x7f06b00b3270 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f06a8009e50 tx=0x7f06a800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b2ec7feabde5ec8 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:58.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.531+0000 7f06add9b700 1 -- 172.21.15.59:0/825544917 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a800e070 con 0x7f06b00d3f00 2023-09-21T00:17:58.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.531+0000 7f06add9b700 1 -- 172.21.15.59:0/825544917 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a800b910 con 0x7f06b00d3f00 2023-09-21T00:17:58.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.531+0000 7f06add9b700 1 -- 172.21.15.59:0/825544917 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a800bcc0 con 0x7f06b00d3f00 2023-09-21T00:17:58.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.531+0000 7f06b51f0700 1 -- 172.21.15.59:0/825544917 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06b00d3f00 msgr2=0x7f06b00b3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:58.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.531+0000 7f06b51f0700 1 --2- 172.21.15.59:0/825544917 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06b00d3f00 0x7f06b00b3270 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f06a8009e50 tx=0x7f06a800b330 comp rx=0 tx=0).stop 2023-09-21T00:17:58.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.532+0000 7f06b51f0700 1 -- 172.21.15.59:0/825544917 shutdown_connections 2023-09-21T00:17:58.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.532+0000 7f06b51f0700 1 --2- 172.21.15.59:0/825544917 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06b00d3f00 0x7f06b00b3270 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:58.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.532+0000 7f06b51f0700 1 --2- 172.21.15.59:0/825544917 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06b00d11b0 0x7f06b00b2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:58.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.532+0000 7f06b51f0700 1 -- 172.21.15.59:0/825544917 >> 172.21.15.59:0/825544917 conn(0x7f06b009c740 msgr2=0x7f06b00d33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:58.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.532+0000 7f06b51f0700 1 -- 172.21.15.59:0/825544917 shutdown_connections 2023-09-21T00:17:58.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.532+0000 7f06b51f0700 1 -- 172.21.15.59:0/825544917 wait complete. 2023-09-21T00:17:58.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.533+0000 7f06b51f0700 1 Processor -- start 2023-09-21T00:17:58.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.533+0000 7f06b51f0700 1 -- start start 2023-09-21T00:17:58.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.534+0000 7f06b51f0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06b00d11b0 0x7f06b00ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:58.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.534+0000 7f06b51f0700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06b00d3f00 0x7f06b00ca9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:58.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.534+0000 7f06b51f0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06b015d7e0 0x7f06b01f68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:58.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.534+0000 7f06b51f0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b014d2a0 con 0x7f06b00d11b0 2023-09-21T00:17:58.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.534+0000 7f06b51f0700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b00ccac0 con 0x7f06b015d7e0 2023-09-21T00:17:58.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.534+0000 7f06b51f0700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06b00ccda0 con 0x7f06b00d3f00 2023-09-21T00:17:58.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.534+0000 7f06aed9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06b00d11b0 0x7f06b00ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:58.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.534+0000 7f06aed9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06b00d11b0 0x7f06b00ca4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52458/0 (socket says 172.21.15.59:52458) 2023-09-21T00:17:58.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.534+0000 7f06aed9d700 1 -- 172.21.15.59:0/1518313271 learned_addr learned my addr 172.21.15.59:0/1518313271 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:58.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.534+0000 7f06ae59c700 1 --2- 172.21.15.59:0/1518313271 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06b00d3f00 0x7f06b00ca9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:58.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.534+0000 7f06af59e700 1 --2- 172.21.15.59:0/1518313271 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06b015d7e0 0x7f06b01f68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:58.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.534+0000 7f06aed9d700 1 -- 172.21.15.59:0/1518313271 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06b00d3f00 msgr2=0x7f06b00ca9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:58.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.534+0000 7f06aed9d700 1 --2- 172.21.15.59:0/1518313271 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06b00d3f00 0x7f06b00ca9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:58.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.534+0000 7f06aed9d700 1 -- 172.21.15.59:0/1518313271 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06b015d7e0 msgr2=0x7f06b01f68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:58.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.534+0000 7f06aed9d700 1 --2- 172.21.15.59:0/1518313271 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06b015d7e0 0x7f06b01f68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:58.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.534+0000 7f06aed9d700 1 -- 172.21.15.59:0/1518313271 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a00094a0 con 0x7f06b00d11b0 2023-09-21T00:17:58.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.534+0000 7f06af59e700 1 --2- 172.21.15.59:0/1518313271 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06b015d7e0 0x7f06b01f68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:17:58.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.534+0000 7f06ae59c700 1 --2- 172.21.15.59:0/1518313271 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06b00d3f00 0x7f06b00ca9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:17:58.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.535+0000 7f06aed9d700 1 --2- 172.21.15.59:0/1518313271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06b00d11b0 0x7f06b00ca4a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f06a400c4a0 tx=0x7f06a400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:58.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.535+0000 7f06977fe700 1 -- 172.21.15.59:0/1518313271 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a40054e0 con 0x7f06b00d11b0 2023-09-21T00:17:58.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.535+0000 7f06977fe700 1 -- 172.21.15.59:0/1518313271 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a40036d0 con 0x7f06b00d11b0 2023-09-21T00:17:58.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.535+0000 7f06b51f0700 1 -- 172.21.15.59:0/1518313271 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06a8009b30 con 0x7f06b00d11b0 2023-09-21T00:17:58.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.535+0000 7f06977fe700 1 -- 172.21.15.59:0/1518313271 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a4003a80 con 0x7f06b00d11b0 2023-09-21T00:17:58.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.535+0000 7f06b51f0700 1 -- 172.21.15.59:0/1518313271 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06b00cd360 con 0x7f06b00d11b0 2023-09-21T00:17:58.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.536+0000 7f06b51f0700 1 -- 172.21.15.59:0/1518313271 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06b00b7040 con 0x7f06b00d11b0 2023-09-21T00:17:58.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.536+0000 7f06977fe700 1 -- 172.21.15.59:0/1518313271 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f06a4003be0 con 0x7f06b00d11b0 2023-09-21T00:17:58.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.537+0000 7f06977fe700 1 --2- 172.21.15.59:0/1518313271 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f069c06ae00 0x7f069c06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:58.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.537+0000 7f06977fe700 1 -- 172.21.15.59:0/1518313271 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f06a4088e10 con 0x7f06b00d11b0 2023-09-21T00:17:58.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.537+0000 7f06ae59c700 1 --2- 172.21.15.59:0/1518313271 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f069c06ae00 0x7f069c06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:58.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.537+0000 7f06ae59c700 1 --2- 172.21.15.59:0/1518313271 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f069c06ae00 0x7f069c06d2c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f06b00b8bf0 tx=0x7f06a0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:58.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.541+0000 7f06977fe700 1 -- 172.21.15.59:0/1518313271 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f06a4053bb0 con 0x7f06b00d11b0 2023-09-21T00:17:58.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.740+0000 7f06b51f0700 1 -- 172.21.15.59:0/1518313271 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06b00b2ba0 con 0x7f06b00d11b0 2023-09-21T00:17:58.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.742+0000 7f06977fe700 1 -- 172.21.15.59:0/1518313271 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18792 (secure 0 0 0) 0x7f06a4017020 con 0x7f06b00d11b0 2023-09-21T00:17:58.744 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:17:58.744 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":26,"fsid":"dd69925c-6e25-42fe-880b-2f60fc6f384b","created":"2023-09-21T00:16:43.074489+0000","modified":"2023-09-21T00:17:50.090179+0000","last_up_change":"2023-09-21T00:16:54.740101+0000","last_in_change":"2023-09-21T00:16:45.987089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T00:16:54.796248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-21T00:17:04.167102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-21T00:17:05.313188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-21T00:17:08.977609+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d4b18344-74c0-4f75-920b-7a9247e48914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6809","nonce":2418314235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6811","nonce":2418314235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6815","nonce":2418314235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6813","nonce":2418314235}]},"public_addr":"172.21.15.59:6809/2418314235","cluster_addr":"172.21.15.59:6811/2418314235","heartbeat_back_addr":"172.21.15.59:6815/2418314235","heartbeat_front_addr":"172.21.15.59:6813/2418314235","state":["exists","up"]},{"osd":1,"uuid":"80940d50-a248-4e64-a282-7ffcdad790ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6801","nonce":869668251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6803","nonce":869668251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6807","nonce":869668251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6805","nonce":869668251}]},"public_addr":"172.21.15.59:6801/869668251","cluster_addr":"172.21.15.59:6803/869668251","heartbeat_back_addr":"172.21.15.59:6807/869668251","heartbeat_front_addr":"172.21.15.59:6805/869668251","state":["exists","up"]},{"osd":2,"uuid":"55f2eceb-c54a-4879-a6ce-968c1c548b5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6817","nonce":372517778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6819","nonce":372517778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6823","nonce":372517778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6821","nonce":372517778}]},"public_addr":"172.21.15.59:6817/372517778","cluster_addr":"172.21.15.59:6819/372517778","heartbeat_back_addr":"172.21.15.59:6823/372517778","heartbeat_front_addr":"172.21.15.59:6821/372517778","state":["exists","up"]},{"osd":3,"uuid":"92b89cd0-869c-49b9-a9f9-97ac8423f304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6825","nonce":575188498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6827","nonce":575188498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6831","nonce":575188498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6829","nonce":575188498}]},"public_addr":"172.21.15.59:6825/575188498","cluster_addr":"172.21.15.59:6827/575188498","heartbeat_back_addr":"172.21.15.59:6831/575188498","heartbeat_front_addr":"172.21.15.59:6829/575188498","state":["exists","up"]},{"osd":4,"uuid":"25b80e94-e0e6-403d-b69f-61542f289637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6803","nonce":1741219098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6805","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6807","nonce":1741219098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6815","nonce":1741219098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6811","nonce":1741219098}]},"public_addr":"172.21.15.83:6803/1741219098","cluster_addr":"172.21.15.83:6807/1741219098","heartbeat_back_addr":"172.21.15.83:6815/1741219098","heartbeat_front_addr":"172.21.15.83:6811/1741219098","state":["exists","up"]},{"osd":5,"uuid":"5498d9ab-1086-4796-a199-9051e6dfea91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6817","nonce":156730565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6819","nonce":156730565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6823","nonce":156730565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6821","nonce":156730565}]},"public_addr":"172.21.15.83:6817/156730565","cluster_addr":"172.21.15.83:6819/156730565","heartbeat_back_addr":"172.21.15.83:6823/156730565","heartbeat_front_addr":"172.21.15.83:6821/156730565","state":["exists","up"]},{"osd":6,"uuid":"cfd810c0-5015-4d60-9a75-7efc93a32e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6801","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6800","nonce":1337723778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6806","nonce":1337723778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6814","nonce":1337723778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6810","nonce":1337723778}]},"public_addr":"172.21.15.83:6800/1337723778","cluster_addr":"172.21.15.83:6806/1337723778","heartbeat_back_addr":"172.21.15.83:6814/1337723778","heartbeat_front_addr":"172.21.15.83:6810/1337723778","state":["exists","up"]},{"osd":7,"uuid":"e992c8fa-0a3d-4b3c-85b5-2c511223dee4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6825","nonce":4204859272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6827","nonce":4204859272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6831","nonce":4204859272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6829","nonce":4204859272}]},"public_addr":"172.21.15.83:6825/4204859272","cluster_addr":"172.21.15.83:6827/4204859272","heartbeat_back_addr":"172.21.15.83:6831/4204859272","heartbeat_front_addr":"172.21.15.83:6829/4204859272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.156498+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.882707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.093978+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.158565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.173933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.888606+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.135525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.149712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":3,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.34","mappings":[{"from":4,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":6}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T00:17:58.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.743+0000 7f06b51f0700 1 -- 172.21.15.59:0/1518313271 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f069c06ae00 msgr2=0x7f069c06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:58.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.743+0000 7f06b51f0700 1 --2- 172.21.15.59:0/1518313271 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f069c06ae00 0x7f069c06d2c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f06b00b8bf0 tx=0x7f06a0008040 comp rx=0 tx=0).stop 2023-09-21T00:17:58.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.743+0000 7f06b51f0700 1 -- 172.21.15.59:0/1518313271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06b00d11b0 msgr2=0x7f06b00ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:58.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.743+0000 7f06b51f0700 1 --2- 172.21.15.59:0/1518313271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06b00d11b0 0x7f06b00ca4a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f06a400c4a0 tx=0x7f06a400c860 comp rx=0 tx=0).stop 2023-09-21T00:17:58.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.744+0000 7f06b51f0700 1 -- 172.21.15.59:0/1518313271 shutdown_connections 2023-09-21T00:17:58.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.744+0000 7f06b51f0700 1 --2- 172.21.15.59:0/1518313271 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06b015d7e0 0x7f06b01f68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:58.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.744+0000 7f06b51f0700 1 --2- 172.21.15.59:0/1518313271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06b00d11b0 0x7f06b00ca4a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:58.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.744+0000 7f06b51f0700 1 --2- 172.21.15.59:0/1518313271 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f069c06ae00 0x7f069c06d2c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:58.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.744+0000 7f06b51f0700 1 --2- 172.21.15.59:0/1518313271 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06b00d3f00 0x7f06b00ca9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:58.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.744+0000 7f06b51f0700 1 -- 172.21.15.59:0/1518313271 >> 172.21.15.59:0/1518313271 conn(0x7f06b009c740 msgr2=0x7f06b00b1910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:58.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.744+0000 7f06b51f0700 1 -- 172.21.15.59:0/1518313271 shutdown_connections 2023-09-21T00:17:58.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.744+0000 7f06b51f0700 1 -- 172.21.15.59:0/1518313271 wait complete. 2023-09-21T00:17:58.758 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-21T00:16:54.796248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-21T00:17:04.167102+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-21T00:17:05.313188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-21T00:17:08.977609+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-21T00:17:58.759 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-21T00:17:58.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.885+0000 7f24ba3bc700 1 Processor -- start 2023-09-21T00:17:58.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.885+0000 7f24ba3bc700 1 -- start start 2023-09-21T00:17:58.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.886+0000 7f24ba3bc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f24b415b2b0 0x7f24b40cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:58.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.886+0000 7f24ba3bc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f24b40ce420 0x7f24b4161190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:58.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.886+0000 7f24ba3bc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f24b406a780 0x7f24b406abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:58.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.886+0000 7f24ba3bc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24b40ce250 con 0x7f24b406a780 2023-09-21T00:17:58.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.886+0000 7f24ba3bc700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24b406b110 con 0x7f24b40ce420 2023-09-21T00:17:58.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.886+0000 7f24ba3bc700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24b40cfee0 con 0x7f24b415b2b0 2023-09-21T00:17:58.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.886+0000 7f24b8959700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f24b406a780 0x7f24b406abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:58.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.886+0000 7f24b8959700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f24b406a780 0x7f24b406abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52468/0 (socket says 172.21.15.59:52468) 2023-09-21T00:17:58.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.886+0000 7f24b8959700 1 -- 172.21.15.59:0/2136619590 learned_addr learned my addr 172.21.15.59:0/2136619590 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:58.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.886+0000 7f24b3fff700 1 --2- 172.21.15.59:0/2136619590 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f24b415b2b0 0x7f24b40cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:58.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.886+0000 7f24b37fe700 1 --2- 172.21.15.59:0/2136619590 >> v2:172.21.15.83:3300/0 conn(0x7f24b40ce420 0x7f24b4161190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:58.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.886+0000 7f24b8959700 1 -- 172.21.15.59:0/2136619590 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f24b415b2b0 msgr2=0x7f24b40cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:58.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.886+0000 7f24b8959700 1 --2- 172.21.15.59:0/2136619590 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f24b415b2b0 0x7f24b40cdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:58.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.886+0000 7f24b8959700 1 -- 172.21.15.59:0/2136619590 >> v2:172.21.15.83:3300/0 conn(0x7f24b40ce420 msgr2=0x7f24b4161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:58.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.886+0000 7f24b8959700 1 --2- 172.21.15.59:0/2136619590 >> v2:172.21.15.83:3300/0 conn(0x7f24b40ce420 0x7f24b4161190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:58.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.887+0000 7f24b8959700 1 -- 172.21.15.59:0/2136619590 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b40ce900 con 0x7f24b406a780 2023-09-21T00:17:58.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.887+0000 7f24b8959700 1 --2- 172.21.15.59:0/2136619590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24b406a780 0x7f24b406abd0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f24b4067370 tx=0x7f24ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c46b4ce3af808fa server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:58.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.887+0000 7f24b2ffd700 1 -- 172.21.15.59:0/2136619590 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac00e070 con 0x7f24b406a780 2023-09-21T00:17:58.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.887+0000 7f24b2ffd700 1 -- 172.21.15.59:0/2136619590 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24ac00b910 con 0x7f24b406a780 2023-09-21T00:17:58.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.887+0000 7f24b2ffd700 1 -- 172.21.15.59:0/2136619590 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac00bcc0 con 0x7f24b406a780 2023-09-21T00:17:58.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.887+0000 7f24ba3bc700 1 -- 172.21.15.59:0/2136619590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24b406a780 msgr2=0x7f24b406abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:58.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.887+0000 7f24ba3bc700 1 --2- 172.21.15.59:0/2136619590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24b406a780 0x7f24b406abd0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f24b4067370 tx=0x7f24ac00b330 comp rx=0 tx=0).stop 2023-09-21T00:17:58.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.887+0000 7f24ba3bc700 1 -- 172.21.15.59:0/2136619590 shutdown_connections 2023-09-21T00:17:58.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.887+0000 7f24ba3bc700 1 --2- 172.21.15.59:0/2136619590 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f24b415b2b0 0x7f24b40cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:58.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.887+0000 7f24ba3bc700 1 --2- 172.21.15.59:0/2136619590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24b406a780 0x7f24b406abd0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:58.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.887+0000 7f24ba3bc700 1 --2- 172.21.15.59:0/2136619590 >> v2:172.21.15.83:3300/0 conn(0x7f24b40ce420 0x7f24b4161190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:58.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.887+0000 7f24ba3bc700 1 -- 172.21.15.59:0/2136619590 >> 172.21.15.59:0/2136619590 conn(0x7f24b40d0140 msgr2=0x7f24b40d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:58.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.887+0000 7f24ba3bc700 1 -- 172.21.15.59:0/2136619590 shutdown_connections 2023-09-21T00:17:58.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.887+0000 7f24ba3bc700 1 -- 172.21.15.59:0/2136619590 wait complete. 2023-09-21T00:17:58.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.889+0000 7f24ba3bc700 1 Processor -- start 2023-09-21T00:17:58.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.889+0000 7f24ba3bc700 1 -- start start 2023-09-21T00:17:58.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.889+0000 7f24ba3bc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f24b406a780 0x7f24b4153d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:58.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.889+0000 7f24ba3bc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f24b40ce420 0x7f24b4159570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:58.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.889+0000 7f24ba3bc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24b415b2b0 0x7f24b4159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:58.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.889+0000 7f24ba3bc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b4150e90 con 0x7f24b415b2b0 2023-09-21T00:17:58.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.890+0000 7f24ba3bc700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b40c8990 con 0x7f24b406a780 2023-09-21T00:17:58.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.890+0000 7f24ba3bc700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24b41542a0 con 0x7f24b40ce420 2023-09-21T00:17:58.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.890+0000 7f24b8959700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24b415b2b0 0x7f24b4159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:58.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.890+0000 7f24b8959700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24b415b2b0 0x7f24b4159ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52470/0 (socket says 172.21.15.59:52470) 2023-09-21T00:17:58.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.890+0000 7f24b8959700 1 -- 172.21.15.59:0/427261522 learned_addr learned my addr 172.21.15.59:0/427261522 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:58.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.890+0000 7f24b3fff700 1 --2- 172.21.15.59:0/427261522 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f24b406a780 0x7f24b4153d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:58.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.890+0000 7f24b37fe700 1 --2- 172.21.15.59:0/427261522 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f24b40ce420 0x7f24b4159570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:58.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.890+0000 7f24b8959700 1 -- 172.21.15.59:0/427261522 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f24b40ce420 msgr2=0x7f24b4159570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:58.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.890+0000 7f24b8959700 1 --2- 172.21.15.59:0/427261522 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f24b40ce420 0x7f24b4159570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:58.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.890+0000 7f24b8959700 1 -- 172.21.15.59:0/427261522 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f24b406a780 msgr2=0x7f24b4153d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:58.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.890+0000 7f24b8959700 1 --2- 172.21.15.59:0/427261522 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f24b406a780 0x7f24b4153d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:58.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.890+0000 7f24b8959700 1 -- 172.21.15.59:0/427261522 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ac009b30 con 0x7f24b415b2b0 2023-09-21T00:17:58.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.890+0000 7f24b8959700 1 --2- 172.21.15.59:0/427261522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24b415b2b0 0x7f24b4159ab0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f24b40728c0 tx=0x7f24ac004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:58.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.890+0000 7f24b0ff9700 1 -- 172.21.15.59:0/427261522 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac0099b0 con 0x7f24b415b2b0 2023-09-21T00:17:58.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.890+0000 7f24b0ff9700 1 -- 172.21.15.59:0/427261522 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24ac00ce80 con 0x7f24b415b2b0 2023-09-21T00:17:58.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.890+0000 7f24ba3bc700 1 -- 172.21.15.59:0/427261522 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24b40c7d80 con 0x7f24b415b2b0 2023-09-21T00:17:58.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.890+0000 7f24b0ff9700 1 -- 172.21.15.59:0/427261522 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac004490 con 0x7f24b415b2b0 2023-09-21T00:17:58.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.890+0000 7f24ba3bc700 1 -- 172.21.15.59:0/427261522 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24b40c8340 con 0x7f24b415b2b0 2023-09-21T00:17:58.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.891+0000 7f24ba3bc700 1 -- 172.21.15.59:0/427261522 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24b415d060 con 0x7f24b415b2b0 2023-09-21T00:17:58.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.892+0000 7f24b0ff9700 1 -- 172.21.15.59:0/427261522 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f24ac0045f0 con 0x7f24b415b2b0 2023-09-21T00:17:58.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.892+0000 7f24b0ff9700 1 --2- 172.21.15.59:0/427261522 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f24a006ae00 0x7f24a006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:58.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.892+0000 7f24b0ff9700 1 -- 172.21.15.59:0/427261522 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f24ac08a930 con 0x7f24b415b2b0 2023-09-21T00:17:58.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.892+0000 7f24b3fff700 1 --2- 172.21.15.59:0/427261522 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f24a006ae00 0x7f24a006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:58.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.893+0000 7f24b3fff700 1 --2- 172.21.15.59:0/427261522 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f24a006ae00 0x7f24a006d2c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f24b41f6520 tx=0x7f24a8009210 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:58.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:58.897+0000 7f24b0ff9700 1 -- 172.21.15.59:0/427261522 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f24ac0556e0 con 0x7f24b415b2b0 2023-09-21T00:17:59.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.101+0000 7f24ba3bc700 1 -- 172.21.15.59:0/427261522 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f24b40c8b00 con 0x7f24b415b2b0 2023-09-21T00:17:59.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.101+0000 7f24b0ff9700 1 -- 172.21.15.59:0/427261522 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f24ac01f020 con 0x7f24b415b2b0 2023-09-21T00:17:59.104 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-09-21T00:17:59.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.103+0000 7f24ba3bc700 1 -- 172.21.15.59:0/427261522 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f24a006ae00 msgr2=0x7f24a006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:59.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.103+0000 7f24ba3bc700 1 --2- 172.21.15.59:0/427261522 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f24a006ae00 0x7f24a006d2c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f24b41f6520 tx=0x7f24a8009210 comp rx=0 tx=0).stop 2023-09-21T00:17:59.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.103+0000 7f24ba3bc700 1 -- 172.21.15.59:0/427261522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24b415b2b0 msgr2=0x7f24b4159ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:59.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.103+0000 7f24ba3bc700 1 --2- 172.21.15.59:0/427261522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24b415b2b0 0x7f24b4159ab0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f24b40728c0 tx=0x7f24ac004ad0 comp rx=0 tx=0).stop 2023-09-21T00:17:59.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.103+0000 7f24ba3bc700 1 -- 172.21.15.59:0/427261522 shutdown_connections 2023-09-21T00:17:59.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.103+0000 7f24ba3bc700 1 --2- 172.21.15.59:0/427261522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24b415b2b0 0x7f24b4159ab0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:59.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.103+0000 7f24ba3bc700 1 --2- 172.21.15.59:0/427261522 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f24b406a780 0x7f24b4153d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:59.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.103+0000 7f24ba3bc700 1 --2- 172.21.15.59:0/427261522 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f24a006ae00 0x7f24a006d2c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:59.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.103+0000 7f24ba3bc700 1 --2- 172.21.15.59:0/427261522 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f24b40ce420 0x7f24b4159570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:59.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.103+0000 7f24ba3bc700 1 -- 172.21.15.59:0/427261522 >> 172.21.15.59:0/427261522 conn(0x7f24b40d0140 msgr2=0x7f24b415c950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:59.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.103+0000 7f24ba3bc700 1 -- 172.21.15.59:0/427261522 shutdown_connections 2023-09-21T00:17:59.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.104+0000 7f24ba3bc700 1 -- 172.21.15.59:0/427261522 wait complete. 2023-09-21T00:17:59.118 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-21T00:17:59.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.245+0000 7fb8cf85d700 1 Processor -- start 2023-09-21T00:17:59.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.245+0000 7fb8cf85d700 1 -- start start 2023-09-21T00:17:59.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.246+0000 7fb8cf85d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8c80b4ee0 0x7fb8c80b5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:59.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.246+0000 7fb8cf85d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8c815de70 con 0x7fb8c815d5e0 2023-09-21T00:17:59.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.246+0000 7fb8cf85d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8c80d1c60 con 0x7fb8c815d9c0 2023-09-21T00:17:59.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.246+0000 7fb8cf85d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c80b58b0 con 0x7fb8c80b4ee0 2023-09-21T00:17:59.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.246+0000 7fb8cd5f9700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb8c815d5e0 0x7fb8c80b8d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58044/0 (socket says 172.21.15.59:58044) 2023-09-21T00:17:59.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.246+0000 7fb8cd5f9700 1 -- 172.21.15.59:0/4006553587 learned_addr learned my addr 172.21.15.59:0/4006553587 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:59.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.246+0000 7fb8cddfa700 1 --2- 172.21.15.59:0/4006553587 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8c80b4ee0 0x7fb8c80b5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:59.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.247+0000 7fb8bffff700 1 -- 172.21.15.59:0/4006553587 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1640216236 0 0) 0x7fb8c815de70 con 0x7fb8c815d5e0 2023-09-21T00:17:59.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.247+0000 7fb8bffff700 1 -- 172.21.15.59:0/4006553587 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8b40035b0 con 0x7fb8c815d5e0 2023-09-21T00:17:59.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.247+0000 7fb8bffff700 1 -- 172.21.15.59:0/4006553587 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3015769007 0 0) 0x7fb8b40035b0 con 0x7fb8c815d5e0 2023-09-21T00:17:59.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.247+0000 7fb8bffff700 1 -- 172.21.15.59:0/4006553587 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8c80b4ee0 msgr2=0x7fb8c80b5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:59.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.247+0000 7fb8bffff700 1 --2- 172.21.15.59:0/4006553587 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8c80b4ee0 0x7fb8c80b5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:59.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.247+0000 7fb8bffff700 1 -- 172.21.15.59:0/4006553587 >> v1:172.21.15.83:6789/0 conn(0x7fb8c815d9c0 legacy=0x7fb8c80d1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:59.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.247+0000 7fb8bffff700 1 -- 172.21.15.59:0/4006553587 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c815e0c0 con 0x7fb8c815d5e0 2023-09-21T00:17:59.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.247+0000 7fb8bffff700 1 -- 172.21.15.59:0/4006553587 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 710825841 0 0) 0x7fb8b8001670 con 0x7fb8c815d5e0 2023-09-21T00:17:59.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.247+0000 7fb8bffff700 1 -- 172.21.15.59:0/4006553587 >> v1:172.21.15.59:6789/0 conn(0x7fb8c815d5e0 legacy=0x7fb8c80b8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:59.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.247+0000 7fb8bffff700 1 --2- 172.21.15.59:0/4006553587 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8b4003a30 0x7fb8b4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:59.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.247+0000 7fb8bffff700 1 --2- 172.21.15.59:0/4006553587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8b40043e0 0x7fb8b40048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:59.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.247+0000 7fb8bffff700 1 --2- 172.21.15.59:0/4006553587 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8c80b4ee0 0x7fb8b4005110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:59.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.247+0000 7fb8bffff700 1 -- 172.21.15.59:0/4006553587 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c80b58b0 con 0x7fb8b40043e0 2023-09-21T00:17:59.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.247+0000 7fb8bffff700 1 -- 172.21.15.59:0/4006553587 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b400ba10 con 0x7fb8b4003a30 2023-09-21T00:17:59.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.247+0000 7fb8bffff700 1 -- 172.21.15.59:0/4006553587 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b400bbd0 con 0x7fb8c80b4ee0 2023-09-21T00:17:59.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.247+0000 7fb8ccdf8700 1 --2- 172.21.15.59:0/4006553587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8b40043e0 0x7fb8b40048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:59.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.247+0000 7fb8cd5f9700 1 --2- 172.21.15.59:0/4006553587 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8b4003a30 0x7fb8b4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:59.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.247+0000 7fb8cddfa700 1 --2- 172.21.15.59:0/4006553587 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8c80b4ee0 0x7fb8b4005110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:59.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.247+0000 7fb8ccdf8700 1 -- 172.21.15.59:0/4006553587 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8c80b4ee0 msgr2=0x7fb8b4005110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:59.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.247+0000 7fb8ccdf8700 1 --2- 172.21.15.59:0/4006553587 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8c80b4ee0 0x7fb8b4005110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:59.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.247+0000 7fb8ccdf8700 1 -- 172.21.15.59:0/4006553587 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8b4003a30 msgr2=0x7fb8b4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:59.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.247+0000 7fb8ccdf8700 1 --2- 172.21.15.59:0/4006553587 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8b4003a30 0x7fb8b4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:59.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.247+0000 7fb8ccdf8700 1 -- 172.21.15.59:0/4006553587 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b40035b0 con 0x7fb8b40043e0 2023-09-21T00:17:59.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.248+0000 7fb8ccdf8700 1 --2- 172.21.15.59:0/4006553587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8b40043e0 0x7fb8b40048b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb8c40018b0 tx=0x7fb8b4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f22e3237a510b518 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:59.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.248+0000 7fb8bffff700 1 -- 172.21.15.59:0/4006553587 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c4001370 con 0x7fb8b40043e0 2023-09-21T00:17:59.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.248+0000 7fb8bffff700 1 -- 172.21.15.59:0/4006553587 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c400c6b0 con 0x7fb8b40043e0 2023-09-21T00:17:59.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.248+0000 7fb8bffff700 1 -- 172.21.15.59:0/4006553587 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c400ca60 con 0x7fb8b40043e0 2023-09-21T00:17:59.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.248+0000 7fb8cf85d700 1 -- 172.21.15.59:0/4006553587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8b40043e0 msgr2=0x7fb8b40048b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:59.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.248+0000 7fb8cf85d700 1 --2- 172.21.15.59:0/4006553587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8b40043e0 0x7fb8b40048b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb8c40018b0 tx=0x7fb8b4005880 comp rx=0 tx=0).stop 2023-09-21T00:17:59.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.248+0000 7fb8cddfa700 1 -- 172.21.15.59:0/4006553587 reap_dead start 2023-09-21T00:17:59.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.248+0000 7fb8cf85d700 1 -- 172.21.15.59:0/4006553587 shutdown_connections 2023-09-21T00:17:59.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.248+0000 7fb8cf85d700 1 -- 172.21.15.59:0/4006553587 >> 172.21.15.59:0/4006553587 conn(0x7fb8c80724e0 msgr2=0x7fb8c80cfee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:59.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.248+0000 7fb8cf85d700 1 -- 172.21.15.59:0/4006553587 shutdown_connections 2023-09-21T00:17:59.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.248+0000 7fb8cf85d700 1 -- 172.21.15.59:0/4006553587 wait complete. 2023-09-21T00:17:59.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.250+0000 7fb8cf85d700 1 Processor -- start 2023-09-21T00:17:59.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.250+0000 7fb8cf85d700 1 -- start start 2023-09-21T00:17:59.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.250+0000 7fb8cf85d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8b40043e0 0x7fb8c80c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:59.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.250+0000 7fb8cf85d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8c815a1d0 0x7fb8c80c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:59.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.250+0000 7fb8cf85d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8c80c9110 0x7fb8c80b76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:59.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.250+0000 7fb8cf85d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c80c7300 con 0x7fb8b40043e0 2023-09-21T00:17:59.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.250+0000 7fb8cf85d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c81f7590 con 0x7fb8c815a1d0 2023-09-21T00:17:59.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.250+0000 7fb8cf85d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c81f6a10 con 0x7fb8c80c9110 2023-09-21T00:17:59.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.250+0000 7fb8cd5f9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8b40043e0 0x7fb8c80c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:59.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.251+0000 7fb8cd5f9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8b40043e0 0x7fb8c80c6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52486/0 (socket says 172.21.15.59:52486) 2023-09-21T00:17:59.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.251+0000 7fb8cd5f9700 1 -- 172.21.15.59:0/1948016639 learned_addr learned my addr 172.21.15.59:0/1948016639 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:59.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.251+0000 7fb8ccdf8700 1 --2- 172.21.15.59:0/1948016639 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8c815a1d0 0x7fb8c80c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:59.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.251+0000 7fb8cd5f9700 1 -- 172.21.15.59:0/1948016639 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8c80c9110 msgr2=0x7fb8c80b76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:59.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.251+0000 7fb8cddfa700 1 --2- 172.21.15.59:0/1948016639 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8c80c9110 0x7fb8c80b76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:59.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.251+0000 7fb8cd5f9700 1 --2- 172.21.15.59:0/1948016639 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8c80c9110 0x7fb8c80b76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:59.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.251+0000 7fb8cd5f9700 1 -- 172.21.15.59:0/1948016639 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8c815a1d0 msgr2=0x7fb8c80c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:59.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.251+0000 7fb8cd5f9700 1 --2- 172.21.15.59:0/1948016639 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8c815a1d0 0x7fb8c80c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:59.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.251+0000 7fb8cd5f9700 1 -- 172.21.15.59:0/1948016639 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c81f6cf0 con 0x7fb8b40043e0 2023-09-21T00:17:59.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.251+0000 7fb8ccdf8700 1 --2- 172.21.15.59:0/1948016639 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8c815a1d0 0x7fb8c80c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:17:59.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.251+0000 7fb8cd5f9700 1 --2- 172.21.15.59:0/1948016639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8b40043e0 0x7fb8c80c6dc0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb8b80072c0 tx=0x7fb8b8007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:59.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.251+0000 7fb8bdffb700 1 -- 172.21.15.59:0/1948016639 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b80077a0 con 0x7fb8b40043e0 2023-09-21T00:17:59.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.251+0000 7fb8bdffb700 1 -- 172.21.15.59:0/1948016639 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b800f850 con 0x7fb8b40043e0 2023-09-21T00:17:59.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.251+0000 7fb8cf85d700 1 -- 172.21.15.59:0/1948016639 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8c81f6fd0 con 0x7fb8b40043e0 2023-09-21T00:17:59.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.251+0000 7fb8bdffb700 1 -- 172.21.15.59:0/1948016639 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b800fbe0 con 0x7fb8b40043e0 2023-09-21T00:17:59.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.251+0000 7fb8cf85d700 1 -- 172.21.15.59:0/1948016639 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8c81f6630 con 0x7fb8b40043e0 2023-09-21T00:17:59.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.252+0000 7fb8cf85d700 1 -- 172.21.15.59:0/1948016639 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8c81f67c0 con 0x7fb8b40043e0 2023-09-21T00:17:59.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.253+0000 7fb8bdffb700 1 -- 172.21.15.59:0/1948016639 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fb8b800fd40 con 0x7fb8b40043e0 2023-09-21T00:17:59.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.253+0000 7fb8bdffb700 1 --2- 172.21.15.59:0/1948016639 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fb8ac06ae00 0x7fb8ac06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:59.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.253+0000 7fb8bdffb700 1 -- 172.21.15.59:0/1948016639 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fb8b80899b0 con 0x7fb8b40043e0 2023-09-21T00:17:59.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.253+0000 7fb8ccdf8700 1 --2- 172.21.15.59:0/1948016639 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fb8ac06ae00 0x7fb8ac06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:59.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.254+0000 7fb8ccdf8700 1 --2- 172.21.15.59:0/1948016639 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fb8ac06ae00 0x7fb8ac06d2c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb8c40018b0 tx=0x7fb8c4005040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:59.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.258+0000 7fb8bdffb700 1 -- 172.21.15.59:0/1948016639 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fb8b80546c0 con 0x7fb8b40043e0 2023-09-21T00:17:59.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.455+0000 7fb8cf85d700 1 -- 172.21.15.59:0/1948016639 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb8c8067e50 con 0x7fb8b40043e0 2023-09-21T00:17:59.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.456+0000 7fb8bdffb700 1 -- 172.21.15.59:0/1948016639 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb8b8057ce0 con 0x7fb8b40043e0 2023-09-21T00:17:59.458 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-09-21T00:17:59.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.458+0000 7fb8cf85d700 1 -- 172.21.15.59:0/1948016639 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fb8ac06ae00 msgr2=0x7fb8ac06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:59.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.458+0000 7fb8cf85d700 1 --2- 172.21.15.59:0/1948016639 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fb8ac06ae00 0x7fb8ac06d2c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb8c40018b0 tx=0x7fb8c4005040 comp rx=0 tx=0).stop 2023-09-21T00:17:59.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.458+0000 7fb8cf85d700 1 -- 172.21.15.59:0/1948016639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8b40043e0 msgr2=0x7fb8c80c6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:59.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.458+0000 7fb8cf85d700 1 --2- 172.21.15.59:0/1948016639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8b40043e0 0x7fb8c80c6dc0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb8b80072c0 tx=0x7fb8b8007680 comp rx=0 tx=0).stop 2023-09-21T00:17:59.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.458+0000 7fb8cf85d700 1 -- 172.21.15.59:0/1948016639 shutdown_connections 2023-09-21T00:17:59.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.458+0000 7fb8cf85d700 1 --2- 172.21.15.59:0/1948016639 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fb8ac06ae00 0x7fb8ac06d2c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:59.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.458+0000 7fb8cf85d700 1 --2- 172.21.15.59:0/1948016639 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8c80c9110 0x7fb8c80b76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:59.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.458+0000 7fb8cf85d700 1 --2- 172.21.15.59:0/1948016639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8b40043e0 0x7fb8c80c6dc0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:59.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.458+0000 7fb8cf85d700 1 --2- 172.21.15.59:0/1948016639 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8c815a1d0 0x7fb8c80c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:59.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.458+0000 7fb8cf85d700 1 -- 172.21.15.59:0/1948016639 >> 172.21.15.59:0/1948016639 conn(0x7fb8c80724e0 msgr2=0x7fb8c815ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:59.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.458+0000 7fb8cf85d700 1 -- 172.21.15.59:0/1948016639 shutdown_connections 2023-09-21T00:17:59.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.458+0000 7fb8cf85d700 1 -- 172.21.15.59:0/1948016639 wait complete. 2023-09-21T00:17:59.472 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-21T00:17:59.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.598+0000 7f9a1190c700 1 Processor -- start 2023-09-21T00:17:59.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.598+0000 7f9a1190c700 1 -- start start 2023-09-21T00:17:59.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.599+0000 7f9a1190c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9a0c0d2f80 0x7f9a0c0b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:59.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.599+0000 7f9a1190c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9a0c0b5460 0x7f9a0c0b65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:59.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.599+0000 7f9a1190c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a0c0b58b0 con 0x7f9a0c15d690 2023-09-21T00:17:59.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.599+0000 7f9a1190c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a0c0d1c30 con 0x7f9a0c0b5460 2023-09-21T00:17:59.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.599+0000 7f9a1190c700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a0c0d1ee0 con 0x7f9a0c0d2f80 2023-09-21T00:17:59.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.599+0000 7f9a0b7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9a0c0b5460 0x7f9a0c0b65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:59.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.599+0000 7f9a0affd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9a0c15d690 0x7f9a0c0d1520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58062/0 (socket says 172.21.15.59:58062) 2023-09-21T00:17:59.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.599+0000 7f9a0affd700 1 -- 172.21.15.59:0/2732017932 learned_addr learned my addr 172.21.15.59:0/2732017932 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:59.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.599+0000 7f9a0a7fc700 1 --2- 172.21.15.59:0/2732017932 >> v2:172.21.15.83:3300/0 conn(0x7f9a0c0d2f80 0x7f9a0c0b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:59.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.599+0000 7f9a0b7fe700 1 -- 172.21.15.59:0/2732017932 >> v2:172.21.15.83:3300/0 conn(0x7f9a0c0d2f80 msgr2=0x7f9a0c0b4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:59.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.600+0000 7f9a0b7fe700 1 --2- 172.21.15.59:0/2732017932 >> v2:172.21.15.83:3300/0 conn(0x7f9a0c0d2f80 0x7f9a0c0b4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:59.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.600+0000 7f9a0b7fe700 1 -- 172.21.15.59:0/2732017932 >> v1:172.21.15.59:6789/0 conn(0x7f9a0c15d690 legacy=0x7f9a0c0d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:59.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.600+0000 7f9a09ffb700 1 -- 172.21.15.59:0/2732017932 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1887251981 0 0) 0x7f9a00001110 con 0x7f9a0c15d690 2023-09-21T00:17:59.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.600+0000 7f9a0b7fe700 1 -- 172.21.15.59:0/2732017932 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a0c0d21c0 con 0x7f9a0c0b5460 2023-09-21T00:17:59.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.600+0000 7f9a0a7fc700 1 --2- 172.21.15.59:0/2732017932 >> v2:172.21.15.83:3300/0 conn(0x7f9a0c0d2f80 0x7f9a0c0b4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:17:59.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.600+0000 7f9a0b7fe700 1 --2- 172.21.15.59:0/2732017932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a0c0b5460 0x7f9a0c0b65d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c0cfe80 tx=0x7f9a0400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ffcb28ace6a88b5 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:59.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.600+0000 7f9a09ffb700 1 -- 172.21.15.59:0/2732017932 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0400e070 con 0x7f9a0c0b5460 2023-09-21T00:17:59.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.600+0000 7f9a09ffb700 1 -- 172.21.15.59:0/2732017932 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a0400bbd0 con 0x7f9a0c0b5460 2023-09-21T00:17:59.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.600+0000 7f9a09ffb700 1 -- 172.21.15.59:0/2732017932 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a04012430 con 0x7f9a0c0b5460 2023-09-21T00:17:59.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.600+0000 7f9a1190c700 1 -- 172.21.15.59:0/2732017932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a0c0b5460 msgr2=0x7f9a0c0b65d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:59.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.600+0000 7f9a1190c700 1 --2- 172.21.15.59:0/2732017932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a0c0b5460 0x7f9a0c0b65d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c0cfe80 tx=0x7f9a0400b330 comp rx=0 tx=0).stop 2023-09-21T00:17:59.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.600+0000 7f9a1190c700 1 -- 172.21.15.59:0/2732017932 shutdown_connections 2023-09-21T00:17:59.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.600+0000 7f9a1190c700 1 --2- 172.21.15.59:0/2732017932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a0c0b5460 0x7f9a0c0b65d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:59.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.600+0000 7f9a1190c700 1 --2- 172.21.15.59:0/2732017932 >> v2:172.21.15.83:3300/0 conn(0x7f9a0c0d2f80 0x7f9a0c0b4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:59.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.600+0000 7f9a1190c700 1 -- 172.21.15.59:0/2732017932 >> 172.21.15.59:0/2732017932 conn(0x7f9a0c072560 msgr2=0x7f9a0c0cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:59.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.600+0000 7f9a1190c700 1 -- 172.21.15.59:0/2732017932 shutdown_connections 2023-09-21T00:17:59.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.600+0000 7f9a1190c700 1 -- 172.21.15.59:0/2732017932 wait complete. 2023-09-21T00:17:59.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.602+0000 7f9a1190c700 1 Processor -- start 2023-09-21T00:17:59.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.602+0000 7f9a1190c700 1 -- start start 2023-09-21T00:17:59.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.602+0000 7f9a1190c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a0c0b5460 0x7f9a0c0b7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:59.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.602+0000 7f9a1190c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a0c0d2f80 0x7f9a0c0b3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:59.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.602+0000 7f9a1190c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9a0c15d690 0x7f9a0c148fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:59.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.602+0000 7f9a1190c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c0b8750 con 0x7f9a0c0b5460 2023-09-21T00:17:59.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.602+0000 7f9a1190c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c0b6590 con 0x7f9a0c0d2f80 2023-09-21T00:17:59.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.602+0000 7f9a1190c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c1f6cb0 con 0x7f9a0c15d690 2023-09-21T00:17:59.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.603+0000 7f9a0affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a0c0b5460 0x7f9a0c0b7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:59.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.603+0000 7f9a0affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a0c0b5460 0x7f9a0c0b7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52500/0 (socket says 172.21.15.59:52500) 2023-09-21T00:17:59.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.603+0000 7f9a0affd700 1 -- 172.21.15.59:0/2567134513 learned_addr learned my addr 172.21.15.59:0/2567134513 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:59.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.603+0000 7f9a0b7fe700 1 --2- 172.21.15.59:0/2567134513 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9a0c15d690 0x7f9a0c148fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:59.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.603+0000 7f9a0a7fc700 1 --2- 172.21.15.59:0/2567134513 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a0c0d2f80 0x7f9a0c0b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:59.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.603+0000 7f9a0affd700 1 -- 172.21.15.59:0/2567134513 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9a0c15d690 msgr2=0x7f9a0c148fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:59.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.603+0000 7f9a0affd700 1 --2- 172.21.15.59:0/2567134513 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9a0c15d690 0x7f9a0c148fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:59.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.603+0000 7f9a0affd700 1 -- 172.21.15.59:0/2567134513 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a0c0d2f80 msgr2=0x7f9a0c0b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:59.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.603+0000 7f9a0affd700 1 --2- 172.21.15.59:0/2567134513 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a0c0d2f80 0x7f9a0c0b3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:59.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.603+0000 7f9a0affd700 1 -- 172.21.15.59:0/2567134513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a04009a70 con 0x7f9a0c0b5460 2023-09-21T00:17:59.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.603+0000 7f9a0b7fe700 1 --2- 172.21.15.59:0/2567134513 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9a0c15d690 0x7f9a0c148fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:17:59.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.603+0000 7f9a0a7fc700 1 --2- 172.21.15.59:0/2567134513 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a0c0d2f80 0x7f9a0c0b3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:17:59.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.603+0000 7f9a0affd700 1 --2- 172.21.15.59:0/2567134513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a0c0b5460 0x7f9a0c0b7280 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9a0000c550 tx=0x7f9a0000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:59.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.603+0000 7f99f3fff700 1 -- 172.21.15.59:0/2567134513 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a00004c80 con 0x7f9a0c0b5460 2023-09-21T00:17:59.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.603+0000 7f99f3fff700 1 -- 172.21.15.59:0/2567134513 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a00004e00 con 0x7f9a0c0b5460 2023-09-21T00:17:59.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.603+0000 7f9a1190c700 1 -- 172.21.15.59:0/2567134513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a0c0b67a0 con 0x7f9a0c0b5460 2023-09-21T00:17:59.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.603+0000 7f99f3fff700 1 -- 172.21.15.59:0/2567134513 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a00007310 con 0x7f9a0c0b5460 2023-09-21T00:17:59.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.603+0000 7f9a1190c700 1 -- 172.21.15.59:0/2567134513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a0c0b77c0 con 0x7f9a0c0b5460 2023-09-21T00:17:59.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.604+0000 7f9a1190c700 1 -- 172.21.15.59:0/2567134513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a0c0b6fa0 con 0x7f9a0c0b5460 2023-09-21T00:17:59.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.605+0000 7f99f3fff700 1 -- 172.21.15.59:0/2567134513 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f9a00007470 con 0x7f9a0c0b5460 2023-09-21T00:17:59.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.605+0000 7f99f3fff700 1 --2- 172.21.15.59:0/2567134513 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f99f806ae00 0x7f99f806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:59.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.605+0000 7f99f3fff700 1 -- 172.21.15.59:0/2567134513 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f9a00089460 con 0x7f9a0c0b5460 2023-09-21T00:17:59.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.605+0000 7f9a0a7fc700 1 --2- 172.21.15.59:0/2567134513 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f99f806ae00 0x7f99f806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:59.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.606+0000 7f9a0a7fc700 1 --2- 172.21.15.59:0/2567134513 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f99f806ae00 0x7f99f806d2c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c1e7710 tx=0x7f99fc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:59.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.609+0000 7f99f3fff700 1 -- 172.21.15.59:0/2567134513 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f9a0c0b6fa0 con 0x7f9a0c0b5460 2023-09-21T00:17:59.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.812+0000 7f9a1190c700 1 -- 172.21.15.59:0/2567134513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9a0c0b58b0 con 0x7f9a0c0b5460 2023-09-21T00:17:59.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.812+0000 7f99f3fff700 1 -- 172.21.15.59:0/2567134513 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9a0c0b58b0 con 0x7f9a0c0b5460 2023-09-21T00:17:59.815 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-09-21T00:17:59.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.814+0000 7f9a1190c700 1 -- 172.21.15.59:0/2567134513 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f99f806ae00 msgr2=0x7f99f806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:59.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.814+0000 7f9a1190c700 1 --2- 172.21.15.59:0/2567134513 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f99f806ae00 0x7f99f806d2c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c1e7710 tx=0x7f99fc008040 comp rx=0 tx=0).stop 2023-09-21T00:17:59.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.814+0000 7f9a1190c700 1 -- 172.21.15.59:0/2567134513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a0c0b5460 msgr2=0x7f9a0c0b7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:59.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.814+0000 7f9a1190c700 1 --2- 172.21.15.59:0/2567134513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a0c0b5460 0x7f9a0c0b7280 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9a0000c550 tx=0x7f9a0000c910 comp rx=0 tx=0).stop 2023-09-21T00:17:59.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.814+0000 7f9a1190c700 1 -- 172.21.15.59:0/2567134513 shutdown_connections 2023-09-21T00:17:59.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.814+0000 7f9a1190c700 1 --2- 172.21.15.59:0/2567134513 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f99f806ae00 0x7f99f806d2c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:59.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.814+0000 7f9a1190c700 1 --2- 172.21.15.59:0/2567134513 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9a0c15d690 0x7f9a0c148fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:59.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.814+0000 7f9a1190c700 1 --2- 172.21.15.59:0/2567134513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a0c0b5460 0x7f9a0c0b7280 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:59.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.814+0000 7f9a1190c700 1 --2- 172.21.15.59:0/2567134513 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a0c0d2f80 0x7f9a0c0b3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:59.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.814+0000 7f9a1190c700 1 -- 172.21.15.59:0/2567134513 >> 172.21.15.59:0/2567134513 conn(0x7f9a0c072560 msgr2=0x7f9a0c14dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:59.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.814+0000 7f9a1190c700 1 -- 172.21.15.59:0/2567134513 shutdown_connections 2023-09-21T00:17:59.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.814+0000 7f9a1190c700 1 -- 172.21.15.59:0/2567134513 wait complete. 2023-09-21T00:17:59.828 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-21T00:17:59.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.955+0000 7faff86ed700 1 Processor -- start 2023-09-21T00:17:59.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.955+0000 7faff86ed700 1 -- start start 2023-09-21T00:17:59.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.956+0000 7faff86ed700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faff00cc250 0x7faff00cc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:59.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.956+0000 7faff86ed700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7faff00714f0 0x7faff00b3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:59.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.956+0000 7faff86ed700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faff0159f70 con 0x7faff015ac90 2023-09-21T00:17:59.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.956+0000 7faff86ed700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faff006d2c0 con 0x7faff00714f0 2023-09-21T00:17:59.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.956+0000 7faff86ed700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faff015a800 con 0x7faff00cc250 2023-09-21T00:17:59.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.956+0000 7faff5c88700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7faff015ac90 0x7faff0070de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58076/0 (socket says 172.21.15.59:58076) 2023-09-21T00:17:59.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.956+0000 7faff5c88700 1 -- 172.21.15.59:0/1276566207 learned_addr learned my addr 172.21.15.59:0/1276566207 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:17:59.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.956+0000 7faff6489700 1 --2- 172.21.15.59:0/1276566207 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faff00cc250 0x7faff00cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:59.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.956+0000 7faff6c8a700 1 --2- 172.21.15.59:0/1276566207 >> v2:172.21.15.83:3300/0 conn(0x7faff00714f0 0x7faff00b3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:59.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.956+0000 7faff5487700 1 -- 172.21.15.59:0/1276566207 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3482374316 0 0) 0x7fafe4001110 con 0x7faff015ac90 2023-09-21T00:17:59.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.956+0000 7faff5487700 1 -- 172.21.15.59:0/1276566207 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafdc0035b0 con 0x7faff015ac90 2023-09-21T00:17:59.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.956+0000 7faff6c8a700 1 -- 172.21.15.59:0/1276566207 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faff00cc250 msgr2=0x7faff00cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:17:59.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.956+0000 7faff5487700 1 -- 172.21.15.59:0/1276566207 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2172017376 0 0) 0x7fafdc0035b0 con 0x7faff015ac90 2023-09-21T00:17:59.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.956+0000 7faff6c8a700 1 --2- 172.21.15.59:0/1276566207 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faff00cc250 0x7faff00cc630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:59.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.956+0000 7faff6c8a700 1 -- 172.21.15.59:0/1276566207 >> v1:172.21.15.59:6789/0 conn(0x7faff015ac90 legacy=0x7faff0070de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:59.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.956+0000 7faff6c8a700 1 -- 172.21.15.59:0/1276566207 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff00ccb70 con 0x7faff00714f0 2023-09-21T00:17:59.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.956+0000 7faff6489700 1 --2- 172.21.15.59:0/1276566207 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faff00cc250 0x7faff00cc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T00:17:59.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.957+0000 7faff6c8a700 1 --2- 172.21.15.59:0/1276566207 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faff00714f0 0x7faff00b3950 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fafe8009dc0 tx=0x7fafe800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c335dfd6ff2425b server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:59.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.957+0000 7faff5487700 1 -- 172.21.15.59:0/1276566207 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe800e070 con 0x7faff00714f0 2023-09-21T00:17:59.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.957+0000 7faff5487700 1 -- 172.21.15.59:0/1276566207 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe8003a70 con 0x7faff00714f0 2023-09-21T00:17:59.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.957+0000 7faff5487700 1 -- 172.21.15.59:0/1276566207 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe4001800 con 0x7faff00714f0 2023-09-21T00:17:59.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.957+0000 7faff86ed700 1 -- 172.21.15.59:0/1276566207 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faff00714f0 msgr2=0x7faff00b3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:59.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.957+0000 7faff86ed700 1 --2- 172.21.15.59:0/1276566207 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faff00714f0 0x7faff00b3950 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fafe8009dc0 tx=0x7fafe800b330 comp rx=0 tx=0).stop 2023-09-21T00:17:59.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.957+0000 7faff86ed700 1 -- 172.21.15.59:0/1276566207 shutdown_connections 2023-09-21T00:17:59.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.957+0000 7faff86ed700 1 --2- 172.21.15.59:0/1276566207 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faff00714f0 0x7faff00b3950 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:59.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.957+0000 7faff86ed700 1 --2- 172.21.15.59:0/1276566207 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faff00cc250 0x7faff00cc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:59.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.957+0000 7faff86ed700 1 -- 172.21.15.59:0/1276566207 >> 172.21.15.59:0/1276566207 conn(0x7faff006a780 msgr2=0x7faff006ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:17:59.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.957+0000 7faff86ed700 1 -- 172.21.15.59:0/1276566207 shutdown_connections 2023-09-21T00:17:59.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.957+0000 7faff86ed700 1 -- 172.21.15.59:0/1276566207 wait complete. 2023-09-21T00:17:59.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.959+0000 7faff86ed700 1 Processor -- start 2023-09-21T00:17:59.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.959+0000 7faff86ed700 1 -- start start 2023-09-21T00:17:59.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.959+0000 7faff86ed700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faff00714f0 0x7faff0158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:59.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.959+0000 7faff86ed700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faff00cc250 0x7faff015bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:59.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.959+0000 7faff86ed700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faff015ac90 0x7faff0138dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:59.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.959+0000 7faff86ed700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff01f6d10 con 0x7faff00714f0 2023-09-21T00:17:59.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.959+0000 7faff86ed700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff01f6190 con 0x7faff015ac90 2023-09-21T00:17:59.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.959+0000 7faff86ed700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faff01f6470 con 0x7faff00cc250 2023-09-21T00:17:59.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.959+0000 7faff6489700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faff00714f0 0x7faff0158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:59.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.959+0000 7faff6489700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faff00714f0 0x7faff0158fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52514/0 (socket says 172.21.15.59:52514) 2023-09-21T00:17:59.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.959+0000 7faff6489700 1 -- 172.21.15.59:0/3409072874 learned_addr learned my addr 172.21.15.59:0/3409072874 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:17:59.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.960+0000 7faff5c88700 1 --2- 172.21.15.59:0/3409072874 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faff00cc250 0x7faff015bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:59.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.960+0000 7faff6c8a700 1 --2- 172.21.15.59:0/3409072874 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faff015ac90 0x7faff0138dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:59.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.960+0000 7faff6489700 1 -- 172.21.15.59:0/3409072874 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faff00cc250 msgr2=0x7faff015bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:59.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.960+0000 7faff6489700 1 --2- 172.21.15.59:0/3409072874 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faff00cc250 0x7faff015bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:59.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.960+0000 7faff6489700 1 -- 172.21.15.59:0/3409072874 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faff015ac90 msgr2=0x7faff0138dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:17:59.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.960+0000 7faff6489700 1 --2- 172.21.15.59:0/3409072874 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faff015ac90 0x7faff0138dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:17:59.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.960+0000 7faff6489700 1 -- 172.21.15.59:0/3409072874 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafec0094a0 con 0x7faff00714f0 2023-09-21T00:17:59.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.960+0000 7faff6489700 1 --2- 172.21.15.59:0/3409072874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faff00714f0 0x7faff0158fa0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fafec00ebe0 tx=0x7fafec009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:59.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.960+0000 7fafe2ffd700 1 -- 172.21.15.59:0/3409072874 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafec00c910 con 0x7faff00714f0 2023-09-21T00:17:59.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.960+0000 7fafe2ffd700 1 -- 172.21.15.59:0/3409072874 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafec00ca70 con 0x7faff00714f0 2023-09-21T00:17:59.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.960+0000 7fafe2ffd700 1 -- 172.21.15.59:0/3409072874 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafec00cde0 con 0x7faff00714f0 2023-09-21T00:17:59.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.960+0000 7faff86ed700 1 -- 172.21.15.59:0/3409072874 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafe8009a70 con 0x7faff00714f0 2023-09-21T00:17:59.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.960+0000 7faff86ed700 1 -- 172.21.15.59:0/3409072874 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faff01f6a30 con 0x7faff00714f0 2023-09-21T00:17:59.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.961+0000 7faff86ed700 1 -- 172.21.15.59:0/3409072874 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faff0147420 con 0x7faff00714f0 2023-09-21T00:17:59.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.962+0000 7fafe2ffd700 1 -- 172.21.15.59:0/3409072874 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fafec013470 con 0x7faff00714f0 2023-09-21T00:17:59.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.962+0000 7fafe2ffd700 1 --2- 172.21.15.59:0/3409072874 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fafd406ae00 0x7fafd406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:17:59.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.962+0000 7fafe2ffd700 1 -- 172.21.15.59:0/3409072874 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fafec089bc0 con 0x7faff00714f0 2023-09-21T00:17:59.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.962+0000 7faff5c88700 1 --2- 172.21.15.59:0/3409072874 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fafd406ae00 0x7fafd406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:17:59.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.963+0000 7faff5c88700 1 --2- 172.21.15.59:0/3409072874 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fafd406ae00 0x7fafd406d2c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7faff00cb9b0 tx=0x7fafe4005880 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:17:59.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:17:59.966+0000 7fafe2ffd700 1 -- 172.21.15.59:0/3409072874 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fafec054850 con 0x7faff00714f0 2023-09-21T00:18:00.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.165+0000 7faff86ed700 1 -- 172.21.15.59:0/3409072874 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7faff0067e50 con 0x7faff00714f0 2023-09-21T00:18:00.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.166+0000 7fafe2ffd700 1 -- 172.21.15.59:0/3409072874 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fafec057e70 con 0x7faff00714f0 2023-09-21T00:18:00.169 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-09-21T00:18:00.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.168+0000 7faff86ed700 1 -- 172.21.15.59:0/3409072874 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fafd406ae00 msgr2=0x7fafd406d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:00.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.168+0000 7faff86ed700 1 --2- 172.21.15.59:0/3409072874 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fafd406ae00 0x7fafd406d2c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7faff00cb9b0 tx=0x7fafe4005880 comp rx=0 tx=0).stop 2023-09-21T00:18:00.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.168+0000 7faff86ed700 1 -- 172.21.15.59:0/3409072874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faff00714f0 msgr2=0x7faff0158fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:00.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.168+0000 7faff86ed700 1 --2- 172.21.15.59:0/3409072874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faff00714f0 0x7faff0158fa0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fafec00ebe0 tx=0x7fafec009ec0 comp rx=0 tx=0).stop 2023-09-21T00:18:00.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.168+0000 7faff86ed700 1 -- 172.21.15.59:0/3409072874 shutdown_connections 2023-09-21T00:18:00.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.168+0000 7faff86ed700 1 --2- 172.21.15.59:0/3409072874 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faff015ac90 0x7faff0138dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:00.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.168+0000 7faff86ed700 1 --2- 172.21.15.59:0/3409072874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faff00714f0 0x7faff0158fa0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:00.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.168+0000 7faff86ed700 1 --2- 172.21.15.59:0/3409072874 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fafd406ae00 0x7fafd406d2c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:00.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.168+0000 7faff86ed700 1 --2- 172.21.15.59:0/3409072874 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faff00cc250 0x7faff015bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:00.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.168+0000 7faff86ed700 1 -- 172.21.15.59:0/3409072874 >> 172.21.15.59:0/3409072874 conn(0x7faff006a780 msgr2=0x7faff00cd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:00.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.168+0000 7faff86ed700 1 -- 172.21.15.59:0/3409072874 shutdown_connections 2023-09-21T00:18:00.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.168+0000 7faff86ed700 1 -- 172.21.15.59:0/3409072874 wait complete. 2023-09-21T00:18:00.182 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-09-21T00:18:00.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.305+0000 7f48abbc7700 1 Processor -- start 2023-09-21T00:18:00.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.305+0000 7f48abbc7700 1 -- start start 2023-09-21T00:18:00.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.306+0000 7f48abbc7700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f48a415a230 0x7f48a415e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:00.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.306+0000 7f48abbc7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f48a4071d90 0x7f48a406eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:00.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.306+0000 7f48abbc7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48a40cb1c0 con 0x7f48a40ca790 2023-09-21T00:18:00.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.306+0000 7f48abbc7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48a40cb780 con 0x7f48a4071d90 2023-09-21T00:18:00.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.306+0000 7f48abbc7700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48a40cb4a0 con 0x7f48a415a230 2023-09-21T00:18:00.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.306+0000 7f48aa164700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f48a4071d90 0x7f48a406eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:00.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.306+0000 7f48a9162700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f48a40ca790 0x7f48a4071680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58092/0 (socket says 172.21.15.59:58092) 2023-09-21T00:18:00.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.306+0000 7f48a9162700 1 -- 172.21.15.59:0/830608348 learned_addr learned my addr 172.21.15.59:0/830608348 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:00.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.306+0000 7f48a9963700 1 --2- 172.21.15.59:0/830608348 >> v2:172.21.15.83:3300/0 conn(0x7f48a415a230 0x7f48a415e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:00.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.307+0000 7f48aa164700 1 -- 172.21.15.59:0/830608348 >> v2:172.21.15.83:3300/0 conn(0x7f48a415a230 msgr2=0x7f48a415e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:00.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.307+0000 7f48aa164700 1 --2- 172.21.15.59:0/830608348 >> v2:172.21.15.83:3300/0 conn(0x7f48a415a230 0x7f48a415e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:00.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.307+0000 7f48aa164700 1 -- 172.21.15.59:0/830608348 >> v1:172.21.15.59:6789/0 conn(0x7f48a40ca790 legacy=0x7f48a4071680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:00.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.307+0000 7f48aa164700 1 -- 172.21.15.59:0/830608348 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a415e0b0 con 0x7f48a4071d90 2023-09-21T00:18:00.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.307+0000 7f48a8961700 1 -- 172.21.15.59:0/830608348 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 888079644 0 0) 0x7f48a40cb1c0 con 0x7f48a40ca790 2023-09-21T00:18:00.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.307+0000 7f48aa164700 1 --2- 172.21.15.59:0/830608348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48a4071d90 0x7f48a406eaa0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f48a40cbb60 tx=0x7f489c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d18091c559ce94b server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:00.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.307+0000 7f48a8961700 1 -- 172.21.15.59:0/830608348 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c00e070 con 0x7f48a4071d90 2023-09-21T00:18:00.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.307+0000 7f48a8961700 1 -- 172.21.15.59:0/830608348 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489c00bbd0 con 0x7f48a4071d90 2023-09-21T00:18:00.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.307+0000 7f48a8961700 1 -- 172.21.15.59:0/830608348 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c012430 con 0x7f48a4071d90 2023-09-21T00:18:00.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.307+0000 7f48abbc7700 1 -- 172.21.15.59:0/830608348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48a4071d90 msgr2=0x7f48a406eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:00.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.307+0000 7f48abbc7700 1 --2- 172.21.15.59:0/830608348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48a4071d90 0x7f48a406eaa0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f48a40cbb60 tx=0x7f489c00b330 comp rx=0 tx=0).stop 2023-09-21T00:18:00.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.307+0000 7f48abbc7700 1 -- 172.21.15.59:0/830608348 shutdown_connections 2023-09-21T00:18:00.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.307+0000 7f48abbc7700 1 --2- 172.21.15.59:0/830608348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48a4071d90 0x7f48a406eaa0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:00.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.308+0000 7f48abbc7700 1 --2- 172.21.15.59:0/830608348 >> v2:172.21.15.83:3300/0 conn(0x7f48a415a230 0x7f48a415e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:00.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.308+0000 7f48abbc7700 1 -- 172.21.15.59:0/830608348 >> 172.21.15.59:0/830608348 conn(0x7f48a40d0140 msgr2=0x7f48a40d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:00.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.308+0000 7f48abbc7700 1 -- 172.21.15.59:0/830608348 shutdown_connections 2023-09-21T00:18:00.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.308+0000 7f48abbc7700 1 -- 172.21.15.59:0/830608348 wait complete. 2023-09-21T00:18:00.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.309+0000 7f48abbc7700 1 Processor -- start 2023-09-21T00:18:00.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.309+0000 7f48abbc7700 1 -- start start 2023-09-21T00:18:00.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.310+0000 7f48abbc7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48a4071d90 0x7f48a4151b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:00.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.310+0000 7f48abbc7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48a40ca790 0x7f48a40ae0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:00.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.310+0000 7f48abbc7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f48a415a230 0x7f48a406a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:00.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.310+0000 7f48abbc7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a40aea50 con 0x7f48a4071d90 2023-09-21T00:18:00.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.310+0000 7f48abbc7700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a40aed30 con 0x7f48a40ca790 2023-09-21T00:18:00.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.310+0000 7f48abbc7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a40af010 con 0x7f48a415a230 2023-09-21T00:18:00.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.310+0000 7f48a9963700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48a4071d90 0x7f48a4151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:00.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.310+0000 7f48a9963700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48a4071d90 0x7f48a4151b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52528/0 (socket says 172.21.15.59:52528) 2023-09-21T00:18:00.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.310+0000 7f48a9963700 1 -- 172.21.15.59:0/1782303570 learned_addr learned my addr 172.21.15.59:0/1782303570 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:00.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.310+0000 7f48a9162700 1 --2- 172.21.15.59:0/1782303570 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48a40ca790 0x7f48a40ae0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:00.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.310+0000 7f48aa164700 1 --2- 172.21.15.59:0/1782303570 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f48a415a230 0x7f48a406a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:00.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.310+0000 7f48a9963700 1 -- 172.21.15.59:0/1782303570 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f48a415a230 msgr2=0x7f48a406a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:00.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.310+0000 7f48a9963700 1 --2- 172.21.15.59:0/1782303570 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f48a415a230 0x7f48a406a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:00.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.310+0000 7f48a9963700 1 -- 172.21.15.59:0/1782303570 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48a40ca790 msgr2=0x7f48a40ae0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:00.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.310+0000 7f48a9963700 1 --2- 172.21.15.59:0/1782303570 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48a40ca790 0x7f48a40ae0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:00.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.310+0000 7f48a9963700 1 -- 172.21.15.59:0/1782303570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f489c009a70 con 0x7f48a4071d90 2023-09-21T00:18:00.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.310+0000 7f48aa164700 1 --2- 172.21.15.59:0/1782303570 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f48a415a230 0x7f48a406a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:18:00.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.310+0000 7f48a9963700 1 --2- 172.21.15.59:0/1782303570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48a4071d90 0x7f48a4151b40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f489400d800 tx=0x7f489400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:00.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.310+0000 7f489a7fc700 1 -- 172.21.15.59:0/1782303570 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48940125f0 con 0x7f48a4071d90 2023-09-21T00:18:00.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.310+0000 7f489a7fc700 1 -- 172.21.15.59:0/1782303570 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4894012750 con 0x7f48a4071d90 2023-09-21T00:18:00.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.310+0000 7f48abbc7700 1 -- 172.21.15.59:0/1782303570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48a40af2f0 con 0x7f48a4071d90 2023-09-21T00:18:00.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.310+0000 7f489a7fc700 1 -- 172.21.15.59:0/1782303570 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4894012b00 con 0x7f48a4071d90 2023-09-21T00:18:00.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.310+0000 7f48abbc7700 1 -- 172.21.15.59:0/1782303570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48a40ae620 con 0x7f48a4071d90 2023-09-21T00:18:00.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.311+0000 7f48abbc7700 1 -- 172.21.15.59:0/1782303570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48a40ac890 con 0x7f48a4071d90 2023-09-21T00:18:00.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.312+0000 7f489a7fc700 1 -- 172.21.15.59:0/1782303570 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f4894012c60 con 0x7f48a4071d90 2023-09-21T00:18:00.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.312+0000 7f489a7fc700 1 --2- 172.21.15.59:0/1782303570 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f488806ae00 0x7f488806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:00.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.312+0000 7f489a7fc700 1 -- 172.21.15.59:0/1782303570 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f4894089b90 con 0x7f48a4071d90 2023-09-21T00:18:00.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.312+0000 7f48a9162700 1 --2- 172.21.15.59:0/1782303570 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f488806ae00 0x7f488806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:00.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.313+0000 7f48a9162700 1 --2- 172.21.15.59:0/1782303570 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f488806ae00 0x7f488806d2c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f48a406f130 tx=0x7f48a0007de0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:00.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.317+0000 7f489a7fc700 1 -- 172.21.15.59:0/1782303570 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f4894054930 con 0x7f48a4071d90 2023-09-21T00:18:00.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:00.595+0000 7f48abbc7700 1 -- 172.21.15.59:0/1782303570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f48a4067e50 con 0x7f48a4071d90 2023-09-21T00:18:01.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.143+0000 7f489a7fc700 1 -- 172.21.15.59:0/1782303570 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v70) v1 ==== 147+0+0 (secure 0 0 0) 0x7f4894057f50 con 0x7f48a4071d90 2023-09-21T00:18:01.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.146+0000 7f48abbc7700 1 -- 172.21.15.59:0/1782303570 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f488806ae00 msgr2=0x7f488806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:01.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.146+0000 7f48abbc7700 1 --2- 172.21.15.59:0/1782303570 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f488806ae00 0x7f488806d2c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f48a406f130 tx=0x7f48a0007de0 comp rx=0 tx=0).stop 2023-09-21T00:18:01.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.146+0000 7f48abbc7700 1 -- 172.21.15.59:0/1782303570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48a4071d90 msgr2=0x7f48a4151b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:01.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.146+0000 7f48abbc7700 1 --2- 172.21.15.59:0/1782303570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48a4071d90 0x7f48a4151b40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f489400d800 tx=0x7f489400db10 comp rx=0 tx=0).stop 2023-09-21T00:18:01.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.146+0000 7f48abbc7700 1 -- 172.21.15.59:0/1782303570 shutdown_connections 2023-09-21T00:18:01.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.146+0000 7f48abbc7700 1 --2- 172.21.15.59:0/1782303570 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f488806ae00 0x7f488806d2c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:01.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.146+0000 7f48abbc7700 1 --2- 172.21.15.59:0/1782303570 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f48a415a230 0x7f48a406a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:01.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.146+0000 7f48abbc7700 1 --2- 172.21.15.59:0/1782303570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48a4071d90 0x7f48a4151b40 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:01.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.146+0000 7f48abbc7700 1 --2- 172.21.15.59:0/1782303570 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48a40ca790 0x7f48a40ae0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:01.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.146+0000 7f48abbc7700 1 -- 172.21.15.59:0/1782303570 >> 172.21.15.59:0/1782303570 conn(0x7f48a40d0140 msgr2=0x7f48a40b0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:01.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.146+0000 7f48abbc7700 1 -- 172.21.15.59:0/1782303570 shutdown_connections 2023-09-21T00:18:01.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.146+0000 7f48abbc7700 1 -- 172.21.15.59:0/1782303570 wait complete. 2023-09-21T00:18:01.163 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-09-21T00:18:01.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.297+0000 7fb869a3b700 1 Processor -- start 2023-09-21T00:18:01.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.297+0000 7fb869a3b700 1 -- start start 2023-09-21T00:18:01.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.298+0000 7fb869a3b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb86415d690 0x7fb8640d1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:01.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.298+0000 7fb869a3b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb8640d1a60 0x7fb8640b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:01.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.298+0000 7fb869a3b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8640d2f80 0x7fb8640b5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:01.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.298+0000 7fb869a3b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8640d1ee0 con 0x7fb8640d1a60 2023-09-21T00:18:01.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.298+0000 7fb869a3b700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8640d21c0 con 0x7fb86415d690 2023-09-21T00:18:01.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.298+0000 7fb869a3b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8640d24a0 con 0x7fb8640d2f80 2023-09-21T00:18:01.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.298+0000 7fb8627fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb8640d1a60 0x7fb8640b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:01.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.298+0000 7fb8627fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb8640d1a60 0x7fb8640b4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52538/0 (socket says 172.21.15.59:52538) 2023-09-21T00:18:01.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.298+0000 7fb8627fc700 1 -- 172.21.15.59:0/2658261084 learned_addr learned my addr 172.21.15.59:0/2658261084 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:01.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.298+0000 7fb8627fc700 1 -- 172.21.15.59:0/2658261084 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8640d2f80 msgr2=0x7fb8640b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:01.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.298+0000 7fb8637fe700 1 --2- 172.21.15.59:0/2658261084 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8640d2f80 0x7fb8640b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:01.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.298+0000 7fb862ffd700 1 --2- 172.21.15.59:0/2658261084 >> v2:172.21.15.83:3300/0 conn(0x7fb86415d690 0x7fb8640d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:01.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.298+0000 7fb8627fc700 1 --2- 172.21.15.59:0/2658261084 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8640d2f80 0x7fb8640b5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:01.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.298+0000 7fb8627fc700 1 -- 172.21.15.59:0/2658261084 >> v2:172.21.15.83:3300/0 conn(0x7fb86415d690 msgr2=0x7fb8640d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:01.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.298+0000 7fb8627fc700 1 --2- 172.21.15.59:0/2658261084 >> v2:172.21.15.83:3300/0 conn(0x7fb86415d690 0x7fb8640d1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:01.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.298+0000 7fb8627fc700 1 -- 172.21.15.59:0/2658261084 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8640d2780 con 0x7fb8640d1a60 2023-09-21T00:18:01.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.298+0000 7fb8637fe700 1 --2- 172.21.15.59:0/2658261084 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8640d2f80 0x7fb8640b5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:18:01.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.298+0000 7fb862ffd700 1 --2- 172.21.15.59:0/2658261084 >> v2:172.21.15.83:3300/0 conn(0x7fb86415d690 0x7fb8640d1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:18:01.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.298+0000 7fb8627fc700 1 --2- 172.21.15.59:0/2658261084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8640d1a60 0x7fb8640b4f20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb86406c950 tx=0x7fb854009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0a1d773600b2442 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:01.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.299+0000 7fb861ffb700 1 -- 172.21.15.59:0/2658261084 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85400b870 con 0x7fb8640d1a60 2023-09-21T00:18:01.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.299+0000 7fb861ffb700 1 -- 172.21.15.59:0/2658261084 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85400b9d0 con 0x7fb8640d1a60 2023-09-21T00:18:01.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.299+0000 7fb861ffb700 1 -- 172.21.15.59:0/2658261084 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85400bd60 con 0x7fb8640d1a60 2023-09-21T00:18:01.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.299+0000 7fb869a3b700 1 -- 172.21.15.59:0/2658261084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8640d1a60 msgr2=0x7fb8640b4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:01.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.299+0000 7fb869a3b700 1 --2- 172.21.15.59:0/2658261084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8640d1a60 0x7fb8640b4f20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb86406c950 tx=0x7fb854009bd0 comp rx=0 tx=0).stop 2023-09-21T00:18:01.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.299+0000 7fb869a3b700 1 -- 172.21.15.59:0/2658261084 shutdown_connections 2023-09-21T00:18:01.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.299+0000 7fb869a3b700 1 --2- 172.21.15.59:0/2658261084 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8640d2f80 0x7fb8640b5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:01.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.299+0000 7fb869a3b700 1 --2- 172.21.15.59:0/2658261084 >> v2:172.21.15.83:3300/0 conn(0x7fb86415d690 0x7fb8640d1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:01.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.299+0000 7fb869a3b700 1 --2- 172.21.15.59:0/2658261084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8640d1a60 0x7fb8640b4f20 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:01.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.299+0000 7fb869a3b700 1 -- 172.21.15.59:0/2658261084 >> 172.21.15.59:0/2658261084 conn(0x7fb864072560 msgr2=0x7fb8640cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:01.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.299+0000 7fb869a3b700 1 -- 172.21.15.59:0/2658261084 shutdown_connections 2023-09-21T00:18:01.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.299+0000 7fb869a3b700 1 -- 172.21.15.59:0/2658261084 wait complete. 2023-09-21T00:18:01.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.301+0000 7fb869a3b700 1 Processor -- start 2023-09-21T00:18:01.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.301+0000 7fb869a3b700 1 -- start start 2023-09-21T00:18:01.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.302+0000 7fb869a3b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8640d1a60 0x7fb86415efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:01.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.302+0000 7fb869a3b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8640d2f80 0x7fb864152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:01.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.302+0000 7fb869a3b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb86415d690 0x7fb8640b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:01.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.302+0000 7fb869a3b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb864153120 con 0x7fb8640d1a60 2023-09-21T00:18:01.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.302+0000 7fb869a3b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86415dbf0 con 0x7fb86415d690 2023-09-21T00:18:01.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.302+0000 7fb869a3b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb86415ded0 con 0x7fb8640d2f80 2023-09-21T00:18:01.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.302+0000 7fb862ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8640d1a60 0x7fb86415efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:01.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.302+0000 7fb862ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8640d1a60 0x7fb86415efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52542/0 (socket says 172.21.15.59:52542) 2023-09-21T00:18:01.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.302+0000 7fb862ffd700 1 -- 172.21.15.59:0/3409178232 learned_addr learned my addr 172.21.15.59:0/3409178232 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:01.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.302+0000 7fb8637fe700 1 --2- 172.21.15.59:0/3409178232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb86415d690 0x7fb8640b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:01.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.302+0000 7fb8627fc700 1 --2- 172.21.15.59:0/3409178232 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8640d2f80 0x7fb864152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:01.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.302+0000 7fb862ffd700 1 -- 172.21.15.59:0/3409178232 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8640d2f80 msgr2=0x7fb864152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:01.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.302+0000 7fb862ffd700 1 --2- 172.21.15.59:0/3409178232 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8640d2f80 0x7fb864152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:01.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.302+0000 7fb862ffd700 1 -- 172.21.15.59:0/3409178232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb86415d690 msgr2=0x7fb8640b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:01.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.302+0000 7fb862ffd700 1 --2- 172.21.15.59:0/3409178232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb86415d690 0x7fb8640b3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:01.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.302+0000 7fb862ffd700 1 -- 172.21.15.59:0/3409178232 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb854009550 con 0x7fb8640d1a60 2023-09-21T00:18:01.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.302+0000 7fb8637fe700 1 --2- 172.21.15.59:0/3409178232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb86415d690 0x7fb8640b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:18:01.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.302+0000 7fb8627fc700 1 --2- 172.21.15.59:0/3409178232 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8640d2f80 0x7fb864152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:18:01.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.302+0000 7fb862ffd700 1 --2- 172.21.15.59:0/3409178232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8640d1a60 0x7fb86415efc0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb85800c750 tx=0x7fb85800cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:01.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.302+0000 7fb84bfff700 1 -- 172.21.15.59:0/3409178232 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb858011800 con 0x7fb8640d1a60 2023-09-21T00:18:01.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.302+0000 7fb84bfff700 1 -- 172.21.15.59:0/3409178232 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb858011960 con 0x7fb8640d1a60 2023-09-21T00:18:01.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.302+0000 7fb84bfff700 1 -- 172.21.15.59:0/3409178232 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb858011cd0 con 0x7fb8640d1a60 2023-09-21T00:18:01.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.302+0000 7fb869a3b700 1 -- 172.21.15.59:0/3409178232 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb86415e1b0 con 0x7fb8640d1a60 2023-09-21T00:18:01.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.302+0000 7fb869a3b700 1 -- 172.21.15.59:0/3409178232 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8640c72b0 con 0x7fb8640d1a60 2023-09-21T00:18:01.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.303+0000 7fb869a3b700 1 -- 172.21.15.59:0/3409178232 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb864067e50 con 0x7fb8640d1a60 2023-09-21T00:18:01.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.304+0000 7fb84bfff700 1 -- 172.21.15.59:0/3409178232 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fb858021350 con 0x7fb8640d1a60 2023-09-21T00:18:01.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.304+0000 7fb84bfff700 1 --2- 172.21.15.59:0/3409178232 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fb85006ae00 0x7fb85006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:01.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.304+0000 7fb84bfff700 1 -- 172.21.15.59:0/3409178232 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fb8580899b0 con 0x7fb8640d1a60 2023-09-21T00:18:01.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.305+0000 7fb8627fc700 1 --2- 172.21.15.59:0/3409178232 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fb85006ae00 0x7fb85006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:01.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.305+0000 7fb8627fc700 1 --2- 172.21.15.59:0/3409178232 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fb85006ae00 0x7fb85006d2c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb86406c950 tx=0x7fb854008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:01.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.309+0000 7fb84bfff700 1 -- 172.21.15.59:0/3409178232 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fb858054620 con 0x7fb8640d1a60 2023-09-21T00:18:01.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.513+0000 7fb869a3b700 1 -- 172.21.15.59:0/3409178232 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fb8641547c0 con 0x7fb8640d1a60 2023-09-21T00:18:01.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.518+0000 7fb84bfff700 1 -- 172.21.15.59:0/3409178232 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb858057c40 con 0x7fb8640d1a60 2023-09-21T00:18:01.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.520+0000 7fb869a3b700 1 -- 172.21.15.59:0/3409178232 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fb85006ae00 msgr2=0x7fb85006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:01.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.520+0000 7fb869a3b700 1 --2- 172.21.15.59:0/3409178232 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fb85006ae00 0x7fb85006d2c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb86406c950 tx=0x7fb854008030 comp rx=0 tx=0).stop 2023-09-21T00:18:01.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.520+0000 7fb869a3b700 1 -- 172.21.15.59:0/3409178232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8640d1a60 msgr2=0x7fb86415efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:01.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.520+0000 7fb869a3b700 1 --2- 172.21.15.59:0/3409178232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8640d1a60 0x7fb86415efc0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb85800c750 tx=0x7fb85800cb10 comp rx=0 tx=0).stop 2023-09-21T00:18:01.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.520+0000 7fb869a3b700 1 -- 172.21.15.59:0/3409178232 shutdown_connections 2023-09-21T00:18:01.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.520+0000 7fb869a3b700 1 --2- 172.21.15.59:0/3409178232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb86415d690 0x7fb8640b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:01.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.520+0000 7fb869a3b700 1 --2- 172.21.15.59:0/3409178232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8640d1a60 0x7fb86415efc0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:01.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.520+0000 7fb869a3b700 1 --2- 172.21.15.59:0/3409178232 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fb85006ae00 0x7fb85006d2c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:01.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.520+0000 7fb869a3b700 1 --2- 172.21.15.59:0/3409178232 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8640d2f80 0x7fb864152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:01.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.520+0000 7fb869a3b700 1 -- 172.21.15.59:0/3409178232 >> 172.21.15.59:0/3409178232 conn(0x7fb864072560 msgr2=0x7fb8641535a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:01.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.520+0000 7fb869a3b700 1 -- 172.21.15.59:0/3409178232 shutdown_connections 2023-09-21T00:18:01.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.520+0000 7fb869a3b700 1 -- 172.21.15.59:0/3409178232 wait complete. 2023-09-21T00:18:01.534 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-21T00:18:01.535 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-21T00:18:01.577 DEBUG:teuthology.orchestra.run.smithi083:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-21T00:18:01.622 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-21T00:18:01.623 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-21T00:18:01.623 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-21T00:18:01.641 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-21T00:18:01.642 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-21T00:18:01.699 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-21T00:18:01.700 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-21T00:18:01.757 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T00:18:01.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.921+0000 7f1b3f093700 1 Processor -- start 2023-09-21T00:18:01.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.921+0000 7f1b3f093700 1 -- start start 2023-09-21T00:18:01.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.922+0000 7f1b3f093700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1b380ca790 0x7f1b38071680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:01.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.922+0000 7f1b3f093700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1b380cabf0 0x7f1b38071bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:01.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.922+0000 7f1b3f093700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b380cb1c0 con 0x7f1b3815a230 2023-09-21T00:18:01.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.922+0000 7f1b3f093700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b380cb780 con 0x7f1b380cabf0 2023-09-21T00:18:01.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.922+0000 7f1b3f093700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b380cb4a0 con 0x7f1b380ca790 2023-09-21T00:18:01.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.922+0000 7f1b3ce2f700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1b3815a230 0x7f1b3815e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58118/0 (socket says 172.21.15.59:58118) 2023-09-21T00:18:01.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.922+0000 7f1b3d630700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1b380cabf0 0x7f1b38071bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:01.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.922+0000 7f1b3ce2f700 1 -- 172.21.15.59:0/707377267 learned_addr learned my addr 172.21.15.59:0/707377267 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:01.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.922+0000 7f1b37fff700 1 --2- 172.21.15.59:0/707377267 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1b380ca790 0x7f1b38071680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:01.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.922+0000 7f1b377fe700 1 -- 172.21.15.59:0/707377267 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2126902831 0 0) 0x7f1b380cb1c0 con 0x7f1b3815a230 2023-09-21T00:18:01.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.923+0000 7f1b377fe700 1 -- 172.21.15.59:0/707377267 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b280057c0 con 0x7f1b3815a230 2023-09-21T00:18:01.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.923+0000 7f1b3d630700 1 -- 172.21.15.59:0/707377267 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1b380ca790 msgr2=0x7f1b38071680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:01.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.923+0000 7f1b3d630700 1 --2- 172.21.15.59:0/707377267 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1b380ca790 0x7f1b38071680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:01.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.923+0000 7f1b3d630700 1 -- 172.21.15.59:0/707377267 >> v1:172.21.15.59:6789/0 conn(0x7f1b3815a230 legacy=0x7f1b3815e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:01.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.923+0000 7f1b3d630700 1 -- 172.21.15.59:0/707377267 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b3815e0b0 con 0x7f1b380cabf0 2023-09-21T00:18:01.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.923+0000 7f1b3d630700 1 --2- 172.21.15.59:0/707377267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b380cabf0 0x7f1b38071bc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1b30009d90 tx=0x7f1b3000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cbdc4a4ea7ba5d4 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:01.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.923+0000 7f1b377fe700 1 -- 172.21.15.59:0/707377267 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3000e070 con 0x7f1b380cabf0 2023-09-21T00:18:01.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.923+0000 7f1b377fe700 1 -- 172.21.15.59:0/707377267 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b3000bb20 con 0x7f1b380cabf0 2023-09-21T00:18:01.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.923+0000 7f1b377fe700 1 -- 172.21.15.59:0/707377267 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b30012430 con 0x7f1b380cabf0 2023-09-21T00:18:01.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.923+0000 7f1b3f093700 1 -- 172.21.15.59:0/707377267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b380cabf0 msgr2=0x7f1b38071bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:01.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.923+0000 7f1b3f093700 1 --2- 172.21.15.59:0/707377267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b380cabf0 0x7f1b38071bc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1b30009d90 tx=0x7f1b3000b330 comp rx=0 tx=0).stop 2023-09-21T00:18:01.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.924+0000 7f1b3f093700 1 -- 172.21.15.59:0/707377267 shutdown_connections 2023-09-21T00:18:01.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.924+0000 7f1b3f093700 1 --2- 172.21.15.59:0/707377267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b380cabf0 0x7f1b38071bc0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:01.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.924+0000 7f1b3f093700 1 --2- 172.21.15.59:0/707377267 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1b380ca790 0x7f1b38071680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:01.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.924+0000 7f1b3f093700 1 -- 172.21.15.59:0/707377267 >> 172.21.15.59:0/707377267 conn(0x7f1b380d0140 msgr2=0x7f1b380d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:01.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.924+0000 7f1b3f093700 1 -- 172.21.15.59:0/707377267 shutdown_connections 2023-09-21T00:18:01.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.924+0000 7f1b3f093700 1 -- 172.21.15.59:0/707377267 wait complete. 2023-09-21T00:18:01.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.925+0000 7f1b3f093700 1 Processor -- start 2023-09-21T00:18:01.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.925+0000 7f1b3f093700 1 -- start start 2023-09-21T00:18:01.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.926+0000 7f1b3f093700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b380ca790 0x7f1b380c7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:01.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.926+0000 7f1b3f093700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b380cabf0 0x7f1b38156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:01.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.926+0000 7f1b3f093700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1b3815a230 0x7f1b38156f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:01.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.926+0000 7f1b3f093700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b380c8220 con 0x7f1b380cabf0 2023-09-21T00:18:01.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.926+0000 7f1b3f093700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b38153ec0 con 0x7f1b380ca790 2023-09-21T00:18:01.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.926+0000 7f1b3f093700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b380c8c20 con 0x7f1b3815a230 2023-09-21T00:18:01.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.926+0000 7f1b37fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b380cabf0 0x7f1b38156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:01.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.926+0000 7f1b37fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b380cabf0 0x7f1b38156a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52558/0 (socket says 172.21.15.59:52558) 2023-09-21T00:18:01.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.926+0000 7f1b37fff700 1 -- 172.21.15.59:0/882395058 learned_addr learned my addr 172.21.15.59:0/882395058 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:01.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.926+0000 7f1b3ce2f700 1 --2- 172.21.15.59:0/882395058 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b380ca790 0x7f1b380c7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:01.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.926+0000 7f1b3d630700 1 --2- 172.21.15.59:0/882395058 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1b3815a230 0x7f1b38156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:01.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.926+0000 7f1b37fff700 1 -- 172.21.15.59:0/882395058 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1b3815a230 msgr2=0x7f1b38156f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:01.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.926+0000 7f1b37fff700 1 --2- 172.21.15.59:0/882395058 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1b3815a230 0x7f1b38156f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:01.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.926+0000 7f1b37fff700 1 -- 172.21.15.59:0/882395058 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b380ca790 msgr2=0x7f1b380c7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:01.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.926+0000 7f1b37fff700 1 --2- 172.21.15.59:0/882395058 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b380ca790 0x7f1b380c7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:01.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.926+0000 7f1b37fff700 1 -- 172.21.15.59:0/882395058 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b30009a70 con 0x7f1b380cabf0 2023-09-21T00:18:01.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.927+0000 7f1b37fff700 1 --2- 172.21.15.59:0/882395058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b380cabf0 0x7f1b38156a40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1b2400e9b0 tx=0x7f1b2400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:01.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.927+0000 7f1b357fa700 1 -- 172.21.15.59:0/882395058 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b24009710 con 0x7f1b380cabf0 2023-09-21T00:18:01.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.927+0000 7f1b357fa700 1 -- 172.21.15.59:0/882395058 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2400ee50 con 0x7f1b380cabf0 2023-09-21T00:18:01.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.927+0000 7f1b3f093700 1 -- 172.21.15.59:0/882395058 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b380c7c60 con 0x7f1b380cabf0 2023-09-21T00:18:01.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.927+0000 7f1b357fa700 1 -- 172.21.15.59:0/882395058 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2400ca50 con 0x7f1b380cabf0 2023-09-21T00:18:01.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.927+0000 7f1b3f093700 1 -- 172.21.15.59:0/882395058 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b380c88b0 con 0x7f1b380cabf0 2023-09-21T00:18:01.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.928+0000 7f1b3f093700 1 -- 172.21.15.59:0/882395058 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b38067e50 con 0x7f1b380cabf0 2023-09-21T00:18:01.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.928+0000 7f1b357fa700 1 -- 172.21.15.59:0/882395058 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f1b2400cbb0 con 0x7f1b380cabf0 2023-09-21T00:18:01.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.929+0000 7f1b357fa700 1 --2- 172.21.15.59:0/882395058 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f1b1c06ae00 0x7f1b1c06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:01.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.929+0000 7f1b357fa700 1 -- 172.21.15.59:0/882395058 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f1b240898e0 con 0x7f1b380cabf0 2023-09-21T00:18:01.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.929+0000 7f1b3ce2f700 1 --2- 172.21.15.59:0/882395058 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f1b1c06ae00 0x7f1b1c06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:01.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.930+0000 7f1b3ce2f700 1 --2- 172.21.15.59:0/882395058 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f1b1c06ae00 0x7f1b1c06d2c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c007fd0 tx=0x7f1b2c007dc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:01.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:01.934+0000 7f1b357fa700 1 -- 172.21.15.59:0/882395058 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f1b24054680 con 0x7f1b380cabf0 2023-09-21T00:18:02.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.136+0000 7f1b3f093700 1 -- 172.21.15.59:0/882395058 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b380c8d60 con 0x7f1b380cabf0 2023-09-21T00:18:02.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.137+0000 7f1b357fa700 1 -- 172.21.15.59:0/882395058 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18792 (secure 0 0 0) 0x7f1b2400ce60 con 0x7f1b380cabf0 2023-09-21T00:18:02.140 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:18:02.140 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":26,"fsid":"dd69925c-6e25-42fe-880b-2f60fc6f384b","created":"2023-09-21T00:16:43.074489+0000","modified":"2023-09-21T00:17:50.090179+0000","last_up_change":"2023-09-21T00:16:54.740101+0000","last_in_change":"2023-09-21T00:16:45.987089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T00:16:54.796248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-21T00:17:04.167102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-21T00:17:05.313188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-21T00:17:08.977609+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d4b18344-74c0-4f75-920b-7a9247e48914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6809","nonce":2418314235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6811","nonce":2418314235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6815","nonce":2418314235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6813","nonce":2418314235}]},"public_addr":"172.21.15.59:6809/2418314235","cluster_addr":"172.21.15.59:6811/2418314235","heartbeat_back_addr":"172.21.15.59:6815/2418314235","heartbeat_front_addr":"172.21.15.59:6813/2418314235","state":["exists","up"]},{"osd":1,"uuid":"80940d50-a248-4e64-a282-7ffcdad790ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6801","nonce":869668251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6803","nonce":869668251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6807","nonce":869668251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6805","nonce":869668251}]},"public_addr":"172.21.15.59:6801/869668251","cluster_addr":"172.21.15.59:6803/869668251","heartbeat_back_addr":"172.21.15.59:6807/869668251","heartbeat_front_addr":"172.21.15.59:6805/869668251","state":["exists","up"]},{"osd":2,"uuid":"55f2eceb-c54a-4879-a6ce-968c1c548b5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6817","nonce":372517778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6819","nonce":372517778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6823","nonce":372517778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6821","nonce":372517778}]},"public_addr":"172.21.15.59:6817/372517778","cluster_addr":"172.21.15.59:6819/372517778","heartbeat_back_addr":"172.21.15.59:6823/372517778","heartbeat_front_addr":"172.21.15.59:6821/372517778","state":["exists","up"]},{"osd":3,"uuid":"92b89cd0-869c-49b9-a9f9-97ac8423f304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6825","nonce":575188498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6827","nonce":575188498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6831","nonce":575188498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6829","nonce":575188498}]},"public_addr":"172.21.15.59:6825/575188498","cluster_addr":"172.21.15.59:6827/575188498","heartbeat_back_addr":"172.21.15.59:6831/575188498","heartbeat_front_addr":"172.21.15.59:6829/575188498","state":["exists","up"]},{"osd":4,"uuid":"25b80e94-e0e6-403d-b69f-61542f289637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6803","nonce":1741219098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6805","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6807","nonce":1741219098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6815","nonce":1741219098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6811","nonce":1741219098}]},"public_addr":"172.21.15.83:6803/1741219098","cluster_addr":"172.21.15.83:6807/1741219098","heartbeat_back_addr":"172.21.15.83:6815/1741219098","heartbeat_front_addr":"172.21.15.83:6811/1741219098","state":["exists","up"]},{"osd":5,"uuid":"5498d9ab-1086-4796-a199-9051e6dfea91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6817","nonce":156730565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6819","nonce":156730565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6823","nonce":156730565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6821","nonce":156730565}]},"public_addr":"172.21.15.83:6817/156730565","cluster_addr":"172.21.15.83:6819/156730565","heartbeat_back_addr":"172.21.15.83:6823/156730565","heartbeat_front_addr":"172.21.15.83:6821/156730565","state":["exists","up"]},{"osd":6,"uuid":"cfd810c0-5015-4d60-9a75-7efc93a32e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6801","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6800","nonce":1337723778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6806","nonce":1337723778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6814","nonce":1337723778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6810","nonce":1337723778}]},"public_addr":"172.21.15.83:6800/1337723778","cluster_addr":"172.21.15.83:6806/1337723778","heartbeat_back_addr":"172.21.15.83:6814/1337723778","heartbeat_front_addr":"172.21.15.83:6810/1337723778","state":["exists","up"]},{"osd":7,"uuid":"e992c8fa-0a3d-4b3c-85b5-2c511223dee4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6825","nonce":4204859272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6827","nonce":4204859272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6831","nonce":4204859272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6829","nonce":4204859272}]},"public_addr":"172.21.15.83:6825/4204859272","cluster_addr":"172.21.15.83:6827/4204859272","heartbeat_back_addr":"172.21.15.83:6831/4204859272","heartbeat_front_addr":"172.21.15.83:6829/4204859272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.156498+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.882707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.093978+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.158565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.173933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.888606+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.135525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.149712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":3,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.34","mappings":[{"from":4,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":6}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T00:18:02.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.139+0000 7f1b3f093700 1 -- 172.21.15.59:0/882395058 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f1b1c06ae00 msgr2=0x7f1b1c06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:02.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.139+0000 7f1b3f093700 1 --2- 172.21.15.59:0/882395058 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f1b1c06ae00 0x7f1b1c06d2c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c007fd0 tx=0x7f1b2c007dc0 comp rx=0 tx=0).stop 2023-09-21T00:18:02.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.139+0000 7f1b3f093700 1 -- 172.21.15.59:0/882395058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b380cabf0 msgr2=0x7f1b38156a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:02.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.139+0000 7f1b3f093700 1 --2- 172.21.15.59:0/882395058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b380cabf0 0x7f1b38156a40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1b2400e9b0 tx=0x7f1b2400ecc0 comp rx=0 tx=0).stop 2023-09-21T00:18:02.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.140+0000 7f1b3f093700 1 -- 172.21.15.59:0/882395058 shutdown_connections 2023-09-21T00:18:02.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.140+0000 7f1b3f093700 1 --2- 172.21.15.59:0/882395058 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f1b1c06ae00 0x7f1b1c06d2c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:02.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.140+0000 7f1b3f093700 1 --2- 172.21.15.59:0/882395058 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1b3815a230 0x7f1b38156f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:02.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.140+0000 7f1b3f093700 1 --2- 172.21.15.59:0/882395058 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b380ca790 0x7f1b380c7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:02.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.140+0000 7f1b3f093700 1 --2- 172.21.15.59:0/882395058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b380cabf0 0x7f1b38156a40 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:02.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.140+0000 7f1b3f093700 1 -- 172.21.15.59:0/882395058 >> 172.21.15.59:0/882395058 conn(0x7f1b380d0140 msgr2=0x7f1b380714d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:02.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.140+0000 7f1b3f093700 1 -- 172.21.15.59:0/882395058 shutdown_connections 2023-09-21T00:18:02.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.140+0000 7f1b3f093700 1 -- 172.21.15.59:0/882395058 wait complete. 2023-09-21T00:18:02.154 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-21T00:16:54.796248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-21T00:17:04.167102+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-21T00:17:05.313188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-21T00:17:08.977609+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-21T00:18:02.155 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-21T00:18:02.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.281+0000 7f76414a2700 1 Processor -- start 2023-09-21T00:18:02.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.281+0000 7f76414a2700 1 -- start start 2023-09-21T00:18:02.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.282+0000 7f76414a2700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f763c0c7ed0 0x7f763c06bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:02.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.282+0000 7f76414a2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f763c15db50 con 0x7f763c0cf510 2023-09-21T00:18:02.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.282+0000 7f76414a2700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f763c0cea80 con 0x7f763c15d770 2023-09-21T00:18:02.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.282+0000 7f76414a2700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f763c0ce7a0 con 0x7f763c0c7ed0 2023-09-21T00:18:02.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.282+0000 7f763b7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f763c0cf510 0x7f763c06c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58136/0 (socket says 172.21.15.59:58136) 2023-09-21T00:18:02.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.282+0000 7f763b7fe700 1 -- 172.21.15.59:0/2643452380 learned_addr learned my addr 172.21.15.59:0/2643452380 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:02.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.283+0000 7f763a7fc700 1 --2- 172.21.15.59:0/2643452380 >> v2:172.21.15.83:3300/0 conn(0x7f763c0c7ed0 0x7f763c06bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:02.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.283+0000 7f7639ffb700 1 -- 172.21.15.59:0/2643452380 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 994278553 0 0) 0x7f763c15db50 con 0x7f763c0cf510 2023-09-21T00:18:02.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.283+0000 7f7639ffb700 1 -- 172.21.15.59:0/2643452380 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76240035b0 con 0x7f763c0cf510 2023-09-21T00:18:02.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.283+0000 7f7639ffb700 1 -- 172.21.15.59:0/2643452380 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1557934748 0 0) 0x7f76240035b0 con 0x7f763c0cf510 2023-09-21T00:18:02.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.283+0000 7f7639ffb700 1 -- 172.21.15.59:0/2643452380 >> v2:172.21.15.83:3300/0 conn(0x7f763c0c7ed0 msgr2=0x7f763c06bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:02.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.283+0000 7f7639ffb700 1 --2- 172.21.15.59:0/2643452380 >> v2:172.21.15.83:3300/0 conn(0x7f763c0c7ed0 0x7f763c06bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:02.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.283+0000 7f7639ffb700 1 -- 172.21.15.59:0/2643452380 >> v1:172.21.15.83:6789/0 conn(0x7f763c15d770 legacy=0x7f763c0cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:02.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.283+0000 7f7639ffb700 1 -- 172.21.15.59:0/2643452380 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f763c1612f0 con 0x7f763c0cf510 2023-09-21T00:18:02.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.283+0000 7f7639ffb700 1 -- 172.21.15.59:0/2643452380 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 710825841 0 0) 0x7f76340019f0 con 0x7f763c0cf510 2023-09-21T00:18:02.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.283+0000 7f7639ffb700 1 -- 172.21.15.59:0/2643452380 >> v1:172.21.15.59:6789/0 conn(0x7f763c0cf510 legacy=0x7f763c06c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:02.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.283+0000 7f7639ffb700 1 --2- 172.21.15.59:0/2643452380 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7624003a00 0x7f7624003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:02.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.283+0000 7f7639ffb700 1 --2- 172.21.15.59:0/2643452380 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7624004400 0x7f76240048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:02.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.283+0000 7f7639ffb700 1 --2- 172.21.15.59:0/2643452380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76240050d0 0x7f762400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:02.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.283+0000 7f7639ffb700 1 -- 172.21.15.59:0/2643452380 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f763c0ce7a0 con 0x7f76240050d0 2023-09-21T00:18:02.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.283+0000 7f7639ffb700 1 -- 172.21.15.59:0/2643452380 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762400c030 con 0x7f7624003a00 2023-09-21T00:18:02.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.283+0000 7f7639ffb700 1 -- 172.21.15.59:0/2643452380 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f762400c1f0 con 0x7f7624004400 2023-09-21T00:18:02.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.283+0000 7f763b7fe700 1 --2- 172.21.15.59:0/2643452380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76240050d0 0x7f762400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:02.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.283+0000 7f763affd700 1 --2- 172.21.15.59:0/2643452380 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7624003a00 0x7f7624003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:02.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.283+0000 7f763a7fc700 1 --2- 172.21.15.59:0/2643452380 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7624004400 0x7f76240048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:02.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.284+0000 7f763b7fe700 1 -- 172.21.15.59:0/2643452380 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7624004400 msgr2=0x7f76240048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:02.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.284+0000 7f763b7fe700 1 --2- 172.21.15.59:0/2643452380 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7624004400 0x7f76240048d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:02.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.284+0000 7f763b7fe700 1 -- 172.21.15.59:0/2643452380 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7624003a00 msgr2=0x7f7624003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:02.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.284+0000 7f763b7fe700 1 --2- 172.21.15.59:0/2643452380 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7624003a00 0x7f7624003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:02.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.284+0000 7f763b7fe700 1 -- 172.21.15.59:0/2643452380 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76240035b0 con 0x7f76240050d0 2023-09-21T00:18:02.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.284+0000 7f763b7fe700 1 -- 172.21.15.59:0/2643452380 reap_dead start 2023-09-21T00:18:02.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.284+0000 7f763b7fe700 1 --2- 172.21.15.59:0/2643452380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76240050d0 0x7f762400ba10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f763400a830 tx=0x7f7624005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76215663b4d9e653 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:02.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.284+0000 7f7639ffb700 1 -- 172.21.15.59:0/2643452380 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7634012600 con 0x7f76240050d0 2023-09-21T00:18:02.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.284+0000 7f7639ffb700 1 -- 172.21.15.59:0/2643452380 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7634012780 con 0x7f76240050d0 2023-09-21T00:18:02.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.284+0000 7f7639ffb700 1 -- 172.21.15.59:0/2643452380 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7634012b30 con 0x7f76240050d0 2023-09-21T00:18:02.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.284+0000 7f76414a2700 1 -- 172.21.15.59:0/2643452380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76240050d0 msgr2=0x7f762400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:02.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.284+0000 7f76414a2700 1 --2- 172.21.15.59:0/2643452380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76240050d0 0x7f762400ba10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f763400a830 tx=0x7f7624005880 comp rx=0 tx=0).stop 2023-09-21T00:18:02.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.284+0000 7f76414a2700 1 -- 172.21.15.59:0/2643452380 shutdown_connections 2023-09-21T00:18:02.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.284+0000 7f76414a2700 1 --2- 172.21.15.59:0/2643452380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76240050d0 0x7f762400ba10 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:02.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.284+0000 7f76414a2700 1 -- 172.21.15.59:0/2643452380 >> 172.21.15.59:0/2643452380 conn(0x7f763c0cdcb0 msgr2=0x7f763c0ce090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:02.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.284+0000 7f76414a2700 1 -- 172.21.15.59:0/2643452380 shutdown_connections 2023-09-21T00:18:02.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.284+0000 7f76414a2700 1 -- 172.21.15.59:0/2643452380 wait complete. 2023-09-21T00:18:02.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.286+0000 7f76414a2700 1 Processor -- start 2023-09-21T00:18:02.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.286+0000 7f76414a2700 1 -- start start 2023-09-21T00:18:02.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.287+0000 7f76414a2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76240050d0 0x7f763c15fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:02.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.287+0000 7f76414a2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f763c0c6db0 0x7f763c0c7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:02.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.287+0000 7f76414a2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f763c15dd20 0x7f763c15e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:02.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.287+0000 7f76414a2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f763c15f1a0 con 0x7f76240050d0 2023-09-21T00:18:02.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.287+0000 7f76414a2700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f763c15e710 con 0x7f763c15dd20 2023-09-21T00:18:02.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.287+0000 7f76414a2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f763c0c7770 con 0x7f763c0c6db0 2023-09-21T00:18:02.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.287+0000 7f763affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76240050d0 0x7f763c15fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:02.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.287+0000 7f763affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76240050d0 0x7f763c15fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52576/0 (socket says 172.21.15.59:52576) 2023-09-21T00:18:02.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.287+0000 7f763affd700 1 -- 172.21.15.59:0/3787077710 learned_addr learned my addr 172.21.15.59:0/3787077710 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:02.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.287+0000 7f763a7fc700 1 --2- 172.21.15.59:0/3787077710 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f763c0c6db0 0x7f763c0c7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:02.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.287+0000 7f763b7fe700 1 --2- 172.21.15.59:0/3787077710 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f763c15dd20 0x7f763c15e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:02.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.287+0000 7f763affd700 1 -- 172.21.15.59:0/3787077710 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f763c0c6db0 msgr2=0x7f763c0c7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:02.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.287+0000 7f763affd700 1 --2- 172.21.15.59:0/3787077710 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f763c0c6db0 0x7f763c0c7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:02.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.287+0000 7f763affd700 1 -- 172.21.15.59:0/3787077710 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f763c15dd20 msgr2=0x7f763c15e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:02.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.287+0000 7f763affd700 1 --2- 172.21.15.59:0/3787077710 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f763c15dd20 0x7f763c15e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:02.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.287+0000 7f763affd700 1 -- 172.21.15.59:0/3787077710 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f763c0b6450 con 0x7f76240050d0 2023-09-21T00:18:02.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.287+0000 7f763a7fc700 1 --2- 172.21.15.59:0/3787077710 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f763c0c6db0 0x7f763c0c7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:18:02.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.287+0000 7f763b7fe700 1 --2- 172.21.15.59:0/3787077710 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f763c15dd20 0x7f763c15e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:18:02.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.287+0000 7f763affd700 1 --2- 172.21.15.59:0/3787077710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76240050d0 0x7f763c15fd00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f763000f7c0 tx=0x7f763000fb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:02.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.287+0000 7f76237fe700 1 -- 172.21.15.59:0/3787077710 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76300052e0 con 0x7f76240050d0 2023-09-21T00:18:02.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.287+0000 7f76237fe700 1 -- 172.21.15.59:0/3787077710 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7630005460 con 0x7f76240050d0 2023-09-21T00:18:02.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.287+0000 7f76414a2700 1 -- 172.21.15.59:0/3787077710 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f763c1f28f0 con 0x7f76240050d0 2023-09-21T00:18:02.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.287+0000 7f76237fe700 1 -- 172.21.15.59:0/3787077710 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76300038c0 con 0x7f76240050d0 2023-09-21T00:18:02.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.287+0000 7f76414a2700 1 -- 172.21.15.59:0/3787077710 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f763c15ebe0 con 0x7f76240050d0 2023-09-21T00:18:02.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.288+0000 7f76414a2700 1 -- 172.21.15.59:0/3787077710 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f763c067e50 con 0x7f76240050d0 2023-09-21T00:18:02.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.289+0000 7f76237fe700 1 -- 172.21.15.59:0/3787077710 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f7630003a20 con 0x7f76240050d0 2023-09-21T00:18:02.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.289+0000 7f76237fe700 1 --2- 172.21.15.59:0/3787077710 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f762806ae00 0x7f762806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:02.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.289+0000 7f76237fe700 1 -- 172.21.15.59:0/3787077710 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f7630089800 con 0x7f76240050d0 2023-09-21T00:18:02.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.289+0000 7f763a7fc700 1 --2- 172.21.15.59:0/3787077710 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f762806ae00 0x7f762806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:02.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.290+0000 7f763a7fc700 1 --2- 172.21.15.59:0/3787077710 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f762806ae00 0x7f762806d2c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f763c06d120 tx=0x7f762c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:02.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.293+0000 7f76237fe700 1 -- 172.21.15.59:0/3787077710 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f7630054520 con 0x7f76240050d0 2023-09-21T00:18:02.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.490+0000 7f76414a2700 1 -- 172.21.15.59:0/3787077710 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f763c161880 con 0x7f76240050d0 2023-09-21T00:18:02.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.490+0000 7f76237fe700 1 -- 172.21.15.59:0/3787077710 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7630057b40 con 0x7f76240050d0 2023-09-21T00:18:02.493 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-09-21T00:18:02.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.492+0000 7f76414a2700 1 -- 172.21.15.59:0/3787077710 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f762806ae00 msgr2=0x7f762806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:02.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.492+0000 7f76414a2700 1 --2- 172.21.15.59:0/3787077710 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f762806ae00 0x7f762806d2c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f763c06d120 tx=0x7f762c008040 comp rx=0 tx=0).stop 2023-09-21T00:18:02.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.492+0000 7f76414a2700 1 -- 172.21.15.59:0/3787077710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76240050d0 msgr2=0x7f763c15fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:02.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.492+0000 7f76414a2700 1 --2- 172.21.15.59:0/3787077710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76240050d0 0x7f763c15fd00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f763000f7c0 tx=0x7f763000fb80 comp rx=0 tx=0).stop 2023-09-21T00:18:02.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.492+0000 7f76414a2700 1 -- 172.21.15.59:0/3787077710 shutdown_connections 2023-09-21T00:18:02.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.492+0000 7f76414a2700 1 --2- 172.21.15.59:0/3787077710 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f763c15dd20 0x7f763c15e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:02.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.492+0000 7f76414a2700 1 --2- 172.21.15.59:0/3787077710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76240050d0 0x7f763c15fd00 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:02.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.492+0000 7f76414a2700 1 --2- 172.21.15.59:0/3787077710 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f762806ae00 0x7f762806d2c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:02.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.492+0000 7f76414a2700 1 --2- 172.21.15.59:0/3787077710 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f763c0c6db0 0x7f763c0c7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:02.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.492+0000 7f76414a2700 1 -- 172.21.15.59:0/3787077710 >> 172.21.15.59:0/3787077710 conn(0x7f763c0cdcb0 msgr2=0x7f763c15c600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:02.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.492+0000 7f76414a2700 1 -- 172.21.15.59:0/3787077710 shutdown_connections 2023-09-21T00:18:02.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.492+0000 7f76414a2700 1 -- 172.21.15.59:0/3787077710 wait complete. 2023-09-21T00:18:02.506 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-21T00:18:02.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.633+0000 7f161ec0a700 1 Processor -- start 2023-09-21T00:18:02.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.633+0000 7f161ec0a700 1 -- start start 2023-09-21T00:18:02.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.634+0000 7f161ec0a700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f161815a230 0x7f161815e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:02.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.634+0000 7f161ec0a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f16180ca790 0x7f1618071680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:02.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.634+0000 7f161ec0a700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16180cb1c0 con 0x7f16180cabf0 2023-09-21T00:18:02.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.634+0000 7f161ec0a700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16180cb780 con 0x7f161815a230 2023-09-21T00:18:02.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.634+0000 7f161ec0a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16180cb4a0 con 0x7f16180ca790 2023-09-21T00:18:02.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.635+0000 7f161c9a6700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f161815a230 0x7f161815e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:02.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.635+0000 7f1617fff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f16180ca790 0x7f1618071680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:02.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.635+0000 7f161c9a6700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f161815a230 0x7f161815e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.59:38700/0 (socket says 172.21.15.59:38700) 2023-09-21T00:18:02.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.635+0000 7f161c9a6700 1 -- 172.21.15.59:0/3095182856 learned_addr learned my addr 172.21.15.59:0/3095182856 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:02.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.635+0000 7f161d1a7700 1 --1- 172.21.15.59:0/3095182856 >> v1:172.21.15.83:6789/0 conn(0x7f16180cabf0 0x7f161806eaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.59:48656/0 (socket says 172.21.15.59:48656) 2023-09-21T00:18:02.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.635+0000 7f1617fff700 1 -- 172.21.15.59:0/3095182856 >> v2:172.21.15.83:3300/0 conn(0x7f161815a230 msgr2=0x7f161815e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:02.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.635+0000 7f1617fff700 1 --2- 172.21.15.59:0/3095182856 >> v2:172.21.15.83:3300/0 conn(0x7f161815a230 0x7f161815e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:02.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.635+0000 7f1617fff700 1 -- 172.21.15.59:0/3095182856 >> v1:172.21.15.83:6789/0 conn(0x7f16180cabf0 legacy=0x7f161806eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:02.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.635+0000 7f16177fe700 1 -- 172.21.15.59:0/3095182856 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3422448846 0 0) 0x7f16180cb1c0 con 0x7f16180cabf0 2023-09-21T00:18:02.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.635+0000 7f1617fff700 1 -- 172.21.15.59:0/3095182856 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f161815e0b0 con 0x7f16180ca790 2023-09-21T00:18:02.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.635+0000 7f161c9a6700 1 --2- 172.21.15.59:0/3095182856 >> v2:172.21.15.83:3300/0 conn(0x7f161815a230 0x7f161815e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T00:18:02.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.636+0000 7f1617fff700 1 --2- 172.21.15.59:0/3095182856 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f16180ca790 0x7f1618071680 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1604009840 tx=0x7f1604009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff11d615dbb8fc22 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:02.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.636+0000 7f16177fe700 1 -- 172.21.15.59:0/3095182856 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1604011830 con 0x7f16180ca790 2023-09-21T00:18:02.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.636+0000 7f16177fe700 1 -- 172.21.15.59:0/3095182856 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1604011990 con 0x7f16180ca790 2023-09-21T00:18:02.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.636+0000 7f16177fe700 1 -- 172.21.15.59:0/3095182856 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1604011d20 con 0x7f16180ca790 2023-09-21T00:18:02.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.636+0000 7f161ec0a700 1 -- 172.21.15.59:0/3095182856 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f16180ca790 msgr2=0x7f1618071680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:02.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.636+0000 7f161ec0a700 1 --2- 172.21.15.59:0/3095182856 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f16180ca790 0x7f1618071680 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1604009840 tx=0x7f1604009b50 comp rx=0 tx=0).stop 2023-09-21T00:18:02.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.636+0000 7f161ec0a700 1 -- 172.21.15.59:0/3095182856 shutdown_connections 2023-09-21T00:18:02.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.636+0000 7f161ec0a700 1 --2- 172.21.15.59:0/3095182856 >> v2:172.21.15.83:3300/0 conn(0x7f161815a230 0x7f161815e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:02.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.636+0000 7f161ec0a700 1 --2- 172.21.15.59:0/3095182856 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f16180ca790 0x7f1618071680 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:02.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.636+0000 7f161ec0a700 1 -- 172.21.15.59:0/3095182856 >> 172.21.15.59:0/3095182856 conn(0x7f16180d0140 msgr2=0x7f16180d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:02.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.636+0000 7f161ec0a700 1 -- 172.21.15.59:0/3095182856 shutdown_connections 2023-09-21T00:18:02.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.636+0000 7f161ec0a700 1 -- 172.21.15.59:0/3095182856 wait complete. 2023-09-21T00:18:02.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.637+0000 7f161ec0a700 1 Processor -- start 2023-09-21T00:18:02.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.638+0000 7f161ec0a700 1 -- start start 2023-09-21T00:18:02.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.638+0000 7f161ec0a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f16180ca790 0x7f16180c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:02.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.638+0000 7f161ec0a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16180cabf0 0x7f16180c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:02.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.638+0000 7f161ec0a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f161815a230 0x7f16180ae580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:02.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.638+0000 7f161ec0a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16180c7a00 con 0x7f161815a230 2023-09-21T00:18:02.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.638+0000 7f161ec0a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16180c8360 con 0x7f16180cabf0 2023-09-21T00:18:02.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.638+0000 7f161ec0a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16180aedb0 con 0x7f16180ca790 2023-09-21T00:18:02.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.639+0000 7f161d1a7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f161815a230 0x7f16180ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:02.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.639+0000 7f161d1a7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f161815a230 0x7f16180ae580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52594/0 (socket says 172.21.15.59:52594) 2023-09-21T00:18:02.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.639+0000 7f161d1a7700 1 -- 172.21.15.59:0/1774558727 learned_addr learned my addr 172.21.15.59:0/1774558727 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:02.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.639+0000 7f1617fff700 1 --2- 172.21.15.59:0/1774558727 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16180cabf0 0x7f16180c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:02.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.639+0000 7f161c9a6700 1 --2- 172.21.15.59:0/1774558727 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f16180ca790 0x7f16180c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:02.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.639+0000 7f161d1a7700 1 -- 172.21.15.59:0/1774558727 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f16180ca790 msgr2=0x7f16180c8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:02.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.639+0000 7f161d1a7700 1 --2- 172.21.15.59:0/1774558727 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f16180ca790 0x7f16180c8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:02.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.639+0000 7f161d1a7700 1 -- 172.21.15.59:0/1774558727 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16180cabf0 msgr2=0x7f16180c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:02.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.639+0000 7f161d1a7700 1 --2- 172.21.15.59:0/1774558727 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16180cabf0 0x7f16180c7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:02.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.639+0000 7f161d1a7700 1 -- 172.21.15.59:0/1774558727 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f160c009550 con 0x7f161815a230 2023-09-21T00:18:02.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.639+0000 7f161d1a7700 1 --2- 172.21.15.59:0/1774558727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f161815a230 0x7f16180ae580 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f161000cca0 tx=0x7f161000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:02.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.639+0000 7f16157fa700 1 -- 172.21.15.59:0/1774558727 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161000ab70 con 0x7f161815a230 2023-09-21T00:18:02.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.639+0000 7f16157fa700 1 -- 172.21.15.59:0/1774558727 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161000acd0 con 0x7f161815a230 2023-09-21T00:18:02.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.639+0000 7f161ec0a700 1 -- 172.21.15.59:0/1774558727 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16040094a0 con 0x7f161815a230 2023-09-21T00:18:02.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.639+0000 7f16157fa700 1 -- 172.21.15.59:0/1774558727 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1610007310 con 0x7f161815a230 2023-09-21T00:18:02.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.639+0000 7f161ec0a700 1 -- 172.21.15.59:0/1774558727 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16180c7620 con 0x7f161815a230 2023-09-21T00:18:02.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.640+0000 7f161ec0a700 1 -- 172.21.15.59:0/1774558727 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1618067e50 con 0x7f161815a230 2023-09-21T00:18:02.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.641+0000 7f16157fa700 1 -- 172.21.15.59:0/1774558727 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f1610007470 con 0x7f161815a230 2023-09-21T00:18:02.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.641+0000 7f16157fa700 1 --2- 172.21.15.59:0/1774558727 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f15fc06ae00 0x7f15fc06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:02.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.642+0000 7f16157fa700 1 -- 172.21.15.59:0/1774558727 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f1610089990 con 0x7f161815a230 2023-09-21T00:18:02.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.642+0000 7f161c9a6700 1 --2- 172.21.15.59:0/1774558727 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f15fc06ae00 0x7f15fc06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:02.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.642+0000 7f161c9a6700 1 --2- 172.21.15.59:0/1774558727 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f15fc06ae00 0x7f15fc06d2c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f16180ae1d0 tx=0x7f160c0092c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:02.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.646+0000 7f16157fa700 1 -- 172.21.15.59:0/1774558727 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f1610054810 con 0x7f161815a230 2023-09-21T00:18:02.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.844+0000 7f161ec0a700 1 -- 172.21.15.59:0/1774558727 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1618070040 con 0x7f161815a230 2023-09-21T00:18:02.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.845+0000 7f16157fa700 1 -- 172.21.15.59:0/1774558727 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1610018020 con 0x7f161815a230 2023-09-21T00:18:02.847 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-09-21T00:18:02.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.847+0000 7f161ec0a700 1 -- 172.21.15.59:0/1774558727 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f15fc06ae00 msgr2=0x7f15fc06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:02.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.847+0000 7f161ec0a700 1 --2- 172.21.15.59:0/1774558727 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f15fc06ae00 0x7f15fc06d2c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f16180ae1d0 tx=0x7f160c0092c0 comp rx=0 tx=0).stop 2023-09-21T00:18:02.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.847+0000 7f161ec0a700 1 -- 172.21.15.59:0/1774558727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f161815a230 msgr2=0x7f16180ae580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:02.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.847+0000 7f161ec0a700 1 --2- 172.21.15.59:0/1774558727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f161815a230 0x7f16180ae580 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f161000cca0 tx=0x7f161000a060 comp rx=0 tx=0).stop 2023-09-21T00:18:02.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.847+0000 7f161ec0a700 1 -- 172.21.15.59:0/1774558727 shutdown_connections 2023-09-21T00:18:02.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.847+0000 7f161ec0a700 1 --2- 172.21.15.59:0/1774558727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f161815a230 0x7f16180ae580 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:02.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.847+0000 7f161ec0a700 1 --2- 172.21.15.59:0/1774558727 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f15fc06ae00 0x7f15fc06d2c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:02.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.847+0000 7f161ec0a700 1 --2- 172.21.15.59:0/1774558727 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f16180ca790 0x7f16180c8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:02.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.847+0000 7f161ec0a700 1 --2- 172.21.15.59:0/1774558727 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16180cabf0 0x7f16180c7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:02.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.847+0000 7f161ec0a700 1 -- 172.21.15.59:0/1774558727 >> 172.21.15.59:0/1774558727 conn(0x7f16180d0140 msgr2=0x7f16180cefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:02.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.847+0000 7f161ec0a700 1 -- 172.21.15.59:0/1774558727 shutdown_connections 2023-09-21T00:18:02.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.847+0000 7f161ec0a700 1 -- 172.21.15.59:0/1774558727 wait complete. 2023-09-21T00:18:02.861 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-21T00:18:02.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.989+0000 7f2985391700 1 Processor -- start 2023-09-21T00:18:02.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.990+0000 7f2985391700 1 -- start start 2023-09-21T00:18:02.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.990+0000 7f2985391700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f298015d690 0x7f29800d1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:02.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.990+0000 7f2985391700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f29800d1a60 0x7f29800b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:02.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.990+0000 7f2985391700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29800d1ee0 con 0x7f29800d2f80 2023-09-21T00:18:02.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.990+0000 7f2985391700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29800d21c0 con 0x7f298015d690 2023-09-21T00:18:02.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.990+0000 7f2985391700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29800d24a0 con 0x7f29800d1a60 2023-09-21T00:18:02.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.990+0000 7f297effd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f298015d690 0x7f29800d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:02.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.990+0000 7f297f7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f29800d2f80 0x7f298006b740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58170/0 (socket says 172.21.15.59:58170) 2023-09-21T00:18:02.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.991+0000 7f297f7fe700 1 -- 172.21.15.59:0/1427744917 learned_addr learned my addr 172.21.15.59:0/1427744917 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:02.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.991+0000 7f297effd700 1 --2- 172.21.15.59:0/1427744917 >> v2:172.21.15.59:3300/0 conn(0x7f298015d690 0x7f29800d1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52598/0 (socket says 172.21.15.59:52598) 2023-09-21T00:18:02.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.991+0000 7f297e7fc700 1 --2- 172.21.15.59:0/1427744917 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f29800d1a60 0x7f29800b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:02.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.991+0000 7f297effd700 1 -- 172.21.15.59:0/1427744917 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f29800d1a60 msgr2=0x7f29800b4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:02.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.991+0000 7f297effd700 1 --2- 172.21.15.59:0/1427744917 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f29800d1a60 0x7f29800b4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:02.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.991+0000 7f297effd700 1 -- 172.21.15.59:0/1427744917 >> v1:172.21.15.59:6789/0 conn(0x7f29800d2f80 legacy=0x7f298006b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:02.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.991+0000 7f297effd700 1 -- 172.21.15.59:0/1427744917 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29800d2780 con 0x7f298015d690 2023-09-21T00:18:02.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.991+0000 7f297dffb700 1 -- 172.21.15.59:0/1427744917 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3827820616 0 0) 0x7f29800d1ee0 con 0x7f29800d2f80 2023-09-21T00:18:02.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.991+0000 7f297effd700 1 --2- 172.21.15.59:0/1427744917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f298015d690 0x7f29800d1520 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2974009840 tx=0x7f2974009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b397b040090c77e8 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:02.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.991+0000 7f297dffb700 1 -- 172.21.15.59:0/1427744917 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2974011830 con 0x7f298015d690 2023-09-21T00:18:02.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.991+0000 7f297dffb700 1 -- 172.21.15.59:0/1427744917 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2974011990 con 0x7f298015d690 2023-09-21T00:18:02.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.991+0000 7f297dffb700 1 -- 172.21.15.59:0/1427744917 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2974011d20 con 0x7f298015d690 2023-09-21T00:18:02.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.992+0000 7f2985391700 1 -- 172.21.15.59:0/1427744917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f298015d690 msgr2=0x7f29800d1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:02.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.992+0000 7f2985391700 1 --2- 172.21.15.59:0/1427744917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f298015d690 0x7f29800d1520 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2974009840 tx=0x7f2974009b50 comp rx=0 tx=0).stop 2023-09-21T00:18:02.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.992+0000 7f2985391700 1 -- 172.21.15.59:0/1427744917 shutdown_connections 2023-09-21T00:18:02.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.992+0000 7f2985391700 1 --2- 172.21.15.59:0/1427744917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f298015d690 0x7f29800d1520 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:02.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.992+0000 7f2985391700 1 --2- 172.21.15.59:0/1427744917 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f29800d1a60 0x7f29800b4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:02.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.992+0000 7f2985391700 1 -- 172.21.15.59:0/1427744917 >> 172.21.15.59:0/1427744917 conn(0x7f2980072560 msgr2=0x7f29800cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:02.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.992+0000 7f2985391700 1 -- 172.21.15.59:0/1427744917 shutdown_connections 2023-09-21T00:18:02.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.992+0000 7f2985391700 1 -- 172.21.15.59:0/1427744917 wait complete. 2023-09-21T00:18:03.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.993+0000 7f2985391700 1 Processor -- start 2023-09-21T00:18:03.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.993+0000 7f2985391700 1 -- start start 2023-09-21T00:18:03.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.994+0000 7f2985391700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29800d1a60 0x7f29800c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:03.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.994+0000 7f2985391700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f29800d2f80 0x7f298014d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:03.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.994+0000 7f2985391700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f298015d690 0x7f298014c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:03.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.994+0000 7f2985391700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29800c98f0 con 0x7f29800d1a60 2023-09-21T00:18:03.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.994+0000 7f2985391700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29800c6fd0 con 0x7f298015d690 2023-09-21T00:18:03.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.994+0000 7f2985391700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29800c9050 con 0x7f29800d2f80 2023-09-21T00:18:03.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.994+0000 7f297effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29800d1a60 0x7f29800c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:03.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.994+0000 7f297effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29800d1a60 0x7f29800c8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52604/0 (socket says 172.21.15.59:52604) 2023-09-21T00:18:03.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.994+0000 7f297effd700 1 -- 172.21.15.59:0/1525674242 learned_addr learned my addr 172.21.15.59:0/1525674242 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:03.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.994+0000 7f297e7fc700 1 --2- 172.21.15.59:0/1525674242 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f29800d2f80 0x7f298014d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:03.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.994+0000 7f297f7fe700 1 --2- 172.21.15.59:0/1525674242 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f298015d690 0x7f298014c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:03.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.994+0000 7f297effd700 1 -- 172.21.15.59:0/1525674242 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f29800d2f80 msgr2=0x7f298014d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:03.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.994+0000 7f297effd700 1 --2- 172.21.15.59:0/1525674242 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f29800d2f80 0x7f298014d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:03.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.994+0000 7f297effd700 1 -- 172.21.15.59:0/1525674242 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f298015d690 msgr2=0x7f298014c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:03.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.994+0000 7f297effd700 1 --2- 172.21.15.59:0/1525674242 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f298015d690 0x7f298014c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:03.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.994+0000 7f297effd700 1 -- 172.21.15.59:0/1525674242 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29740094a0 con 0x7f29800d1a60 2023-09-21T00:18:03.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.994+0000 7f297effd700 1 --2- 172.21.15.59:0/1525674242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29800d1a60 0x7f29800c8a70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2974014040 tx=0x7f2974004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:03.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.995+0000 7f29677fe700 1 -- 172.21.15.59:0/1525674242 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29740045f0 con 0x7f29800d1a60 2023-09-21T00:18:03.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.995+0000 7f29677fe700 1 -- 172.21.15.59:0/1525674242 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297401e070 con 0x7f29800d1a60 2023-09-21T00:18:03.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.995+0000 7f2985391700 1 -- 172.21.15.59:0/1525674242 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29800c9330 con 0x7f29800d1a60 2023-09-21T00:18:03.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.995+0000 7f29677fe700 1 -- 172.21.15.59:0/1525674242 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2974003ae0 con 0x7f29800d1a60 2023-09-21T00:18:03.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.995+0000 7f2985391700 1 -- 172.21.15.59:0/1525674242 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29800c71e0 con 0x7f29800d1a60 2023-09-21T00:18:03.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.996+0000 7f2985391700 1 -- 172.21.15.59:0/1525674242 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2980067e50 con 0x7f29800d1a60 2023-09-21T00:18:03.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.996+0000 7f29677fe700 1 -- 172.21.15.59:0/1525674242 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f2974003c40 con 0x7f29800d1a60 2023-09-21T00:18:03.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.996+0000 7f29677fe700 1 --2- 172.21.15.59:0/1525674242 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f296c06ae00 0x7f296c06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:03.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.997+0000 7f29677fe700 1 -- 172.21.15.59:0/1525674242 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f297408aa80 con 0x7f29800d1a60 2023-09-21T00:18:03.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.997+0000 7f297e7fc700 1 --2- 172.21.15.59:0/1525674242 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f296c06ae00 0x7f296c06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:03.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:02.997+0000 7f297e7fc700 1 --2- 172.21.15.59:0/1525674242 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f296c06ae00 0x7f296c06d2c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f29801f6990 tx=0x7f2970008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:03.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.001+0000 7f29677fe700 1 -- 172.21.15.59:0/1525674242 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f2974055820 con 0x7f29800d1a60 2023-09-21T00:18:03.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.200+0000 7f2985391700 1 -- 172.21.15.59:0/1525674242 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f29800b8910 con 0x7f29800d1a60 2023-09-21T00:18:03.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.200+0000 7f29677fe700 1 -- 172.21.15.59:0/1525674242 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2974015020 con 0x7f29800d1a60 2023-09-21T00:18:03.203 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-09-21T00:18:03.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.202+0000 7f2985391700 1 -- 172.21.15.59:0/1525674242 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f296c06ae00 msgr2=0x7f296c06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:03.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.202+0000 7f2985391700 1 --2- 172.21.15.59:0/1525674242 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f296c06ae00 0x7f296c06d2c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f29801f6990 tx=0x7f2970008040 comp rx=0 tx=0).stop 2023-09-21T00:18:03.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.202+0000 7f2985391700 1 -- 172.21.15.59:0/1525674242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29800d1a60 msgr2=0x7f29800c8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:03.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.202+0000 7f2985391700 1 --2- 172.21.15.59:0/1525674242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29800d1a60 0x7f29800c8a70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2974014040 tx=0x7f2974004750 comp rx=0 tx=0).stop 2023-09-21T00:18:03.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.202+0000 7f2985391700 1 -- 172.21.15.59:0/1525674242 shutdown_connections 2023-09-21T00:18:03.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.202+0000 7f2985391700 1 --2- 172.21.15.59:0/1525674242 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f298015d690 0x7f298014c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:03.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.202+0000 7f2985391700 1 --2- 172.21.15.59:0/1525674242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29800d1a60 0x7f29800c8a70 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:03.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.202+0000 7f2985391700 1 --2- 172.21.15.59:0/1525674242 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f296c06ae00 0x7f296c06d2c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:03.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.202+0000 7f2985391700 1 --2- 172.21.15.59:0/1525674242 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f29800d2f80 0x7f298014d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:03.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.202+0000 7f2985391700 1 -- 172.21.15.59:0/1525674242 >> 172.21.15.59:0/1525674242 conn(0x7f2980072560 msgr2=0x7f29800b8200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:03.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.202+0000 7f2985391700 1 -- 172.21.15.59:0/1525674242 shutdown_connections 2023-09-21T00:18:03.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.202+0000 7f2985391700 1 -- 172.21.15.59:0/1525674242 wait complete. 2023-09-21T00:18:03.217 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-21T00:18:03.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.343+0000 7f7c76925700 1 Processor -- start 2023-09-21T00:18:03.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.343+0000 7f7c76925700 1 -- start start 2023-09-21T00:18:03.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.344+0000 7f7c76925700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7c700d0820 0x7f7c7006f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:03.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.344+0000 7f7c76925700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7c700708f0 0x7f7c700b44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:03.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.344+0000 7f7c76925700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c700b4030 con 0x7f7c7015b480 2023-09-21T00:18:03.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.344+0000 7f7c76925700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c700cb8d0 con 0x7f7c700708f0 2023-09-21T00:18:03.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.344+0000 7f7c76925700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c700cbb40 con 0x7f7c700d0820 2023-09-21T00:18:03.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.344+0000 7f7c74ec2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7c700708f0 0x7f7c700b44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:03.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.344+0000 7f7c74ec2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7c700708f0 0x7f7c700b44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52616/0 (socket says 172.21.15.59:52616) 2023-09-21T00:18:03.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.344+0000 7f7c74ec2700 1 -- 172.21.15.59:0/2425920000 learned_addr learned my addr 172.21.15.59:0/2425920000 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:03.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.344+0000 7f7c6f7fe700 1 --2- 172.21.15.59:0/2425920000 >> v2:172.21.15.83:3300/0 conn(0x7f7c700d0820 0x7f7c7006f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:03.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.345+0000 7f7c74ec2700 1 -- 172.21.15.59:0/2425920000 >> v2:172.21.15.83:3300/0 conn(0x7f7c700d0820 msgr2=0x7f7c7006f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:03.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.345+0000 7f7c74ec2700 1 --2- 172.21.15.59:0/2425920000 >> v2:172.21.15.83:3300/0 conn(0x7f7c700d0820 0x7f7c7006f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:03.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.345+0000 7f7c74ec2700 1 -- 172.21.15.59:0/2425920000 >> v1:172.21.15.83:6789/0 conn(0x7f7c7015b480 legacy=0x7f7c700701e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:03.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.345+0000 7f7c74ec2700 1 -- 172.21.15.59:0/2425920000 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c700cbe20 con 0x7f7c700708f0 2023-09-21T00:18:03.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.345+0000 7f7c74ec2700 1 --2- 172.21.15.59:0/2425920000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c700708f0 0x7f7c700b44c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7c7006e300 tx=0x7f7c6800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eb535c21ae57978 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:03.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.345+0000 7f7c6effd700 1 -- 172.21.15.59:0/2425920000 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6800e070 con 0x7f7c700708f0 2023-09-21T00:18:03.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.345+0000 7f7c6effd700 1 -- 172.21.15.59:0/2425920000 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6800b910 con 0x7f7c700708f0 2023-09-21T00:18:03.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.345+0000 7f7c6effd700 1 -- 172.21.15.59:0/2425920000 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6800bcc0 con 0x7f7c700708f0 2023-09-21T00:18:03.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.345+0000 7f7c76925700 1 -- 172.21.15.59:0/2425920000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c700708f0 msgr2=0x7f7c700b44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:03.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.345+0000 7f7c76925700 1 --2- 172.21.15.59:0/2425920000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c700708f0 0x7f7c700b44c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7c7006e300 tx=0x7f7c6800b330 comp rx=0 tx=0).stop 2023-09-21T00:18:03.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.345+0000 7f7c76925700 1 -- 172.21.15.59:0/2425920000 shutdown_connections 2023-09-21T00:18:03.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.346+0000 7f7c76925700 1 --2- 172.21.15.59:0/2425920000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c700708f0 0x7f7c700b44c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:03.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.346+0000 7f7c76925700 1 --2- 172.21.15.59:0/2425920000 >> v2:172.21.15.83:3300/0 conn(0x7f7c700d0820 0x7f7c7006f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:03.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.346+0000 7f7c76925700 1 -- 172.21.15.59:0/2425920000 >> 172.21.15.59:0/2425920000 conn(0x7f7c700d11e0 msgr2=0x7f7c700d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:03.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.346+0000 7f7c76925700 1 -- 172.21.15.59:0/2425920000 shutdown_connections 2023-09-21T00:18:03.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.346+0000 7f7c76925700 1 -- 172.21.15.59:0/2425920000 wait complete. 2023-09-21T00:18:03.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.347+0000 7f7c76925700 1 Processor -- start 2023-09-21T00:18:03.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.347+0000 7f7c76925700 1 -- start start 2023-09-21T00:18:03.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.348+0000 7f7c76925700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c700708f0 0x7f7c700caac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:03.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.348+0000 7f7c76925700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c700d0820 0x7f7c700b0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:03.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.348+0000 7f7c76925700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7c7015b480 0x7f7c7014ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:03.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.348+0000 7f7c76925700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7006be00 con 0x7f7c700708f0 2023-09-21T00:18:03.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.348+0000 7f7c76925700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7006c0e0 con 0x7f7c700d0820 2023-09-21T00:18:03.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.348+0000 7f7c76925700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7006c3c0 con 0x7f7c7015b480 2023-09-21T00:18:03.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.348+0000 7f7c6ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c700708f0 0x7f7c700caac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:03.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.348+0000 7f7c6ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c700708f0 0x7f7c700caac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52618/0 (socket says 172.21.15.59:52618) 2023-09-21T00:18:03.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.348+0000 7f7c6ffff700 1 -- 172.21.15.59:0/4048640570 learned_addr learned my addr 172.21.15.59:0/4048640570 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:03.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.348+0000 7f7c6f7fe700 1 --2- 172.21.15.59:0/4048640570 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c700d0820 0x7f7c700b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:03.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.348+0000 7f7c74ec2700 1 --2- 172.21.15.59:0/4048640570 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7c7015b480 0x7f7c7014ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:03.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.348+0000 7f7c6ffff700 1 -- 172.21.15.59:0/4048640570 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7c7015b480 msgr2=0x7f7c7014ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:03.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.348+0000 7f7c6ffff700 1 --2- 172.21.15.59:0/4048640570 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7c7015b480 0x7f7c7014ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:03.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.348+0000 7f7c6ffff700 1 -- 172.21.15.59:0/4048640570 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c700d0820 msgr2=0x7f7c700b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:03.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.348+0000 7f7c6ffff700 1 --2- 172.21.15.59:0/4048640570 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c700d0820 0x7f7c700b0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:03.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.348+0000 7f7c6ffff700 1 -- 172.21.15.59:0/4048640570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c68009b30 con 0x7f7c700708f0 2023-09-21T00:18:03.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.348+0000 7f7c6ffff700 1 --2- 172.21.15.59:0/4048640570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c700708f0 0x7f7c700caac0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7c6400c4e0 tx=0x7f7c6400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:03.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.349+0000 7f7c6cff9700 1 -- 172.21.15.59:0/4048640570 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c640052d0 con 0x7f7c700708f0 2023-09-21T00:18:03.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.349+0000 7f7c6cff9700 1 -- 172.21.15.59:0/4048640570 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c64005430 con 0x7f7c700708f0 2023-09-21T00:18:03.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.349+0000 7f7c76925700 1 -- 172.21.15.59:0/4048640570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c7015b9e0 con 0x7f7c700708f0 2023-09-21T00:18:03.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.349+0000 7f7c6cff9700 1 -- 172.21.15.59:0/4048640570 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c640038c0 con 0x7f7c700708f0 2023-09-21T00:18:03.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.349+0000 7f7c76925700 1 -- 172.21.15.59:0/4048640570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c7006c980 con 0x7f7c700708f0 2023-09-21T00:18:03.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.350+0000 7f7c76925700 1 -- 172.21.15.59:0/4048640570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c700cf4a0 con 0x7f7c700708f0 2023-09-21T00:18:03.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.350+0000 7f7c6cff9700 1 -- 172.21.15.59:0/4048640570 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f7c64003a20 con 0x7f7c700708f0 2023-09-21T00:18:03.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.351+0000 7f7c6cff9700 1 --2- 172.21.15.59:0/4048640570 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f7c5c06ae00 0x7f7c5c06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:03.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.351+0000 7f7c6cff9700 1 -- 172.21.15.59:0/4048640570 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f7c64088cf0 con 0x7f7c700708f0 2023-09-21T00:18:03.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.351+0000 7f7c6f7fe700 1 --2- 172.21.15.59:0/4048640570 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f7c5c06ae00 0x7f7c5c06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:03.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.351+0000 7f7c6f7fe700 1 --2- 172.21.15.59:0/4048640570 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f7c5c06ae00 0x7f7c5c06d2c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7c700d0660 tx=0x7f7c60009210 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:03.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.355+0000 7f7c6cff9700 1 -- 172.21.15.59:0/4048640570 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f7c6408d070 con 0x7f7c700708f0 2023-09-21T00:18:03.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.554+0000 7f7c76925700 1 -- 172.21.15.59:0/4048640570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f7c70067e50 con 0x7f7c700708f0 2023-09-21T00:18:03.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.554+0000 7f7c6cff9700 1 -- 172.21.15.59:0/4048640570 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7c640170a0 con 0x7f7c700708f0 2023-09-21T00:18:03.556 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-09-21T00:18:03.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.556+0000 7f7c76925700 1 -- 172.21.15.59:0/4048640570 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f7c5c06ae00 msgr2=0x7f7c5c06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:03.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.556+0000 7f7c76925700 1 --2- 172.21.15.59:0/4048640570 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f7c5c06ae00 0x7f7c5c06d2c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7c700d0660 tx=0x7f7c60009210 comp rx=0 tx=0).stop 2023-09-21T00:18:03.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.556+0000 7f7c76925700 1 -- 172.21.15.59:0/4048640570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c700708f0 msgr2=0x7f7c700caac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:03.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.556+0000 7f7c76925700 1 --2- 172.21.15.59:0/4048640570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c700708f0 0x7f7c700caac0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7c6400c4e0 tx=0x7f7c6400c7f0 comp rx=0 tx=0).stop 2023-09-21T00:18:03.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.556+0000 7f7c76925700 1 -- 172.21.15.59:0/4048640570 shutdown_connections 2023-09-21T00:18:03.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.556+0000 7f7c76925700 1 --2- 172.21.15.59:0/4048640570 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f7c5c06ae00 0x7f7c5c06d2c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:03.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.556+0000 7f7c76925700 1 --2- 172.21.15.59:0/4048640570 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7c7015b480 0x7f7c7014ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:03.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.556+0000 7f7c76925700 1 --2- 172.21.15.59:0/4048640570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c700708f0 0x7f7c700caac0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:03.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.556+0000 7f7c76925700 1 --2- 172.21.15.59:0/4048640570 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c700d0820 0x7f7c700b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:03.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.556+0000 7f7c76925700 1 -- 172.21.15.59:0/4048640570 >> 172.21.15.59:0/4048640570 conn(0x7f7c700d11e0 msgr2=0x7f7c700ced90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:03.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.556+0000 7f7c76925700 1 -- 172.21.15.59:0/4048640570 shutdown_connections 2023-09-21T00:18:03.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.556+0000 7f7c76925700 1 -- 172.21.15.59:0/4048640570 wait complete. 2023-09-21T00:18:03.570 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-21T00:18:03.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.694+0000 7efeac2c2700 1 Processor -- start 2023-09-21T00:18:03.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.694+0000 7efeac2c2700 1 -- start start 2023-09-21T00:18:03.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.695+0000 7efeac2c2700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7efea40cc280 0x7efea406f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:03.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.695+0000 7efeac2c2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efea415ea50 0x7efea40cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.695+0000 7efeac2c2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efea415efa0 con 0x7efea415a460 2023-09-21T00:18:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.695+0000 7efeac2c2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efea406fe00 con 0x7efea415ea50 2023-09-21T00:18:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.695+0000 7efeac2c2700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efea406e8f0 con 0x7efea40cc280 2023-09-21T00:18:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.696+0000 7efeaa05e700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7efea415a460 0x7efea40cbb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58194/0 (socket says 172.21.15.59:58194) 2023-09-21T00:18:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.696+0000 7efeaa05e700 1 -- 172.21.15.59:0/2755179125 learned_addr learned my addr 172.21.15.59:0/2755179125 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:03.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.696+0000 7efeaa85f700 1 --2- 172.21.15.59:0/2755179125 >> v2:172.21.15.59:3300/0 conn(0x7efea415ea50 0x7efea40cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:03.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.696+0000 7efea985d700 1 --2- 172.21.15.59:0/2755179125 >> v2:172.21.15.83:3300/0 conn(0x7efea40cc280 0x7efea406f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:03.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.696+0000 7efea905c700 1 -- 172.21.15.59:0/2755179125 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 248895315 0 0) 0x7efea415efa0 con 0x7efea415a460 2023-09-21T00:18:03.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.696+0000 7efea905c700 1 -- 172.21.15.59:0/2755179125 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe900035b0 con 0x7efea415a460 2023-09-21T00:18:03.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.696+0000 7efeaa85f700 1 -- 172.21.15.59:0/2755179125 >> v2:172.21.15.83:3300/0 conn(0x7efea40cc280 msgr2=0x7efea406f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:03.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.696+0000 7efeaa85f700 1 --2- 172.21.15.59:0/2755179125 >> v2:172.21.15.83:3300/0 conn(0x7efea40cc280 0x7efea406f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:03.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.696+0000 7efeaa85f700 1 -- 172.21.15.59:0/2755179125 >> v1:172.21.15.59:6789/0 conn(0x7efea415a460 legacy=0x7efea40cbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:03.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.696+0000 7efeaa85f700 1 -- 172.21.15.59:0/2755179125 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea406eb00 con 0x7efea415ea50 2023-09-21T00:18:03.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.696+0000 7efeaa85f700 1 --2- 172.21.15.59:0/2755179125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efea415ea50 0x7efea40cdc10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7efea40701f0 tx=0x7efe9c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50b007e066eb81c2 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:03.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.696+0000 7efea905c700 1 -- 172.21.15.59:0/2755179125 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9c00e070 con 0x7efea415ea50 2023-09-21T00:18:03.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.696+0000 7efea905c700 1 -- 172.21.15.59:0/2755179125 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe9c00bb20 con 0x7efea415ea50 2023-09-21T00:18:03.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.696+0000 7efea905c700 1 -- 172.21.15.59:0/2755179125 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9c012430 con 0x7efea415ea50 2023-09-21T00:18:03.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.697+0000 7efeac2c2700 1 -- 172.21.15.59:0/2755179125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efea415ea50 msgr2=0x7efea40cdc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:03.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.697+0000 7efeac2c2700 1 --2- 172.21.15.59:0/2755179125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efea415ea50 0x7efea40cdc10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7efea40701f0 tx=0x7efe9c00b330 comp rx=0 tx=0).stop 2023-09-21T00:18:03.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.697+0000 7efeac2c2700 1 -- 172.21.15.59:0/2755179125 shutdown_connections 2023-09-21T00:18:03.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.697+0000 7efeac2c2700 1 --2- 172.21.15.59:0/2755179125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efea415ea50 0x7efea40cdc10 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:03.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.697+0000 7efeac2c2700 1 --2- 172.21.15.59:0/2755179125 >> v2:172.21.15.83:3300/0 conn(0x7efea40cc280 0x7efea406f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:03.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.697+0000 7efeac2c2700 1 -- 172.21.15.59:0/2755179125 >> 172.21.15.59:0/2755179125 conn(0x7efea40ccac0 msgr2=0x7efea40cced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:03.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.697+0000 7efeac2c2700 1 -- 172.21.15.59:0/2755179125 shutdown_connections 2023-09-21T00:18:03.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.697+0000 7efeac2c2700 1 -- 172.21.15.59:0/2755179125 wait complete. 2023-09-21T00:18:03.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.698+0000 7efeac2c2700 1 Processor -- start 2023-09-21T00:18:03.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.698+0000 7efeac2c2700 1 -- start start 2023-09-21T00:18:03.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.699+0000 7efeac2c2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efea40cc280 0x7efea415c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:03.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.699+0000 7efeac2c2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efea415a460 0x7efea40c5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:03.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.699+0000 7efeac2c2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efea415ea50 0x7efea4157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:03.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.699+0000 7efeac2c2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea40c63d0 con 0x7efea415a460 2023-09-21T00:18:03.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.699+0000 7efeac2c2700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea40c5560 con 0x7efea415ea50 2023-09-21T00:18:03.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.699+0000 7efeac2c2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea4157da0 con 0x7efea40cc280 2023-09-21T00:18:03.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.699+0000 7efea985d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efea415a460 0x7efea40c5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:03.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.699+0000 7efea985d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efea415a460 0x7efea40c5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52632/0 (socket says 172.21.15.59:52632) 2023-09-21T00:18:03.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.699+0000 7efea985d700 1 -- 172.21.15.59:0/394790740 learned_addr learned my addr 172.21.15.59:0/394790740 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:03.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.699+0000 7efeaa05e700 1 --2- 172.21.15.59:0/394790740 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efea40cc280 0x7efea415c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:03.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.699+0000 7efeaa85f700 1 --2- 172.21.15.59:0/394790740 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efea415ea50 0x7efea4157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:03.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.699+0000 7efea985d700 1 -- 172.21.15.59:0/394790740 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efea40cc280 msgr2=0x7efea415c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:03.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.699+0000 7efea985d700 1 --2- 172.21.15.59:0/394790740 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efea40cc280 0x7efea415c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:03.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.699+0000 7efea985d700 1 -- 172.21.15.59:0/394790740 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efea415ea50 msgr2=0x7efea4157860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:03.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.699+0000 7efea985d700 1 --2- 172.21.15.59:0/394790740 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efea415ea50 0x7efea4157860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:03.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.699+0000 7efea985d700 1 -- 172.21.15.59:0/394790740 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe9c009a70 con 0x7efea415a460 2023-09-21T00:18:03.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.699+0000 7efeaa05e700 1 --2- 172.21.15.59:0/394790740 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efea40cc280 0x7efea415c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:18:03.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.699+0000 7efeaa85f700 1 --2- 172.21.15.59:0/394790740 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efea415ea50 0x7efea4157860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:18:03.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.700+0000 7efea985d700 1 --2- 172.21.15.59:0/394790740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efea415a460 0x7efea40c5020 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7efe9800d800 tx=0x7efe9800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:03.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.700+0000 7efe96ffd700 1 -- 172.21.15.59:0/394790740 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe980125f0 con 0x7efea415a460 2023-09-21T00:18:03.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.700+0000 7efe96ffd700 1 -- 172.21.15.59:0/394790740 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe98012750 con 0x7efea415a460 2023-09-21T00:18:03.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.700+0000 7efeac2c2700 1 -- 172.21.15.59:0/394790740 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efea40c5750 con 0x7efea415a460 2023-09-21T00:18:03.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.700+0000 7efe96ffd700 1 -- 172.21.15.59:0/394790740 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe98012b00 con 0x7efea415a460 2023-09-21T00:18:03.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.700+0000 7efeac2c2700 1 -- 172.21.15.59:0/394790740 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efea40c5d10 con 0x7efea415a460 2023-09-21T00:18:03.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.701+0000 7efeac2c2700 1 -- 172.21.15.59:0/394790740 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efea40c6510 con 0x7efea415a460 2023-09-21T00:18:03.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.701+0000 7efe96ffd700 1 -- 172.21.15.59:0/394790740 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7efe98012c60 con 0x7efea415a460 2023-09-21T00:18:03.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.702+0000 7efe96ffd700 1 --2- 172.21.15.59:0/394790740 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7efe8806ae00 0x7efe8806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:03.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.702+0000 7efe96ffd700 1 -- 172.21.15.59:0/394790740 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7efe98089c00 con 0x7efea415a460 2023-09-21T00:18:03.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.702+0000 7efeaa05e700 1 --2- 172.21.15.59:0/394790740 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7efe8806ae00 0x7efe8806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:03.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.702+0000 7efeaa05e700 1 --2- 172.21.15.59:0/394790740 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7efe8806ae00 0x7efe8806d2c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efea00011e0 tx=0x7efea0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:03.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.706+0000 7efe96ffd700 1 -- 172.21.15.59:0/394790740 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7efea40c6510 con 0x7efea415a460 2023-09-21T00:18:03.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.919+0000 7efeac2c2700 1 -- 172.21.15.59:0/394790740 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7efea40c6510 con 0x7efea415a460 2023-09-21T00:18:03.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.919+0000 7efe96ffd700 1 -- 172.21.15.59:0/394790740 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7efea40c6510 con 0x7efea415a460 2023-09-21T00:18:03.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.921+0000 7efeac2c2700 1 -- 172.21.15.59:0/394790740 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7efe8806ae00 msgr2=0x7efe8806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:03.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.921+0000 7efeac2c2700 1 --2- 172.21.15.59:0/394790740 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7efe8806ae00 0x7efe8806d2c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efea00011e0 tx=0x7efea0009040 comp rx=0 tx=0).stop 2023-09-21T00:18:03.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.921+0000 7efeac2c2700 1 -- 172.21.15.59:0/394790740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efea415a460 msgr2=0x7efea40c5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:03.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.921+0000 7efeac2c2700 1 --2- 172.21.15.59:0/394790740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efea415a460 0x7efea40c5020 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7efe9800d800 tx=0x7efe9800dbc0 comp rx=0 tx=0).stop 2023-09-21T00:18:03.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.921+0000 7efeac2c2700 1 -- 172.21.15.59:0/394790740 shutdown_connections 2023-09-21T00:18:03.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.921+0000 7efeac2c2700 1 --2- 172.21.15.59:0/394790740 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efea415ea50 0x7efea4157860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:03.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.921+0000 7efeac2c2700 1 --2- 172.21.15.59:0/394790740 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7efe8806ae00 0x7efe8806d2c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:03.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.921+0000 7efeac2c2700 1 --2- 172.21.15.59:0/394790740 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efea40cc280 0x7efea415c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:03.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.921+0000 7efeac2c2700 1 --2- 172.21.15.59:0/394790740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efea415a460 0x7efea40c5020 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:03.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.921+0000 7efeac2c2700 1 -- 172.21.15.59:0/394790740 >> 172.21.15.59:0/394790740 conn(0x7efea40ccac0 msgr2=0x7efea40b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:03.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.921+0000 7efeac2c2700 1 -- 172.21.15.59:0/394790740 shutdown_connections 2023-09-21T00:18:03.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:03.921+0000 7efeac2c2700 1 -- 172.21.15.59:0/394790740 wait complete. 2023-09-21T00:18:03.926 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2023-09-21T00:18:03.935 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-09-21T00:18:03.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:18:03.936 DEBUG:teuthology.orchestra.run.smithi059:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-09-21T00:18:03.982 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2023-09-21T00:18:03.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:18:03.984 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-09-21T00:18:04.001 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-09-21T00:18:04.001 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-21T00:18:04.023 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-09-21T00:18:04.023 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-21T00:18:04.082 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-09-21T00:18:04.083 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-21T00:18:04.142 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T00:18:04.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.266+0000 7fe5bd351700 1 Processor -- start 2023-09-21T00:18:04.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.266+0000 7fe5bd351700 1 -- start start 2023-09-21T00:18:04.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.267+0000 7fe5bd351700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5b80d11b0 0x7fe5b80b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:04.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.267+0000 7fe5bd351700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe5b80d3f00 0x7fe5b80b3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:04.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.267+0000 7fe5bd351700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5b80d1720 con 0x7fe5b815d7e0 2023-09-21T00:18:04.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.267+0000 7fe5bd351700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5b80ced00 con 0x7fe5b80d3f00 2023-09-21T00:18:04.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.267+0000 7fe5bd351700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b80ce360 con 0x7fe5b80d11b0 2023-09-21T00:18:04.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.267+0000 7fe5b6ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe5b815d7e0 0x7fe5b80cf120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58208/0 (socket says 172.21.15.59:58208) 2023-09-21T00:18:04.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.267+0000 7fe5b6ffd700 1 -- 172.21.15.59:0/89646804 learned_addr learned my addr 172.21.15.59:0/89646804 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:04.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.267+0000 7fe5b67fc700 1 --2- 172.21.15.59:0/89646804 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5b80d11b0 0x7fe5b80b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:04.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.267+0000 7fe5b77fe700 1 --2- 172.21.15.59:0/89646804 >> v2:172.21.15.83:3300/0 conn(0x7fe5b80d3f00 0x7fe5b80b3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:04.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.267+0000 7fe5b5ffb700 1 -- 172.21.15.59:0/89646804 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 837187152 0 0) 0x7fe5b80d1720 con 0x7fe5b815d7e0 2023-09-21T00:18:04.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.267+0000 7fe5b5ffb700 1 -- 172.21.15.59:0/89646804 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5a00035b0 con 0x7fe5b815d7e0 2023-09-21T00:18:04.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.267+0000 7fe5b5ffb700 1 -- 172.21.15.59:0/89646804 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2830903448 0 0) 0x7fe5a00035b0 con 0x7fe5b815d7e0 2023-09-21T00:18:04.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.267+0000 7fe5b5ffb700 1 -- 172.21.15.59:0/89646804 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5b80d11b0 msgr2=0x7fe5b80b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:04.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.267+0000 7fe5b5ffb700 1 --2- 172.21.15.59:0/89646804 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5b80d11b0 0x7fe5b80b2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:04.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.267+0000 7fe5b5ffb700 1 -- 172.21.15.59:0/89646804 >> v2:172.21.15.83:3300/0 conn(0x7fe5b80d3f00 msgr2=0x7fe5b80b3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:04.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.267+0000 7fe5b5ffb700 1 --2- 172.21.15.59:0/89646804 >> v2:172.21.15.83:3300/0 conn(0x7fe5b80d3f00 0x7fe5b80b3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:04.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.267+0000 7fe5b5ffb700 1 -- 172.21.15.59:0/89646804 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b80ce640 con 0x7fe5b815d7e0 2023-09-21T00:18:04.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.267+0000 7fe5b5ffb700 1 -- 172.21.15.59:0/89646804 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 710825841 0 0) 0x7fe5ac0017f0 con 0x7fe5b815d7e0 2023-09-21T00:18:04.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.268+0000 7fe5b5ffb700 1 -- 172.21.15.59:0/89646804 >> v1:172.21.15.59:6789/0 conn(0x7fe5b815d7e0 legacy=0x7fe5b80cf120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:04.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.268+0000 7fe5b5ffb700 1 --2- 172.21.15.59:0/89646804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5a0003a70 0x7fe5a0003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:04.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.268+0000 7fe5b5ffb700 1 --2- 172.21.15.59:0/89646804 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5a0004850 0x7fe5a0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:04.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.268+0000 7fe5b5ffb700 1 --2- 172.21.15.59:0/89646804 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5b80d11b0 0x7fe5a0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:04.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.268+0000 7fe5b5ffb700 1 -- 172.21.15.59:0/89646804 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b80ced00 con 0x7fe5a0003a70 2023-09-21T00:18:04.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.268+0000 7fe5b5ffb700 1 -- 172.21.15.59:0/89646804 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b80ce360 con 0x7fe5a0004850 2023-09-21T00:18:04.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.268+0000 7fe5b5ffb700 1 -- 172.21.15.59:0/89646804 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a000ba90 con 0x7fe5b80d11b0 2023-09-21T00:18:04.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.268+0000 7fe5b6ffd700 1 --2- 172.21.15.59:0/89646804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5a0003a70 0x7fe5a0003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:04.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.268+0000 7fe5b67fc700 1 --2- 172.21.15.59:0/89646804 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5a0004850 0x7fe5a0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:04.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.268+0000 7fe5b77fe700 1 --2- 172.21.15.59:0/89646804 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5b80d11b0 0x7fe5a0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:04.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.268+0000 7fe5b6ffd700 1 -- 172.21.15.59:0/89646804 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5b80d11b0 msgr2=0x7fe5a0005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:04.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.268+0000 7fe5b6ffd700 1 --2- 172.21.15.59:0/89646804 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5b80d11b0 0x7fe5a0005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:04.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.268+0000 7fe5b6ffd700 1 -- 172.21.15.59:0/89646804 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5a0004850 msgr2=0x7fe5a0004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:04.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.268+0000 7fe5b6ffd700 1 --2- 172.21.15.59:0/89646804 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5a0004850 0x7fe5a0004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:04.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.268+0000 7fe5b6ffd700 1 -- 172.21.15.59:0/89646804 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a00035b0 con 0x7fe5a0003a70 2023-09-21T00:18:04.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.268+0000 7fe5b6ffd700 1 --2- 172.21.15.59:0/89646804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5a0003a70 0x7fe5a0003e90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac00c240 tx=0x7fe5a0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1fac5bd45afe508 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:04.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.268+0000 7fe5b5ffb700 1 -- 172.21.15.59:0/89646804 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac00cde0 con 0x7fe5a0003a70 2023-09-21T00:18:04.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.268+0000 7fe5b5ffb700 1 -- 172.21.15.59:0/89646804 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5ac007bd0 con 0x7fe5a0003a70 2023-09-21T00:18:04.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.268+0000 7fe5b5ffb700 1 -- 172.21.15.59:0/89646804 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac007310 con 0x7fe5a0003a70 2023-09-21T00:18:04.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.269+0000 7fe5bd351700 1 -- 172.21.15.59:0/89646804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5a0003a70 msgr2=0x7fe5a0003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:04.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.269+0000 7fe5bd351700 1 --2- 172.21.15.59:0/89646804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5a0003a70 0x7fe5a0003e90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac00c240 tx=0x7fe5a0005880 comp rx=0 tx=0).stop 2023-09-21T00:18:04.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.269+0000 7fe5b77fe700 1 -- 172.21.15.59:0/89646804 reap_dead start 2023-09-21T00:18:04.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.269+0000 7fe5bd351700 1 -- 172.21.15.59:0/89646804 shutdown_connections 2023-09-21T00:18:04.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.269+0000 7fe5bd351700 1 -- 172.21.15.59:0/89646804 >> 172.21.15.59:0/89646804 conn(0x7fe5b809c740 msgr2=0x7fe5b80d33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:04.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.269+0000 7fe5bd351700 1 -- 172.21.15.59:0/89646804 shutdown_connections 2023-09-21T00:18:04.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.269+0000 7fe5bd351700 1 -- 172.21.15.59:0/89646804 wait complete. 2023-09-21T00:18:04.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.270+0000 7fe5bd351700 1 Processor -- start 2023-09-21T00:18:04.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.270+0000 7fe5bd351700 1 -- start start 2023-09-21T00:18:04.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.271+0000 7fe5bd351700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5a0003a70 0x7fe5b80cc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:04.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.271+0000 7fe5bd351700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5b8159af0 0x7fe5b80b5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:04.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.271+0000 7fe5bd351700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5b80b2d30 0x7fe5b815ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:04.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.271+0000 7fe5bd351700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b80b52d0 con 0x7fe5b8159af0 2023-09-21T00:18:04.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.271+0000 7fe5bd351700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b80ccc90 con 0x7fe5b80b2d30 2023-09-21T00:18:04.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.271+0000 7fe5bd351700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b80b3280 con 0x7fe5a0003a70 2023-09-21T00:18:04.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.271+0000 7fe5b67fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5b8159af0 0x7fe5b80b5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:04.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.271+0000 7fe5b67fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5b8159af0 0x7fe5b80b5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52654/0 (socket says 172.21.15.59:52654) 2023-09-21T00:18:04.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.271+0000 7fe5b67fc700 1 -- 172.21.15.59:0/3145139422 learned_addr learned my addr 172.21.15.59:0/3145139422 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:04.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.271+0000 7fe5b77fe700 1 --2- 172.21.15.59:0/3145139422 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5b80b2d30 0x7fe5b815ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:04.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.271+0000 7fe5b67fc700 1 -- 172.21.15.59:0/3145139422 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5a0003a70 msgr2=0x7fe5b80cc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:04.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.271+0000 7fe5b67fc700 1 --2- 172.21.15.59:0/3145139422 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5a0003a70 0x7fe5b80cc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:04.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.271+0000 7fe5b67fc700 1 -- 172.21.15.59:0/3145139422 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5b80b2d30 msgr2=0x7fe5b815ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:04.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.271+0000 7fe5b67fc700 1 --2- 172.21.15.59:0/3145139422 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5b80b2d30 0x7fe5b815ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:04.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.271+0000 7fe5b67fc700 1 -- 172.21.15.59:0/3145139422 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b80b49a0 con 0x7fe5b8159af0 2023-09-21T00:18:04.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.272+0000 7fe5b67fc700 1 --2- 172.21.15.59:0/3145139422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5b8159af0 0x7fe5b80b5760 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe5a80119a0 tx=0x7fe5a8011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:04.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.272+0000 7fe59f7fe700 1 -- 172.21.15.59:0/3145139422 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a800f940 con 0x7fe5b8159af0 2023-09-21T00:18:04.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.272+0000 7fe59f7fe700 1 -- 172.21.15.59:0/3145139422 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a800faa0 con 0x7fe5b8159af0 2023-09-21T00:18:04.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.272+0000 7fe59f7fe700 1 -- 172.21.15.59:0/3145139422 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a800fe30 con 0x7fe5b8159af0 2023-09-21T00:18:04.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.272+0000 7fe5bd351700 1 -- 172.21.15.59:0/3145139422 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5b80b4c80 con 0x7fe5b8159af0 2023-09-21T00:18:04.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.272+0000 7fe5bd351700 1 -- 172.21.15.59:0/3145139422 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5b80cd290 con 0x7fe5b8159af0 2023-09-21T00:18:04.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.273+0000 7fe5bd351700 1 -- 172.21.15.59:0/3145139422 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5b80b2ba0 con 0x7fe5b8159af0 2023-09-21T00:18:04.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.273+0000 7fe59f7fe700 1 -- 172.21.15.59:0/3145139422 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fe5a8014440 con 0x7fe5b8159af0 2023-09-21T00:18:04.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.274+0000 7fe59f7fe700 1 --2- 172.21.15.59:0/3145139422 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fe5a406ae00 0x7fe5a406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:04.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.274+0000 7fe59f7fe700 1 -- 172.21.15.59:0/3145139422 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fe5a808a050 con 0x7fe5b8159af0 2023-09-21T00:18:04.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.274+0000 7fe5b6ffd700 1 --2- 172.21.15.59:0/3145139422 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fe5a406ae00 0x7fe5a406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:04.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.274+0000 7fe5b6ffd700 1 --2- 172.21.15.59:0/3145139422 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fe5a406ae00 0x7fe5a406d2c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe5b80b9080 tx=0x7fe5ac00f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:04.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.278+0000 7fe59f7fe700 1 -- 172.21.15.59:0/3145139422 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fe5a8054e10 con 0x7fe5b8159af0 2023-09-21T00:18:04.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.477+0000 7fe5bd351700 1 -- 172.21.15.59:0/3145139422 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5b80d08b0 con 0x7fe5b8159af0 2023-09-21T00:18:04.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.478+0000 7fe59f7fe700 1 -- 172.21.15.59:0/3145139422 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18792 (secure 0 0 0) 0x7fe5b80d08b0 con 0x7fe5b8159af0 2023-09-21T00:18:04.480 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:18:04.480 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":26,"fsid":"dd69925c-6e25-42fe-880b-2f60fc6f384b","created":"2023-09-21T00:16:43.074489+0000","modified":"2023-09-21T00:17:50.090179+0000","last_up_change":"2023-09-21T00:16:54.740101+0000","last_in_change":"2023-09-21T00:16:45.987089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T00:16:54.796248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-21T00:17:04.167102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-21T00:17:05.313188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-21T00:17:08.977609+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d4b18344-74c0-4f75-920b-7a9247e48914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6809","nonce":2418314235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6811","nonce":2418314235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6815","nonce":2418314235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6813","nonce":2418314235}]},"public_addr":"172.21.15.59:6809/2418314235","cluster_addr":"172.21.15.59:6811/2418314235","heartbeat_back_addr":"172.21.15.59:6815/2418314235","heartbeat_front_addr":"172.21.15.59:6813/2418314235","state":["exists","up"]},{"osd":1,"uuid":"80940d50-a248-4e64-a282-7ffcdad790ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6801","nonce":869668251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6803","nonce":869668251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6807","nonce":869668251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6805","nonce":869668251}]},"public_addr":"172.21.15.59:6801/869668251","cluster_addr":"172.21.15.59:6803/869668251","heartbeat_back_addr":"172.21.15.59:6807/869668251","heartbeat_front_addr":"172.21.15.59:6805/869668251","state":["exists","up"]},{"osd":2,"uuid":"55f2eceb-c54a-4879-a6ce-968c1c548b5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6817","nonce":372517778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6819","nonce":372517778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6823","nonce":372517778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6821","nonce":372517778}]},"public_addr":"172.21.15.59:6817/372517778","cluster_addr":"172.21.15.59:6819/372517778","heartbeat_back_addr":"172.21.15.59:6823/372517778","heartbeat_front_addr":"172.21.15.59:6821/372517778","state":["exists","up"]},{"osd":3,"uuid":"92b89cd0-869c-49b9-a9f9-97ac8423f304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6825","nonce":575188498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6827","nonce":575188498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6831","nonce":575188498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6829","nonce":575188498}]},"public_addr":"172.21.15.59:6825/575188498","cluster_addr":"172.21.15.59:6827/575188498","heartbeat_back_addr":"172.21.15.59:6831/575188498","heartbeat_front_addr":"172.21.15.59:6829/575188498","state":["exists","up"]},{"osd":4,"uuid":"25b80e94-e0e6-403d-b69f-61542f289637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6803","nonce":1741219098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6805","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6807","nonce":1741219098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6815","nonce":1741219098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6811","nonce":1741219098}]},"public_addr":"172.21.15.83:6803/1741219098","cluster_addr":"172.21.15.83:6807/1741219098","heartbeat_back_addr":"172.21.15.83:6815/1741219098","heartbeat_front_addr":"172.21.15.83:6811/1741219098","state":["exists","up"]},{"osd":5,"uuid":"5498d9ab-1086-4796-a199-9051e6dfea91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6817","nonce":156730565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6819","nonce":156730565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6823","nonce":156730565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6821","nonce":156730565}]},"public_addr":"172.21.15.83:6817/156730565","cluster_addr":"172.21.15.83:6819/156730565","heartbeat_back_addr":"172.21.15.83:6823/156730565","heartbeat_front_addr":"172.21.15.83:6821/156730565","state":["exists","up"]},{"osd":6,"uuid":"cfd810c0-5015-4d60-9a75-7efc93a32e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6801","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6800","nonce":1337723778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6806","nonce":1337723778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6814","nonce":1337723778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6810","nonce":1337723778}]},"public_addr":"172.21.15.83:6800/1337723778","cluster_addr":"172.21.15.83:6806/1337723778","heartbeat_back_addr":"172.21.15.83:6814/1337723778","heartbeat_front_addr":"172.21.15.83:6810/1337723778","state":["exists","up"]},{"osd":7,"uuid":"e992c8fa-0a3d-4b3c-85b5-2c511223dee4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6825","nonce":4204859272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6827","nonce":4204859272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6831","nonce":4204859272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6829","nonce":4204859272}]},"public_addr":"172.21.15.83:6825/4204859272","cluster_addr":"172.21.15.83:6827/4204859272","heartbeat_back_addr":"172.21.15.83:6831/4204859272","heartbeat_front_addr":"172.21.15.83:6829/4204859272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.156498+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.882707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.093978+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.158565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.173933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.888606+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.135525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.149712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":3,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.34","mappings":[{"from":4,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":6}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T00:18:04.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.480+0000 7fe5bd351700 1 -- 172.21.15.59:0/3145139422 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fe5a406ae00 msgr2=0x7fe5a406d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:04.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.480+0000 7fe5bd351700 1 --2- 172.21.15.59:0/3145139422 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fe5a406ae00 0x7fe5a406d2c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe5b80b9080 tx=0x7fe5ac00f000 comp rx=0 tx=0).stop 2023-09-21T00:18:04.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.480+0000 7fe5bd351700 1 -- 172.21.15.59:0/3145139422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5b8159af0 msgr2=0x7fe5b80b5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:04.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.480+0000 7fe5bd351700 1 --2- 172.21.15.59:0/3145139422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5b8159af0 0x7fe5b80b5760 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe5a80119a0 tx=0x7fe5a8011d60 comp rx=0 tx=0).stop 2023-09-21T00:18:04.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.480+0000 7fe5bd351700 1 -- 172.21.15.59:0/3145139422 shutdown_connections 2023-09-21T00:18:04.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.480+0000 7fe5bd351700 1 --2- 172.21.15.59:0/3145139422 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5b80b2d30 0x7fe5b815ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:04.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.480+0000 7fe5bd351700 1 --2- 172.21.15.59:0/3145139422 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fe5a406ae00 0x7fe5a406d2c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:04.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.480+0000 7fe5bd351700 1 --2- 172.21.15.59:0/3145139422 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe5a0003a70 0x7fe5b80cc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:04.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.480+0000 7fe5bd351700 1 --2- 172.21.15.59:0/3145139422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5b8159af0 0x7fe5b80b5760 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:04.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.480+0000 7fe5bd351700 1 -- 172.21.15.59:0/3145139422 >> 172.21.15.59:0/3145139422 conn(0x7fe5b809c740 msgr2=0x7fe5b806cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:04.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.480+0000 7fe5bd351700 1 -- 172.21.15.59:0/3145139422 shutdown_connections 2023-09-21T00:18:04.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.480+0000 7fe5bd351700 1 -- 172.21.15.59:0/3145139422 wait complete. 2023-09-21T00:18:04.494 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-21T00:16:54.796248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-21T00:17:04.167102+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-21T00:17:05.313188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-21T00:17:08.977609+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-21T00:18:04.495 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-21T00:18:04.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.621+0000 7fc1bc444700 1 Processor -- start 2023-09-21T00:18:04.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.621+0000 7fc1bc444700 1 -- start start 2023-09-21T00:18:04.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.622+0000 7fc1bc444700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1b40ce420 0x7fc1b40cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:04.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.622+0000 7fc1bc444700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc1b406a780 0x7fc1b406abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:04.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.622+0000 7fc1bc444700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b406b110 con 0x7fc1b415b2b0 2023-09-21T00:18:04.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.622+0000 7fc1bc444700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1b40ce250 con 0x7fc1b406a780 2023-09-21T00:18:04.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.622+0000 7fc1bc444700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b41618a0 con 0x7fc1b40ce420 2023-09-21T00:18:04.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.622+0000 7fc1ba9e1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc1b406a780 0x7fc1b406abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:04.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.622+0000 7fc1ba1e0700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc1b415b2b0 0x7fc1b4161190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58228/0 (socket says 172.21.15.59:58228) 2023-09-21T00:18:04.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.622+0000 7fc1ba9e1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc1b406a780 0x7fc1b406abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52664/0 (socket says 172.21.15.59:52664) 2023-09-21T00:18:04.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.622+0000 7fc1ba1e0700 1 -- 172.21.15.59:0/272227713 learned_addr learned my addr 172.21.15.59:0/272227713 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:04.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.622+0000 7fc1b99df700 1 --2- 172.21.15.59:0/272227713 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1b40ce420 0x7fc1b40cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:04.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.622+0000 7fc1ba9e1700 1 -- 172.21.15.59:0/272227713 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1b40ce420 msgr2=0x7fc1b40cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:04.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.622+0000 7fc1ba9e1700 1 --2- 172.21.15.59:0/272227713 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1b40ce420 0x7fc1b40cdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:04.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.622+0000 7fc1ba9e1700 1 -- 172.21.15.59:0/272227713 >> v1:172.21.15.59:6789/0 conn(0x7fc1b415b2b0 legacy=0x7fc1b4161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:04.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.622+0000 7fc1ba9e1700 1 -- 172.21.15.59:0/272227713 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b40cfee0 con 0x7fc1b406a780 2023-09-21T00:18:04.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.622+0000 7fc1b99df700 1 --2- 172.21.15.59:0/272227713 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1b40ce420 0x7fc1b40cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:18:04.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.622+0000 7fc1ba9e1700 1 --2- 172.21.15.59:0/272227713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1b406a780 0x7fc1b406abd0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac009d90 tx=0x7fc1ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c44642f430959059 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:04.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.623+0000 7fc1b91de700 1 -- 172.21.15.59:0/272227713 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac00e070 con 0x7fc1b406a780 2023-09-21T00:18:04.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.623+0000 7fc1b91de700 1 -- 172.21.15.59:0/272227713 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ac00bbd0 con 0x7fc1b406a780 2023-09-21T00:18:04.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.623+0000 7fc1b91de700 1 -- 172.21.15.59:0/272227713 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac012430 con 0x7fc1b406a780 2023-09-21T00:18:04.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.623+0000 7fc1bc444700 1 -- 172.21.15.59:0/272227713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1b406a780 msgr2=0x7fc1b406abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:04.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.623+0000 7fc1bc444700 1 --2- 172.21.15.59:0/272227713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1b406a780 0x7fc1b406abd0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac009d90 tx=0x7fc1ac00b330 comp rx=0 tx=0).stop 2023-09-21T00:18:04.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.623+0000 7fc1bc444700 1 -- 172.21.15.59:0/272227713 shutdown_connections 2023-09-21T00:18:04.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.623+0000 7fc1bc444700 1 --2- 172.21.15.59:0/272227713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1b406a780 0x7fc1b406abd0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:04.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.623+0000 7fc1bc444700 1 --2- 172.21.15.59:0/272227713 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1b40ce420 0x7fc1b40cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:04.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.623+0000 7fc1bc444700 1 -- 172.21.15.59:0/272227713 >> 172.21.15.59:0/272227713 conn(0x7fc1b40d0140 msgr2=0x7fc1b40d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:04.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.623+0000 7fc1bc444700 1 -- 172.21.15.59:0/272227713 shutdown_connections 2023-09-21T00:18:04.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.623+0000 7fc1bc444700 1 -- 172.21.15.59:0/272227713 wait complete. 2023-09-21T00:18:04.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.625+0000 7fc1bc444700 1 Processor -- start 2023-09-21T00:18:04.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.625+0000 7fc1bc444700 1 -- start start 2023-09-21T00:18:04.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.625+0000 7fc1bc444700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc1b406a780 0x7fc1b4148660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:04.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.625+0000 7fc1bc444700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1b40ce420 0x7fc1b4161040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:04.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.625+0000 7fc1bc444700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1b415b2b0 0x7fc1b414ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:04.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.625+0000 7fc1bc444700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b4160c20 con 0x7fc1b415b2b0 2023-09-21T00:18:04.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.625+0000 7fc1bc444700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b4148ba0 con 0x7fc1b406a780 2023-09-21T00:18:04.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.625+0000 7fc1bc444700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b40c6920 con 0x7fc1b40ce420 2023-09-21T00:18:04.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.625+0000 7fc1ba9e1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1b415b2b0 0x7fc1b414ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:04.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.625+0000 7fc1ba9e1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1b415b2b0 0x7fc1b414ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52670/0 (socket says 172.21.15.59:52670) 2023-09-21T00:18:04.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.625+0000 7fc1ba9e1700 1 -- 172.21.15.59:0/4228208153 learned_addr learned my addr 172.21.15.59:0/4228208153 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:04.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.626+0000 7fc1ba1e0700 1 --2- 172.21.15.59:0/4228208153 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc1b406a780 0x7fc1b4148660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:04.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.626+0000 7fc1b99df700 1 --2- 172.21.15.59:0/4228208153 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1b40ce420 0x7fc1b4161040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:04.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.626+0000 7fc1ba9e1700 1 -- 172.21.15.59:0/4228208153 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1b40ce420 msgr2=0x7fc1b4161040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:04.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.626+0000 7fc1ba9e1700 1 --2- 172.21.15.59:0/4228208153 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1b40ce420 0x7fc1b4161040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:04.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.626+0000 7fc1ba9e1700 1 -- 172.21.15.59:0/4228208153 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc1b406a780 msgr2=0x7fc1b4148660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:04.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.626+0000 7fc1ba9e1700 1 --2- 172.21.15.59:0/4228208153 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc1b406a780 0x7fc1b4148660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:04.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.626+0000 7fc1ba9e1700 1 -- 172.21.15.59:0/4228208153 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ac009a70 con 0x7fc1b415b2b0 2023-09-21T00:18:04.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.626+0000 7fc1ba9e1700 1 --2- 172.21.15.59:0/4228208153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1b415b2b0 0x7fc1b414ae60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac014040 tx=0x7fc1ac004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:04.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.626+0000 7fc1aaffd700 1 -- 172.21.15.59:0/4228208153 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac012430 con 0x7fc1b415b2b0 2023-09-21T00:18:04.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.626+0000 7fc1aaffd700 1 -- 172.21.15.59:0/4228208153 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ac020070 con 0x7fc1b415b2b0 2023-09-21T00:18:04.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.626+0000 7fc1bc444700 1 -- 172.21.15.59:0/4228208153 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1b414ba10 con 0x7fc1b415b2b0 2023-09-21T00:18:04.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.626+0000 7fc1aaffd700 1 -- 172.21.15.59:0/4228208153 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac003ea0 con 0x7fc1b415b2b0 2023-09-21T00:18:04.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.626+0000 7fc1bc444700 1 -- 172.21.15.59:0/4228208153 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1b4160840 con 0x7fc1b415b2b0 2023-09-21T00:18:04.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.627+0000 7fc1bc444700 1 -- 172.21.15.59:0/4228208153 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1b4160d60 con 0x7fc1b415b2b0 2023-09-21T00:18:04.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.628+0000 7fc1aaffd700 1 -- 172.21.15.59:0/4228208153 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fc1ac004040 con 0x7fc1b415b2b0 2023-09-21T00:18:04.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.628+0000 7fc1aaffd700 1 --2- 172.21.15.59:0/4228208153 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fc19806ae00 0x7fc19806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:04.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.628+0000 7fc1aaffd700 1 -- 172.21.15.59:0/4228208153 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fc1ac022070 con 0x7fc1b415b2b0 2023-09-21T00:18:04.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.628+0000 7fc1ba1e0700 1 --2- 172.21.15.59:0/4228208153 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fc19806ae00 0x7fc19806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:04.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.629+0000 7fc1ba1e0700 1 --2- 172.21.15.59:0/4228208153 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fc19806ae00 0x7fc19806d2c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4005910 tx=0x7fc1a4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:04.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.633+0000 7fc1aaffd700 1 -- 172.21.15.59:0/4228208153 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fc1b4160d60 con 0x7fc1b415b2b0 2023-09-21T00:18:04.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.834+0000 7fc1bc444700 1 -- 172.21.15.59:0/4228208153 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc1b4160d60 con 0x7fc1b415b2b0 2023-09-21T00:18:04.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.834+0000 7fc1aaffd700 1 -- 172.21.15.59:0/4228208153 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc1b4160d60 con 0x7fc1b415b2b0 2023-09-21T00:18:04.837 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-09-21T00:18:04.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.836+0000 7fc1bc444700 1 -- 172.21.15.59:0/4228208153 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fc19806ae00 msgr2=0x7fc19806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:04.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.836+0000 7fc1bc444700 1 --2- 172.21.15.59:0/4228208153 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fc19806ae00 0x7fc19806d2c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4005910 tx=0x7fc1a4009040 comp rx=0 tx=0).stop 2023-09-21T00:18:04.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.836+0000 7fc1bc444700 1 -- 172.21.15.59:0/4228208153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1b415b2b0 msgr2=0x7fc1b414ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:04.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.836+0000 7fc1bc444700 1 --2- 172.21.15.59:0/4228208153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1b415b2b0 0x7fc1b414ae60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac014040 tx=0x7fc1ac004ad0 comp rx=0 tx=0).stop 2023-09-21T00:18:04.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.836+0000 7fc1bc444700 1 -- 172.21.15.59:0/4228208153 shutdown_connections 2023-09-21T00:18:04.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.836+0000 7fc1bc444700 1 --2- 172.21.15.59:0/4228208153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1b415b2b0 0x7fc1b414ae60 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:04.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.836+0000 7fc1bc444700 1 --2- 172.21.15.59:0/4228208153 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc1b406a780 0x7fc1b4148660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:04.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.836+0000 7fc1bc444700 1 --2- 172.21.15.59:0/4228208153 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fc19806ae00 0x7fc19806d2c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:04.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.836+0000 7fc1bc444700 1 --2- 172.21.15.59:0/4228208153 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1b40ce420 0x7fc1b4161040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:04.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.836+0000 7fc1bc444700 1 -- 172.21.15.59:0/4228208153 >> 172.21.15.59:0/4228208153 conn(0x7fc1b40d0140 msgr2=0x7fc1b406f380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:04.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.837+0000 7fc1bc444700 1 -- 172.21.15.59:0/4228208153 shutdown_connections 2023-09-21T00:18:04.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.837+0000 7fc1bc444700 1 -- 172.21.15.59:0/4228208153 wait complete. 2023-09-21T00:18:04.851 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-21T00:18:04.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.977+0000 7f77f99f8700 1 Processor -- start 2023-09-21T00:18:04.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.977+0000 7f77f99f8700 1 -- start start 2023-09-21T00:18:04.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.978+0000 7f77f99f8700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f77f415d690 0x7f77f40d1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:04.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.978+0000 7f77f99f8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f77f40d1a60 0x7f77f40b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:04.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.978+0000 7f77f99f8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77f40d2f80 0x7f77f40b5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:04.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.978+0000 7f77f99f8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77f40d1ee0 con 0x7f77f40d1a60 2023-09-21T00:18:04.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.978+0000 7f77f99f8700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77f40d21c0 con 0x7f77f415d690 2023-09-21T00:18:04.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.978+0000 7f77f99f8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f40d24a0 con 0x7f77f40d2f80 2023-09-21T00:18:04.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.978+0000 7f77f27fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f77f40d1a60 0x7f77f40b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:04.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.978+0000 7f77f27fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f77f40d1a60 0x7f77f40b4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52674/0 (socket says 172.21.15.59:52674) 2023-09-21T00:18:04.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.978+0000 7f77f27fc700 1 -- 172.21.15.59:0/2235613583 learned_addr learned my addr 172.21.15.59:0/2235613583 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:04.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.978+0000 7f77f2ffd700 1 --2- 172.21.15.59:0/2235613583 >> v2:172.21.15.83:3300/0 conn(0x7f77f415d690 0x7f77f40d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:04.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.978+0000 7f77f37fe700 1 --2- 172.21.15.59:0/2235613583 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77f40d2f80 0x7f77f40b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:04.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.978+0000 7f77f27fc700 1 -- 172.21.15.59:0/2235613583 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77f40d2f80 msgr2=0x7f77f40b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:04.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.978+0000 7f77f27fc700 1 --2- 172.21.15.59:0/2235613583 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77f40d2f80 0x7f77f40b5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:04.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.978+0000 7f77f27fc700 1 -- 172.21.15.59:0/2235613583 >> v2:172.21.15.83:3300/0 conn(0x7f77f415d690 msgr2=0x7f77f40d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:04.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.978+0000 7f77f27fc700 1 --2- 172.21.15.59:0/2235613583 >> v2:172.21.15.83:3300/0 conn(0x7f77f415d690 0x7f77f40d1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:04.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.978+0000 7f77f27fc700 1 -- 172.21.15.59:0/2235613583 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f40d2780 con 0x7f77f40d1a60 2023-09-21T00:18:04.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.979+0000 7f77f27fc700 1 --2- 172.21.15.59:0/2235613583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77f40d1a60 0x7f77f40b4f20 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f77f406c950 tx=0x7f77e4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41abcf14e6a2a362 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:04.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.979+0000 7f77f1ffb700 1 -- 172.21.15.59:0/2235613583 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e400b870 con 0x7f77f40d1a60 2023-09-21T00:18:04.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.979+0000 7f77f1ffb700 1 -- 172.21.15.59:0/2235613583 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e400b9d0 con 0x7f77f40d1a60 2023-09-21T00:18:04.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.979+0000 7f77f1ffb700 1 -- 172.21.15.59:0/2235613583 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e400bd60 con 0x7f77f40d1a60 2023-09-21T00:18:04.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.979+0000 7f77f99f8700 1 -- 172.21.15.59:0/2235613583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77f40d1a60 msgr2=0x7f77f40b4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:04.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.979+0000 7f77f99f8700 1 --2- 172.21.15.59:0/2235613583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77f40d1a60 0x7f77f40b4f20 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f77f406c950 tx=0x7f77e4009bd0 comp rx=0 tx=0).stop 2023-09-21T00:18:04.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.979+0000 7f77f99f8700 1 -- 172.21.15.59:0/2235613583 shutdown_connections 2023-09-21T00:18:04.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.979+0000 7f77f99f8700 1 --2- 172.21.15.59:0/2235613583 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77f40d2f80 0x7f77f40b5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:04.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.979+0000 7f77f99f8700 1 --2- 172.21.15.59:0/2235613583 >> v2:172.21.15.83:3300/0 conn(0x7f77f415d690 0x7f77f40d1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:04.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.979+0000 7f77f99f8700 1 --2- 172.21.15.59:0/2235613583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77f40d1a60 0x7f77f40b4f20 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:04.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.979+0000 7f77f99f8700 1 -- 172.21.15.59:0/2235613583 >> 172.21.15.59:0/2235613583 conn(0x7f77f4072560 msgr2=0x7f77f40cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:04.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.979+0000 7f77f99f8700 1 -- 172.21.15.59:0/2235613583 shutdown_connections 2023-09-21T00:18:04.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.979+0000 7f77f99f8700 1 -- 172.21.15.59:0/2235613583 wait complete. 2023-09-21T00:18:04.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.981+0000 7f77f99f8700 1 Processor -- start 2023-09-21T00:18:04.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.981+0000 7f77f99f8700 1 -- start start 2023-09-21T00:18:04.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.982+0000 7f77f99f8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77f40d1a60 0x7f77f40b7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:04.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.982+0000 7f77f99f8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77f40d2f80 0x7f77f41419e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:04.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.982+0000 7f77f99f8700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77f415d690 0x7f77f41f2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:04.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.982+0000 7f77f99f8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f41f27b0 con 0x7f77f40d1a60 2023-09-21T00:18:04.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.982+0000 7f77f99f8700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f40b3ab0 con 0x7f77f415d690 2023-09-21T00:18:04.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.982+0000 7f77f99f8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f40b3d50 con 0x7f77f40d2f80 2023-09-21T00:18:04.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.982+0000 7f77f2ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77f40d1a60 0x7f77f40b7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:04.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.982+0000 7f77f2ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77f40d1a60 0x7f77f40b7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52680/0 (socket says 172.21.15.59:52680) 2023-09-21T00:18:04.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.982+0000 7f77f2ffd700 1 -- 172.21.15.59:0/2523501631 learned_addr learned my addr 172.21.15.59:0/2523501631 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:04.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.982+0000 7f77f27fc700 1 --2- 172.21.15.59:0/2523501631 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77f40d2f80 0x7f77f41419e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:04.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.982+0000 7f77f37fe700 1 --2- 172.21.15.59:0/2523501631 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77f415d690 0x7f77f41f2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:04.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.982+0000 7f77f2ffd700 1 -- 172.21.15.59:0/2523501631 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77f40d2f80 msgr2=0x7f77f41419e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:04.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.982+0000 7f77f2ffd700 1 --2- 172.21.15.59:0/2523501631 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77f40d2f80 0x7f77f41419e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:04.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.982+0000 7f77f2ffd700 1 -- 172.21.15.59:0/2523501631 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77f415d690 msgr2=0x7f77f41f2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:04.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.982+0000 7f77f2ffd700 1 --2- 172.21.15.59:0/2523501631 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77f415d690 0x7f77f41f2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:04.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.982+0000 7f77f2ffd700 1 -- 172.21.15.59:0/2523501631 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e4009550 con 0x7f77f40d1a60 2023-09-21T00:18:04.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.982+0000 7f77f37fe700 1 --2- 172.21.15.59:0/2523501631 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77f415d690 0x7f77f41f2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:18:04.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.982+0000 7f77f2ffd700 1 --2- 172.21.15.59:0/2523501631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77f40d1a60 0x7f77f40b7aa0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f77e800e810 tx=0x7f77e800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:04.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.982+0000 7f77dbfff700 1 -- 172.21.15.59:0/2523501631 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e8013610 con 0x7f77f40d1a60 2023-09-21T00:18:04.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.982+0000 7f77dbfff700 1 -- 172.21.15.59:0/2523501631 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e8013770 con 0x7f77f40d1a60 2023-09-21T00:18:04.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.982+0000 7f77f99f8700 1 -- 172.21.15.59:0/2523501631 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f40b4030 con 0x7f77f40d1a60 2023-09-21T00:18:04.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.982+0000 7f77dbfff700 1 -- 172.21.15.59:0/2523501631 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e8013b20 con 0x7f77f40d1a60 2023-09-21T00:18:04.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.982+0000 7f77f99f8700 1 -- 172.21.15.59:0/2523501631 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f40b45f0 con 0x7f77f40d1a60 2023-09-21T00:18:04.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.983+0000 7f77f99f8700 1 -- 172.21.15.59:0/2523501631 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77f40b47e0 con 0x7f77f40d1a60 2023-09-21T00:18:04.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.984+0000 7f77dbfff700 1 -- 172.21.15.59:0/2523501631 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f77e8013c80 con 0x7f77f40d1a60 2023-09-21T00:18:04.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.984+0000 7f77dbfff700 1 --2- 172.21.15.59:0/2523501631 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f77e006ae00 0x7f77e006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:04.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.984+0000 7f77dbfff700 1 -- 172.21.15.59:0/2523501631 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f77e8089600 con 0x7f77f40d1a60 2023-09-21T00:18:04.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.984+0000 7f77f27fc700 1 --2- 172.21.15.59:0/2523501631 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f77e006ae00 0x7f77e006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:04.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.985+0000 7f77f27fc700 1 --2- 172.21.15.59:0/2523501631 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f77e006ae00 0x7f77e006d2c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f77f406c950 tx=0x7f77e4008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:04.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:04.989+0000 7f77dbfff700 1 -- 172.21.15.59:0/2523501631 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f77e8054320 con 0x7f77f40d1a60 2023-09-21T00:18:05.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.189+0000 7f77f99f8700 1 -- 172.21.15.59:0/2523501631 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f77f4067e50 con 0x7f77f40d1a60 2023-09-21T00:18:05.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.189+0000 7f77dbfff700 1 -- 172.21.15.59:0/2523501631 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f77e8057940 con 0x7f77f40d1a60 2023-09-21T00:18:05.192 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-09-21T00:18:05.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.191+0000 7f77f99f8700 1 -- 172.21.15.59:0/2523501631 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f77e006ae00 msgr2=0x7f77e006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:05.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.191+0000 7f77f99f8700 1 --2- 172.21.15.59:0/2523501631 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f77e006ae00 0x7f77e006d2c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f77f406c950 tx=0x7f77e4008030 comp rx=0 tx=0).stop 2023-09-21T00:18:05.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.191+0000 7f77f99f8700 1 -- 172.21.15.59:0/2523501631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77f40d1a60 msgr2=0x7f77f40b7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:05.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.191+0000 7f77f99f8700 1 --2- 172.21.15.59:0/2523501631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77f40d1a60 0x7f77f40b7aa0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f77e800e810 tx=0x7f77e800ebd0 comp rx=0 tx=0).stop 2023-09-21T00:18:05.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.191+0000 7f77f99f8700 1 -- 172.21.15.59:0/2523501631 shutdown_connections 2023-09-21T00:18:05.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.191+0000 7f77f99f8700 1 --2- 172.21.15.59:0/2523501631 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77f415d690 0x7f77f41f2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:05.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.191+0000 7f77f99f8700 1 --2- 172.21.15.59:0/2523501631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77f40d1a60 0x7f77f40b7aa0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:05.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.191+0000 7f77f99f8700 1 --2- 172.21.15.59:0/2523501631 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f77e006ae00 0x7f77e006d2c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:05.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.191+0000 7f77f99f8700 1 --2- 172.21.15.59:0/2523501631 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77f40d2f80 0x7f77f41419e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:05.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.191+0000 7f77f99f8700 1 -- 172.21.15.59:0/2523501631 >> 172.21.15.59:0/2523501631 conn(0x7f77f4072560 msgr2=0x7f77f4142240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:05.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.192+0000 7f77f99f8700 1 -- 172.21.15.59:0/2523501631 shutdown_connections 2023-09-21T00:18:05.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.192+0000 7f77f99f8700 1 -- 172.21.15.59:0/2523501631 wait complete. 2023-09-21T00:18:05.206 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-21T00:18:05.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.332+0000 7f36fef1a700 1 Processor -- start 2023-09-21T00:18:05.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.332+0000 7f36fef1a700 1 -- start start 2023-09-21T00:18:05.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.333+0000 7f36fef1a700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f36f815b2b0 0x7f36f80cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:05.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.333+0000 7f36fef1a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36f81618a0 con 0x7f36f80ce420 2023-09-21T00:18:05.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.333+0000 7f36fef1a700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36f80cfee0 con 0x7f36f806a780 2023-09-21T00:18:05.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.333+0000 7f36fef1a700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36f80ce250 con 0x7f36f815b2b0 2023-09-21T00:18:05.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.333+0000 7f36f7fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f36f80ce420 0x7f36f8161190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58256/0 (socket says 172.21.15.59:58256) 2023-09-21T00:18:05.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.333+0000 7f36f7fff700 1 -- 172.21.15.59:0/135806793 learned_addr learned my addr 172.21.15.59:0/135806793 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:05.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.334+0000 7f36fccb6700 1 --2- 172.21.15.59:0/135806793 >> v2:172.21.15.83:3300/0 conn(0x7f36f815b2b0 0x7f36f80cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:05.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.334+0000 7f36f77fe700 1 -- 172.21.15.59:0/135806793 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1970058985 0 0) 0x7f36f81618a0 con 0x7f36f80ce420 2023-09-21T00:18:05.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.334+0000 7f36f77fe700 1 -- 172.21.15.59:0/135806793 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36e80035b0 con 0x7f36f80ce420 2023-09-21T00:18:05.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.334+0000 7f36f77fe700 1 -- 172.21.15.59:0/135806793 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 967538883 0 0) 0x7f36e80035b0 con 0x7f36f80ce420 2023-09-21T00:18:05.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.334+0000 7f36f77fe700 1 -- 172.21.15.59:0/135806793 >> v2:172.21.15.83:3300/0 conn(0x7f36f815b2b0 msgr2=0x7f36f80cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:05.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.334+0000 7f36f77fe700 1 --2- 172.21.15.59:0/135806793 >> v2:172.21.15.83:3300/0 conn(0x7f36f815b2b0 0x7f36f80cdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:05.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.334+0000 7f36f77fe700 1 -- 172.21.15.59:0/135806793 >> v1:172.21.15.83:6789/0 conn(0x7f36f806a780 legacy=0x7f36f815e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:05.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.334+0000 7f36f77fe700 1 -- 172.21.15.59:0/135806793 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f80ce900 con 0x7f36f80ce420 2023-09-21T00:18:05.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.334+0000 7f36f77fe700 1 -- 172.21.15.59:0/135806793 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 710825841 0 0) 0x7f36e4001670 con 0x7f36f80ce420 2023-09-21T00:18:05.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.334+0000 7f36f77fe700 1 -- 172.21.15.59:0/135806793 >> v1:172.21.15.59:6789/0 conn(0x7f36f80ce420 legacy=0x7f36f8161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:05.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.334+0000 7f36f77fe700 1 --2- 172.21.15.59:0/135806793 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f36e8003a00 0x7f36e8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:05.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.334+0000 7f36f77fe700 1 --2- 172.21.15.59:0/135806793 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36e8004850 0x7f36e8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:05.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.334+0000 7f36f77fe700 1 --2- 172.21.15.59:0/135806793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36e8005210 0x7f36e800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:05.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.334+0000 7f36f77fe700 1 -- 172.21.15.59:0/135806793 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e800c080 con 0x7f36e8005210 2023-09-21T00:18:05.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.334+0000 7f36f77fe700 1 -- 172.21.15.59:0/135806793 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e800c1f0 con 0x7f36e8004850 2023-09-21T00:18:05.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.334+0000 7f36f77fe700 1 -- 172.21.15.59:0/135806793 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e800c3b0 con 0x7f36e8003a00 2023-09-21T00:18:05.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.334+0000 7f36fd4b7700 1 --2- 172.21.15.59:0/135806793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36e8005210 0x7f36e800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:05.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.334+0000 7f36f7fff700 1 --2- 172.21.15.59:0/135806793 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36e8004850 0x7f36e8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:05.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.334+0000 7f36fccb6700 1 --2- 172.21.15.59:0/135806793 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f36e8003a00 0x7f36e8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:05.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.334+0000 7f36fd4b7700 1 -- 172.21.15.59:0/135806793 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f36e8003a00 msgr2=0x7f36e8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:05.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.334+0000 7f36fd4b7700 1 --2- 172.21.15.59:0/135806793 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f36e8003a00 0x7f36e8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:05.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.334+0000 7f36fd4b7700 1 -- 172.21.15.59:0/135806793 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36e8004850 msgr2=0x7f36e8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:05.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.334+0000 7f36fd4b7700 1 --2- 172.21.15.59:0/135806793 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36e8004850 0x7f36e8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:05.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.334+0000 7f36fd4b7700 1 -- 172.21.15.59:0/135806793 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e80035b0 con 0x7f36e8005210 2023-09-21T00:18:05.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.335+0000 7f36fd4b7700 1 -- 172.21.15.59:0/135806793 reap_dead start 2023-09-21T00:18:05.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.335+0000 7f36fd4b7700 1 --2- 172.21.15.59:0/135806793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36e8005210 0x7f36e800ba10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f36f000c190 tx=0x7f36e8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a7534bb9fded5bb server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:05.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.335+0000 7f36f77fe700 1 -- 172.21.15.59:0/135806793 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f0001db0 con 0x7f36e8005210 2023-09-21T00:18:05.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.335+0000 7f36f77fe700 1 -- 172.21.15.59:0/135806793 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f000ccf0 con 0x7f36e8005210 2023-09-21T00:18:05.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.335+0000 7f36f77fe700 1 -- 172.21.15.59:0/135806793 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f0003c40 con 0x7f36e8005210 2023-09-21T00:18:05.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.335+0000 7f36fef1a700 1 -- 172.21.15.59:0/135806793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36e8005210 msgr2=0x7f36e800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:05.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.335+0000 7f36fef1a700 1 --2- 172.21.15.59:0/135806793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36e8005210 0x7f36e800ba10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f36f000c190 tx=0x7f36e8005880 comp rx=0 tx=0).stop 2023-09-21T00:18:05.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.335+0000 7f36fef1a700 1 -- 172.21.15.59:0/135806793 shutdown_connections 2023-09-21T00:18:05.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.335+0000 7f36fef1a700 1 --2- 172.21.15.59:0/135806793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36e8005210 0x7f36e800ba10 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:05.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.335+0000 7f36fef1a700 1 -- 172.21.15.59:0/135806793 >> 172.21.15.59:0/135806793 conn(0x7f36f80d0140 msgr2=0x7f36f80d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:05.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.335+0000 7f36fef1a700 1 -- 172.21.15.59:0/135806793 shutdown_connections 2023-09-21T00:18:05.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.335+0000 7f36fef1a700 1 -- 172.21.15.59:0/135806793 wait complete. 2023-09-21T00:18:05.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.337+0000 7f36fef1a700 1 Processor -- start 2023-09-21T00:18:05.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.337+0000 7f36fef1a700 1 -- start start 2023-09-21T00:18:05.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.338+0000 7f36fef1a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36e8005210 0x7f36f814f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:05.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.338+0000 7f36fef1a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36f80af030 0x7f36f80c7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:05.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.338+0000 7f36fef1a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f36f80ae420 0x7f36f80ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:05.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.338+0000 7f36fef1a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f80b4440 con 0x7f36e8005210 2023-09-21T00:18:05.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.338+0000 7f36fef1a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f80aee10 con 0x7f36f80af030 2023-09-21T00:18:05.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.338+0000 7f36fef1a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f80b40f0 con 0x7f36f80ae420 2023-09-21T00:18:05.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.338+0000 7f36fccb6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36e8005210 0x7f36f814f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:05.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.338+0000 7f36fccb6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36e8005210 0x7f36f814f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52700/0 (socket says 172.21.15.59:52700) 2023-09-21T00:18:05.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.338+0000 7f36fccb6700 1 -- 172.21.15.59:0/1772605729 learned_addr learned my addr 172.21.15.59:0/1772605729 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:05.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.339+0000 7f36fccb6700 1 -- 172.21.15.59:0/1772605729 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f36f80ae420 msgr2=0x7f36f80ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:05.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.339+0000 7f36f7fff700 1 --2- 172.21.15.59:0/1772605729 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36f80af030 0x7f36f80c7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:05.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.339+0000 7f36fccb6700 1 --2- 172.21.15.59:0/1772605729 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f36f80ae420 0x7f36f80ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:05.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.339+0000 7f36fccb6700 1 -- 172.21.15.59:0/1772605729 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36f80af030 msgr2=0x7f36f80c7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:05.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.339+0000 7f36fccb6700 1 --2- 172.21.15.59:0/1772605729 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36f80af030 0x7f36f80c7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:05.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.339+0000 7f36fccb6700 1 -- 172.21.15.59:0/1772605729 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f80c82e0 con 0x7f36e8005210 2023-09-21T00:18:05.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.339+0000 7f36fccb6700 1 --2- 172.21.15.59:0/1772605729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36e8005210 0x7f36f814f740 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f36ec0119a0 tx=0x7f36ec011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:05.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.339+0000 7f36f57fa700 1 -- 172.21.15.59:0/1772605729 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec00f8c0 con 0x7f36e8005210 2023-09-21T00:18:05.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.339+0000 7f36f57fa700 1 -- 172.21.15.59:0/1772605729 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ec00fa20 con 0x7f36e8005210 2023-09-21T00:18:05.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.339+0000 7f36fef1a700 1 -- 172.21.15.59:0/1772605729 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36f80c85c0 con 0x7f36e8005210 2023-09-21T00:18:05.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.339+0000 7f36f57fa700 1 -- 172.21.15.59:0/1772605729 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec00fdb0 con 0x7f36e8005210 2023-09-21T00:18:05.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.339+0000 7f36fef1a700 1 -- 172.21.15.59:0/1772605729 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f814fc80 con 0x7f36e8005210 2023-09-21T00:18:05.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.340+0000 7f36fef1a700 1 -- 172.21.15.59:0/1772605729 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36f80b46b0 con 0x7f36e8005210 2023-09-21T00:18:05.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.340+0000 7f36f57fa700 1 -- 172.21.15.59:0/1772605729 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f36ec014440 con 0x7f36e8005210 2023-09-21T00:18:05.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.341+0000 7f36f57fa700 1 --2- 172.21.15.59:0/1772605729 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f36dc06ae00 0x7f36dc06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:05.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.341+0000 7f36f57fa700 1 -- 172.21.15.59:0/1772605729 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f36ec089f50 con 0x7f36e8005210 2023-09-21T00:18:05.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.341+0000 7f36f7fff700 1 --2- 172.21.15.59:0/1772605729 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f36dc06ae00 0x7f36dc06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:05.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.341+0000 7f36f7fff700 1 --2- 172.21.15.59:0/1772605729 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f36dc06ae00 0x7f36dc06d2c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f36e4001050 tx=0x7f36e4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:05.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.345+0000 7f36f57fa700 1 -- 172.21.15.59:0/1772605729 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f36ec054cf0 con 0x7f36e8005210 2023-09-21T00:18:05.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.543+0000 7f36fef1a700 1 -- 172.21.15.59:0/1772605729 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f36f80c8ae0 con 0x7f36e8005210 2023-09-21T00:18:05.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.544+0000 7f36f57fa700 1 -- 172.21.15.59:0/1772605729 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f36ec058310 con 0x7f36e8005210 2023-09-21T00:18:05.546 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-09-21T00:18:05.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.546+0000 7f36fef1a700 1 -- 172.21.15.59:0/1772605729 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f36dc06ae00 msgr2=0x7f36dc06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:05.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.546+0000 7f36fef1a700 1 --2- 172.21.15.59:0/1772605729 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f36dc06ae00 0x7f36dc06d2c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f36e4001050 tx=0x7f36e4009040 comp rx=0 tx=0).stop 2023-09-21T00:18:05.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.546+0000 7f36fef1a700 1 -- 172.21.15.59:0/1772605729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36e8005210 msgr2=0x7f36f814f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:05.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.546+0000 7f36fef1a700 1 --2- 172.21.15.59:0/1772605729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36e8005210 0x7f36f814f740 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f36ec0119a0 tx=0x7f36ec011d60 comp rx=0 tx=0).stop 2023-09-21T00:18:05.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.546+0000 7f36fef1a700 1 -- 172.21.15.59:0/1772605729 shutdown_connections 2023-09-21T00:18:05.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.546+0000 7f36fef1a700 1 --2- 172.21.15.59:0/1772605729 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f36dc06ae00 0x7f36dc06d2c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:05.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.546+0000 7f36fef1a700 1 --2- 172.21.15.59:0/1772605729 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f36f80ae420 0x7f36f80ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:05.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.546+0000 7f36fef1a700 1 --2- 172.21.15.59:0/1772605729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36e8005210 0x7f36f814f740 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:05.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.546+0000 7f36fef1a700 1 --2- 172.21.15.59:0/1772605729 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36f80af030 0x7f36f80c7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:05.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.546+0000 7f36fef1a700 1 -- 172.21.15.59:0/1772605729 >> 172.21.15.59:0/1772605729 conn(0x7f36f80d0140 msgr2=0x7f36f806f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:05.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.546+0000 7f36fef1a700 1 -- 172.21.15.59:0/1772605729 shutdown_connections 2023-09-21T00:18:05.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.546+0000 7f36fef1a700 1 -- 172.21.15.59:0/1772605729 wait complete. 2023-09-21T00:18:05.560 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-21T00:18:05.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.686+0000 7f9f60b25700 1 Processor -- start 2023-09-21T00:18:05.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.686+0000 7f9f60b25700 1 -- start start 2023-09-21T00:18:05.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.687+0000 7f9f60b25700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9f5c0cac80 0x7f9f5c0cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:05.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.687+0000 7f9f60b25700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f5c0b3030 con 0x7f9f5c15b4f0 2023-09-21T00:18:05.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.687+0000 7f9f60b25700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f5c0cb180 con 0x7f9f5c06ae90 2023-09-21T00:18:05.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.687+0000 7f9f60b25700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f5c0cb460 con 0x7f9f5c0cac80 2023-09-21T00:18:05.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.687+0000 7f9f5a59c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9f5c15b4f0 0x7f9f5c06a780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58276/0 (socket says 172.21.15.59:58276) 2023-09-21T00:18:05.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.687+0000 7f9f5a59c700 1 -- 172.21.15.59:0/1068290894 learned_addr learned my addr 172.21.15.59:0/1068290894 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:05.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.687+0000 7f9f5ad9d700 1 --2- 172.21.15.59:0/1068290894 >> v2:172.21.15.83:3300/0 conn(0x7f9f5c0cac80 0x7f9f5c0cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:05.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.688+0000 7f9f5959a700 1 -- 172.21.15.59:0/1068290894 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3571984482 0 0) 0x7f9f5c0b3030 con 0x7f9f5c15b4f0 2023-09-21T00:18:05.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.688+0000 7f9f5959a700 1 -- 172.21.15.59:0/1068290894 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f440035b0 con 0x7f9f5c15b4f0 2023-09-21T00:18:05.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.688+0000 7f9f5959a700 1 -- 172.21.15.59:0/1068290894 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4069095179 0 0) 0x7f9f440035b0 con 0x7f9f5c15b4f0 2023-09-21T00:18:05.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.688+0000 7f9f5ad9d700 1 -- 172.21.15.59:0/1068290894 >> v1:172.21.15.83:6789/0 conn(0x7f9f5c06ae90 legacy=0x7f9f5c0b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:05.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.688+0000 7f9f5ad9d700 1 -- 172.21.15.59:0/1068290894 >> v1:172.21.15.59:6789/0 conn(0x7f9f5c15b4f0 legacy=0x7f9f5c06a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:05.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.688+0000 7f9f5ad9d700 1 -- 172.21.15.59:0/1068290894 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f5c0cb740 con 0x7f9f5c0cac80 2023-09-21T00:18:05.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.688+0000 7f9f5ad9d700 1 --2- 172.21.15.59:0/1068290894 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f5c0cac80 0x7f9f5c0cc410 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9f54009d90 tx=0x7f9f5400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de8fd2cd6e758caf server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:05.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.688+0000 7f9f5959a700 1 -- 172.21.15.59:0/1068290894 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5400e070 con 0x7f9f5c0cac80 2023-09-21T00:18:05.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.688+0000 7f9f5959a700 1 -- 172.21.15.59:0/1068290894 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f54003a20 con 0x7f9f5c0cac80 2023-09-21T00:18:05.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.688+0000 7f9f5959a700 1 -- 172.21.15.59:0/1068290894 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f50001670 con 0x7f9f5c0cac80 2023-09-21T00:18:05.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.689+0000 7f9f60b25700 1 -- 172.21.15.59:0/1068290894 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f5c0cac80 msgr2=0x7f9f5c0cc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:05.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.689+0000 7f9f60b25700 1 --2- 172.21.15.59:0/1068290894 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f5c0cac80 0x7f9f5c0cc410 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9f54009d90 tx=0x7f9f5400b330 comp rx=0 tx=0).stop 2023-09-21T00:18:05.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.689+0000 7f9f60b25700 1 -- 172.21.15.59:0/1068290894 shutdown_connections 2023-09-21T00:18:05.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.689+0000 7f9f60b25700 1 --2- 172.21.15.59:0/1068290894 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f5c0cac80 0x7f9f5c0cc410 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:05.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.689+0000 7f9f60b25700 1 -- 172.21.15.59:0/1068290894 >> 172.21.15.59:0/1068290894 conn(0x7f9f5c0d0140 msgr2=0x7f9f5c0d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:05.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.689+0000 7f9f60b25700 1 -- 172.21.15.59:0/1068290894 shutdown_connections 2023-09-21T00:18:05.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.689+0000 7f9f60b25700 1 -- 172.21.15.59:0/1068290894 wait complete. 2023-09-21T00:18:05.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.690+0000 7f9f60b25700 1 Processor -- start 2023-09-21T00:18:05.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.690+0000 7f9f60b25700 1 -- start start 2023-09-21T00:18:05.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.691+0000 7f9f60b25700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f5c06ae90 0x7f9f5c0c4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:05.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.691+0000 7f9f60b25700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9f5c0cac80 0x7f9f5c0b13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:05.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.691+0000 7f9f60b25700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f5c15b4f0 0x7f9f5c0c6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:05.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.691+0000 7f9f60b25700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c0b0360 con 0x7f9f5c15b4f0 2023-09-21T00:18:05.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.691+0000 7f9f60b25700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c0b0640 con 0x7f9f5c06ae90 2023-09-21T00:18:05.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.691+0000 7f9f60b25700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c0b0920 con 0x7f9f5c0cac80 2023-09-21T00:18:05.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.691+0000 7f9f5ad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f5c15b4f0 0x7f9f5c0c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:05.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.691+0000 7f9f5ad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f5c15b4f0 0x7f9f5c0c6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52718/0 (socket says 172.21.15.59:52718) 2023-09-21T00:18:05.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.691+0000 7f9f5ad9d700 1 -- 172.21.15.59:0/1867565245 learned_addr learned my addr 172.21.15.59:0/1867565245 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:05.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.691+0000 7f9f5a59c700 1 --2- 172.21.15.59:0/1867565245 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f5c06ae90 0x7f9f5c0c4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:05.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.691+0000 7f9f59d9b700 1 --2- 172.21.15.59:0/1867565245 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9f5c0cac80 0x7f9f5c0b13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:05.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.691+0000 7f9f5ad9d700 1 -- 172.21.15.59:0/1867565245 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9f5c0cac80 msgr2=0x7f9f5c0b13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:05.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.691+0000 7f9f5ad9d700 1 --2- 172.21.15.59:0/1867565245 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9f5c0cac80 0x7f9f5c0b13e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:05.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.691+0000 7f9f5ad9d700 1 -- 172.21.15.59:0/1867565245 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f5c06ae90 msgr2=0x7f9f5c0c4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:05.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.691+0000 7f9f5ad9d700 1 --2- 172.21.15.59:0/1867565245 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f5c06ae90 0x7f9f5c0c4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:05.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.691+0000 7f9f5ad9d700 1 -- 172.21.15.59:0/1867565245 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f54009a70 con 0x7f9f5c15b4f0 2023-09-21T00:18:05.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.691+0000 7f9f5a59c700 1 --2- 172.21.15.59:0/1867565245 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f5c06ae90 0x7f9f5c0c4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:18:05.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.692+0000 7f9f5ad9d700 1 --2- 172.21.15.59:0/1867565245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f5c15b4f0 0x7f9f5c0c6810 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9f54004000 tx=0x7f9f54004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:05.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.692+0000 7f9f4affd700 1 -- 172.21.15.59:0/1867565245 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f54004640 con 0x7f9f5c15b4f0 2023-09-21T00:18:05.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.692+0000 7f9f4affd700 1 -- 172.21.15.59:0/1867565245 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f540047a0 con 0x7f9f5c15b4f0 2023-09-21T00:18:05.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.692+0000 7f9f60b25700 1 -- 172.21.15.59:0/1867565245 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f5c0b0c00 con 0x7f9f5c15b4f0 2023-09-21T00:18:05.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.692+0000 7f9f4affd700 1 -- 172.21.15.59:0/1867565245 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5401d670 con 0x7f9f5c15b4f0 2023-09-21T00:18:05.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.692+0000 7f9f60b25700 1 -- 172.21.15.59:0/1867565245 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f5c0b1920 con 0x7f9f5c15b4f0 2023-09-21T00:18:05.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.693+0000 7f9f60b25700 1 -- 172.21.15.59:0/1867565245 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f5c0b1250 con 0x7f9f5c15b4f0 2023-09-21T00:18:05.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.693+0000 7f9f4affd700 1 -- 172.21.15.59:0/1867565245 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f9f5401d7d0 con 0x7f9f5c15b4f0 2023-09-21T00:18:05.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.693+0000 7f9f4affd700 1 --2- 172.21.15.59:0/1867565245 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f9f3c06ae00 0x7f9f3c06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:05.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.694+0000 7f9f4affd700 1 -- 172.21.15.59:0/1867565245 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f9f5408b650 con 0x7f9f5c15b4f0 2023-09-21T00:18:05.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.694+0000 7f9f5a59c700 1 --2- 172.21.15.59:0/1867565245 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f9f3c06ae00 0x7f9f3c06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:05.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.694+0000 7f9f5a59c700 1 --2- 172.21.15.59:0/1867565245 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f9f3c06ae00 0x7f9f3c06d2c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9f500078f0 tx=0x7f9f50009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:05.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.698+0000 7f9f4affd700 1 -- 172.21.15.59:0/1867565245 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f9f54059e80 con 0x7f9f5c15b4f0 2023-09-21T00:18:05.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.896+0000 7f9f60b25700 1 -- 172.21.15.59:0/1867565245 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9f5c067e50 con 0x7f9f5c15b4f0 2023-09-21T00:18:05.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.896+0000 7f9f4affd700 1 -- 172.21.15.59:0/1867565245 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9f54059a10 con 0x7f9f5c15b4f0 2023-09-21T00:18:05.901 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-09-21T00:18:05.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.898+0000 7f9f60b25700 1 -- 172.21.15.59:0/1867565245 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f9f3c06ae00 msgr2=0x7f9f3c06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:05.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.898+0000 7f9f60b25700 1 --2- 172.21.15.59:0/1867565245 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f9f3c06ae00 0x7f9f3c06d2c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9f500078f0 tx=0x7f9f50009040 comp rx=0 tx=0).stop 2023-09-21T00:18:05.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.898+0000 7f9f60b25700 1 -- 172.21.15.59:0/1867565245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f5c15b4f0 msgr2=0x7f9f5c0c6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:05.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.898+0000 7f9f60b25700 1 --2- 172.21.15.59:0/1867565245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f5c15b4f0 0x7f9f5c0c6810 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9f54004000 tx=0x7f9f54004ad0 comp rx=0 tx=0).stop 2023-09-21T00:18:05.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.898+0000 7f9f60b25700 1 -- 172.21.15.59:0/1867565245 shutdown_connections 2023-09-21T00:18:05.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.898+0000 7f9f60b25700 1 --2- 172.21.15.59:0/1867565245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f5c15b4f0 0x7f9f5c0c6810 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:05.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.898+0000 7f9f60b25700 1 --2- 172.21.15.59:0/1867565245 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f5c06ae90 0x7f9f5c0c4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:05.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.898+0000 7f9f60b25700 1 --2- 172.21.15.59:0/1867565245 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f9f3c06ae00 0x7f9f3c06d2c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:05.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.898+0000 7f9f60b25700 1 --2- 172.21.15.59:0/1867565245 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9f5c0cac80 0x7f9f5c0b13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:05.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.898+0000 7f9f60b25700 1 -- 172.21.15.59:0/1867565245 >> 172.21.15.59:0/1867565245 conn(0x7f9f5c0d0140 msgr2=0x7f9f5c06a780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:05.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.899+0000 7f9f60b25700 1 -- 172.21.15.59:0/1867565245 shutdown_connections 2023-09-21T00:18:05.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:05.899+0000 7f9f60b25700 1 -- 172.21.15.59:0/1867565245 wait complete. 2023-09-21T00:18:05.913 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-21T00:18:06.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.038+0000 7f12254a2700 1 Processor -- start 2023-09-21T00:18:06.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.038+0000 7f12254a2700 1 -- start start 2023-09-21T00:18:06.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.038+0000 7f12254a2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f122015d930 0x7f12200d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:06.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.038+0000 7f12254a2700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f12200d3f90 0x7f1220161320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:06.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.038+0000 7f12254a2700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12200cf500 con 0x7f122015d550 2023-09-21T00:18:06.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.038+0000 7f12254a2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12200cf7e0 con 0x7f122015d930 2023-09-21T00:18:06.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.038+0000 7f12254a2700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12200cfac0 con 0x7f12200d3f90 2023-09-21T00:18:06.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.039+0000 7f121e7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f122015d930 0x7f12200d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:06.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.039+0000 7f121e7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f122015d930 0x7f12200d05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52724/0 (socket says 172.21.15.59:52724) 2023-09-21T00:18:06.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.039+0000 7f121e7fc700 1 -- 172.21.15.59:0/1467482422 learned_addr learned my addr 172.21.15.59:0/1467482422 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:06.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.039+0000 7f121f7fe700 1 --2- 172.21.15.59:0/1467482422 >> v2:172.21.15.83:3300/0 conn(0x7f12200d3f90 0x7f1220161320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:06.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.039+0000 7f121e7fc700 1 -- 172.21.15.59:0/1467482422 >> v2:172.21.15.83:3300/0 conn(0x7f12200d3f90 msgr2=0x7f1220161320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:06.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.039+0000 7f121e7fc700 1 --2- 172.21.15.59:0/1467482422 >> v2:172.21.15.83:3300/0 conn(0x7f12200d3f90 0x7f1220161320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:06.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.039+0000 7f121e7fc700 1 -- 172.21.15.59:0/1467482422 >> v1:172.21.15.83:6789/0 conn(0x7f122015d550 legacy=0x7f12200cecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:06.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.039+0000 7f121e7fc700 1 -- 172.21.15.59:0/1467482422 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12200cfda0 con 0x7f122015d930 2023-09-21T00:18:06.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.039+0000 7f121e7fc700 1 --2- 172.21.15.59:0/1467482422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f122015d930 0x7f12200d05a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1220067240 tx=0x7f1210009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aa55641cef11f40 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:06.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.039+0000 7f121dffb700 1 -- 172.21.15.59:0/1467482422 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1210004230 con 0x7f122015d930 2023-09-21T00:18:06.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.039+0000 7f121dffb700 1 -- 172.21.15.59:0/1467482422 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1210004390 con 0x7f122015d930 2023-09-21T00:18:06.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.039+0000 7f121dffb700 1 -- 172.21.15.59:0/1467482422 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12100036a0 con 0x7f122015d930 2023-09-21T00:18:06.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.040+0000 7f12254a2700 1 -- 172.21.15.59:0/1467482422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f122015d930 msgr2=0x7f12200d05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:06.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.040+0000 7f12254a2700 1 --2- 172.21.15.59:0/1467482422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f122015d930 0x7f12200d05a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1220067240 tx=0x7f1210009bd0 comp rx=0 tx=0).stop 2023-09-21T00:18:06.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.040+0000 7f12254a2700 1 -- 172.21.15.59:0/1467482422 shutdown_connections 2023-09-21T00:18:06.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.040+0000 7f12254a2700 1 --2- 172.21.15.59:0/1467482422 >> v2:172.21.15.83:3300/0 conn(0x7f12200d3f90 0x7f1220161320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:06.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.040+0000 7f12254a2700 1 --2- 172.21.15.59:0/1467482422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f122015d930 0x7f12200d05a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:06.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.040+0000 7f12254a2700 1 -- 172.21.15.59:0/1467482422 >> 172.21.15.59:0/1467482422 conn(0x7f122009c740 msgr2=0x7f12200d33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:06.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.040+0000 7f12254a2700 1 -- 172.21.15.59:0/1467482422 shutdown_connections 2023-09-21T00:18:06.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.040+0000 7f12254a2700 1 -- 172.21.15.59:0/1467482422 wait complete. 2023-09-21T00:18:06.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.041+0000 7f12254a2700 1 Processor -- start 2023-09-21T00:18:06.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.041+0000 7f12254a2700 1 -- start start 2023-09-21T00:18:06.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.042+0000 7f12254a2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12200d3f90 0x7f12200b73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:06.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.042+0000 7f12254a2700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f122015d550 0x7f122015c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:06.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.042+0000 7f12254a2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f122015d930 0x7f12200cb190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:06.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.042+0000 7f12254a2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12200cb9e0 con 0x7f12200d3f90 2023-09-21T00:18:06.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.042+0000 7f12254a2700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12200cbcc0 con 0x7f122015d930 2023-09-21T00:18:06.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.042+0000 7f12254a2700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12200cbfa0 con 0x7f122015d550 2023-09-21T00:18:06.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.042+0000 7f121effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12200d3f90 0x7f12200b73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:06.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.042+0000 7f121effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12200d3f90 0x7f12200b73e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52728/0 (socket says 172.21.15.59:52728) 2023-09-21T00:18:06.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.042+0000 7f121effd700 1 -- 172.21.15.59:0/1674279348 learned_addr learned my addr 172.21.15.59:0/1674279348 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:06.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.042+0000 7f121effd700 1 -- 172.21.15.59:0/1674279348 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f122015d550 msgr2=0x7f122015c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:06.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.042+0000 7f121effd700 1 --2- 172.21.15.59:0/1674279348 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f122015d550 0x7f122015c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:06.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.042+0000 7f121f7fe700 1 --2- 172.21.15.59:0/1674279348 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f122015d930 0x7f12200cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:06.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.042+0000 7f121effd700 1 -- 172.21.15.59:0/1674279348 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f122015d930 msgr2=0x7f12200cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:06.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.042+0000 7f121effd700 1 --2- 172.21.15.59:0/1674279348 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f122015d930 0x7f12200cb190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:06.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.042+0000 7f121effd700 1 -- 172.21.15.59:0/1674279348 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1210009550 con 0x7f12200d3f90 2023-09-21T00:18:06.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.043+0000 7f121effd700 1 --2- 172.21.15.59:0/1674279348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12200d3f90 0x7f12200b73e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f121400c4b0 tx=0x7f121400c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:06.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.043+0000 7f12077fe700 1 -- 172.21.15.59:0/1674279348 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1214011790 con 0x7f12200d3f90 2023-09-21T00:18:06.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.043+0000 7f12077fe700 1 -- 172.21.15.59:0/1674279348 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12140118f0 con 0x7f12200d3f90 2023-09-21T00:18:06.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.043+0000 7f12254a2700 1 -- 172.21.15.59:0/1674279348 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f122009e5b0 con 0x7f12200d3f90 2023-09-21T00:18:06.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.043+0000 7f12077fe700 1 -- 172.21.15.59:0/1674279348 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1214011ca0 con 0x7f12200d3f90 2023-09-21T00:18:06.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.043+0000 7f12254a2700 1 -- 172.21.15.59:0/1674279348 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12200cb6d0 con 0x7f12200d3f90 2023-09-21T00:18:06.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.044+0000 7f12254a2700 1 -- 172.21.15.59:0/1674279348 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f122009e410 con 0x7f12200d3f90 2023-09-21T00:18:06.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.044+0000 7f12077fe700 1 -- 172.21.15.59:0/1674279348 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f1214012420 con 0x7f12200d3f90 2023-09-21T00:18:06.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.045+0000 7f12077fe700 1 --2- 172.21.15.59:0/1674279348 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f120c06ae00 0x7f120c06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:06.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.045+0000 7f12077fe700 1 -- 172.21.15.59:0/1674279348 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f1214089480 con 0x7f12200d3f90 2023-09-21T00:18:06.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.045+0000 7f121e7fc700 1 --2- 172.21.15.59:0/1674279348 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f120c06ae00 0x7f120c06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:06.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.045+0000 7f121e7fc700 1 --2- 172.21.15.59:0/1674279348 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f120c06ae00 0x7f120c06d2c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f12200cd4c0 tx=0x7f1210010000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:06.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.049+0000 7f12077fe700 1 -- 172.21.15.59:0/1674279348 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f122009e410 con 0x7f12200d3f90 2023-09-21T00:18:06.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.265+0000 7f12254a2700 1 -- 172.21.15.59:0/1674279348 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f122009e410 con 0x7f12200d3f90 2023-09-21T00:18:06.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.266+0000 7f12077fe700 1 -- 172.21.15.59:0/1674279348 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f122009e410 con 0x7f12200d3f90 2023-09-21T00:18:06.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.268+0000 7f12254a2700 1 -- 172.21.15.59:0/1674279348 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f120c06ae00 msgr2=0x7f120c06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:06.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.268+0000 7f12254a2700 1 --2- 172.21.15.59:0/1674279348 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f120c06ae00 0x7f120c06d2c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f12200cd4c0 tx=0x7f1210010000 comp rx=0 tx=0).stop 2023-09-21T00:18:06.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.268+0000 7f12254a2700 1 -- 172.21.15.59:0/1674279348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12200d3f90 msgr2=0x7f12200b73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:06.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.268+0000 7f12254a2700 1 --2- 172.21.15.59:0/1674279348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12200d3f90 0x7f12200b73e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f121400c4b0 tx=0x7f121400c870 comp rx=0 tx=0).stop 2023-09-21T00:18:06.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.268+0000 7f12254a2700 1 -- 172.21.15.59:0/1674279348 shutdown_connections 2023-09-21T00:18:06.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.268+0000 7f12254a2700 1 --2- 172.21.15.59:0/1674279348 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f122015d930 0x7f12200cb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:06.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.268+0000 7f12254a2700 1 --2- 172.21.15.59:0/1674279348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12200d3f90 0x7f12200b73e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:06.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.268+0000 7f12254a2700 1 --2- 172.21.15.59:0/1674279348 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f120c06ae00 0x7f120c06d2c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:06.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.268+0000 7f12254a2700 1 --2- 172.21.15.59:0/1674279348 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f122015d550 0x7f122015c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:06.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.268+0000 7f12254a2700 1 -- 172.21.15.59:0/1674279348 >> 172.21.15.59:0/1674279348 conn(0x7f122009c740 msgr2=0x7f12200d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:06.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.268+0000 7f12254a2700 1 -- 172.21.15.59:0/1674279348 shutdown_connections 2023-09-21T00:18:06.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.268+0000 7f12254a2700 1 -- 172.21.15.59:0/1674279348 wait complete. 2023-09-21T00:18:06.273 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2023-09-21T00:18:06.282 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-09-21T00:18:06.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:18:06.283 DEBUG:teuthology.orchestra.run.smithi083:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-09-21T00:18:06.327 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi083.front.sepia.ceph.com 2023-09-21T00:18:06.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:18:06.328 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-09-21T00:18:06.393 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-21T00:18:06.393 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-21T00:18:06.412 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-21T00:18:06.412 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-21T00:18:06.470 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-21T00:18:06.470 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-21T00:18:06.527 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T00:18:06.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.693+0000 7f884aa47700 1 Processor -- start 2023-09-21T00:18:06.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.693+0000 7f884aa47700 1 -- start start 2023-09-21T00:18:06.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.694+0000 7f884aa47700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f884415b2b0 0x7f88440cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:06.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.694+0000 7f884aa47700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f88440ce420 0x7f8844161190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:06.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.694+0000 7f884aa47700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f884406a780 0x7f884406abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:06.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.694+0000 7f884aa47700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88440ce250 con 0x7f88440ce420 2023-09-21T00:18:06.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.694+0000 7f884aa47700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f884406b110 con 0x7f884406a780 2023-09-21T00:18:06.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.694+0000 7f884aa47700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88440cfee0 con 0x7f884415b2b0 2023-09-21T00:18:06.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.694+0000 7f88437fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f88440ce420 0x7f8844161190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:06.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.694+0000 7f88437fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f88440ce420 0x7f8844161190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52736/0 (socket says 172.21.15.59:52736) 2023-09-21T00:18:06.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.694+0000 7f88437fe700 1 -- 172.21.15.59:0/2719282308 learned_addr learned my addr 172.21.15.59:0/2719282308 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:06.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.695+0000 7f8848fe4700 1 --2- 172.21.15.59:0/2719282308 >> v2:172.21.15.83:3300/0 conn(0x7f884406a780 0x7f884406abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:06.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.695+0000 7f8843fff700 1 --2- 172.21.15.59:0/2719282308 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f884415b2b0 0x7f88440cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:06.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.695+0000 7f88437fe700 1 -- 172.21.15.59:0/2719282308 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f884415b2b0 msgr2=0x7f88440cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:06.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.695+0000 7f88437fe700 1 --2- 172.21.15.59:0/2719282308 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f884415b2b0 0x7f88440cdd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:06.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.695+0000 7f88437fe700 1 -- 172.21.15.59:0/2719282308 >> v2:172.21.15.83:3300/0 conn(0x7f884406a780 msgr2=0x7f884406abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:06.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.695+0000 7f88437fe700 1 --2- 172.21.15.59:0/2719282308 >> v2:172.21.15.83:3300/0 conn(0x7f884406a780 0x7f884406abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:06.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.695+0000 7f88437fe700 1 -- 172.21.15.59:0/2719282308 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88440ce900 con 0x7f88440ce420 2023-09-21T00:18:06.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.695+0000 7f8848fe4700 1 --2- 172.21.15.59:0/2719282308 >> v2:172.21.15.83:3300/0 conn(0x7f884406a780 0x7f884406abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:18:06.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.695+0000 7f88437fe700 1 --2- 172.21.15.59:0/2719282308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88440ce420 0x7f8844161190 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8844072bd0 tx=0x7f8838009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce04f16f14fcfae6 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:06.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.695+0000 7f8842ffd700 1 -- 172.21.15.59:0/2719282308 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883800b870 con 0x7f88440ce420 2023-09-21T00:18:06.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.695+0000 7f8842ffd700 1 -- 172.21.15.59:0/2719282308 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883800b9d0 con 0x7f88440ce420 2023-09-21T00:18:06.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.695+0000 7f8842ffd700 1 -- 172.21.15.59:0/2719282308 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883800bd60 con 0x7f88440ce420 2023-09-21T00:18:06.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.696+0000 7f884aa47700 1 -- 172.21.15.59:0/2719282308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88440ce420 msgr2=0x7f8844161190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:06.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.696+0000 7f884aa47700 1 --2- 172.21.15.59:0/2719282308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88440ce420 0x7f8844161190 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8844072bd0 tx=0x7f8838009bd0 comp rx=0 tx=0).stop 2023-09-21T00:18:06.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.696+0000 7f884aa47700 1 -- 172.21.15.59:0/2719282308 shutdown_connections 2023-09-21T00:18:06.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.696+0000 7f884aa47700 1 --2- 172.21.15.59:0/2719282308 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f884415b2b0 0x7f88440cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:06.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.696+0000 7f884aa47700 1 --2- 172.21.15.59:0/2719282308 >> v2:172.21.15.83:3300/0 conn(0x7f884406a780 0x7f884406abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:06.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.696+0000 7f884aa47700 1 --2- 172.21.15.59:0/2719282308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88440ce420 0x7f8844161190 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:06.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.696+0000 7f884aa47700 1 -- 172.21.15.59:0/2719282308 >> 172.21.15.59:0/2719282308 conn(0x7f88440d0140 msgr2=0x7f88440d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:06.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.696+0000 7f884aa47700 1 -- 172.21.15.59:0/2719282308 shutdown_connections 2023-09-21T00:18:06.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.696+0000 7f884aa47700 1 -- 172.21.15.59:0/2719282308 wait complete. 2023-09-21T00:18:06.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.697+0000 7f884aa47700 1 Processor -- start 2023-09-21T00:18:06.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.697+0000 7f884aa47700 1 -- start start 2023-09-21T00:18:06.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.698+0000 7f884aa47700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f884406a780 0x7f88441e7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:06.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.698+0000 7f884aa47700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88440ce420 0x7f88441582a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:06.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.698+0000 7f884aa47700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f884415b2b0 0x7f884406ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:06.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.698+0000 7f884aa47700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88440c7210 con 0x7f88440ce420 2023-09-21T00:18:06.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.698+0000 7f884aa47700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88440c9430 con 0x7f884406a780 2023-09-21T00:18:06.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.698+0000 7f884aa47700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88441e8050 con 0x7f884415b2b0 2023-09-21T00:18:06.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.698+0000 7f88437fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88440ce420 0x7f88441582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:06.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.698+0000 7f88437fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88440ce420 0x7f88441582a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52744/0 (socket says 172.21.15.59:52744) 2023-09-21T00:18:06.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.698+0000 7f88437fe700 1 -- 172.21.15.59:0/3072514388 learned_addr learned my addr 172.21.15.59:0/3072514388 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:06.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.698+0000 7f8843fff700 1 --2- 172.21.15.59:0/3072514388 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f884406a780 0x7f88441e7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:06.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.698+0000 7f8848fe4700 1 --2- 172.21.15.59:0/3072514388 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f884415b2b0 0x7f884406ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:06.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.698+0000 7f88437fe700 1 -- 172.21.15.59:0/3072514388 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f884415b2b0 msgr2=0x7f884406ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:06.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.698+0000 7f88437fe700 1 --2- 172.21.15.59:0/3072514388 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f884415b2b0 0x7f884406ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:06.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.698+0000 7f88437fe700 1 -- 172.21.15.59:0/3072514388 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f884406a780 msgr2=0x7f88441e7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:06.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.698+0000 7f88437fe700 1 --2- 172.21.15.59:0/3072514388 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f884406a780 0x7f88441e7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:06.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.698+0000 7f88437fe700 1 -- 172.21.15.59:0/3072514388 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8838009550 con 0x7f88440ce420 2023-09-21T00:18:06.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.698+0000 7f8843fff700 1 --2- 172.21.15.59:0/3072514388 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f884406a780 0x7f88441e7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:18:06.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.698+0000 7f8848fe4700 1 --2- 172.21.15.59:0/3072514388 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f884415b2b0 0x7f884406ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:18:06.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.698+0000 7f88437fe700 1 --2- 172.21.15.59:0/3072514388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88440ce420 0x7f88441582a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8838009fd0 tx=0x7f8838004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:06.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.699+0000 7f8840ff9700 1 -- 172.21.15.59:0/3072514388 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8838004310 con 0x7f88440ce420 2023-09-21T00:18:06.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.699+0000 7f8840ff9700 1 -- 172.21.15.59:0/3072514388 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883801f070 con 0x7f88440ce420 2023-09-21T00:18:06.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.699+0000 7f8840ff9700 1 -- 172.21.15.59:0/3072514388 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88380036a0 con 0x7f88440ce420 2023-09-21T00:18:06.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.699+0000 7f884aa47700 1 -- 172.21.15.59:0/3072514388 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88441f4070 con 0x7f88440ce420 2023-09-21T00:18:06.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.699+0000 7f884aa47700 1 -- 172.21.15.59:0/3072514388 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88441f3590 con 0x7f88440ce420 2023-09-21T00:18:06.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.699+0000 7f884aa47700 1 -- 172.21.15.59:0/3072514388 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8844067e50 con 0x7f88440ce420 2023-09-21T00:18:06.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.700+0000 7f8840ff9700 1 -- 172.21.15.59:0/3072514388 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f8838021030 con 0x7f88440ce420 2023-09-21T00:18:06.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.700+0000 7f8840ff9700 1 --2- 172.21.15.59:0/3072514388 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f883006ae00 0x7f883006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:06.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.700+0000 7f8840ff9700 1 -- 172.21.15.59:0/3072514388 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f883808ada0 con 0x7f88440ce420 2023-09-21T00:18:06.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.701+0000 7f8843fff700 1 --2- 172.21.15.59:0/3072514388 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f883006ae00 0x7f883006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:06.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.701+0000 7f8843fff700 1 --2- 172.21.15.59:0/3072514388 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f883006ae00 0x7f883006d2c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f88440aea90 tx=0x7f8834008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:06.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.705+0000 7f8840ff9700 1 -- 172.21.15.59:0/3072514388 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f8838055b40 con 0x7f88440ce420 2023-09-21T00:18:06.741 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:18:06.744 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:18:06.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.909+0000 7f884aa47700 1 -- 172.21.15.59:0/3072514388 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f884415dc80 con 0x7f88440ce420 2023-09-21T00:18:06.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.910+0000 7f8840ff9700 1 -- 172.21.15.59:0/3072514388 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18792 (secure 0 0 0) 0x7f8838015090 con 0x7f88440ce420 2023-09-21T00:18:06.913 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:18:06.913 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":26,"fsid":"dd69925c-6e25-42fe-880b-2f60fc6f384b","created":"2023-09-21T00:16:43.074489+0000","modified":"2023-09-21T00:17:50.090179+0000","last_up_change":"2023-09-21T00:16:54.740101+0000","last_in_change":"2023-09-21T00:16:45.987089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T00:16:54.796248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-21T00:17:04.167102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-21T00:17:05.313188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-21T00:17:08.977609+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d4b18344-74c0-4f75-920b-7a9247e48914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6809","nonce":2418314235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6811","nonce":2418314235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6815","nonce":2418314235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6813","nonce":2418314235}]},"public_addr":"172.21.15.59:6809/2418314235","cluster_addr":"172.21.15.59:6811/2418314235","heartbeat_back_addr":"172.21.15.59:6815/2418314235","heartbeat_front_addr":"172.21.15.59:6813/2418314235","state":["exists","up"]},{"osd":1,"uuid":"80940d50-a248-4e64-a282-7ffcdad790ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6801","nonce":869668251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6803","nonce":869668251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6807","nonce":869668251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6805","nonce":869668251}]},"public_addr":"172.21.15.59:6801/869668251","cluster_addr":"172.21.15.59:6803/869668251","heartbeat_back_addr":"172.21.15.59:6807/869668251","heartbeat_front_addr":"172.21.15.59:6805/869668251","state":["exists","up"]},{"osd":2,"uuid":"55f2eceb-c54a-4879-a6ce-968c1c548b5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6817","nonce":372517778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6819","nonce":372517778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6823","nonce":372517778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6821","nonce":372517778}]},"public_addr":"172.21.15.59:6817/372517778","cluster_addr":"172.21.15.59:6819/372517778","heartbeat_back_addr":"172.21.15.59:6823/372517778","heartbeat_front_addr":"172.21.15.59:6821/372517778","state":["exists","up"]},{"osd":3,"uuid":"92b89cd0-869c-49b9-a9f9-97ac8423f304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6825","nonce":575188498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6827","nonce":575188498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6831","nonce":575188498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6829","nonce":575188498}]},"public_addr":"172.21.15.59:6825/575188498","cluster_addr":"172.21.15.59:6827/575188498","heartbeat_back_addr":"172.21.15.59:6831/575188498","heartbeat_front_addr":"172.21.15.59:6829/575188498","state":["exists","up"]},{"osd":4,"uuid":"25b80e94-e0e6-403d-b69f-61542f289637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6803","nonce":1741219098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6805","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6807","nonce":1741219098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6815","nonce":1741219098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6811","nonce":1741219098}]},"public_addr":"172.21.15.83:6803/1741219098","cluster_addr":"172.21.15.83:6807/1741219098","heartbeat_back_addr":"172.21.15.83:6815/1741219098","heartbeat_front_addr":"172.21.15.83:6811/1741219098","state":["exists","up"]},{"osd":5,"uuid":"5498d9ab-1086-4796-a199-9051e6dfea91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6817","nonce":156730565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6819","nonce":156730565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6823","nonce":156730565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6821","nonce":156730565}]},"public_addr":"172.21.15.83:6817/156730565","cluster_addr":"172.21.15.83:6819/156730565","heartbeat_back_addr":"172.21.15.83:6823/156730565","heartbeat_front_addr":"172.21.15.83:6821/156730565","state":["exists","up"]},{"osd":6,"uuid":"cfd810c0-5015-4d60-9a75-7efc93a32e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6801","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6800","nonce":1337723778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6806","nonce":1337723778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6814","nonce":1337723778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6810","nonce":1337723778}]},"public_addr":"172.21.15.83:6800/1337723778","cluster_addr":"172.21.15.83:6806/1337723778","heartbeat_back_addr":"172.21.15.83:6814/1337723778","heartbeat_front_addr":"172.21.15.83:6810/1337723778","state":["exists","up"]},{"osd":7,"uuid":"e992c8fa-0a3d-4b3c-85b5-2c511223dee4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6825","nonce":4204859272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6827","nonce":4204859272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6831","nonce":4204859272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6829","nonce":4204859272}]},"public_addr":"172.21.15.83:6825/4204859272","cluster_addr":"172.21.15.83:6827/4204859272","heartbeat_back_addr":"172.21.15.83:6831/4204859272","heartbeat_front_addr":"172.21.15.83:6829/4204859272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.156498+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.882707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.093978+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.158565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.173933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.888606+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.135525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.149712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":3,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.34","mappings":[{"from":4,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":6}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T00:18:06.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.913+0000 7f884aa47700 1 -- 172.21.15.59:0/3072514388 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f883006ae00 msgr2=0x7f883006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:06.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.913+0000 7f884aa47700 1 --2- 172.21.15.59:0/3072514388 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f883006ae00 0x7f883006d2c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f88440aea90 tx=0x7f8834008040 comp rx=0 tx=0).stop 2023-09-21T00:18:06.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.913+0000 7f884aa47700 1 -- 172.21.15.59:0/3072514388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88440ce420 msgr2=0x7f88441582a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:06.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.913+0000 7f884aa47700 1 --2- 172.21.15.59:0/3072514388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88440ce420 0x7f88441582a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8838009fd0 tx=0x7f8838004750 comp rx=0 tx=0).stop 2023-09-21T00:18:06.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.913+0000 7f884aa47700 1 -- 172.21.15.59:0/3072514388 shutdown_connections 2023-09-21T00:18:06.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.913+0000 7f884aa47700 1 --2- 172.21.15.59:0/3072514388 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f883006ae00 0x7f883006d2c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:06.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.913+0000 7f884aa47700 1 --2- 172.21.15.59:0/3072514388 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f884415b2b0 0x7f884406ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:06.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.913+0000 7f884aa47700 1 --2- 172.21.15.59:0/3072514388 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f884406a780 0x7f88441e7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:06.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.913+0000 7f884aa47700 1 --2- 172.21.15.59:0/3072514388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88440ce420 0x7f88441582a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:06.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.913+0000 7f884aa47700 1 -- 172.21.15.59:0/3072514388 >> 172.21.15.59:0/3072514388 conn(0x7f88440d0140 msgr2=0x7f884406f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:06.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.913+0000 7f884aa47700 1 -- 172.21.15.59:0/3072514388 shutdown_connections 2023-09-21T00:18:06.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:06.913+0000 7f884aa47700 1 -- 172.21.15.59:0/3072514388 wait complete. 2023-09-21T00:18:06.927 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-21T00:16:54.796248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-21T00:17:04.167102+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-21T00:17:05.313188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-21T00:17:08.977609+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-21T00:18:06.928 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-21T00:18:07.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.056+0000 7f86ebfb7700 1 Processor -- start 2023-09-21T00:18:07.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.056+0000 7f86ebfb7700 1 -- start start 2023-09-21T00:18:07.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.057+0000 7f86ebfb7700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f86e415a230 0x7f86e415e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:07.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.057+0000 7f86ebfb7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f86e40ca790 0x7f86e4071680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:07.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.057+0000 7f86ebfb7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e40cb1c0 con 0x7f86e40cabf0 2023-09-21T00:18:07.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.057+0000 7f86ebfb7700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e40cb780 con 0x7f86e415a230 2023-09-21T00:18:07.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.057+0000 7f86ebfb7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e40cb4a0 con 0x7f86e40ca790 2023-09-21T00:18:07.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.057+0000 7f86ea554700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f86e40cabf0 0x7f86e406eaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58322/0 (socket says 172.21.15.59:58322) 2023-09-21T00:18:07.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.057+0000 7f86ea554700 1 -- 172.21.15.59:0/2055558361 learned_addr learned my addr 172.21.15.59:0/2055558361 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:07.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.057+0000 7f86e9552700 1 --2- 172.21.15.59:0/2055558361 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f86e40ca790 0x7f86e4071680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:07.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.057+0000 7f86e9d53700 1 --2- 172.21.15.59:0/2055558361 >> v2:172.21.15.83:3300/0 conn(0x7f86e415a230 0x7f86e415e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:07.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.057+0000 7f86e8d51700 1 -- 172.21.15.59:0/2055558361 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4136366471 0 0) 0x7f86e40cb1c0 con 0x7f86e40cabf0 2023-09-21T00:18:07.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.057+0000 7f86e8d51700 1 -- 172.21.15.59:0/2055558361 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86d00035b0 con 0x7f86e40cabf0 2023-09-21T00:18:07.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.057+0000 7f86e8d51700 1 -- 172.21.15.59:0/2055558361 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4196195603 0 0) 0x7f86d00035b0 con 0x7f86e40cabf0 2023-09-21T00:18:07.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.057+0000 7f86e8d51700 1 -- 172.21.15.59:0/2055558361 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f86e40ca790 msgr2=0x7f86e4071680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:07.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.057+0000 7f86e8d51700 1 --2- 172.21.15.59:0/2055558361 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f86e40ca790 0x7f86e4071680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:07.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.058+0000 7f86e8d51700 1 -- 172.21.15.59:0/2055558361 >> v2:172.21.15.83:3300/0 conn(0x7f86e415a230 msgr2=0x7f86e415e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:07.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.058+0000 7f86e8d51700 1 --2- 172.21.15.59:0/2055558361 >> v2:172.21.15.83:3300/0 conn(0x7f86e415a230 0x7f86e415e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:07.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.058+0000 7f86e8d51700 1 -- 172.21.15.59:0/2055558361 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e415e0b0 con 0x7f86e40cabf0 2023-09-21T00:18:07.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.058+0000 7f86e8d51700 1 -- 172.21.15.59:0/2055558361 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 710825841 0 0) 0x7f86dc0019f0 con 0x7f86e40cabf0 2023-09-21T00:18:07.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.058+0000 7f86e8d51700 1 -- 172.21.15.59:0/2055558361 >> v1:172.21.15.59:6789/0 conn(0x7f86e40cabf0 legacy=0x7f86e406eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:07.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.058+0000 7f86e8d51700 1 --2- 172.21.15.59:0/2055558361 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f86e40ca790 0x7f86d0003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:07.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.058+0000 7f86e8d51700 1 --2- 172.21.15.59:0/2055558361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86d0003f80 0x7f86d0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:07.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.058+0000 7f86e8d51700 1 --2- 172.21.15.59:0/2055558361 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86d0004d90 0x7f86d0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:07.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.058+0000 7f86e8d51700 1 -- 172.21.15.59:0/2055558361 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e40cb780 con 0x7f86d0003f80 2023-09-21T00:18:07.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.058+0000 7f86e8d51700 1 -- 172.21.15.59:0/2055558361 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e40cb4a0 con 0x7f86d0004d90 2023-09-21T00:18:07.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.058+0000 7f86e8d51700 1 -- 172.21.15.59:0/2055558361 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d000ba10 con 0x7f86e40ca790 2023-09-21T00:18:07.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.058+0000 7f86e9552700 1 --2- 172.21.15.59:0/2055558361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86d0003f80 0x7f86d0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:07.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.058+0000 7f86e9d53700 1 --2- 172.21.15.59:0/2055558361 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f86e40ca790 0x7f86d0003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:07.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.058+0000 7f86ea554700 1 --2- 172.21.15.59:0/2055558361 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86d0004d90 0x7f86d0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:07.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.058+0000 7f86e9552700 1 -- 172.21.15.59:0/2055558361 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f86e40ca790 msgr2=0x7f86d0003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:07.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.058+0000 7f86e9552700 1 --2- 172.21.15.59:0/2055558361 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f86e40ca790 0x7f86d0003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:07.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.058+0000 7f86e9552700 1 -- 172.21.15.59:0/2055558361 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86d0004d90 msgr2=0x7f86d0005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:07.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.058+0000 7f86e9552700 1 --2- 172.21.15.59:0/2055558361 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86d0004d90 0x7f86d0005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:07.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.058+0000 7f86e9552700 1 -- 172.21.15.59:0/2055558361 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d00035b0 con 0x7f86d0003f80 2023-09-21T00:18:07.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.058+0000 7f86e9552700 1 --2- 172.21.15.59:0/2055558361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86d0003f80 0x7f86d0004850 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f86e0009b60 tx=0x7f86d0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f73d5356d9636be4 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:07.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.058+0000 7f86e8d51700 1 -- 172.21.15.59:0/2055558361 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e000e660 con 0x7f86d0003f80 2023-09-21T00:18:07.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.058+0000 7f86e8d51700 1 -- 172.21.15.59:0/2055558361 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e000e7c0 con 0x7f86d0003f80 2023-09-21T00:18:07.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.058+0000 7f86e8d51700 1 -- 172.21.15.59:0/2055558361 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e000eb30 con 0x7f86d0003f80 2023-09-21T00:18:07.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.059+0000 7f86ebfb7700 1 -- 172.21.15.59:0/2055558361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86d0003f80 msgr2=0x7f86d0004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:07.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.059+0000 7f86ebfb7700 1 --2- 172.21.15.59:0/2055558361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86d0003f80 0x7f86d0004850 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f86e0009b60 tx=0x7f86d0005880 comp rx=0 tx=0).stop 2023-09-21T00:18:07.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.059+0000 7f86ea554700 1 -- 172.21.15.59:0/2055558361 reap_dead start 2023-09-21T00:18:07.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.059+0000 7f86ebfb7700 1 -- 172.21.15.59:0/2055558361 shutdown_connections 2023-09-21T00:18:07.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.059+0000 7f86ebfb7700 1 -- 172.21.15.59:0/2055558361 >> 172.21.15.59:0/2055558361 conn(0x7f86e40d0140 msgr2=0x7f86e40d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:07.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.059+0000 7f86ebfb7700 1 -- 172.21.15.59:0/2055558361 shutdown_connections 2023-09-21T00:18:07.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.059+0000 7f86ebfb7700 1 -- 172.21.15.59:0/2055558361 wait complete. 2023-09-21T00:18:07.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.060+0000 7f86ebfb7700 1 Processor -- start 2023-09-21T00:18:07.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.060+0000 7f86ebfb7700 1 -- start start 2023-09-21T00:18:07.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.061+0000 7f86ebfb7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f86d0003f80 0x7f86e406a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:07.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.061+0000 7f86ebfb7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86e415d0e0 0x7f86e415d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:07.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.061+0000 7f86ebfb7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86e40b2d60 0x7f86e40b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:07.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.061+0000 7f86ebfb7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e40b5240 con 0x7f86e40b2d60 2023-09-21T00:18:07.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.061+0000 7f86ebfb7700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e415daa0 con 0x7f86e415d0e0 2023-09-21T00:18:07.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.061+0000 7f86ebfb7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e40b4670 con 0x7f86d0003f80 2023-09-21T00:18:07.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.061+0000 7f86ea554700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86e40b2d60 0x7f86e40b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:07.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.061+0000 7f86ea554700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86e40b2d60 0x7f86e40b31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52766/0 (socket says 172.21.15.59:52766) 2023-09-21T00:18:07.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.061+0000 7f86ea554700 1 -- 172.21.15.59:0/2834720498 learned_addr learned my addr 172.21.15.59:0/2834720498 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:07.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.061+0000 7f86e9552700 1 --2- 172.21.15.59:0/2834720498 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86e415d0e0 0x7f86e415d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:07.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.061+0000 7f86e9d53700 1 --2- 172.21.15.59:0/2834720498 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f86d0003f80 0x7f86e406a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:07.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.061+0000 7f86ea554700 1 -- 172.21.15.59:0/2834720498 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f86d0003f80 msgr2=0x7f86e406a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:07.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.061+0000 7f86ea554700 1 --2- 172.21.15.59:0/2834720498 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f86d0003f80 0x7f86e406a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:07.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.061+0000 7f86ea554700 1 -- 172.21.15.59:0/2834720498 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86e415d0e0 msgr2=0x7f86e415d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:07.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.061+0000 7f86ea554700 1 --2- 172.21.15.59:0/2834720498 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86e415d0e0 0x7f86e415d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:07.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.061+0000 7f86ea554700 1 -- 172.21.15.59:0/2834720498 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e40b4910 con 0x7f86e40b2d60 2023-09-21T00:18:07.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.061+0000 7f86e9552700 1 --2- 172.21.15.59:0/2834720498 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86e415d0e0 0x7f86e415d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:18:07.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.062+0000 7f86ea554700 1 --2- 172.21.15.59:0/2834720498 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86e40b2d60 0x7f86e40b31e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f86e4067340 tx=0x7f86dc00a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:07.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.062+0000 7f86da7fc700 1 -- 172.21.15.59:0/2834720498 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc00ae70 con 0x7f86e40b2d60 2023-09-21T00:18:07.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.062+0000 7f86da7fc700 1 -- 172.21.15.59:0/2834720498 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86dc0133f0 con 0x7f86e40b2d60 2023-09-21T00:18:07.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.062+0000 7f86da7fc700 1 -- 172.21.15.59:0/2834720498 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc0137c0 con 0x7f86e40b2d60 2023-09-21T00:18:07.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.062+0000 7f86ebfb7700 1 -- 172.21.15.59:0/2834720498 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e40b4bf0 con 0x7f86e40b2d60 2023-09-21T00:18:07.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.062+0000 7f86ebfb7700 1 -- 172.21.15.59:0/2834720498 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e40b56d0 con 0x7f86e40b2d60 2023-09-21T00:18:07.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.063+0000 7f86ebfb7700 1 -- 172.21.15.59:0/2834720498 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86e4067e50 con 0x7f86e40b2d60 2023-09-21T00:18:07.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.063+0000 7f86da7fc700 1 -- 172.21.15.59:0/2834720498 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f86dc013920 con 0x7f86e40b2d60 2023-09-21T00:18:07.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.064+0000 7f86da7fc700 1 --2- 172.21.15.59:0/2834720498 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f86c806ae00 0x7f86c806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:07.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.064+0000 7f86da7fc700 1 -- 172.21.15.59:0/2834720498 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f86dc08a330 con 0x7f86e40b2d60 2023-09-21T00:18:07.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.064+0000 7f86e9d53700 1 --2- 172.21.15.59:0/2834720498 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f86c806ae00 0x7f86c806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:07.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.064+0000 7f86e9d53700 1 --2- 172.21.15.59:0/2834720498 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f86c806ae00 0x7f86c806d2c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f86d4009c20 tx=0x7f86d4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:07.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.068+0000 7f86da7fc700 1 -- 172.21.15.59:0/2834720498 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f86dc055040 con 0x7f86e40b2d60 2023-09-21T00:18:07.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.268+0000 7f86ebfb7700 1 -- 172.21.15.59:0/2834720498 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f86e4070040 con 0x7f86e40b2d60 2023-09-21T00:18:07.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.268+0000 7f86da7fc700 1 -- 172.21.15.59:0/2834720498 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f86dc058660 con 0x7f86e40b2d60 2023-09-21T00:18:07.270 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-09-21T00:18:07.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.270+0000 7f86ebfb7700 1 -- 172.21.15.59:0/2834720498 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f86c806ae00 msgr2=0x7f86c806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:07.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.270+0000 7f86ebfb7700 1 --2- 172.21.15.59:0/2834720498 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f86c806ae00 0x7f86c806d2c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f86d4009c20 tx=0x7f86d4008040 comp rx=0 tx=0).stop 2023-09-21T00:18:07.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.270+0000 7f86ebfb7700 1 -- 172.21.15.59:0/2834720498 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86e40b2d60 msgr2=0x7f86e40b31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:07.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.270+0000 7f86ebfb7700 1 --2- 172.21.15.59:0/2834720498 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86e40b2d60 0x7f86e40b31e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f86e4067340 tx=0x7f86dc00a640 comp rx=0 tx=0).stop 2023-09-21T00:18:07.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.270+0000 7f86ebfb7700 1 -- 172.21.15.59:0/2834720498 shutdown_connections 2023-09-21T00:18:07.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.270+0000 7f86ebfb7700 1 --2- 172.21.15.59:0/2834720498 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86e40b2d60 0x7f86e40b31e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:07.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.270+0000 7f86ebfb7700 1 --2- 172.21.15.59:0/2834720498 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f86c806ae00 0x7f86c806d2c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:07.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.270+0000 7f86ebfb7700 1 --2- 172.21.15.59:0/2834720498 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f86d0003f80 0x7f86e406a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:07.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.270+0000 7f86ebfb7700 1 --2- 172.21.15.59:0/2834720498 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86e415d0e0 0x7f86e415d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:07.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.270+0000 7f86ebfb7700 1 -- 172.21.15.59:0/2834720498 >> 172.21.15.59:0/2834720498 conn(0x7f86e40d0140 msgr2=0x7f86e4073200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:07.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.270+0000 7f86ebfb7700 1 -- 172.21.15.59:0/2834720498 shutdown_connections 2023-09-21T00:18:07.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.270+0000 7f86ebfb7700 1 -- 172.21.15.59:0/2834720498 wait complete. 2023-09-21T00:18:07.284 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-21T00:18:07.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.410+0000 7f6c3e5e7700 1 Processor -- start 2023-09-21T00:18:07.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.410+0000 7f6c3e5e7700 1 -- start start 2023-09-21T00:18:07.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.411+0000 7f6c3e5e7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c3806a9f0 0x7f6c380ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:07.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.411+0000 7f6c3e5e7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6c380cb090 0x7f6c381604b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:07.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.411+0000 7f6c3e5e7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c380cb620 con 0x7f6c3806add0 2023-09-21T00:18:07.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.411+0000 7f6c3e5e7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c380cdd90 con 0x7f6c380cb090 2023-09-21T00:18:07.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.411+0000 7f6c3e5e7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c380ce070 con 0x7f6c3806a9f0 2023-09-21T00:18:07.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.411+0000 7f6c3cb84700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6c380cb090 0x7f6c381604b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:07.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.411+0000 7f6c3cb84700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6c380cb090 0x7f6c381604b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52774/0 (socket says 172.21.15.59:52774) 2023-09-21T00:18:07.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.411+0000 7f6c3cb84700 1 -- 172.21.15.59:0/693556408 learned_addr learned my addr 172.21.15.59:0/693556408 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:07.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.411+0000 7f6c377fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6c3806add0 0x7f6c380ca980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58338/0 (socket says 172.21.15.59:58338) 2023-09-21T00:18:07.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.412+0000 7f6c37fff700 1 --2- 172.21.15.59:0/693556408 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c3806a9f0 0x7f6c380ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:07.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.412+0000 7f6c3cb84700 1 -- 172.21.15.59:0/693556408 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c3806a9f0 msgr2=0x7f6c380ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:07.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.412+0000 7f6c3cb84700 1 --2- 172.21.15.59:0/693556408 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c3806a9f0 0x7f6c380ceb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:07.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.412+0000 7f6c3cb84700 1 -- 172.21.15.59:0/693556408 >> v1:172.21.15.59:6789/0 conn(0x7f6c3806add0 legacy=0x7f6c380ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:07.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.412+0000 7f6c36ffd700 1 -- 172.21.15.59:0/693556408 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 296823094 0 0) 0x7f6c380cb620 con 0x7f6c3806add0 2023-09-21T00:18:07.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.412+0000 7f6c3cb84700 1 -- 172.21.15.59:0/693556408 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c380ce350 con 0x7f6c380cb090 2023-09-21T00:18:07.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.412+0000 7f6c3cb84700 1 --2- 172.21.15.59:0/693556408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c380cb090 0x7f6c381604b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6c30009e50 tx=0x7f6c3000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e986586f402211e server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:07.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.412+0000 7f6c36ffd700 1 -- 172.21.15.59:0/693556408 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3000e070 con 0x7f6c380cb090 2023-09-21T00:18:07.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.412+0000 7f6c36ffd700 1 -- 172.21.15.59:0/693556408 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c3000b9c0 con 0x7f6c380cb090 2023-09-21T00:18:07.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.412+0000 7f6c36ffd700 1 -- 172.21.15.59:0/693556408 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3000bd70 con 0x7f6c380cb090 2023-09-21T00:18:07.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.413+0000 7f6c3e5e7700 1 -- 172.21.15.59:0/693556408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c380cb090 msgr2=0x7f6c381604b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:07.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.413+0000 7f6c3e5e7700 1 --2- 172.21.15.59:0/693556408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c380cb090 0x7f6c381604b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6c30009e50 tx=0x7f6c3000b330 comp rx=0 tx=0).stop 2023-09-21T00:18:07.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.413+0000 7f6c3e5e7700 1 -- 172.21.15.59:0/693556408 shutdown_connections 2023-09-21T00:18:07.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.413+0000 7f6c3e5e7700 1 --2- 172.21.15.59:0/693556408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c380cb090 0x7f6c381604b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:07.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.413+0000 7f6c3e5e7700 1 --2- 172.21.15.59:0/693556408 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c3806a9f0 0x7f6c380ceb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:07.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.413+0000 7f6c3e5e7700 1 -- 172.21.15.59:0/693556408 >> 172.21.15.59:0/693556408 conn(0x7f6c380d0120 msgr2=0x7f6c380d0530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:07.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.413+0000 7f6c3e5e7700 1 -- 172.21.15.59:0/693556408 shutdown_connections 2023-09-21T00:18:07.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.413+0000 7f6c3e5e7700 1 -- 172.21.15.59:0/693556408 wait complete. 2023-09-21T00:18:07.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.414+0000 7f6c3e5e7700 1 Processor -- start 2023-09-21T00:18:07.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.415+0000 7f6c3e5e7700 1 -- start start 2023-09-21T00:18:07.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.415+0000 7f6c3e5e7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c3806a9f0 0x7f6c381f3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:07.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.415+0000 7f6c3e5e7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c3806add0 0x7f6c380c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:07.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.415+0000 7f6c3e5e7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c380cb090 0x7f6c381f29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:07.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.415+0000 7f6c3e5e7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c380c4f80 con 0x7f6c3806add0 2023-09-21T00:18:07.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.415+0000 7f6c3e5e7700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c381f2f10 con 0x7f6c3806a9f0 2023-09-21T00:18:07.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.415+0000 7f6c3e5e7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c380c51b0 con 0x7f6c380cb090 2023-09-21T00:18:07.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.416+0000 7f6c377fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c3806add0 0x7f6c380c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:07.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.416+0000 7f6c377fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c3806add0 0x7f6c380c4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52778/0 (socket says 172.21.15.59:52778) 2023-09-21T00:18:07.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.416+0000 7f6c377fe700 1 -- 172.21.15.59:0/1751512096 learned_addr learned my addr 172.21.15.59:0/1751512096 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:07.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.416+0000 7f6c3cb84700 1 --2- 172.21.15.59:0/1751512096 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c380cb090 0x7f6c381f29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:07.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.416+0000 7f6c37fff700 1 --2- 172.21.15.59:0/1751512096 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c3806a9f0 0x7f6c381f3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:07.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.416+0000 7f6c377fe700 1 -- 172.21.15.59:0/1751512096 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c380cb090 msgr2=0x7f6c381f29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:07.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.416+0000 7f6c377fe700 1 --2- 172.21.15.59:0/1751512096 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c380cb090 0x7f6c381f29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:07.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.416+0000 7f6c377fe700 1 -- 172.21.15.59:0/1751512096 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c3806a9f0 msgr2=0x7f6c381f3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:07.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.416+0000 7f6c377fe700 1 --2- 172.21.15.59:0/1751512096 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c3806a9f0 0x7f6c381f3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:07.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.416+0000 7f6c377fe700 1 -- 172.21.15.59:0/1751512096 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c30009b30 con 0x7f6c3806add0 2023-09-21T00:18:07.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.416+0000 7f6c37fff700 1 --2- 172.21.15.59:0/1751512096 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c3806a9f0 0x7f6c381f3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:18:07.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.416+0000 7f6c377fe700 1 --2- 172.21.15.59:0/1751512096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c3806add0 0x7f6c380c4a40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6c200011e0 tx=0x7f6c2000cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:07.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.416+0000 7f6c34ff9700 1 -- 172.21.15.59:0/1751512096 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c20004c80 con 0x7f6c3806add0 2023-09-21T00:18:07.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.416+0000 7f6c34ff9700 1 -- 172.21.15.59:0/1751512096 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c20004e00 con 0x7f6c3806add0 2023-09-21T00:18:07.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.416+0000 7f6c3e5e7700 1 -- 172.21.15.59:0/1751512096 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c380c5490 con 0x7f6c3806add0 2023-09-21T00:18:07.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.416+0000 7f6c34ff9700 1 -- 172.21.15.59:0/1751512096 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c20007310 con 0x7f6c3806add0 2023-09-21T00:18:07.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.416+0000 7f6c3e5e7700 1 -- 172.21.15.59:0/1751512096 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c380c5a50 con 0x7f6c3806add0 2023-09-21T00:18:07.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.417+0000 7f6c3e5e7700 1 -- 172.21.15.59:0/1751512096 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c38067e50 con 0x7f6c3806add0 2023-09-21T00:18:07.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.418+0000 7f6c34ff9700 1 -- 172.21.15.59:0/1751512096 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f6c20007470 con 0x7f6c3806add0 2023-09-21T00:18:07.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.418+0000 7f6c34ff9700 1 --2- 172.21.15.59:0/1751512096 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f6c1806ae00 0x7f6c1806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:07.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.418+0000 7f6c34ff9700 1 -- 172.21.15.59:0/1751512096 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f6c200896d0 con 0x7f6c3806add0 2023-09-21T00:18:07.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.418+0000 7f6c37fff700 1 --2- 172.21.15.59:0/1751512096 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f6c1806ae00 0x7f6c1806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:07.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.419+0000 7f6c37fff700 1 --2- 172.21.15.59:0/1751512096 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f6c1806ae00 0x7f6c1806d2c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6c380c49d0 tx=0x7f6c28008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:07.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.423+0000 7f6c34ff9700 1 -- 172.21.15.59:0/1751512096 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f6c200543e0 con 0x7f6c3806add0 2023-09-21T00:18:07.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.623+0000 7f6c3e5e7700 1 -- 172.21.15.59:0/1751512096 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6c380b60a0 con 0x7f6c3806add0 2023-09-21T00:18:07.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.623+0000 7f6c34ff9700 1 -- 172.21.15.59:0/1751512096 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6c20057a00 con 0x7f6c3806add0 2023-09-21T00:18:07.626 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-09-21T00:18:07.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.625+0000 7f6c3e5e7700 1 -- 172.21.15.59:0/1751512096 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f6c1806ae00 msgr2=0x7f6c1806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:07.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.625+0000 7f6c3e5e7700 1 --2- 172.21.15.59:0/1751512096 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f6c1806ae00 0x7f6c1806d2c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6c380c49d0 tx=0x7f6c28008040 comp rx=0 tx=0).stop 2023-09-21T00:18:07.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.625+0000 7f6c3e5e7700 1 -- 172.21.15.59:0/1751512096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c3806add0 msgr2=0x7f6c380c4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:07.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.625+0000 7f6c3e5e7700 1 --2- 172.21.15.59:0/1751512096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c3806add0 0x7f6c380c4a40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6c200011e0 tx=0x7f6c2000cae0 comp rx=0 tx=0).stop 2023-09-21T00:18:07.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.625+0000 7f6c3e5e7700 1 -- 172.21.15.59:0/1751512096 shutdown_connections 2023-09-21T00:18:07.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.625+0000 7f6c3e5e7700 1 --2- 172.21.15.59:0/1751512096 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f6c1806ae00 0x7f6c1806d2c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:07.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.625+0000 7f6c3e5e7700 1 --2- 172.21.15.59:0/1751512096 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6c380cb090 0x7f6c381f29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:07.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.625+0000 7f6c3e5e7700 1 --2- 172.21.15.59:0/1751512096 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c3806a9f0 0x7f6c381f3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:07.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.625+0000 7f6c3e5e7700 1 --2- 172.21.15.59:0/1751512096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c3806add0 0x7f6c380c4a40 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:07.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.625+0000 7f6c3e5e7700 1 -- 172.21.15.59:0/1751512096 >> 172.21.15.59:0/1751512096 conn(0x7f6c380d0120 msgr2=0x7f6c3815e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:07.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.625+0000 7f6c3e5e7700 1 -- 172.21.15.59:0/1751512096 shutdown_connections 2023-09-21T00:18:07.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.625+0000 7f6c3e5e7700 1 -- 172.21.15.59:0/1751512096 wait complete. 2023-09-21T00:18:07.639 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-21T00:18:07.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.766+0000 7fec35928700 1 Processor -- start 2023-09-21T00:18:07.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.766+0000 7fec35928700 1 -- start start 2023-09-21T00:18:07.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.767+0000 7fec35928700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fec300d2f80 0x7fec300b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:07.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.767+0000 7fec35928700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fec300b5460 0x7fec300b65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:07.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.767+0000 7fec35928700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec300b58b0 con 0x7fec3015d690 2023-09-21T00:18:07.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.767+0000 7fec35928700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec300d1c30 con 0x7fec300d2f80 2023-09-21T00:18:07.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.767+0000 7fec35928700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec300d1ee0 con 0x7fec300b5460 2023-09-21T00:18:07.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.767+0000 7fec2e7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fec300d2f80 0x7fec300b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:07.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.767+0000 7fec2e7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fec300d2f80 0x7fec300b4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52786/0 (socket says 172.21.15.59:52786) 2023-09-21T00:18:07.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.767+0000 7fec2e7fc700 1 -- 172.21.15.59:0/1356005971 learned_addr learned my addr 172.21.15.59:0/1356005971 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:07.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.767+0000 7fec2f7fe700 1 --2- 172.21.15.59:0/1356005971 >> v2:172.21.15.83:3300/0 conn(0x7fec300b5460 0x7fec300b65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:07.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.767+0000 7fec2e7fc700 1 -- 172.21.15.59:0/1356005971 >> v2:172.21.15.83:3300/0 conn(0x7fec300b5460 msgr2=0x7fec300b65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:07.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.767+0000 7fec2e7fc700 1 --2- 172.21.15.59:0/1356005971 >> v2:172.21.15.83:3300/0 conn(0x7fec300b5460 0x7fec300b65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:07.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.767+0000 7fec2e7fc700 1 -- 172.21.15.59:0/1356005971 >> v1:172.21.15.83:6789/0 conn(0x7fec3015d690 legacy=0x7fec300d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:07.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.767+0000 7fec2e7fc700 1 -- 172.21.15.59:0/1356005971 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec300d21c0 con 0x7fec300d2f80 2023-09-21T00:18:07.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.767+0000 7fec2e7fc700 1 --2- 172.21.15.59:0/1356005971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec300d2f80 0x7fec300b4f20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fec300d1000 tx=0x7fec20009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73e9d7602ad020e4 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:07.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.768+0000 7fec2dffb700 1 -- 172.21.15.59:0/1356005971 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec20004230 con 0x7fec300d2f80 2023-09-21T00:18:07.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.768+0000 7fec2dffb700 1 -- 172.21.15.59:0/1356005971 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec20004390 con 0x7fec300d2f80 2023-09-21T00:18:07.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.768+0000 7fec2dffb700 1 -- 172.21.15.59:0/1356005971 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec200036a0 con 0x7fec300d2f80 2023-09-21T00:18:07.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.768+0000 7fec35928700 1 -- 172.21.15.59:0/1356005971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec300d2f80 msgr2=0x7fec300b4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:07.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.768+0000 7fec35928700 1 --2- 172.21.15.59:0/1356005971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec300d2f80 0x7fec300b4f20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fec300d1000 tx=0x7fec20009bd0 comp rx=0 tx=0).stop 2023-09-21T00:18:07.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.768+0000 7fec35928700 1 -- 172.21.15.59:0/1356005971 shutdown_connections 2023-09-21T00:18:07.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.768+0000 7fec35928700 1 --2- 172.21.15.59:0/1356005971 >> v2:172.21.15.83:3300/0 conn(0x7fec300b5460 0x7fec300b65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:07.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.768+0000 7fec35928700 1 --2- 172.21.15.59:0/1356005971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec300d2f80 0x7fec300b4f20 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:07.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.768+0000 7fec35928700 1 -- 172.21.15.59:0/1356005971 >> 172.21.15.59:0/1356005971 conn(0x7fec30072560 msgr2=0x7fec300cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:07.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.768+0000 7fec35928700 1 -- 172.21.15.59:0/1356005971 shutdown_connections 2023-09-21T00:18:07.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.768+0000 7fec35928700 1 -- 172.21.15.59:0/1356005971 wait complete. 2023-09-21T00:18:07.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.769+0000 7fec35928700 1 Processor -- start 2023-09-21T00:18:07.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.770+0000 7fec35928700 1 -- start start 2023-09-21T00:18:07.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.770+0000 7fec35928700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec300b5460 0x7fec30154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:07.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.770+0000 7fec35928700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fec300d2f80 0x7fec300ca570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:07.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.770+0000 7fec35928700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fec3015d690 0x7fec30158710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:07.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.770+0000 7fec35928700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec301556c0 con 0x7fec300b5460 2023-09-21T00:18:07.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.770+0000 7fec35928700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec300cb8b0 con 0x7fec3015d690 2023-09-21T00:18:07.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.770+0000 7fec35928700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec300cb010 con 0x7fec300d2f80 2023-09-21T00:18:07.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.770+0000 7fec2effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec300b5460 0x7fec30154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:07.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.771+0000 7fec2effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec300b5460 0x7fec30154950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52790/0 (socket says 172.21.15.59:52790) 2023-09-21T00:18:07.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.771+0000 7fec2effd700 1 -- 172.21.15.59:0/1799198897 learned_addr learned my addr 172.21.15.59:0/1799198897 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:07.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.771+0000 7fec2f7fe700 1 --2- 172.21.15.59:0/1799198897 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fec3015d690 0x7fec30158710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:07.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.771+0000 7fec2e7fc700 1 --2- 172.21.15.59:0/1799198897 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fec300d2f80 0x7fec300ca570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:07.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.771+0000 7fec2effd700 1 -- 172.21.15.59:0/1799198897 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fec300d2f80 msgr2=0x7fec300ca570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:07.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.771+0000 7fec2effd700 1 --2- 172.21.15.59:0/1799198897 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fec300d2f80 0x7fec300ca570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:07.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.771+0000 7fec2effd700 1 -- 172.21.15.59:0/1799198897 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fec3015d690 msgr2=0x7fec30158710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:07.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.771+0000 7fec2effd700 1 --2- 172.21.15.59:0/1799198897 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fec3015d690 0x7fec30158710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:07.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.771+0000 7fec2effd700 1 -- 172.21.15.59:0/1799198897 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec20009550 con 0x7fec300b5460 2023-09-21T00:18:07.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.771+0000 7fec2e7fc700 1 --2- 172.21.15.59:0/1799198897 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fec300d2f80 0x7fec300ca570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:18:07.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.771+0000 7fec2effd700 1 --2- 172.21.15.59:0/1799198897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec300b5460 0x7fec30154950 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fec2400b4a0 tx=0x7fec2400b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:07.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.771+0000 7fec17fff700 1 -- 172.21.15.59:0/1799198897 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec24011830 con 0x7fec300b5460 2023-09-21T00:18:07.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.771+0000 7fec17fff700 1 -- 172.21.15.59:0/1799198897 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec24011990 con 0x7fec300b5460 2023-09-21T00:18:07.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.771+0000 7fec35928700 1 -- 172.21.15.59:0/1799198897 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec300cb2f0 con 0x7fec300b5460 2023-09-21T00:18:07.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.771+0000 7fec17fff700 1 -- 172.21.15.59:0/1799198897 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec24011d40 con 0x7fec300b5460 2023-09-21T00:18:07.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.771+0000 7fec35928700 1 -- 172.21.15.59:0/1799198897 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec301558f0 con 0x7fec300b5460 2023-09-21T00:18:07.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.772+0000 7fec35928700 1 -- 172.21.15.59:0/1799198897 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec30067e50 con 0x7fec300b5460 2023-09-21T00:18:07.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.773+0000 7fec17fff700 1 -- 172.21.15.59:0/1799198897 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fec2401a400 con 0x7fec300b5460 2023-09-21T00:18:07.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.773+0000 7fec17fff700 1 --2- 172.21.15.59:0/1799198897 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fec1c06ae00 0x7fec1c06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:07.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.773+0000 7fec17fff700 1 -- 172.21.15.59:0/1799198897 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fec240895e0 con 0x7fec300b5460 2023-09-21T00:18:07.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.773+0000 7fec2e7fc700 1 --2- 172.21.15.59:0/1799198897 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fec1c06ae00 0x7fec1c06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:07.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.774+0000 7fec2e7fc700 1 --2- 172.21.15.59:0/1799198897 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fec1c06ae00 0x7fec1c06d2c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fec20009c10 tx=0x7fec20008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:07.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.777+0000 7fec17fff700 1 -- 172.21.15.59:0/1799198897 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fec24054380 con 0x7fec300b5460 2023-09-21T00:18:07.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.976+0000 7fec35928700 1 -- 172.21.15.59:0/1799198897 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fec300b9080 con 0x7fec300b5460 2023-09-21T00:18:07.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.976+0000 7fec17fff700 1 -- 172.21.15.59:0/1799198897 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fec240579a0 con 0x7fec300b5460 2023-09-21T00:18:07.979 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-09-21T00:18:07.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.978+0000 7fec35928700 1 -- 172.21.15.59:0/1799198897 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fec1c06ae00 msgr2=0x7fec1c06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:07.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.978+0000 7fec35928700 1 --2- 172.21.15.59:0/1799198897 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fec1c06ae00 0x7fec1c06d2c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fec20009c10 tx=0x7fec20008030 comp rx=0 tx=0).stop 2023-09-21T00:18:07.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.978+0000 7fec35928700 1 -- 172.21.15.59:0/1799198897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec300b5460 msgr2=0x7fec30154950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:07.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.978+0000 7fec35928700 1 --2- 172.21.15.59:0/1799198897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec300b5460 0x7fec30154950 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fec2400b4a0 tx=0x7fec2400b860 comp rx=0 tx=0).stop 2023-09-21T00:18:07.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.979+0000 7fec35928700 1 -- 172.21.15.59:0/1799198897 shutdown_connections 2023-09-21T00:18:07.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.979+0000 7fec35928700 1 --2- 172.21.15.59:0/1799198897 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fec3015d690 0x7fec30158710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:07.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.979+0000 7fec35928700 1 --2- 172.21.15.59:0/1799198897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec300b5460 0x7fec30154950 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:07.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.979+0000 7fec35928700 1 --2- 172.21.15.59:0/1799198897 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fec1c06ae00 0x7fec1c06d2c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:07.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.979+0000 7fec35928700 1 --2- 172.21.15.59:0/1799198897 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fec300d2f80 0x7fec300ca570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:07.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.979+0000 7fec35928700 1 -- 172.21.15.59:0/1799198897 >> 172.21.15.59:0/1799198897 conn(0x7fec30072560 msgr2=0x7fec300b4480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:07.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.979+0000 7fec35928700 1 -- 172.21.15.59:0/1799198897 shutdown_connections 2023-09-21T00:18:07.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:07.979+0000 7fec35928700 1 -- 172.21.15.59:0/1799198897 wait complete. 2023-09-21T00:18:07.993 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-21T00:18:08.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.119+0000 7f0de1097700 1 Processor -- start 2023-09-21T00:18:08.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.119+0000 7f0de1097700 1 -- start start 2023-09-21T00:18:08.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.119+0000 7f0de1097700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0ddc06ae90 0x7f0ddc0cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:08.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.119+0000 7f0de1097700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ddc1618a0 con 0x7f0ddc15b2b0 2023-09-21T00:18:08.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.120+0000 7f0de1097700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ddc0cfee0 con 0x7f0ddc0ce420 2023-09-21T00:18:08.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.120+0000 7f0de1097700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ddc0ce250 con 0x7f0ddc06ae90 2023-09-21T00:18:08.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.120+0000 7f0ddad9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0ddc15b2b0 0x7f0ddc161190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58366/0 (socket says 172.21.15.59:58366) 2023-09-21T00:18:08.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.120+0000 7f0ddad9d700 1 -- 172.21.15.59:0/4189872773 learned_addr learned my addr 172.21.15.59:0/4189872773 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:08.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.120+0000 7f0ddb59e700 1 --2- 172.21.15.59:0/4189872773 >> v2:172.21.15.59:3300/0 conn(0x7f0ddc06ae90 0x7f0ddc0cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:08.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.120+0000 7f0dd9d9b700 1 -- 172.21.15.59:0/4189872773 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4237628803 0 0) 0x7f0ddc1618a0 con 0x7f0ddc15b2b0 2023-09-21T00:18:08.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.120+0000 7f0dd9d9b700 1 -- 172.21.15.59:0/4189872773 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dc40035b0 con 0x7f0ddc15b2b0 2023-09-21T00:18:08.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.120+0000 7f0ddb59e700 1 -- 172.21.15.59:0/4189872773 >> v1:172.21.15.83:6789/0 conn(0x7f0ddc0ce420 legacy=0x7f0ddc06a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:08.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.120+0000 7f0ddb59e700 1 -- 172.21.15.59:0/4189872773 >> v1:172.21.15.59:6789/0 conn(0x7f0ddc15b2b0 legacy=0x7f0ddc161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:08.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.120+0000 7f0ddb59e700 1 -- 172.21.15.59:0/4189872773 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ddc0ce900 con 0x7f0ddc06ae90 2023-09-21T00:18:08.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.120+0000 7f0ddb59e700 1 --2- 172.21.15.59:0/4189872773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ddc06ae90 0x7f0ddc0cdd10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4009dc0 tx=0x7f0dd400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa01f73ec61a87cb server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:08.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.120+0000 7f0dd9d9b700 1 -- 172.21.15.59:0/4189872773 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd400e070 con 0x7f0ddc06ae90 2023-09-21T00:18:08.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.120+0000 7f0dd9d9b700 1 -- 172.21.15.59:0/4189872773 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd400bae0 con 0x7f0ddc06ae90 2023-09-21T00:18:08.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.120+0000 7f0dd9d9b700 1 -- 172.21.15.59:0/4189872773 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd400be90 con 0x7f0ddc06ae90 2023-09-21T00:18:08.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.121+0000 7f0de1097700 1 -- 172.21.15.59:0/4189872773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ddc06ae90 msgr2=0x7f0ddc0cdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:08.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.121+0000 7f0de1097700 1 --2- 172.21.15.59:0/4189872773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ddc06ae90 0x7f0ddc0cdd10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4009dc0 tx=0x7f0dd400b330 comp rx=0 tx=0).stop 2023-09-21T00:18:08.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.121+0000 7f0de1097700 1 -- 172.21.15.59:0/4189872773 shutdown_connections 2023-09-21T00:18:08.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.121+0000 7f0de1097700 1 --2- 172.21.15.59:0/4189872773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ddc06ae90 0x7f0ddc0cdd10 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:08.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.121+0000 7f0de1097700 1 -- 172.21.15.59:0/4189872773 >> 172.21.15.59:0/4189872773 conn(0x7f0ddc0d0140 msgr2=0x7f0ddc0d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:08.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.121+0000 7f0de1097700 1 -- 172.21.15.59:0/4189872773 shutdown_connections 2023-09-21T00:18:08.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.121+0000 7f0de1097700 1 -- 172.21.15.59:0/4189872773 wait complete. 2023-09-21T00:18:08.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.123+0000 7f0de1097700 1 Processor -- start 2023-09-21T00:18:08.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.123+0000 7f0de1097700 1 -- start start 2023-09-21T00:18:08.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.124+0000 7f0de1097700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ddc06ae90 0x7f0ddc1536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:08.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.124+0000 7f0de1097700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ddc0ce420 0x7f0ddc0b1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:08.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.124+0000 7f0de1097700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ddc15b2b0 0x7f0ddc0b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:08.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.124+0000 7f0de1097700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc0b4020 con 0x7f0ddc15b2b0 2023-09-21T00:18:08.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.124+0000 7f0de1097700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc0b4300 con 0x7f0ddc06ae90 2023-09-21T00:18:08.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.124+0000 7f0de1097700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc0b45e0 con 0x7f0ddc0ce420 2023-09-21T00:18:08.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.124+0000 7f0ddb59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ddc15b2b0 0x7f0ddc0b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:08.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.124+0000 7f0ddb59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ddc15b2b0 0x7f0ddc0b4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52806/0 (socket says 172.21.15.59:52806) 2023-09-21T00:18:08.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.124+0000 7f0ddb59e700 1 -- 172.21.15.59:0/1189748336 learned_addr learned my addr 172.21.15.59:0/1189748336 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:08.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.124+0000 7f0ddad9d700 1 --2- 172.21.15.59:0/1189748336 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ddc06ae90 0x7f0ddc1536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:08.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.124+0000 7f0dda59c700 1 --2- 172.21.15.59:0/1189748336 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ddc0ce420 0x7f0ddc0b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:08.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.124+0000 7f0ddb59e700 1 -- 172.21.15.59:0/1189748336 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ddc0ce420 msgr2=0x7f0ddc0b1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:08.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.124+0000 7f0ddb59e700 1 --2- 172.21.15.59:0/1189748336 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ddc0ce420 0x7f0ddc0b1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:08.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.124+0000 7f0ddb59e700 1 -- 172.21.15.59:0/1189748336 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ddc06ae90 msgr2=0x7f0ddc1536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:08.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.124+0000 7f0ddb59e700 1 --2- 172.21.15.59:0/1189748336 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ddc06ae90 0x7f0ddc1536a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:08.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.124+0000 7f0ddb59e700 1 -- 172.21.15.59:0/1189748336 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd4009a70 con 0x7f0ddc15b2b0 2023-09-21T00:18:08.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.124+0000 7f0ddb59e700 1 --2- 172.21.15.59:0/1189748336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ddc15b2b0 0x7f0ddc0b4de0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4014040 tx=0x7f0dd4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:08.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.124+0000 7f0dc37fe700 1 -- 172.21.15.59:0/1189748336 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd40045d0 con 0x7f0ddc15b2b0 2023-09-21T00:18:08.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.125+0000 7f0dc37fe700 1 -- 172.21.15.59:0/1189748336 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd4020070 con 0x7f0ddc15b2b0 2023-09-21T00:18:08.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.125+0000 7f0dc37fe700 1 -- 172.21.15.59:0/1189748336 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd4004970 con 0x7f0ddc15b2b0 2023-09-21T00:18:08.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.125+0000 7f0de1097700 1 -- 172.21.15.59:0/1189748336 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ddc0b48c0 con 0x7f0ddc15b2b0 2023-09-21T00:18:08.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.125+0000 7f0de1097700 1 -- 172.21.15.59:0/1189748336 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ddc153be0 con 0x7f0ddc15b2b0 2023-09-21T00:18:08.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.125+0000 7f0dc17fa700 1 -- 172.21.15.59:0/1189748336 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db40052f0 con 0x7f0ddc15b2b0 2023-09-21T00:18:08.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.126+0000 7f0dc37fe700 1 -- 172.21.15.59:0/1189748336 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f0dd4012430 con 0x7f0ddc15b2b0 2023-09-21T00:18:08.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.126+0000 7f0dc37fe700 1 --2- 172.21.15.59:0/1189748336 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f0dc806ae00 0x7f0dc806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:08.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.126+0000 7f0dc37fe700 1 -- 172.21.15.59:0/1189748336 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f0dd4022070 con 0x7f0ddc15b2b0 2023-09-21T00:18:08.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.127+0000 7f0ddad9d700 1 --2- 172.21.15.59:0/1189748336 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f0dc806ae00 0x7f0dc806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:08.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.127+0000 7f0ddad9d700 1 --2- 172.21.15.59:0/1189748336 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f0dc806ae00 0x7f0dc806d2c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc007fd0 tx=0x7f0dcc007dc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:08.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.131+0000 7f0dc37fe700 1 -- 172.21.15.59:0/1189748336 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f0dd4059e10 con 0x7f0ddc15b2b0 2023-09-21T00:18:08.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.335+0000 7f0dc17fa700 1 -- 172.21.15.59:0/1189748336 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0db4005b20 con 0x7f0ddc15b2b0 2023-09-21T00:18:08.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.335+0000 7f0dc37fe700 1 -- 172.21.15.59:0/1189748336 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0dd40599a0 con 0x7f0ddc15b2b0 2023-09-21T00:18:08.338 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-09-21T00:18:08.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.337+0000 7f0dc17fa700 1 -- 172.21.15.59:0/1189748336 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f0dc806ae00 msgr2=0x7f0dc806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:08.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.337+0000 7f0dc17fa700 1 --2- 172.21.15.59:0/1189748336 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f0dc806ae00 0x7f0dc806d2c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc007fd0 tx=0x7f0dcc007dc0 comp rx=0 tx=0).stop 2023-09-21T00:18:08.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.337+0000 7f0dc17fa700 1 -- 172.21.15.59:0/1189748336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ddc15b2b0 msgr2=0x7f0ddc0b4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:08.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.337+0000 7f0dc17fa700 1 --2- 172.21.15.59:0/1189748336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ddc15b2b0 0x7f0ddc0b4de0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4014040 tx=0x7f0dd4004ad0 comp rx=0 tx=0).stop 2023-09-21T00:18:08.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.337+0000 7f0dc17fa700 1 -- 172.21.15.59:0/1189748336 shutdown_connections 2023-09-21T00:18:08.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.337+0000 7f0dc17fa700 1 --2- 172.21.15.59:0/1189748336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ddc15b2b0 0x7f0ddc0b4de0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:08.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.337+0000 7f0dc17fa700 1 --2- 172.21.15.59:0/1189748336 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ddc06ae90 0x7f0ddc1536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:08.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.337+0000 7f0dc17fa700 1 --2- 172.21.15.59:0/1189748336 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f0dc806ae00 0x7f0dc806d2c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:08.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.337+0000 7f0dc17fa700 1 --2- 172.21.15.59:0/1189748336 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ddc0ce420 0x7f0ddc0b1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:08.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.337+0000 7f0dc17fa700 1 -- 172.21.15.59:0/1189748336 >> 172.21.15.59:0/1189748336 conn(0x7f0ddc0d0140 msgr2=0x7f0ddc06a780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:08.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.337+0000 7f0dc17fa700 1 -- 172.21.15.59:0/1189748336 shutdown_connections 2023-09-21T00:18:08.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.338+0000 7f0dc17fa700 1 -- 172.21.15.59:0/1189748336 wait complete. 2023-09-21T00:18:08.352 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-21T00:18:08.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.476+0000 7fca2ab19700 1 Processor -- start 2023-09-21T00:18:08.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.476+0000 7fca2ab19700 1 -- start start 2023-09-21T00:18:08.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.477+0000 7fca2ab19700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fca240cb9a0 0x7fca24152550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:08.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.477+0000 7fca2ab19700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca2406b1b0 con 0x7fca2406db30 2023-09-21T00:18:08.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.477+0000 7fca2ab19700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca2415c990 con 0x7fca2406add0 2023-09-21T00:18:08.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.477+0000 7fca2ab19700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca2415bd80 con 0x7fca240cb9a0 2023-09-21T00:18:08.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.477+0000 7fca23fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fca2406db30 0x7fca24151e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58380/0 (socket says 172.21.15.59:58380) 2023-09-21T00:18:08.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.477+0000 7fca23fff700 1 -- 172.21.15.59:0/3805511441 learned_addr learned my addr 172.21.15.59:0/3805511441 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:08.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.477+0000 7fca290b6700 1 --2- 172.21.15.59:0/3805511441 >> v2:172.21.15.83:3300/0 conn(0x7fca240cb9a0 0x7fca24152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:08.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.477+0000 7fca237fe700 1 -- 172.21.15.59:0/3805511441 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 860289936 0 0) 0x7fca2406b1b0 con 0x7fca2406db30 2023-09-21T00:18:08.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.477+0000 7fca237fe700 1 -- 172.21.15.59:0/3805511441 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca140035b0 con 0x7fca2406db30 2023-09-21T00:18:08.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.477+0000 7fca237fe700 1 -- 172.21.15.59:0/3805511441 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3091524878 0 0) 0x7fca2415c990 con 0x7fca2406add0 2023-09-21T00:18:08.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.477+0000 7fca237fe700 1 -- 172.21.15.59:0/3805511441 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca2406b1b0 con 0x7fca2406add0 2023-09-21T00:18:08.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.477+0000 7fca237fe700 1 -- 172.21.15.59:0/3805511441 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 842207625 0 0) 0x7fca140035b0 con 0x7fca2406db30 2023-09-21T00:18:08.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.478+0000 7fca237fe700 1 -- 172.21.15.59:0/3805511441 >> v2:172.21.15.83:3300/0 conn(0x7fca240cb9a0 msgr2=0x7fca24152550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:08.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.478+0000 7fca237fe700 1 --2- 172.21.15.59:0/3805511441 >> v2:172.21.15.83:3300/0 conn(0x7fca240cb9a0 0x7fca24152550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:08.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.478+0000 7fca237fe700 1 -- 172.21.15.59:0/3805511441 >> v1:172.21.15.83:6789/0 conn(0x7fca2406add0 legacy=0x7fca2406fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:08.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.478+0000 7fca237fe700 1 -- 172.21.15.59:0/3805511441 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca2415c060 con 0x7fca2406db30 2023-09-21T00:18:08.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.478+0000 7fca290b6700 1 --2- 172.21.15.59:0/3805511441 >> v2:172.21.15.83:3300/0 conn(0x7fca240cb9a0 0x7fca24152550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T00:18:08.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.478+0000 7fca237fe700 1 -- 172.21.15.59:0/3805511441 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 710825841 0 0) 0x7fca10001670 con 0x7fca2406db30 2023-09-21T00:18:08.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.478+0000 7fca237fe700 1 -- 172.21.15.59:0/3805511441 >> v1:172.21.15.59:6789/0 conn(0x7fca2406db30 legacy=0x7fca24151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:08.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.478+0000 7fca237fe700 1 --2- 172.21.15.59:0/3805511441 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca14003b90 0x7fca14003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:08.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.478+0000 7fca237fe700 1 --2- 172.21.15.59:0/3805511441 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fca14004850 0x7fca14004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:08.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.478+0000 7fca237fe700 1 --2- 172.21.15.59:0/3805511441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca14005210 0x7fca1400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:08.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.478+0000 7fca237fe700 1 -- 172.21.15.59:0/3805511441 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2415bd80 con 0x7fca14005210 2023-09-21T00:18:08.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.478+0000 7fca237fe700 1 -- 172.21.15.59:0/3805511441 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1400c090 con 0x7fca14003b90 2023-09-21T00:18:08.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.478+0000 7fca237fe700 1 -- 172.21.15.59:0/3805511441 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca1400c250 con 0x7fca14004850 2023-09-21T00:18:08.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.478+0000 7fca290b6700 1 --2- 172.21.15.59:0/3805511441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca14005210 0x7fca1400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:08.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.478+0000 7fca288b5700 1 --2- 172.21.15.59:0/3805511441 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca14003b90 0x7fca14003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:08.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.478+0000 7fca23fff700 1 --2- 172.21.15.59:0/3805511441 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fca14004850 0x7fca14004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:08.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.478+0000 7fca290b6700 1 -- 172.21.15.59:0/3805511441 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fca14004850 msgr2=0x7fca14004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:08.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.478+0000 7fca290b6700 1 --2- 172.21.15.59:0/3805511441 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fca14004850 0x7fca14004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:08.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.478+0000 7fca290b6700 1 -- 172.21.15.59:0/3805511441 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca14003b90 msgr2=0x7fca14003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:08.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.478+0000 7fca290b6700 1 --2- 172.21.15.59:0/3805511441 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca14003b90 0x7fca14003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:08.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.478+0000 7fca290b6700 1 -- 172.21.15.59:0/3805511441 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca140035b0 con 0x7fca14005210 2023-09-21T00:18:08.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.478+0000 7fca23fff700 1 --2- 172.21.15.59:0/3805511441 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fca14004850 0x7fca14004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:18:08.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.478+0000 7fca290b6700 1 -- 172.21.15.59:0/3805511441 reap_dead start 2023-09-21T00:18:08.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.478+0000 7fca290b6700 1 --2- 172.21.15.59:0/3805511441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca14005210 0x7fca1400ba10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fca1c00e320 tx=0x7fca14005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbf83029d6673ebc server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:08.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.478+0000 7fca237fe700 1 -- 172.21.15.59:0/3805511441 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1c00edc0 con 0x7fca14005210 2023-09-21T00:18:08.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.478+0000 7fca237fe700 1 -- 172.21.15.59:0/3805511441 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca1c00f040 con 0x7fca14005210 2023-09-21T00:18:08.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.478+0000 7fca237fe700 1 -- 172.21.15.59:0/3805511441 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1c0146c0 con 0x7fca14005210 2023-09-21T00:18:08.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.479+0000 7fca2ab19700 1 -- 172.21.15.59:0/3805511441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca14005210 msgr2=0x7fca1400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:08.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.479+0000 7fca2ab19700 1 --2- 172.21.15.59:0/3805511441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca14005210 0x7fca1400ba10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fca1c00e320 tx=0x7fca14005880 comp rx=0 tx=0).stop 2023-09-21T00:18:08.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.479+0000 7fca2ab19700 1 -- 172.21.15.59:0/3805511441 shutdown_connections 2023-09-21T00:18:08.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.479+0000 7fca2ab19700 1 --2- 172.21.15.59:0/3805511441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca14005210 0x7fca1400ba10 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:08.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.479+0000 7fca2ab19700 1 -- 172.21.15.59:0/3805511441 >> 172.21.15.59:0/3805511441 conn(0x7fca240ccae0 msgr2=0x7fca240ccef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:08.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.479+0000 7fca2ab19700 1 -- 172.21.15.59:0/3805511441 shutdown_connections 2023-09-21T00:18:08.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.479+0000 7fca2ab19700 1 -- 172.21.15.59:0/3805511441 wait complete. 2023-09-21T00:18:08.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.480+0000 7fca2ab19700 1 Processor -- start 2023-09-21T00:18:08.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.480+0000 7fca2ab19700 1 -- start start 2023-09-21T00:18:08.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.481+0000 7fca2ab19700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca14005210 0x7fca241f6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:08.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.481+0000 7fca2ab19700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fca241536e0 0x7fca24153b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:08.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.481+0000 7fca2ab19700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca240ce240 0x7fca240ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:08.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.481+0000 7fca2ab19700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca241540a0 con 0x7fca240ce240 2023-09-21T00:18:08.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.481+0000 7fca2ab19700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca240cf000 con 0x7fca14005210 2023-09-21T00:18:08.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.481+0000 7fca2ab19700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca240cf2e0 con 0x7fca241536e0 2023-09-21T00:18:08.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.481+0000 7fca290b6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca240ce240 0x7fca240ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:08.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.481+0000 7fca290b6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca240ce240 0x7fca240ce6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52826/0 (socket says 172.21.15.59:52826) 2023-09-21T00:18:08.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.481+0000 7fca290b6700 1 -- 172.21.15.59:0/2538393609 learned_addr learned my addr 172.21.15.59:0/2538393609 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:08.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.481+0000 7fca23fff700 1 --2- 172.21.15.59:0/2538393609 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fca241536e0 0x7fca24153b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:08.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.482+0000 7fca288b5700 1 --2- 172.21.15.59:0/2538393609 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca14005210 0x7fca241f6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:08.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.482+0000 7fca290b6700 1 -- 172.21.15.59:0/2538393609 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fca241536e0 msgr2=0x7fca24153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:08.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.482+0000 7fca290b6700 1 --2- 172.21.15.59:0/2538393609 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fca241536e0 0x7fca24153b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:08.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.482+0000 7fca290b6700 1 -- 172.21.15.59:0/2538393609 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca14005210 msgr2=0x7fca241f6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:08.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.482+0000 7fca290b6700 1 --2- 172.21.15.59:0/2538393609 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca14005210 0x7fca241f6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:08.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.482+0000 7fca290b6700 1 -- 172.21.15.59:0/2538393609 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca240cf5c0 con 0x7fca240ce240 2023-09-21T00:18:08.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.482+0000 7fca288b5700 1 --2- 172.21.15.59:0/2538393609 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca14005210 0x7fca241f6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:18:08.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.482+0000 7fca290b6700 1 --2- 172.21.15.59:0/2538393609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca240ce240 0x7fca240ce6c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fca24066fa0 tx=0x7fca1c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:08.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.482+0000 7fca217fa700 1 -- 172.21.15.59:0/2538393609 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1c007000 con 0x7fca240ce240 2023-09-21T00:18:08.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.482+0000 7fca217fa700 1 -- 172.21.15.59:0/2538393609 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca1c021070 con 0x7fca240ce240 2023-09-21T00:18:08.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.482+0000 7fca2ab19700 1 -- 172.21.15.59:0/2538393609 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca240cf8a0 con 0x7fca240ce240 2023-09-21T00:18:08.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.482+0000 7fca217fa700 1 -- 172.21.15.59:0/2538393609 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1c01d640 con 0x7fca240ce240 2023-09-21T00:18:08.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.482+0000 7fca2ab19700 1 -- 172.21.15.59:0/2538393609 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca240cec00 con 0x7fca240ce240 2023-09-21T00:18:08.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.483+0000 7fca2ab19700 1 -- 172.21.15.59:0/2538393609 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca2406e550 con 0x7fca240ce240 2023-09-21T00:18:08.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.483+0000 7fca217fa700 1 -- 172.21.15.59:0/2538393609 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fca1c01d7a0 con 0x7fca240ce240 2023-09-21T00:18:08.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.484+0000 7fca217fa700 1 --2- 172.21.15.59:0/2538393609 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fca0806ae00 0x7fca0806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:08.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.484+0000 7fca217fa700 1 -- 172.21.15.59:0/2538393609 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fca1c08b370 con 0x7fca240ce240 2023-09-21T00:18:08.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.484+0000 7fca288b5700 1 --2- 172.21.15.59:0/2538393609 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fca0806ae00 0x7fca0806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:08.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.484+0000 7fca288b5700 1 --2- 172.21.15.59:0/2538393609 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fca0806ae00 0x7fca0806d2c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fca18007fd0 tx=0x7fca18009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:08.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.488+0000 7fca217fa700 1 -- 172.21.15.59:0/2538393609 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fca1c0561c0 con 0x7fca240ce240 2023-09-21T00:18:08.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.703+0000 7fca2ab19700 1 -- 172.21.15.59:0/2538393609 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fca240cf420 con 0x7fca240ce240 2023-09-21T00:18:08.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.703+0000 7fca217fa700 1 -- 172.21.15.59:0/2538393609 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fca240cf420 con 0x7fca240ce240 2023-09-21T00:18:08.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.706+0000 7fca2ab19700 1 -- 172.21.15.59:0/2538393609 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fca0806ae00 msgr2=0x7fca0806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:08.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.706+0000 7fca2ab19700 1 --2- 172.21.15.59:0/2538393609 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fca0806ae00 0x7fca0806d2c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fca18007fd0 tx=0x7fca18009040 comp rx=0 tx=0).stop 2023-09-21T00:18:08.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.706+0000 7fca2ab19700 1 -- 172.21.15.59:0/2538393609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca240ce240 msgr2=0x7fca240ce6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:08.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.706+0000 7fca2ab19700 1 --2- 172.21.15.59:0/2538393609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca240ce240 0x7fca240ce6c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fca24066fa0 tx=0x7fca1c009750 comp rx=0 tx=0).stop 2023-09-21T00:18:08.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.706+0000 7fca2ab19700 1 -- 172.21.15.59:0/2538393609 shutdown_connections 2023-09-21T00:18:08.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.706+0000 7fca2ab19700 1 --2- 172.21.15.59:0/2538393609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca240ce240 0x7fca240ce6c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:08.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.706+0000 7fca2ab19700 1 --2- 172.21.15.59:0/2538393609 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca14005210 0x7fca241f6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:08.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.706+0000 7fca2ab19700 1 --2- 172.21.15.59:0/2538393609 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fca0806ae00 0x7fca0806d2c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:08.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.706+0000 7fca2ab19700 1 --2- 172.21.15.59:0/2538393609 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fca241536e0 0x7fca24153b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:08.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.706+0000 7fca2ab19700 1 -- 172.21.15.59:0/2538393609 >> 172.21.15.59:0/2538393609 conn(0x7fca240ccae0 msgr2=0x7fca240b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:08.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.706+0000 7fca2ab19700 1 -- 172.21.15.59:0/2538393609 shutdown_connections 2023-09-21T00:18:08.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:08.706+0000 7fca2ab19700 1 -- 172.21.15.59:0/2538393609 wait complete. 2023-09-21T00:18:08.711 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2023-09-21T00:18:08.720 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-09-21T00:18:08.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:18:08.721 DEBUG:teuthology.orchestra.run.smithi059:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-09-21T00:18:08.762 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2023-09-21T00:18:08.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:18:08.764 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-09-21T00:18:08.820 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-09-21T00:18:08.820 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-21T00:18:08.842 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-09-21T00:18:08.843 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-21T00:18:08.903 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-09-21T00:18:08.904 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-21T00:18:08.964 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T00:18:09.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.087+0000 7fa8a45ef700 1 Processor -- start 2023-09-21T00:18:09.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.087+0000 7fa8a45ef700 1 -- start start 2023-09-21T00:18:09.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.088+0000 7fa8a45ef700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa89c15a230 0x7fa89c15e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:09.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.088+0000 7fa8a45ef700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa89c0ca790 0x7fa89c071680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:09.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.088+0000 7fa8a45ef700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa89c0cabf0 0x7fa89c071bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:09.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.088+0000 7fa8a45ef700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa89c0cb780 con 0x7fa89c0cabf0 2023-09-21T00:18:09.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.088+0000 7fa8a45ef700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa89c0cb1c0 con 0x7fa89c15a230 2023-09-21T00:18:09.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.088+0000 7fa8a45ef700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c0cb4a0 con 0x7fa89c0ca790 2023-09-21T00:18:09.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.088+0000 7fa8a2b8c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa89c0cabf0 0x7fa89c071bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:09.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.088+0000 7fa8a2b8c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa89c0cabf0 0x7fa89c071bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52834/0 (socket says 172.21.15.59:52834) 2023-09-21T00:18:09.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.088+0000 7fa8a2b8c700 1 -- 172.21.15.59:0/2589656693 learned_addr learned my addr 172.21.15.59:0/2589656693 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:09.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.088+0000 7fa8a238b700 1 --2- 172.21.15.59:0/2589656693 >> v2:172.21.15.83:3300/0 conn(0x7fa89c15a230 0x7fa89c15e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:09.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.089+0000 7fa8a1b8a700 1 --2- 172.21.15.59:0/2589656693 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa89c0ca790 0x7fa89c071680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:09.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.089+0000 7fa8a2b8c700 1 -- 172.21.15.59:0/2589656693 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa89c0ca790 msgr2=0x7fa89c071680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:09.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.089+0000 7fa8a2b8c700 1 --2- 172.21.15.59:0/2589656693 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa89c0ca790 0x7fa89c071680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:09.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.089+0000 7fa8a2b8c700 1 -- 172.21.15.59:0/2589656693 >> v2:172.21.15.83:3300/0 conn(0x7fa89c15a230 msgr2=0x7fa89c15e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:09.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.089+0000 7fa8a2b8c700 1 --2- 172.21.15.59:0/2589656693 >> v2:172.21.15.83:3300/0 conn(0x7fa89c15a230 0x7fa89c15e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:09.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.089+0000 7fa8a2b8c700 1 -- 172.21.15.59:0/2589656693 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa89c15e0b0 con 0x7fa89c0cabf0 2023-09-21T00:18:09.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.089+0000 7fa8a1b8a700 1 --2- 172.21.15.59:0/2589656693 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa89c0ca790 0x7fa89c071680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:18:09.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.089+0000 7fa8a2b8c700 1 --2- 172.21.15.59:0/2589656693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa89c0cabf0 0x7fa89c071bc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa89c0cbb60 tx=0x7fa89400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b0db01d53156506 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:09.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.089+0000 7fa8a1389700 1 -- 172.21.15.59:0/2589656693 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89400e070 con 0x7fa89c0cabf0 2023-09-21T00:18:09.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.089+0000 7fa8a1389700 1 -- 172.21.15.59:0/2589656693 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89400b9c0 con 0x7fa89c0cabf0 2023-09-21T00:18:09.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.089+0000 7fa8a1389700 1 -- 172.21.15.59:0/2589656693 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89400bd70 con 0x7fa89c0cabf0 2023-09-21T00:18:09.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.089+0000 7fa8a45ef700 1 -- 172.21.15.59:0/2589656693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa89c0cabf0 msgr2=0x7fa89c071bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:09.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.089+0000 7fa8a45ef700 1 --2- 172.21.15.59:0/2589656693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa89c0cabf0 0x7fa89c071bc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa89c0cbb60 tx=0x7fa89400b330 comp rx=0 tx=0).stop 2023-09-21T00:18:09.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.089+0000 7fa8a45ef700 1 -- 172.21.15.59:0/2589656693 shutdown_connections 2023-09-21T00:18:09.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.090+0000 7fa8a45ef700 1 --2- 172.21.15.59:0/2589656693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa89c0cabf0 0x7fa89c071bc0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:09.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.090+0000 7fa8a45ef700 1 --2- 172.21.15.59:0/2589656693 >> v2:172.21.15.83:3300/0 conn(0x7fa89c15a230 0x7fa89c15e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:09.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.090+0000 7fa8a45ef700 1 --2- 172.21.15.59:0/2589656693 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa89c0ca790 0x7fa89c071680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:09.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.090+0000 7fa8a45ef700 1 -- 172.21.15.59:0/2589656693 >> 172.21.15.59:0/2589656693 conn(0x7fa89c0d0140 msgr2=0x7fa89c0d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:09.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.090+0000 7fa8a45ef700 1 -- 172.21.15.59:0/2589656693 shutdown_connections 2023-09-21T00:18:09.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.090+0000 7fa8a45ef700 1 -- 172.21.15.59:0/2589656693 wait complete. 2023-09-21T00:18:09.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.091+0000 7fa8a45ef700 1 Processor -- start 2023-09-21T00:18:09.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.091+0000 7fa8a45ef700 1 -- start start 2023-09-21T00:18:09.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.092+0000 7fa8a45ef700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa89c0ca790 0x7fa89c151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:09.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.092+0000 7fa8a45ef700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa89c0cabf0 0x7fa89c1f1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:09.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.092+0000 7fa8a45ef700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa89c15a230 0x7fa89c0b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:09.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.092+0000 7fa8a45ef700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c151d50 con 0x7fa89c0ca790 2023-09-21T00:18:09.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.092+0000 7fa8a45ef700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c1f1a60 con 0x7fa89c0cabf0 2023-09-21T00:18:09.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.092+0000 7fa8a45ef700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c0c7f50 con 0x7fa89c15a230 2023-09-21T00:18:09.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.092+0000 7fa8a238b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa89c0ca790 0x7fa89c151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:09.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.092+0000 7fa8a238b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa89c0ca790 0x7fa89c151810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52836/0 (socket says 172.21.15.59:52836) 2023-09-21T00:18:09.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.092+0000 7fa8a238b700 1 -- 172.21.15.59:0/1191229408 learned_addr learned my addr 172.21.15.59:0/1191229408 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:09.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.092+0000 7fa8a1b8a700 1 --2- 172.21.15.59:0/1191229408 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa89c0cabf0 0x7fa89c1f1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:09.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.092+0000 7fa8a2b8c700 1 --2- 172.21.15.59:0/1191229408 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa89c15a230 0x7fa89c0b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:09.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.093+0000 7fa8a238b700 1 -- 172.21.15.59:0/1191229408 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa89c15a230 msgr2=0x7fa89c0b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:09.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.093+0000 7fa8a238b700 1 --2- 172.21.15.59:0/1191229408 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa89c15a230 0x7fa89c0b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:09.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.093+0000 7fa8a238b700 1 -- 172.21.15.59:0/1191229408 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa89c0cabf0 msgr2=0x7fa89c1f1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:09.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.093+0000 7fa8a238b700 1 --2- 172.21.15.59:0/1191229408 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa89c0cabf0 0x7fa89c1f1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:09.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.093+0000 7fa8a238b700 1 -- 172.21.15.59:0/1191229408 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa894009b30 con 0x7fa89c0ca790 2023-09-21T00:18:09.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.093+0000 7fa8a238b700 1 --2- 172.21.15.59:0/1191229408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa89c0ca790 0x7fa89c151810 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa88c00d800 tx=0x7fa88c00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:09.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.093+0000 7fa892ffd700 1 -- 172.21.15.59:0/1191229408 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88c0125f0 con 0x7fa89c0ca790 2023-09-21T00:18:09.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.093+0000 7fa892ffd700 1 -- 172.21.15.59:0/1191229408 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88c012750 con 0x7fa89c0ca790 2023-09-21T00:18:09.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.093+0000 7fa8a45ef700 1 -- 172.21.15.59:0/1191229408 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa89c0c8210 con 0x7fa89c0ca790 2023-09-21T00:18:09.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.093+0000 7fa892ffd700 1 -- 172.21.15.59:0/1191229408 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88c012b00 con 0x7fa89c0ca790 2023-09-21T00:18:09.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.093+0000 7fa8a45ef700 1 -- 172.21.15.59:0/1191229408 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa89c0c8ae0 con 0x7fa89c0ca790 2023-09-21T00:18:09.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.094+0000 7fa8a45ef700 1 -- 172.21.15.59:0/1191229408 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa89c0c8e50 con 0x7fa89c0ca790 2023-09-21T00:18:09.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.095+0000 7fa892ffd700 1 -- 172.21.15.59:0/1191229408 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fa88c012c60 con 0x7fa89c0ca790 2023-09-21T00:18:09.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.095+0000 7fa892ffd700 1 --2- 172.21.15.59:0/1191229408 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa88006ae00 0x7fa88006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:09.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.095+0000 7fa892ffd700 1 -- 172.21.15.59:0/1191229408 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fa88c089940 con 0x7fa89c0ca790 2023-09-21T00:18:09.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.095+0000 7fa8a1b8a700 1 --2- 172.21.15.59:0/1191229408 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa88006ae00 0x7fa88006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:09.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.096+0000 7fa8a1b8a700 1 --2- 172.21.15.59:0/1191229408 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa88006ae00 0x7fa88006d2c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa89c157680 tx=0x7fa898008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:09.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.099+0000 7fa892ffd700 1 -- 172.21.15.59:0/1191229408 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fa88c054700 con 0x7fa89c0ca790 2023-09-21T00:18:09.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.305+0000 7fa8a45ef700 1 -- 172.21.15.59:0/1191229408 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa89c0c8450 con 0x7fa89c0ca790 2023-09-21T00:18:09.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.306+0000 7fa892ffd700 1 -- 172.21.15.59:0/1191229408 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18792 (secure 0 0 0) 0x7fa89c0c8450 con 0x7fa89c0ca790 2023-09-21T00:18:09.308 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:18:09.309 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":26,"fsid":"dd69925c-6e25-42fe-880b-2f60fc6f384b","created":"2023-09-21T00:16:43.074489+0000","modified":"2023-09-21T00:17:50.090179+0000","last_up_change":"2023-09-21T00:16:54.740101+0000","last_in_change":"2023-09-21T00:16:45.987089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T00:16:54.796248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-21T00:17:04.167102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-21T00:17:05.313188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-21T00:17:08.977609+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d4b18344-74c0-4f75-920b-7a9247e48914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6809","nonce":2418314235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6811","nonce":2418314235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6815","nonce":2418314235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6813","nonce":2418314235}]},"public_addr":"172.21.15.59:6809/2418314235","cluster_addr":"172.21.15.59:6811/2418314235","heartbeat_back_addr":"172.21.15.59:6815/2418314235","heartbeat_front_addr":"172.21.15.59:6813/2418314235","state":["exists","up"]},{"osd":1,"uuid":"80940d50-a248-4e64-a282-7ffcdad790ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6801","nonce":869668251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6803","nonce":869668251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6807","nonce":869668251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6805","nonce":869668251}]},"public_addr":"172.21.15.59:6801/869668251","cluster_addr":"172.21.15.59:6803/869668251","heartbeat_back_addr":"172.21.15.59:6807/869668251","heartbeat_front_addr":"172.21.15.59:6805/869668251","state":["exists","up"]},{"osd":2,"uuid":"55f2eceb-c54a-4879-a6ce-968c1c548b5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6817","nonce":372517778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6819","nonce":372517778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6823","nonce":372517778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6821","nonce":372517778}]},"public_addr":"172.21.15.59:6817/372517778","cluster_addr":"172.21.15.59:6819/372517778","heartbeat_back_addr":"172.21.15.59:6823/372517778","heartbeat_front_addr":"172.21.15.59:6821/372517778","state":["exists","up"]},{"osd":3,"uuid":"92b89cd0-869c-49b9-a9f9-97ac8423f304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6825","nonce":575188498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6827","nonce":575188498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6831","nonce":575188498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6829","nonce":575188498}]},"public_addr":"172.21.15.59:6825/575188498","cluster_addr":"172.21.15.59:6827/575188498","heartbeat_back_addr":"172.21.15.59:6831/575188498","heartbeat_front_addr":"172.21.15.59:6829/575188498","state":["exists","up"]},{"osd":4,"uuid":"25b80e94-e0e6-403d-b69f-61542f289637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6803","nonce":1741219098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6805","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6807","nonce":1741219098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6815","nonce":1741219098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6811","nonce":1741219098}]},"public_addr":"172.21.15.83:6803/1741219098","cluster_addr":"172.21.15.83:6807/1741219098","heartbeat_back_addr":"172.21.15.83:6815/1741219098","heartbeat_front_addr":"172.21.15.83:6811/1741219098","state":["exists","up"]},{"osd":5,"uuid":"5498d9ab-1086-4796-a199-9051e6dfea91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6817","nonce":156730565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6819","nonce":156730565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6823","nonce":156730565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6821","nonce":156730565}]},"public_addr":"172.21.15.83:6817/156730565","cluster_addr":"172.21.15.83:6819/156730565","heartbeat_back_addr":"172.21.15.83:6823/156730565","heartbeat_front_addr":"172.21.15.83:6821/156730565","state":["exists","up"]},{"osd":6,"uuid":"cfd810c0-5015-4d60-9a75-7efc93a32e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6801","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6800","nonce":1337723778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6806","nonce":1337723778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6814","nonce":1337723778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6810","nonce":1337723778}]},"public_addr":"172.21.15.83:6800/1337723778","cluster_addr":"172.21.15.83:6806/1337723778","heartbeat_back_addr":"172.21.15.83:6814/1337723778","heartbeat_front_addr":"172.21.15.83:6810/1337723778","state":["exists","up"]},{"osd":7,"uuid":"e992c8fa-0a3d-4b3c-85b5-2c511223dee4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6825","nonce":4204859272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6827","nonce":4204859272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6831","nonce":4204859272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6829","nonce":4204859272}]},"public_addr":"172.21.15.83:6825/4204859272","cluster_addr":"172.21.15.83:6827/4204859272","heartbeat_back_addr":"172.21.15.83:6831/4204859272","heartbeat_front_addr":"172.21.15.83:6829/4204859272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.156498+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.882707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.093978+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.158565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.173933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.888606+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.135525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.149712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":3,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.34","mappings":[{"from":4,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":6}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T00:18:09.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.308+0000 7fa8a45ef700 1 -- 172.21.15.59:0/1191229408 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa88006ae00 msgr2=0x7fa88006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:09.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.308+0000 7fa8a45ef700 1 --2- 172.21.15.59:0/1191229408 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa88006ae00 0x7fa88006d2c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa89c157680 tx=0x7fa898008040 comp rx=0 tx=0).stop 2023-09-21T00:18:09.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.308+0000 7fa8a45ef700 1 -- 172.21.15.59:0/1191229408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa89c0ca790 msgr2=0x7fa89c151810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:09.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.308+0000 7fa8a45ef700 1 --2- 172.21.15.59:0/1191229408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa89c0ca790 0x7fa89c151810 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa88c00d800 tx=0x7fa88c00db10 comp rx=0 tx=0).stop 2023-09-21T00:18:09.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.308+0000 7fa8a45ef700 1 -- 172.21.15.59:0/1191229408 shutdown_connections 2023-09-21T00:18:09.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.308+0000 7fa8a45ef700 1 --2- 172.21.15.59:0/1191229408 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa88006ae00 0x7fa88006d2c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:09.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.308+0000 7fa8a45ef700 1 --2- 172.21.15.59:0/1191229408 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa89c15a230 0x7fa89c0b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:09.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.308+0000 7fa8a45ef700 1 --2- 172.21.15.59:0/1191229408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa89c0ca790 0x7fa89c151810 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:09.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.308+0000 7fa8a45ef700 1 --2- 172.21.15.59:0/1191229408 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa89c0cabf0 0x7fa89c1f1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:09.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.308+0000 7fa8a45ef700 1 -- 172.21.15.59:0/1191229408 >> 172.21.15.59:0/1191229408 conn(0x7fa89c0d0140 msgr2=0x7fa89c159820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:09.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.308+0000 7fa8a45ef700 1 -- 172.21.15.59:0/1191229408 shutdown_connections 2023-09-21T00:18:09.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.308+0000 7fa8a45ef700 1 -- 172.21.15.59:0/1191229408 wait complete. 2023-09-21T00:18:09.322 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-21T00:16:54.796248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-21T00:17:04.167102+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-21T00:17:05.313188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-21T00:17:08.977609+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-21T00:18:09.323 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-21T00:18:09.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.451+0000 7f8f5d9b3700 1 Processor -- start 2023-09-21T00:18:09.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.451+0000 7f8f5d9b3700 1 -- start start 2023-09-21T00:18:09.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.451+0000 7f8f5d9b3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8f5815b2b0 0x7f8f580cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:09.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.451+0000 7f8f5d9b3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f581618a0 con 0x7f8f580ce420 2023-09-21T00:18:09.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.451+0000 7f8f5d9b3700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f580cfee0 con 0x7f8f5806a780 2023-09-21T00:18:09.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.451+0000 7f8f5d9b3700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f580ce250 con 0x7f8f5815b2b0 2023-09-21T00:18:09.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.452+0000 7f8f567fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8f580ce420 0x7f8f58161190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58414/0 (socket says 172.21.15.59:58414) 2023-09-21T00:18:09.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.452+0000 7f8f567fc700 1 -- 172.21.15.59:0/745098939 learned_addr learned my addr 172.21.15.59:0/745098939 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:09.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.452+0000 7f8f56ffd700 1 --2- 172.21.15.59:0/745098939 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8f5815b2b0 0x7f8f580cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:09.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.452+0000 7f8f55ffb700 1 -- 172.21.15.59:0/745098939 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 174700511 0 0) 0x7f8f581618a0 con 0x7f8f580ce420 2023-09-21T00:18:09.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.452+0000 7f8f55ffb700 1 -- 172.21.15.59:0/745098939 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f400035b0 con 0x7f8f580ce420 2023-09-21T00:18:09.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.452+0000 7f8f55ffb700 1 -- 172.21.15.59:0/745098939 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2708375893 0 0) 0x7f8f400035b0 con 0x7f8f580ce420 2023-09-21T00:18:09.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.452+0000 7f8f55ffb700 1 -- 172.21.15.59:0/745098939 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8f5815b2b0 msgr2=0x7f8f580cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:09.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.452+0000 7f8f55ffb700 1 --2- 172.21.15.59:0/745098939 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8f5815b2b0 0x7f8f580cdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:09.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.452+0000 7f8f55ffb700 1 -- 172.21.15.59:0/745098939 >> v1:172.21.15.83:6789/0 conn(0x7f8f5806a780 legacy=0x7f8f5815e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:09.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.452+0000 7f8f55ffb700 1 -- 172.21.15.59:0/745098939 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f580ce900 con 0x7f8f580ce420 2023-09-21T00:18:09.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.452+0000 7f8f55ffb700 1 -- 172.21.15.59:0/745098939 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 710825841 0 0) 0x7f8f4c001670 con 0x7f8f580ce420 2023-09-21T00:18:09.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.452+0000 7f8f55ffb700 1 -- 172.21.15.59:0/745098939 >> v1:172.21.15.59:6789/0 conn(0x7f8f580ce420 legacy=0x7f8f58161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:09.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.452+0000 7f8f55ffb700 1 --2- 172.21.15.59:0/745098939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f40003a30 0x7f8f40003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:09.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.452+0000 7f8f55ffb700 1 --2- 172.21.15.59:0/745098939 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8f5815b2b0 0x7f8f40004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:09.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.452+0000 7f8f55ffb700 1 --2- 172.21.15.59:0/745098939 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8f40004d90 0x7f8f40005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:09.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.452+0000 7f8f55ffb700 1 -- 172.21.15.59:0/745098939 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4000ba10 con 0x7f8f40003a30 2023-09-21T00:18:09.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.452+0000 7f8f55ffb700 1 -- 172.21.15.59:0/745098939 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4000bb50 con 0x7f8f40004d90 2023-09-21T00:18:09.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.452+0000 7f8f55ffb700 1 -- 172.21.15.59:0/745098939 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4000bd10 con 0x7f8f5815b2b0 2023-09-21T00:18:09.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.452+0000 7f8f56ffd700 1 --2- 172.21.15.59:0/745098939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f40003a30 0x7f8f40003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:09.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.452+0000 7f8f567fc700 1 --2- 172.21.15.59:0/745098939 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8f5815b2b0 0x7f8f40004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:09.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.452+0000 7f8f577fe700 1 --2- 172.21.15.59:0/745098939 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8f40004d90 0x7f8f40005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:09.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.453+0000 7f8f56ffd700 1 -- 172.21.15.59:0/745098939 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8f5815b2b0 msgr2=0x7f8f40004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:09.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.453+0000 7f8f56ffd700 1 --2- 172.21.15.59:0/745098939 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8f5815b2b0 0x7f8f40004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:09.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.453+0000 7f8f56ffd700 1 -- 172.21.15.59:0/745098939 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8f40004d90 msgr2=0x7f8f40005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:09.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.453+0000 7f8f56ffd700 1 --2- 172.21.15.59:0/745098939 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8f40004d90 0x7f8f40005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:09.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.453+0000 7f8f56ffd700 1 -- 172.21.15.59:0/745098939 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f400035b0 con 0x7f8f40003a30 2023-09-21T00:18:09.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.453+0000 7f8f567fc700 1 --2- 172.21.15.59:0/745098939 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8f5815b2b0 0x7f8f40004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:18:09.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.453+0000 7f8f56ffd700 1 --2- 172.21.15.59:0/745098939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f40003a30 0x7f8f40003e10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8f48009b60 tx=0x7f8f40005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49d21561d7ac6500 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:09.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.453+0000 7f8f55ffb700 1 -- 172.21.15.59:0/745098939 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4800e6c0 con 0x7f8f40003a30 2023-09-21T00:18:09.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.453+0000 7f8f55ffb700 1 -- 172.21.15.59:0/745098939 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f4800e820 con 0x7f8f40003a30 2023-09-21T00:18:09.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.453+0000 7f8f55ffb700 1 -- 172.21.15.59:0/745098939 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4800eb90 con 0x7f8f40003a30 2023-09-21T00:18:09.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.453+0000 7f8f5d9b3700 1 -- 172.21.15.59:0/745098939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f40003a30 msgr2=0x7f8f40003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:09.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.453+0000 7f8f5d9b3700 1 --2- 172.21.15.59:0/745098939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f40003a30 0x7f8f40003e10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8f48009b60 tx=0x7f8f40005880 comp rx=0 tx=0).stop 2023-09-21T00:18:09.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.453+0000 7f8f577fe700 1 -- 172.21.15.59:0/745098939 reap_dead start 2023-09-21T00:18:09.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.453+0000 7f8f5d9b3700 1 -- 172.21.15.59:0/745098939 shutdown_connections 2023-09-21T00:18:09.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.453+0000 7f8f5d9b3700 1 -- 172.21.15.59:0/745098939 >> 172.21.15.59:0/745098939 conn(0x7f8f580d0140 msgr2=0x7f8f580d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:09.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.453+0000 7f8f5d9b3700 1 -- 172.21.15.59:0/745098939 shutdown_connections 2023-09-21T00:18:09.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.454+0000 7f8f5d9b3700 1 -- 172.21.15.59:0/745098939 wait complete. 2023-09-21T00:18:09.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.455+0000 7f8f5d9b3700 1 Processor -- start 2023-09-21T00:18:09.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.455+0000 7f8f5d9b3700 1 -- start start 2023-09-21T00:18:09.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.456+0000 7f8f5d9b3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8f40003a30 0x7f8f58153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:09.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.456+0000 7f8f5d9b3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8f580b4f70 0x7f8f580c7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:09.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.456+0000 7f8f5d9b3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f580b53f0 0x7f8f580ae280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:09.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.456+0000 7f8f5d9b3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f580c3df0 con 0x7f8f580b53f0 2023-09-21T00:18:09.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.456+0000 7f8f5d9b3700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f580c40d0 con 0x7f8f580b4f70 2023-09-21T00:18:09.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.456+0000 7f8f5d9b3700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f580c43b0 con 0x7f8f40003a30 2023-09-21T00:18:09.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.456+0000 7f8f577fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f580b53f0 0x7f8f580ae280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:09.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.456+0000 7f8f56ffd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8f40003a30 0x7f8f58153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:09.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.456+0000 7f8f577fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f580b53f0 0x7f8f580ae280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52860/0 (socket says 172.21.15.59:52860) 2023-09-21T00:18:09.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.456+0000 7f8f56ffd700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8f40003a30 0x7f8f58153540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.59:53472/0 (socket says 172.21.15.59:53472) 2023-09-21T00:18:09.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.456+0000 7f8f577fe700 1 -- 172.21.15.59:0/4501174 learned_addr learned my addr 172.21.15.59:0/4501174 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:09.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.456+0000 7f8f567fc700 1 --2- 172.21.15.59:0/4501174 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8f580b4f70 0x7f8f580c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:09.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.456+0000 7f8f577fe700 1 -- 172.21.15.59:0/4501174 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8f40003a30 msgr2=0x7f8f58153540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:09.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.456+0000 7f8f577fe700 1 --2- 172.21.15.59:0/4501174 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8f40003a30 0x7f8f58153540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:09.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.456+0000 7f8f577fe700 1 -- 172.21.15.59:0/4501174 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8f580b4f70 msgr2=0x7f8f580c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:09.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.456+0000 7f8f577fe700 1 --2- 172.21.15.59:0/4501174 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8f580b4f70 0x7f8f580c7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:09.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.456+0000 7f8f577fe700 1 -- 172.21.15.59:0/4501174 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f580c4690 con 0x7f8f580b53f0 2023-09-21T00:18:09.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.456+0000 7f8f577fe700 1 --2- 172.21.15.59:0/4501174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f580b53f0 0x7f8f580ae280 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8f580672f0 tx=0x7f8f5000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:09.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.456+0000 7f8f3ffff700 1 -- 172.21.15.59:0/4501174 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f50003c10 con 0x7f8f580b53f0 2023-09-21T00:18:09.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.456+0000 7f8f3ffff700 1 -- 172.21.15.59:0/4501174 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f50003d70 con 0x7f8f580b53f0 2023-09-21T00:18:09.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.456+0000 7f8f5d9b3700 1 -- 172.21.15.59:0/4501174 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f580c4970 con 0x7f8f580b53f0 2023-09-21T00:18:09.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.456+0000 7f8f3ffff700 1 -- 172.21.15.59:0/4501174 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f50005310 con 0x7f8f580b53f0 2023-09-21T00:18:09.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.457+0000 7f8f5d9b3700 1 -- 172.21.15.59:0/4501174 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f58153a80 con 0x7f8f580b53f0 2023-09-21T00:18:09.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.457+0000 7f8f5d9b3700 1 -- 172.21.15.59:0/4501174 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f580c4b30 con 0x7f8f580b53f0 2023-09-21T00:18:09.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.458+0000 7f8f3ffff700 1 -- 172.21.15.59:0/4501174 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f8f50005470 con 0x7f8f580b53f0 2023-09-21T00:18:09.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.458+0000 7f8f3ffff700 1 --2- 172.21.15.59:0/4501174 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f8f4406ae00 0x7f8f4406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:09.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.458+0000 7f8f3ffff700 1 -- 172.21.15.59:0/4501174 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f8f500899a0 con 0x7f8f580b53f0 2023-09-21T00:18:09.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.458+0000 7f8f56ffd700 1 --2- 172.21.15.59:0/4501174 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f8f4406ae00 0x7f8f4406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:09.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.459+0000 7f8f56ffd700 1 --2- 172.21.15.59:0/4501174 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f8f4406ae00 0x7f8f4406d2c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8f480090b0 tx=0x7f8f4801f040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:09.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.463+0000 7f8f3ffff700 1 -- 172.21.15.59:0/4501174 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f8f500546b0 con 0x7f8f580b53f0 2023-09-21T00:18:09.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.661+0000 7f8f5d9b3700 1 -- 172.21.15.59:0/4501174 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8f58067e50 con 0x7f8f580b53f0 2023-09-21T00:18:09.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.661+0000 7f8f3ffff700 1 -- 172.21.15.59:0/4501174 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8f50057cd0 con 0x7f8f580b53f0 2023-09-21T00:18:09.664 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-09-21T00:18:09.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.664+0000 7f8f5d9b3700 1 -- 172.21.15.59:0/4501174 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f8f4406ae00 msgr2=0x7f8f4406d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:09.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.664+0000 7f8f5d9b3700 1 --2- 172.21.15.59:0/4501174 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f8f4406ae00 0x7f8f4406d2c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8f480090b0 tx=0x7f8f4801f040 comp rx=0 tx=0).stop 2023-09-21T00:18:09.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.664+0000 7f8f5d9b3700 1 -- 172.21.15.59:0/4501174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f580b53f0 msgr2=0x7f8f580ae280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:09.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.664+0000 7f8f5d9b3700 1 --2- 172.21.15.59:0/4501174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f580b53f0 0x7f8f580ae280 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8f580672f0 tx=0x7f8f5000ee70 comp rx=0 tx=0).stop 2023-09-21T00:18:09.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.664+0000 7f8f5d9b3700 1 -- 172.21.15.59:0/4501174 shutdown_connections 2023-09-21T00:18:09.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.664+0000 7f8f5d9b3700 1 --2- 172.21.15.59:0/4501174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f580b53f0 0x7f8f580ae280 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:09.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.664+0000 7f8f5d9b3700 1 --2- 172.21.15.59:0/4501174 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f8f4406ae00 0x7f8f4406d2c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:09.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.664+0000 7f8f5d9b3700 1 --2- 172.21.15.59:0/4501174 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8f40003a30 0x7f8f58153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:09.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.664+0000 7f8f5d9b3700 1 --2- 172.21.15.59:0/4501174 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8f580b4f70 0x7f8f580c7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:09.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.664+0000 7f8f5d9b3700 1 -- 172.21.15.59:0/4501174 >> 172.21.15.59:0/4501174 conn(0x7f8f580d0140 msgr2=0x7f8f5806da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:09.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.664+0000 7f8f5d9b3700 1 -- 172.21.15.59:0/4501174 shutdown_connections 2023-09-21T00:18:09.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.664+0000 7f8f5d9b3700 1 -- 172.21.15.59:0/4501174 wait complete. 2023-09-21T00:18:09.678 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-21T00:18:09.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.804+0000 7f6043948700 1 Processor -- start 2023-09-21T00:18:09.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.804+0000 7f6043948700 1 -- start start 2023-09-21T00:18:09.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.805+0000 7f6043948700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f603c071d90 0x7f603c06eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:09.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.805+0000 7f6043948700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f603c0cb1c0 con 0x7f603c15a230 2023-09-21T00:18:09.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.805+0000 7f6043948700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f603c0cb4a0 con 0x7f603c0ca790 2023-09-21T00:18:09.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.805+0000 7f6043948700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f603c0cb780 con 0x7f603c071d90 2023-09-21T00:18:09.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.805+0000 7f6041ee5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f603c071d90 0x7f603c06eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:09.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.805+0000 7f60416e4700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f603c15a230 0x7f603c15e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58432/0 (socket says 172.21.15.59:58432) 2023-09-21T00:18:09.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.805+0000 7f60416e4700 1 -- 172.21.15.59:0/1828270784 learned_addr learned my addr 172.21.15.59:0/1828270784 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:09.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.805+0000 7f6041ee5700 1 -- 172.21.15.59:0/1828270784 >> v1:172.21.15.83:6789/0 conn(0x7f603c0ca790 legacy=0x7f603c071680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:09.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.805+0000 7f6033fff700 1 -- 172.21.15.59:0/1828270784 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1086820805 0 0) 0x7f603c0cb1c0 con 0x7f603c15a230 2023-09-21T00:18:09.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.805+0000 7f6041ee5700 1 -- 172.21.15.59:0/1828270784 >> v1:172.21.15.59:6789/0 conn(0x7f603c15a230 legacy=0x7f603c15e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:09.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.805+0000 7f6041ee5700 1 -- 172.21.15.59:0/1828270784 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f603c15e0b0 con 0x7f603c071d90 2023-09-21T00:18:09.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.806+0000 7f6041ee5700 1 --2- 172.21.15.59:0/1828270784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f603c071d90 0x7f603c06eaa0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6034009d90 tx=0x7f603400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf6c0a683e93294 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:09.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.806+0000 7f6033fff700 1 -- 172.21.15.59:0/1828270784 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603400e070 con 0x7f603c071d90 2023-09-21T00:18:09.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.806+0000 7f6033fff700 1 -- 172.21.15.59:0/1828270784 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603400bbd0 con 0x7f603c071d90 2023-09-21T00:18:09.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.806+0000 7f6033fff700 1 -- 172.21.15.59:0/1828270784 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6034012430 con 0x7f603c071d90 2023-09-21T00:18:09.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.806+0000 7f6043948700 1 -- 172.21.15.59:0/1828270784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f603c071d90 msgr2=0x7f603c06eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:09.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.806+0000 7f6043948700 1 --2- 172.21.15.59:0/1828270784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f603c071d90 0x7f603c06eaa0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6034009d90 tx=0x7f603400b330 comp rx=0 tx=0).stop 2023-09-21T00:18:09.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.806+0000 7f6043948700 1 -- 172.21.15.59:0/1828270784 shutdown_connections 2023-09-21T00:18:09.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.806+0000 7f6043948700 1 --2- 172.21.15.59:0/1828270784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f603c071d90 0x7f603c06eaa0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:09.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.806+0000 7f6043948700 1 -- 172.21.15.59:0/1828270784 >> 172.21.15.59:0/1828270784 conn(0x7f603c0d0140 msgr2=0x7f603c0d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:09.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.806+0000 7f6043948700 1 -- 172.21.15.59:0/1828270784 shutdown_connections 2023-09-21T00:18:09.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.806+0000 7f6043948700 1 -- 172.21.15.59:0/1828270784 wait complete. 2023-09-21T00:18:09.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.808+0000 7f6043948700 1 Processor -- start 2023-09-21T00:18:09.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.808+0000 7f6043948700 1 -- start start 2023-09-21T00:18:09.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.808+0000 7f6043948700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f603c071d90 0x7f603c1f4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:09.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.808+0000 7f6043948700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f603c0ca790 0x7f603c0c6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:09.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.808+0000 7f6043948700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f603c15a230 0x7f603c0ae7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:09.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.808+0000 7f6043948700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603c0c70b0 con 0x7f603c071d90 2023-09-21T00:18:09.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.808+0000 7f6043948700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603c0c40c0 con 0x7f603c15a230 2023-09-21T00:18:09.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.808+0000 7f6043948700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f603c0c6dd0 con 0x7f603c0ca790 2023-09-21T00:18:09.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.808+0000 7f60416e4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f603c071d90 0x7f603c1f4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:09.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.808+0000 7f60416e4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f603c071d90 0x7f603c1f4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52870/0 (socket says 172.21.15.59:52870) 2023-09-21T00:18:09.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.808+0000 7f60416e4700 1 -- 172.21.15.59:0/1105629265 learned_addr learned my addr 172.21.15.59:0/1105629265 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:09.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.809+0000 7f6041ee5700 1 --2- 172.21.15.59:0/1105629265 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f603c15a230 0x7f603c0ae7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:09.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.809+0000 7f6040ee3700 1 --2- 172.21.15.59:0/1105629265 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f603c0ca790 0x7f603c0c6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:09.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.809+0000 7f60416e4700 1 -- 172.21.15.59:0/1105629265 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f603c0ca790 msgr2=0x7f603c0c6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:09.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.809+0000 7f60416e4700 1 --2- 172.21.15.59:0/1105629265 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f603c0ca790 0x7f603c0c6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:09.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.809+0000 7f60416e4700 1 -- 172.21.15.59:0/1105629265 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f603c15a230 msgr2=0x7f603c0ae7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:09.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.809+0000 7f60416e4700 1 --2- 172.21.15.59:0/1105629265 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f603c15a230 0x7f603c0ae7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:09.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.809+0000 7f60416e4700 1 -- 172.21.15.59:0/1105629265 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6034009a70 con 0x7f603c071d90 2023-09-21T00:18:09.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.809+0000 7f60416e4700 1 --2- 172.21.15.59:0/1105629265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f603c071d90 0x7f603c1f4500 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f602c00c520 tx=0x7f602c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:09.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.809+0000 7f6031ffb700 1 -- 172.21.15.59:0/1105629265 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602c004c80 con 0x7f603c071d90 2023-09-21T00:18:09.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.809+0000 7f6031ffb700 1 -- 172.21.15.59:0/1105629265 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f602c004de0 con 0x7f603c071d90 2023-09-21T00:18:09.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.809+0000 7f6043948700 1 -- 172.21.15.59:0/1105629265 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f603c0c3a70 con 0x7f603c071d90 2023-09-21T00:18:09.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.809+0000 7f6031ffb700 1 -- 172.21.15.59:0/1105629265 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602c007310 con 0x7f603c071d90 2023-09-21T00:18:09.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.809+0000 7f6043948700 1 -- 172.21.15.59:0/1105629265 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f603c1f4a40 con 0x7f603c071d90 2023-09-21T00:18:09.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.810+0000 7f6043948700 1 -- 172.21.15.59:0/1105629265 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f603c0c38d0 con 0x7f603c071d90 2023-09-21T00:18:09.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.811+0000 7f6031ffb700 1 -- 172.21.15.59:0/1105629265 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f602c007470 con 0x7f603c071d90 2023-09-21T00:18:09.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.811+0000 7f6031ffb700 1 --2- 172.21.15.59:0/1105629265 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f602006ae00 0x7f602006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:09.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.811+0000 7f6031ffb700 1 -- 172.21.15.59:0/1105629265 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f602c089590 con 0x7f603c071d90 2023-09-21T00:18:09.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.812+0000 7f6040ee3700 1 --2- 172.21.15.59:0/1105629265 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f602006ae00 0x7f602006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:09.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.812+0000 7f6040ee3700 1 --2- 172.21.15.59:0/1105629265 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f602006ae00 0x7f602006d2c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f603c0b0f70 tx=0x7f6038009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:09.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:09.816+0000 7f6031ffb700 1 -- 172.21.15.59:0/1105629265 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f603c0c38d0 con 0x7f603c071d90 2023-09-21T00:18:10.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.015+0000 7f6043948700 1 -- 172.21.15.59:0/1105629265 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f603c0c38d0 con 0x7f603c071d90 2023-09-21T00:18:10.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.016+0000 7f6031ffb700 1 -- 172.21.15.59:0/1105629265 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f603c0c38d0 con 0x7f603c071d90 2023-09-21T00:18:10.018 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-09-21T00:18:10.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.018+0000 7f6043948700 1 -- 172.21.15.59:0/1105629265 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f602006ae00 msgr2=0x7f602006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:10.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.018+0000 7f6043948700 1 --2- 172.21.15.59:0/1105629265 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f602006ae00 0x7f602006d2c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f603c0b0f70 tx=0x7f6038009040 comp rx=0 tx=0).stop 2023-09-21T00:18:10.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.018+0000 7f6043948700 1 -- 172.21.15.59:0/1105629265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f603c071d90 msgr2=0x7f603c1f4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:10.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.018+0000 7f6043948700 1 --2- 172.21.15.59:0/1105629265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f603c071d90 0x7f603c1f4500 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f602c00c520 tx=0x7f602c00c830 comp rx=0 tx=0).stop 2023-09-21T00:18:10.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.018+0000 7f6043948700 1 -- 172.21.15.59:0/1105629265 shutdown_connections 2023-09-21T00:18:10.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.018+0000 7f6043948700 1 --2- 172.21.15.59:0/1105629265 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f603c15a230 0x7f603c0ae7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:10.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.018+0000 7f6043948700 1 --2- 172.21.15.59:0/1105629265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f603c071d90 0x7f603c1f4500 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:10.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.018+0000 7f6043948700 1 --2- 172.21.15.59:0/1105629265 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f602006ae00 0x7f602006d2c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:10.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.018+0000 7f6043948700 1 --2- 172.21.15.59:0/1105629265 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f603c0ca790 0x7f603c0c6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:10.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.018+0000 7f6043948700 1 -- 172.21.15.59:0/1105629265 >> 172.21.15.59:0/1105629265 conn(0x7f603c0d0140 msgr2=0x7f603c0ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:10.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.018+0000 7f6043948700 1 -- 172.21.15.59:0/1105629265 shutdown_connections 2023-09-21T00:18:10.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.018+0000 7f6043948700 1 -- 172.21.15.59:0/1105629265 wait complete. 2023-09-21T00:18:10.032 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-21T00:18:10.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.159+0000 7fae41669700 1 Processor -- start 2023-09-21T00:18:10.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.159+0000 7fae41669700 1 -- start start 2023-09-21T00:18:10.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.160+0000 7fae41669700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fae3c15b3b0 0x7fae3c0d1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:10.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.160+0000 7fae41669700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fae3c161300 0x7fae3c15dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:10.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.160+0000 7fae41669700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae3c15ec20 con 0x7fae3c15e0f0 2023-09-21T00:18:10.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.160+0000 7fae41669700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae3c15e660 con 0x7fae3c161300 2023-09-21T00:18:10.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.160+0000 7fae41669700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae3c15e940 con 0x7fae3c15b3b0 2023-09-21T00:18:10.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.160+0000 7fae3a7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fae3c161300 0x7fae3c15dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:10.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.160+0000 7fae3b7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fae3c15e0f0 0x7fae3c0b4f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58450/0 (socket says 172.21.15.59:58450) 2023-09-21T00:18:10.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.160+0000 7fae3b7fe700 1 -- 172.21.15.59:0/693437174 learned_addr learned my addr 172.21.15.59:0/693437174 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:10.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.160+0000 7fae3affd700 1 --2- 172.21.15.59:0/693437174 >> v2:172.21.15.83:3300/0 conn(0x7fae3c15b3b0 0x7fae3c0d1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:10.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.160+0000 7fae3a7fc700 1 -- 172.21.15.59:0/693437174 >> v2:172.21.15.83:3300/0 conn(0x7fae3c15b3b0 msgr2=0x7fae3c0d1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:10.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.160+0000 7fae3a7fc700 1 --2- 172.21.15.59:0/693437174 >> v2:172.21.15.83:3300/0 conn(0x7fae3c15b3b0 0x7fae3c0d1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:10.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.160+0000 7fae3a7fc700 1 -- 172.21.15.59:0/693437174 >> v1:172.21.15.59:6789/0 conn(0x7fae3c15e0f0 legacy=0x7fae3c0b4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:10.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.160+0000 7fae3a7fc700 1 -- 172.21.15.59:0/693437174 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae3c0d1400 con 0x7fae3c161300 2023-09-21T00:18:10.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.160+0000 7fae39ffb700 1 -- 172.21.15.59:0/693437174 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3570554734 0 0) 0x7fae3c15ec20 con 0x7fae3c15e0f0 2023-09-21T00:18:10.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.160+0000 7fae3a7fc700 1 --2- 172.21.15.59:0/693437174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae3c161300 0x7fae3c15dbb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fae3c0d40c0 tx=0x7fae2c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b3f52e767bc23ac server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:10.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.161+0000 7fae39ffb700 1 -- 172.21.15.59:0/693437174 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c011830 con 0x7fae3c161300 2023-09-21T00:18:10.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.161+0000 7fae39ffb700 1 -- 172.21.15.59:0/693437174 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2c011990 con 0x7fae3c161300 2023-09-21T00:18:10.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.161+0000 7fae39ffb700 1 -- 172.21.15.59:0/693437174 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c011d20 con 0x7fae3c161300 2023-09-21T00:18:10.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.161+0000 7fae41669700 1 -- 172.21.15.59:0/693437174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae3c161300 msgr2=0x7fae3c15dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:10.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.161+0000 7fae41669700 1 --2- 172.21.15.59:0/693437174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae3c161300 0x7fae3c15dbb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fae3c0d40c0 tx=0x7fae2c009b20 comp rx=0 tx=0).stop 2023-09-21T00:18:10.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.161+0000 7fae41669700 1 -- 172.21.15.59:0/693437174 shutdown_connections 2023-09-21T00:18:10.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.161+0000 7fae41669700 1 --2- 172.21.15.59:0/693437174 >> v2:172.21.15.83:3300/0 conn(0x7fae3c15b3b0 0x7fae3c0d1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:10.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.161+0000 7fae41669700 1 --2- 172.21.15.59:0/693437174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae3c161300 0x7fae3c15dbb0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:10.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.161+0000 7fae41669700 1 -- 172.21.15.59:0/693437174 >> 172.21.15.59:0/693437174 conn(0x7fae3c0724e0 msgr2=0x7fae3c0d3510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:10.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.161+0000 7fae41669700 1 -- 172.21.15.59:0/693437174 shutdown_connections 2023-09-21T00:18:10.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.161+0000 7fae41669700 1 -- 172.21.15.59:0/693437174 wait complete. 2023-09-21T00:18:10.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.163+0000 7fae41669700 1 Processor -- start 2023-09-21T00:18:10.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.163+0000 7fae41669700 1 -- start start 2023-09-21T00:18:10.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.164+0000 7fae41669700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae3c15b3b0 0x7fae3c0c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:10.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.164+0000 7fae41669700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fae3c15e0f0 0x7fae3c0aadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:10.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.164+0000 7fae41669700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fae3c161300 0x7fae3c0ab330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:10.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.164+0000 7fae41669700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c0ca5e0 con 0x7fae3c15b3b0 2023-09-21T00:18:10.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.164+0000 7fae41669700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c1f6af0 con 0x7fae3c15e0f0 2023-09-21T00:18:10.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.164+0000 7fae41669700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c0ca8a0 con 0x7fae3c161300 2023-09-21T00:18:10.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.164+0000 7fae3affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae3c15b3b0 0x7fae3c0c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:10.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.164+0000 7fae3affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae3c15b3b0 0x7fae3c0c8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52884/0 (socket says 172.21.15.59:52884) 2023-09-21T00:18:10.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.164+0000 7fae3affd700 1 -- 172.21.15.59:0/1559567266 learned_addr learned my addr 172.21.15.59:0/1559567266 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:10.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.164+0000 7fae3a7fc700 1 --2- 172.21.15.59:0/1559567266 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fae3c15e0f0 0x7fae3c0aadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:10.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.164+0000 7fae3b7fe700 1 --2- 172.21.15.59:0/1559567266 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fae3c161300 0x7fae3c0ab330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:10.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.165+0000 7fae3affd700 1 -- 172.21.15.59:0/1559567266 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fae3c161300 msgr2=0x7fae3c0ab330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:10.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.165+0000 7fae3affd700 1 --2- 172.21.15.59:0/1559567266 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fae3c161300 0x7fae3c0ab330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:10.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.165+0000 7fae3affd700 1 -- 172.21.15.59:0/1559567266 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fae3c15e0f0 msgr2=0x7fae3c0aadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:10.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.165+0000 7fae3affd700 1 --2- 172.21.15.59:0/1559567266 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fae3c15e0f0 0x7fae3c0aadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:10.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.165+0000 7fae3affd700 1 -- 172.21.15.59:0/1559567266 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae2c0094a0 con 0x7fae3c15b3b0 2023-09-21T00:18:10.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.165+0000 7fae3affd700 1 --2- 172.21.15.59:0/1559567266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae3c15b3b0 0x7fae3c0c8fe0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fae3000e990 tx=0x7fae3000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:10.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.165+0000 7fae237fe700 1 -- 172.21.15.59:0/1559567266 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae300096f0 con 0x7fae3c15b3b0 2023-09-21T00:18:10.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.165+0000 7fae237fe700 1 -- 172.21.15.59:0/1559567266 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae3000c690 con 0x7fae3c15b3b0 2023-09-21T00:18:10.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.165+0000 7fae41669700 1 -- 172.21.15.59:0/1559567266 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae3c0cab80 con 0x7fae3c15b3b0 2023-09-21T00:18:10.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.165+0000 7fae237fe700 1 -- 172.21.15.59:0/1559567266 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3000ca00 con 0x7fae3c15b3b0 2023-09-21T00:18:10.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.165+0000 7fae41669700 1 -- 172.21.15.59:0/1559567266 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae3c0cb380 con 0x7fae3c15b3b0 2023-09-21T00:18:10.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.166+0000 7fae41669700 1 -- 172.21.15.59:0/1559567266 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae3c0cb0a0 con 0x7fae3c15b3b0 2023-09-21T00:18:10.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.166+0000 7fae237fe700 1 -- 172.21.15.59:0/1559567266 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fae3000cb60 con 0x7fae3c15b3b0 2023-09-21T00:18:10.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.167+0000 7fae237fe700 1 --2- 172.21.15.59:0/1559567266 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fae2806ae30 0x7fae2806d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:10.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.167+0000 7fae237fe700 1 -- 172.21.15.59:0/1559567266 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fae30089c70 con 0x7fae3c15b3b0 2023-09-21T00:18:10.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.167+0000 7fae3a7fc700 1 --2- 172.21.15.59:0/1559567266 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fae2806ae30 0x7fae2806d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:10.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.167+0000 7fae3a7fc700 1 --2- 172.21.15.59:0/1559567266 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fae2806ae30 0x7fae2806d2f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fae2c0090b0 tx=0x7fae2c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:10.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.171+0000 7fae237fe700 1 -- 172.21.15.59:0/1559567266 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fae3c0cb0a0 con 0x7fae3c15b3b0 2023-09-21T00:18:10.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.369+0000 7fae41669700 1 -- 172.21.15.59:0/1559567266 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fae3c0cb0a0 con 0x7fae3c15b3b0 2023-09-21T00:18:10.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.369+0000 7fae237fe700 1 -- 172.21.15.59:0/1559567266 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fae3c0cb0a0 con 0x7fae3c15b3b0 2023-09-21T00:18:10.372 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-09-21T00:18:10.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.371+0000 7fae41669700 1 -- 172.21.15.59:0/1559567266 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fae2806ae30 msgr2=0x7fae2806d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:10.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.371+0000 7fae41669700 1 --2- 172.21.15.59:0/1559567266 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fae2806ae30 0x7fae2806d2f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fae2c0090b0 tx=0x7fae2c008030 comp rx=0 tx=0).stop 2023-09-21T00:18:10.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.371+0000 7fae41669700 1 -- 172.21.15.59:0/1559567266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae3c15b3b0 msgr2=0x7fae3c0c8fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:10.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.371+0000 7fae41669700 1 --2- 172.21.15.59:0/1559567266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae3c15b3b0 0x7fae3c0c8fe0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fae3000e990 tx=0x7fae3000eca0 comp rx=0 tx=0).stop 2023-09-21T00:18:10.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.372+0000 7fae41669700 1 -- 172.21.15.59:0/1559567266 shutdown_connections 2023-09-21T00:18:10.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.372+0000 7fae41669700 1 --2- 172.21.15.59:0/1559567266 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fae2806ae30 0x7fae2806d2f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:10.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.372+0000 7fae41669700 1 --2- 172.21.15.59:0/1559567266 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fae3c161300 0x7fae3c0ab330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:10.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.372+0000 7fae41669700 1 --2- 172.21.15.59:0/1559567266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae3c15b3b0 0x7fae3c0c8fe0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:10.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.372+0000 7fae41669700 1 --2- 172.21.15.59:0/1559567266 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fae3c15e0f0 0x7fae3c0aadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:10.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.372+0000 7fae41669700 1 -- 172.21.15.59:0/1559567266 >> 172.21.15.59:0/1559567266 conn(0x7fae3c0724e0 msgr2=0x7fae3c159bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:10.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.372+0000 7fae41669700 1 -- 172.21.15.59:0/1559567266 shutdown_connections 2023-09-21T00:18:10.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.372+0000 7fae41669700 1 -- 172.21.15.59:0/1559567266 wait complete. 2023-09-21T00:18:10.386 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-21T00:18:10.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.513+0000 7f942f3fe700 1 Processor -- start 2023-09-21T00:18:10.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.513+0000 7f942f3fe700 1 -- start start 2023-09-21T00:18:10.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.514+0000 7f942f3fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f942815d540 0x7f942806d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:10.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.514+0000 7f942f3fe700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f942806d7e0 0x7f94280cc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:10.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.514+0000 7f942f3fe700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94280b2810 con 0x7f94280cc7d0 2023-09-21T00:18:10.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.514+0000 7f942f3fe700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94280ca030 con 0x7f942815d540 2023-09-21T00:18:10.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.514+0000 7f942f3fe700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94280b5790 con 0x7f942806d7e0 2023-09-21T00:18:10.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.514+0000 7f942d19a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f942815d540 0x7f942806d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:10.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.514+0000 7f942d19a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f942815d540 0x7f942806d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52892/0 (socket says 172.21.15.59:52892) 2023-09-21T00:18:10.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.514+0000 7f942d19a700 1 -- 172.21.15.59:0/2964168805 learned_addr learned my addr 172.21.15.59:0/2964168805 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:10.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.514+0000 7f942c999700 1 --2- 172.21.15.59:0/2964168805 >> v2:172.21.15.83:3300/0 conn(0x7f942806d7e0 0x7f94280cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:10.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.514+0000 7f942d19a700 1 -- 172.21.15.59:0/2964168805 >> v2:172.21.15.83:3300/0 conn(0x7f942806d7e0 msgr2=0x7f94280cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:10.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.514+0000 7f942d19a700 1 --2- 172.21.15.59:0/2964168805 >> v2:172.21.15.83:3300/0 conn(0x7f942806d7e0 0x7f94280cc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:10.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.514+0000 7f942d19a700 1 -- 172.21.15.59:0/2964168805 >> v1:172.21.15.83:6789/0 conn(0x7f94280cc7d0 legacy=0x7f94280c8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:10.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.514+0000 7f942d19a700 1 -- 172.21.15.59:0/2964168805 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94280ca2d0 con 0x7f942815d540 2023-09-21T00:18:10.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.515+0000 7f942d19a700 1 --2- 172.21.15.59:0/2964168805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f942815d540 0x7f942806d250 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f94280717d0 tx=0x7f9418009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b536924d4ec1a71 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:10.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.515+0000 7f941ffff700 1 -- 172.21.15.59:0/2964168805 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9418011830 con 0x7f942815d540 2023-09-21T00:18:10.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.515+0000 7f941ffff700 1 -- 172.21.15.59:0/2964168805 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9418011990 con 0x7f942815d540 2023-09-21T00:18:10.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.515+0000 7f941ffff700 1 -- 172.21.15.59:0/2964168805 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9418011d20 con 0x7f942815d540 2023-09-21T00:18:10.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.515+0000 7f942f3fe700 1 -- 172.21.15.59:0/2964168805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f942815d540 msgr2=0x7f942806d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:10.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.515+0000 7f942f3fe700 1 --2- 172.21.15.59:0/2964168805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f942815d540 0x7f942806d250 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f94280717d0 tx=0x7f9418009bd0 comp rx=0 tx=0).stop 2023-09-21T00:18:10.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.515+0000 7f942f3fe700 1 -- 172.21.15.59:0/2964168805 shutdown_connections 2023-09-21T00:18:10.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.515+0000 7f942f3fe700 1 --2- 172.21.15.59:0/2964168805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f942815d540 0x7f942806d250 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:10.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.515+0000 7f942f3fe700 1 --2- 172.21.15.59:0/2964168805 >> v2:172.21.15.83:3300/0 conn(0x7f942806d7e0 0x7f94280cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:10.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.515+0000 7f942f3fe700 1 -- 172.21.15.59:0/2964168805 >> 172.21.15.59:0/2964168805 conn(0x7f942806a780 msgr2=0x7f942806ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:10.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.515+0000 7f942f3fe700 1 -- 172.21.15.59:0/2964168805 shutdown_connections 2023-09-21T00:18:10.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.515+0000 7f942f3fe700 1 -- 172.21.15.59:0/2964168805 wait complete. 2023-09-21T00:18:10.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.517+0000 7f942f3fe700 1 Processor -- start 2023-09-21T00:18:10.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.517+0000 7f942f3fe700 1 -- start start 2023-09-21T00:18:10.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.517+0000 7f942f3fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f942806d7e0 0x7f94281527b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:10.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.517+0000 7f942f3fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94280cc7d0 0x7f9428155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:10.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.517+0000 7f942f3fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f942815d540 0x7f94280b09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:10.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.517+0000 7f942f3fe700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9428155ac0 con 0x7f94280cc7d0 2023-09-21T00:18:10.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.517+0000 7f942f3fe700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9428152cf0 con 0x7f942806d7e0 2023-09-21T00:18:10.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.517+0000 7f942f3fe700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9428154e40 con 0x7f942815d540 2023-09-21T00:18:10.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.518+0000 7f942c999700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94280cc7d0 0x7f9428155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:10.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.518+0000 7f942c999700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94280cc7d0 0x7f9428155ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52900/0 (socket says 172.21.15.59:52900) 2023-09-21T00:18:10.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.518+0000 7f942c999700 1 -- 172.21.15.59:0/1306554374 learned_addr learned my addr 172.21.15.59:0/1306554374 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:10.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.518+0000 7f942d19a700 1 --2- 172.21.15.59:0/1306554374 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f942806d7e0 0x7f94281527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:10.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.518+0000 7f942d99b700 1 --2- 172.21.15.59:0/1306554374 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f942815d540 0x7f94280b09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:10.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.518+0000 7f942c999700 1 -- 172.21.15.59:0/1306554374 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f942815d540 msgr2=0x7f94280b09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:10.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.518+0000 7f942c999700 1 --2- 172.21.15.59:0/1306554374 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f942815d540 0x7f94280b09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:10.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.518+0000 7f942c999700 1 -- 172.21.15.59:0/1306554374 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f942806d7e0 msgr2=0x7f94281527b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:10.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.518+0000 7f942c999700 1 --2- 172.21.15.59:0/1306554374 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f942806d7e0 0x7f94281527b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:10.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.518+0000 7f942c999700 1 -- 172.21.15.59:0/1306554374 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9418009550 con 0x7f94280cc7d0 2023-09-21T00:18:10.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.518+0000 7f942d19a700 1 --2- 172.21.15.59:0/1306554374 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f942806d7e0 0x7f94281527b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T00:18:10.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.518+0000 7f942c999700 1 --2- 172.21.15.59:0/1306554374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94280cc7d0 0x7f9428155ee0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f942400e9b0 tx=0x7f942400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:10.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.518+0000 7f941dffb700 1 -- 172.21.15.59:0/1306554374 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9424009710 con 0x7f94280cc7d0 2023-09-21T00:18:10.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.518+0000 7f941dffb700 1 -- 172.21.15.59:0/1306554374 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942400ee50 con 0x7f94280cc7d0 2023-09-21T00:18:10.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.518+0000 7f942f3fe700 1 -- 172.21.15.59:0/1306554374 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9428155120 con 0x7f94280cc7d0 2023-09-21T00:18:10.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.518+0000 7f941dffb700 1 -- 172.21.15.59:0/1306554374 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942400ca50 con 0x7f94280cc7d0 2023-09-21T00:18:10.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.519+0000 7f942f3fe700 1 -- 172.21.15.59:0/1306554374 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94281556e0 con 0x7f94280cc7d0 2023-09-21T00:18:10.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.520+0000 7f942f3fe700 1 -- 172.21.15.59:0/1306554374 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9428067e50 con 0x7f94280cc7d0 2023-09-21T00:18:10.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.520+0000 7f941dffb700 1 -- 172.21.15.59:0/1306554374 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f942400cbb0 con 0x7f94280cc7d0 2023-09-21T00:18:10.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.520+0000 7f941dffb700 1 --2- 172.21.15.59:0/1306554374 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f940c06ae00 0x7f940c06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:10.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.520+0000 7f941dffb700 1 -- 172.21.15.59:0/1306554374 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f9424089870 con 0x7f94280cc7d0 2023-09-21T00:18:10.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.520+0000 7f942d19a700 1 --2- 172.21.15.59:0/1306554374 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f940c06ae00 0x7f940c06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:10.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.521+0000 7f942d19a700 1 --2- 172.21.15.59:0/1306554374 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f940c06ae00 0x7f940c06d2c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9418014040 tx=0x7f9418008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:10.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.525+0000 7f941dffb700 1 -- 172.21.15.59:0/1306554374 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f9424054610 con 0x7f94280cc7d0 2023-09-21T00:18:10.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.723+0000 7f942f3fe700 1 -- 172.21.15.59:0/1306554374 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9428068b50 con 0x7f94280cc7d0 2023-09-21T00:18:10.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.723+0000 7f941dffb700 1 -- 172.21.15.59:0/1306554374 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f942400ce60 con 0x7f94280cc7d0 2023-09-21T00:18:10.725 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-09-21T00:18:10.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.725+0000 7f942f3fe700 1 -- 172.21.15.59:0/1306554374 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f940c06ae00 msgr2=0x7f940c06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:10.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.725+0000 7f942f3fe700 1 --2- 172.21.15.59:0/1306554374 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f940c06ae00 0x7f940c06d2c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9418014040 tx=0x7f9418008030 comp rx=0 tx=0).stop 2023-09-21T00:18:10.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.725+0000 7f942f3fe700 1 -- 172.21.15.59:0/1306554374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94280cc7d0 msgr2=0x7f9428155ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:10.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.725+0000 7f942f3fe700 1 --2- 172.21.15.59:0/1306554374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94280cc7d0 0x7f9428155ee0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f942400e9b0 tx=0x7f942400ecc0 comp rx=0 tx=0).stop 2023-09-21T00:18:10.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.725+0000 7f942f3fe700 1 -- 172.21.15.59:0/1306554374 shutdown_connections 2023-09-21T00:18:10.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.725+0000 7f942f3fe700 1 --2- 172.21.15.59:0/1306554374 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f940c06ae00 0x7f940c06d2c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:10.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.725+0000 7f942f3fe700 1 --2- 172.21.15.59:0/1306554374 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f942815d540 0x7f94280b09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:10.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.725+0000 7f942f3fe700 1 --2- 172.21.15.59:0/1306554374 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f942806d7e0 0x7f94281527b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:10.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.725+0000 7f942f3fe700 1 --2- 172.21.15.59:0/1306554374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94280cc7d0 0x7f9428155ee0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:10.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.725+0000 7f942f3fe700 1 -- 172.21.15.59:0/1306554374 >> 172.21.15.59:0/1306554374 conn(0x7f942806a780 msgr2=0x7f94280b2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:10.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.725+0000 7f942f3fe700 1 -- 172.21.15.59:0/1306554374 shutdown_connections 2023-09-21T00:18:10.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.725+0000 7f942f3fe700 1 -- 172.21.15.59:0/1306554374 wait complete. 2023-09-21T00:18:10.740 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-21T00:18:10.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.864+0000 7fdf01145700 1 Processor -- start 2023-09-21T00:18:10.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.864+0000 7fdf01145700 1 -- start start 2023-09-21T00:18:10.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.865+0000 7fdf01145700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fdefc0cc2a0 0x7fdefc06f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:10.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.865+0000 7fdf01145700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdefc06e8f0 con 0x7fdefc072690 2023-09-21T00:18:10.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.865+0000 7fdf01145700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdefc15e350 con 0x7fdefc15a5f0 2023-09-21T00:18:10.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.865+0000 7fdf01145700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdefc15a9d0 con 0x7fdefc0cc2a0 2023-09-21T00:18:10.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.865+0000 7fdefb59e700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fdefc072690 0x7fdefc0cdc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58478/0 (socket says 172.21.15.59:58478) 2023-09-21T00:18:10.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.865+0000 7fdefb59e700 1 -- 172.21.15.59:0/2166369205 learned_addr learned my addr 172.21.15.59:0/2166369205 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:10.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.866+0000 7fdefa59c700 1 --2- 172.21.15.59:0/2166369205 >> v2:172.21.15.83:3300/0 conn(0x7fdefc0cc2a0 0x7fdefc06f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:10.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.866+0000 7fdef9d9b700 1 -- 172.21.15.59:0/2166369205 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3251113204 0 0) 0x7fdefc06e8f0 con 0x7fdefc072690 2023-09-21T00:18:10.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.866+0000 7fdef9d9b700 1 -- 172.21.15.59:0/2166369205 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdee40035b0 con 0x7fdefc072690 2023-09-21T00:18:10.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.866+0000 7fdefa59c700 1 -- 172.21.15.59:0/2166369205 >> v1:172.21.15.83:6789/0 conn(0x7fdefc15a5f0 legacy=0x7fdefc0cbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:10.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.866+0000 7fdef9d9b700 1 -- 172.21.15.59:0/2166369205 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1650620224 0 0) 0x7fdee40035b0 con 0x7fdefc072690 2023-09-21T00:18:10.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.866+0000 7fdefa59c700 1 -- 172.21.15.59:0/2166369205 >> v1:172.21.15.59:6789/0 conn(0x7fdefc072690 legacy=0x7fdefc0cdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:10.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.866+0000 7fdefa59c700 1 -- 172.21.15.59:0/2166369205 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdefc06f450 con 0x7fdefc0cc2a0 2023-09-21T00:18:10.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.866+0000 7fdefa59c700 1 --2- 172.21.15.59:0/2166369205 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdefc0cc2a0 0x7fdefc06f8e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fdeec009840 tx=0x7fdeec009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24541b218a629a server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:10.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.866+0000 7fdef9d9b700 1 -- 172.21.15.59:0/2166369205 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef40019f0 con 0x7fdefc0cc2a0 2023-09-21T00:18:10.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.866+0000 7fdef9d9b700 1 -- 172.21.15.59:0/2166369205 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeec004030 con 0x7fdefc0cc2a0 2023-09-21T00:18:10.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.866+0000 7fdef9d9b700 1 -- 172.21.15.59:0/2166369205 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeec0043a0 con 0x7fdefc0cc2a0 2023-09-21T00:18:10.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.867+0000 7fdf01145700 1 -- 172.21.15.59:0/2166369205 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdefc0cc2a0 msgr2=0x7fdefc06f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:10.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.867+0000 7fdf01145700 1 --2- 172.21.15.59:0/2166369205 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdefc0cc2a0 0x7fdefc06f8e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fdeec009840 tx=0x7fdeec009b50 comp rx=0 tx=0).stop 2023-09-21T00:18:10.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.867+0000 7fdf01145700 1 -- 172.21.15.59:0/2166369205 shutdown_connections 2023-09-21T00:18:10.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.867+0000 7fdf01145700 1 --2- 172.21.15.59:0/2166369205 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdefc0cc2a0 0x7fdefc06f8e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:10.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.867+0000 7fdf01145700 1 -- 172.21.15.59:0/2166369205 >> 172.21.15.59:0/2166369205 conn(0x7fdefc0ccae0 msgr2=0x7fdefc0ccef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:10.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.867+0000 7fdf01145700 1 -- 172.21.15.59:0/2166369205 shutdown_connections 2023-09-21T00:18:10.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.867+0000 7fdf01145700 1 -- 172.21.15.59:0/2166369205 wait complete. 2023-09-21T00:18:10.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.868+0000 7fdf01145700 1 Processor -- start 2023-09-21T00:18:10.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.868+0000 7fdf01145700 1 -- start start 2023-09-21T00:18:10.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.869+0000 7fdf01145700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdefc072690 0x7fdefc152e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:10.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.869+0000 7fdf01145700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdefc0cc2a0 0x7fdefc153f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:10.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.869+0000 7fdf01145700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdefc15a5f0 0x7fdefc0c95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:10.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.869+0000 7fdf01145700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdefc0c56f0 con 0x7fdefc15a5f0 2023-09-21T00:18:10.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.869+0000 7fdf01145700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdefc0c69c0 con 0x7fdefc072690 2023-09-21T00:18:10.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.869+0000 7fdf01145700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdefc0c5920 con 0x7fdefc0cc2a0 2023-09-21T00:18:10.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.869+0000 7fdefb59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdefc15a5f0 0x7fdefc0c95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:10.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.869+0000 7fdefb59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdefc15a5f0 0x7fdefc0c95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52914/0 (socket says 172.21.15.59:52914) 2023-09-21T00:18:10.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.869+0000 7fdefb59e700 1 -- 172.21.15.59:0/3872649950 learned_addr learned my addr 172.21.15.59:0/3872649950 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:10.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.870+0000 7fdefad9d700 1 --2- 172.21.15.59:0/3872649950 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdefc072690 0x7fdefc152e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:10.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.870+0000 7fdefa59c700 1 --2- 172.21.15.59:0/3872649950 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdefc0cc2a0 0x7fdefc153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:10.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.870+0000 7fdefb59e700 1 -- 172.21.15.59:0/3872649950 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdefc0cc2a0 msgr2=0x7fdefc153f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:10.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.870+0000 7fdefb59e700 1 --2- 172.21.15.59:0/3872649950 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdefc0cc2a0 0x7fdefc153f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:10.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.870+0000 7fdefb59e700 1 -- 172.21.15.59:0/3872649950 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdefc072690 msgr2=0x7fdefc152e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:10.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.870+0000 7fdefb59e700 1 --2- 172.21.15.59:0/3872649950 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdefc072690 0x7fdefc152e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:10.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.870+0000 7fdefb59e700 1 -- 172.21.15.59:0/3872649950 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeec0094a0 con 0x7fdefc15a5f0 2023-09-21T00:18:10.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.870+0000 7fdefa59c700 1 --2- 172.21.15.59:0/3872649950 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdefc0cc2a0 0x7fdefc153f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:18:10.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.870+0000 7fdefb59e700 1 --2- 172.21.15.59:0/3872649950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdefc15a5f0 0x7fdefc0c95b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fdef4001ba0 tx=0x7fdef400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:10.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.870+0000 7fdee37fe700 1 -- 172.21.15.59:0/3872649950 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef400ac20 con 0x7fdefc15a5f0 2023-09-21T00:18:10.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.870+0000 7fdee37fe700 1 -- 172.21.15.59:0/3872649950 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef400ad80 con 0x7fdefc15a5f0 2023-09-21T00:18:10.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.870+0000 7fdf01145700 1 -- 172.21.15.59:0/3872649950 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdefc0c5c00 con 0x7fdefc15a5f0 2023-09-21T00:18:10.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.870+0000 7fdee37fe700 1 -- 172.21.15.59:0/3872649950 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef4007310 con 0x7fdefc15a5f0 2023-09-21T00:18:10.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.870+0000 7fdf01145700 1 -- 172.21.15.59:0/3872649950 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdefc0c61c0 con 0x7fdefc15a5f0 2023-09-21T00:18:10.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.871+0000 7fdf01145700 1 -- 172.21.15.59:0/3872649950 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdefc067e50 con 0x7fdefc15a5f0 2023-09-21T00:18:10.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.872+0000 7fdee37fe700 1 -- 172.21.15.59:0/3872649950 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fdef4007470 con 0x7fdefc15a5f0 2023-09-21T00:18:10.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.872+0000 7fdee37fe700 1 --2- 172.21.15.59:0/3872649950 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fdee806ae00 0x7fdee806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:10.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.872+0000 7fdee37fe700 1 -- 172.21.15.59:0/3872649950 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fdef4089870 con 0x7fdefc15a5f0 2023-09-21T00:18:10.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.872+0000 7fdefad9d700 1 --2- 172.21.15.59:0/3872649950 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fdee806ae00 0x7fdee806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:10.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.873+0000 7fdefad9d700 1 --2- 172.21.15.59:0/3872649950 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fdee806ae00 0x7fdee806d2c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdef0001620 tx=0x7fdef0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:10.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:10.876+0000 7fdee37fe700 1 -- 172.21.15.59:0/3872649950 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fdef4054580 con 0x7fdefc15a5f0 2023-09-21T00:18:11.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.097+0000 7fdf01145700 1 -- 172.21.15.59:0/3872649950 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdefc06eaf0 con 0x7fdefc15a5f0 2023-09-21T00:18:11.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.098+0000 7fdee37fe700 1 -- 172.21.15.59:0/3872649950 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fdef4057ba0 con 0x7fdefc15a5f0 2023-09-21T00:18:11.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.100+0000 7fdf01145700 1 -- 172.21.15.59:0/3872649950 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fdee806ae00 msgr2=0x7fdee806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:11.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.100+0000 7fdf01145700 1 --2- 172.21.15.59:0/3872649950 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fdee806ae00 0x7fdee806d2c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdef0001620 tx=0x7fdef0009040 comp rx=0 tx=0).stop 2023-09-21T00:18:11.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.100+0000 7fdf01145700 1 -- 172.21.15.59:0/3872649950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdefc15a5f0 msgr2=0x7fdefc0c95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:11.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.100+0000 7fdf01145700 1 --2- 172.21.15.59:0/3872649950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdefc15a5f0 0x7fdefc0c95b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fdef4001ba0 tx=0x7fdef400a060 comp rx=0 tx=0).stop 2023-09-21T00:18:11.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.100+0000 7fdf01145700 1 -- 172.21.15.59:0/3872649950 shutdown_connections 2023-09-21T00:18:11.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.100+0000 7fdf01145700 1 --2- 172.21.15.59:0/3872649950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdefc15a5f0 0x7fdefc0c95b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:11.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.100+0000 7fdf01145700 1 --2- 172.21.15.59:0/3872649950 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdefc072690 0x7fdefc152e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:11.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.100+0000 7fdf01145700 1 --2- 172.21.15.59:0/3872649950 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fdee806ae00 0x7fdee806d2c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:11.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.100+0000 7fdf01145700 1 --2- 172.21.15.59:0/3872649950 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdefc0cc2a0 0x7fdefc153f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:11.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.100+0000 7fdf01145700 1 -- 172.21.15.59:0/3872649950 >> 172.21.15.59:0/3872649950 conn(0x7fdefc0ccae0 msgr2=0x7fdefc0ceea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:11.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.100+0000 7fdf01145700 1 -- 172.21.15.59:0/3872649950 shutdown_connections 2023-09-21T00:18:11.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.100+0000 7fdf01145700 1 -- 172.21.15.59:0/3872649950 wait complete. 2023-09-21T00:18:11.104 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2023-09-21T00:18:11.114 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-09-21T00:18:11.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:18:11.115 DEBUG:teuthology.orchestra.run.smithi083:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-09-21T00:18:11.155 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi083.front.sepia.ceph.com 2023-09-21T00:18:11.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:18:11.156 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-09-21T00:18:11.214 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-09-21T00:18:11.214 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T00:18:11.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.338+0000 7febd9570700 1 Processor -- start 2023-09-21T00:18:11.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.338+0000 7febd9570700 1 -- start start 2023-09-21T00:18:11.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.339+0000 7febd9570700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7febd415b2b0 0x7febd40cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:11.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.339+0000 7febd9570700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7febd40ce420 0x7febd4161190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:11.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.339+0000 7febd9570700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febd40cfee0 con 0x7febd406a780 2023-09-21T00:18:11.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.339+0000 7febd9570700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febd40ce250 con 0x7febd415b2b0 2023-09-21T00:18:11.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.339+0000 7febd9570700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd40ce900 con 0x7febd40ce420 2023-09-21T00:18:11.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.339+0000 7febd27fc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7febd40ce420 0x7febd4161190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:11.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.339+0000 7febd2ffd700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7febd415b2b0 0x7febd40cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:11.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.339+0000 7febd37fe700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7febd406a780 0x7febd415e1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.59:48992/0 (socket says 172.21.15.59:48992) 2023-09-21T00:18:11.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.339+0000 7febd37fe700 1 -- 172.21.15.59:0/4097295927 learned_addr learned my addr 172.21.15.59:0/4097295927 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:11.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.339+0000 7febd27fc700 1 --2- 172.21.15.59:0/4097295927 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7febd40ce420 0x7febd4161190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.59:53536/0 (socket says 172.21.15.59:53536) 2023-09-21T00:18:11.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.339+0000 7febd2ffd700 1 --2- 172.21.15.59:0/4097295927 >> v2:172.21.15.83:3300/0 conn(0x7febd415b2b0 0x7febd40cdd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.59:39036/0 (socket says 172.21.15.59:39036) 2023-09-21T00:18:11.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.340+0000 7febd2ffd700 1 -- 172.21.15.59:0/4097295927 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7febd40ce420 msgr2=0x7febd4161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:11.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.340+0000 7febd2ffd700 1 --2- 172.21.15.59:0/4097295927 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7febd40ce420 0x7febd4161190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:11.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.340+0000 7febd2ffd700 1 -- 172.21.15.59:0/4097295927 >> v1:172.21.15.83:6789/0 conn(0x7febd406a780 legacy=0x7febd415e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:11.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.340+0000 7febd2ffd700 1 -- 172.21.15.59:0/4097295927 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd40cebe0 con 0x7febd415b2b0 2023-09-21T00:18:11.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.340+0000 7febd27fc700 1 --2- 172.21.15.59:0/4097295927 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7febd40ce420 0x7febd4161190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T00:18:11.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.340+0000 7febd1ffb700 1 -- 172.21.15.59:0/4097295927 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3207819982 0 0) 0x7febd40cfee0 con 0x7febd406a780 2023-09-21T00:18:11.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.340+0000 7febd2ffd700 1 --2- 172.21.15.59:0/4097295927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7febd415b2b0 0x7febd40cdd10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7febc8009840 tx=0x7febc8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aabf5bcb474c2603 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:11.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.340+0000 7febd1ffb700 1 -- 172.21.15.59:0/4097295927 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc8011830 con 0x7febd415b2b0 2023-09-21T00:18:11.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.340+0000 7febd1ffb700 1 -- 172.21.15.59:0/4097295927 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc8011990 con 0x7febd415b2b0 2023-09-21T00:18:11.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.340+0000 7febd1ffb700 1 -- 172.21.15.59:0/4097295927 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc8011d20 con 0x7febd415b2b0 2023-09-21T00:18:11.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.341+0000 7febd9570700 1 -- 172.21.15.59:0/4097295927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7febd415b2b0 msgr2=0x7febd40cdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:11.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.341+0000 7febd9570700 1 --2- 172.21.15.59:0/4097295927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7febd415b2b0 0x7febd40cdd10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7febc8009840 tx=0x7febc8009b50 comp rx=0 tx=0).stop 2023-09-21T00:18:11.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.341+0000 7febd9570700 1 -- 172.21.15.59:0/4097295927 shutdown_connections 2023-09-21T00:18:11.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.341+0000 7febd9570700 1 --2- 172.21.15.59:0/4097295927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7febd415b2b0 0x7febd40cdd10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:11.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.341+0000 7febd9570700 1 --2- 172.21.15.59:0/4097295927 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7febd40ce420 0x7febd4161190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:11.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.341+0000 7febd9570700 1 -- 172.21.15.59:0/4097295927 >> 172.21.15.59:0/4097295927 conn(0x7febd40d0140 msgr2=0x7febd40d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:11.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.341+0000 7febd9570700 1 -- 172.21.15.59:0/4097295927 shutdown_connections 2023-09-21T00:18:11.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.341+0000 7febd9570700 1 -- 172.21.15.59:0/4097295927 wait complete. 2023-09-21T00:18:11.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.342+0000 7febd9570700 1 Processor -- start 2023-09-21T00:18:11.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.342+0000 7febd9570700 1 -- start start 2023-09-21T00:18:11.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.343+0000 7febd9570700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febd406a780 0x7febd4156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:11.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.343+0000 7febd9570700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7febd40ce420 0x7febd40c8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:11.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.343+0000 7febd9570700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7febd415b2b0 0x7febd40c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:11.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.343+0000 7febd9570700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd40ad260 con 0x7febd406a780 2023-09-21T00:18:11.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.343+0000 7febd9570700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd41e7020 con 0x7febd415b2b0 2023-09-21T00:18:11.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.343+0000 7febd9570700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd41e7300 con 0x7febd40ce420 2023-09-21T00:18:11.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.343+0000 7febd2ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febd406a780 0x7febd4156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:11.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.343+0000 7febd2ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febd406a780 0x7febd4156160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52926/0 (socket says 172.21.15.59:52926) 2023-09-21T00:18:11.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.343+0000 7febd2ffd700 1 -- 172.21.15.59:0/1535778320 learned_addr learned my addr 172.21.15.59:0/1535778320 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:11.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.343+0000 7febd27fc700 1 --2- 172.21.15.59:0/1535778320 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7febd40ce420 0x7febd40c8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:11.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.343+0000 7febd37fe700 1 --2- 172.21.15.59:0/1535778320 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7febd415b2b0 0x7febd40c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:11.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.343+0000 7febd2ffd700 1 -- 172.21.15.59:0/1535778320 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7febd40ce420 msgr2=0x7febd40c8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:11.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.343+0000 7febd2ffd700 1 --2- 172.21.15.59:0/1535778320 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7febd40ce420 0x7febd40c8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:11.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.343+0000 7febd2ffd700 1 -- 172.21.15.59:0/1535778320 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7febd415b2b0 msgr2=0x7febd40c8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:11.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.343+0000 7febd2ffd700 1 --2- 172.21.15.59:0/1535778320 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7febd415b2b0 0x7febd40c8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:11.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.344+0000 7febd2ffd700 1 -- 172.21.15.59:0/1535778320 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc40094a0 con 0x7febd406a780 2023-09-21T00:18:11.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.344+0000 7febd2ffd700 1 --2- 172.21.15.59:0/1535778320 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febd406a780 0x7febd4156160 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7febc8009b90 tx=0x7febc8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:11.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.344+0000 7febbb7fe700 1 -- 172.21.15.59:0/1535778320 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc80038a0 con 0x7febd406a780 2023-09-21T00:18:11.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.344+0000 7febbb7fe700 1 -- 172.21.15.59:0/1535778320 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc801e070 con 0x7febd406a780 2023-09-21T00:18:11.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.344+0000 7febd9570700 1 -- 172.21.15.59:0/1535778320 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febc80094a0 con 0x7febd406a780 2023-09-21T00:18:11.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.344+0000 7febbb7fe700 1 -- 172.21.15.59:0/1535778320 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc8003c40 con 0x7febd406a780 2023-09-21T00:18:11.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.344+0000 7febd9570700 1 -- 172.21.15.59:0/1535778320 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febd41e78c0 con 0x7febd406a780 2023-09-21T00:18:11.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.345+0000 7febd9570700 1 -- 172.21.15.59:0/1535778320 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febd4067e50 con 0x7febd406a780 2023-09-21T00:18:11.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.345+0000 7febbb7fe700 1 -- 172.21.15.59:0/1535778320 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7febc802d450 con 0x7febd406a780 2023-09-21T00:18:11.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.346+0000 7febbb7fe700 1 --2- 172.21.15.59:0/1535778320 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7febc006ae00 0x7febc006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:11.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.346+0000 7febbb7fe700 1 -- 172.21.15.59:0/1535778320 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7febc808a980 con 0x7febd406a780 2023-09-21T00:18:11.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.346+0000 7febd27fc700 1 --2- 172.21.15.59:0/1535778320 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7febc006ae00 0x7febc006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:11.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.346+0000 7febd27fc700 1 --2- 172.21.15.59:0/1535778320 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7febc006ae00 0x7febc006d2c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7febc4009d00 tx=0x7febc4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:11.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.350+0000 7febbb7fe700 1 -- 172.21.15.59:0/1535778320 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7febc8055680 con 0x7febd406a780 2023-09-21T00:18:11.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.594+0000 7febd9570700 1 -- 172.21.15.59:0/1535778320 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7febd4070040 con 0x7febd406a780 2023-09-21T00:18:11.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.595+0000 7febbb7fe700 1 -- 172.21.15.59:0/1535778320 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4903 (secure 0 0 0) 0x7febc8058ca0 con 0x7febd406a780 2023-09-21T00:18:11.598 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:18:11.598 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/461673980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":461673980},{"type":"v1","addr":"172.21.15.59:6835","nonce":461673980}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/3148728526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3148728526},{"type":"v1","addr":"172.21.15.59:6834","nonce":3148728526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/3250481509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3250481509},{"type":"v1","addr":"172.21.15.83:6836","nonce":3250481509}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-21T00:17:06.338694+0000","modified":"2023-09-21T00:17:29.401478+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6837/792952552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":792952552},{"type":"v1","addr":"172.21.15.83:6837","nonce":792952552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-21T00:18:11.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.597+0000 7febd9570700 1 -- 172.21.15.59:0/1535778320 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7febc006ae00 msgr2=0x7febc006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:11.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.597+0000 7febd9570700 1 --2- 172.21.15.59:0/1535778320 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7febc006ae00 0x7febc006d2c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7febc4009d00 tx=0x7febc4008040 comp rx=0 tx=0).stop 2023-09-21T00:18:11.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.597+0000 7febd9570700 1 -- 172.21.15.59:0/1535778320 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febd406a780 msgr2=0x7febd4156160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:11.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.597+0000 7febd9570700 1 --2- 172.21.15.59:0/1535778320 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febd406a780 0x7febd4156160 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7febc8009b90 tx=0x7febc8004750 comp rx=0 tx=0).stop 2023-09-21T00:18:11.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.597+0000 7febd9570700 1 -- 172.21.15.59:0/1535778320 shutdown_connections 2023-09-21T00:18:11.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.597+0000 7febd9570700 1 --2- 172.21.15.59:0/1535778320 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7febd415b2b0 0x7febd40c8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:11.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.597+0000 7febd9570700 1 --2- 172.21.15.59:0/1535778320 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febd406a780 0x7febd4156160 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:11.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.597+0000 7febd9570700 1 --2- 172.21.15.59:0/1535778320 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7febc006ae00 0x7febc006d2c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:11.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.597+0000 7febd9570700 1 --2- 172.21.15.59:0/1535778320 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7febd40ce420 0x7febd40c8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:11.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.597+0000 7febd9570700 1 -- 172.21.15.59:0/1535778320 >> 172.21.15.59:0/1535778320 conn(0x7febd40d0140 msgr2=0x7febd41593d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:11.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.597+0000 7febd9570700 1 -- 172.21.15.59:0/1535778320 shutdown_connections 2023-09-21T00:18:11.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.597+0000 7febd9570700 1 -- 172.21.15.59:0/1535778320 wait complete. 2023-09-21T00:18:11.602 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 8 2023-09-21T00:18:11.612 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T00:18:11.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.735+0000 7f4b7c026700 1 Processor -- start 2023-09-21T00:18:11.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.735+0000 7f4b7c026700 1 -- start start 2023-09-21T00:18:11.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.736+0000 7f4b7c026700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4b7406ae90 0x7f4b740cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:11.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.736+0000 7f4b7c026700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b741618a0 con 0x7f4b740ce420 2023-09-21T00:18:11.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.736+0000 7f4b7c026700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b740cfee0 con 0x7f4b7415b2b0 2023-09-21T00:18:11.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.736+0000 7f4b7c026700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b740ce250 con 0x7f4b7406ae90 2023-09-21T00:18:11.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.736+0000 7f4b795c1700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4b740ce420 0x7f4b7406a780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58504/0 (socket says 172.21.15.59:58504) 2023-09-21T00:18:11.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.736+0000 7f4b795c1700 1 -- 172.21.15.59:0/4070449119 learned_addr learned my addr 172.21.15.59:0/4070449119 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:11.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.736+0000 7f4b7a5c3700 1 --2- 172.21.15.59:0/4070449119 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4b7406ae90 0x7f4b740cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:11.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.736+0000 7f4b78dc0700 1 -- 172.21.15.59:0/4070449119 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3611406416 0 0) 0x7f4b741618a0 con 0x7f4b740ce420 2023-09-21T00:18:11.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.736+0000 7f4b78dc0700 1 -- 172.21.15.59:0/4070449119 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b600035b0 con 0x7f4b740ce420 2023-09-21T00:18:11.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.737+0000 7f4b78dc0700 1 -- 172.21.15.59:0/4070449119 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 280546541 0 0) 0x7f4b740cfee0 con 0x7f4b7415b2b0 2023-09-21T00:18:11.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.737+0000 7f4b78dc0700 1 -- 172.21.15.59:0/4070449119 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b741618a0 con 0x7f4b7415b2b0 2023-09-21T00:18:11.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.737+0000 7f4b78dc0700 1 -- 172.21.15.59:0/4070449119 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 250449586 0 0) 0x7f4b600035b0 con 0x7f4b740ce420 2023-09-21T00:18:11.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.737+0000 7f4b78dc0700 1 -- 172.21.15.59:0/4070449119 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4b7406ae90 msgr2=0x7f4b740cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:11.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.737+0000 7f4b78dc0700 1 --2- 172.21.15.59:0/4070449119 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4b7406ae90 0x7f4b740cdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:11.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.737+0000 7f4b78dc0700 1 -- 172.21.15.59:0/4070449119 >> v1:172.21.15.83:6789/0 conn(0x7f4b7415b2b0 legacy=0x7f4b74161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:11.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.737+0000 7f4b78dc0700 1 -- 172.21.15.59:0/4070449119 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b740ce900 con 0x7f4b740ce420 2023-09-21T00:18:11.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.737+0000 7f4b78dc0700 1 -- 172.21.15.59:0/4070449119 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 710825841 0 0) 0x7f4b70001670 con 0x7f4b740ce420 2023-09-21T00:18:11.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.737+0000 7f4b78dc0700 1 -- 172.21.15.59:0/4070449119 >> v1:172.21.15.59:6789/0 conn(0x7f4b740ce420 legacy=0x7f4b7406a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:11.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.737+0000 7f4b78dc0700 1 --2- 172.21.15.59:0/4070449119 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b60003c30 0x7f4b60004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:11.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.737+0000 7f4b78dc0700 1 --2- 172.21.15.59:0/4070449119 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4b7406ae90 0x7f4b60004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:11.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.737+0000 7f4b78dc0700 1 --2- 172.21.15.59:0/4070449119 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b60004d90 0x7f4b60005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:11.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.737+0000 7f4b78dc0700 1 -- 172.21.15.59:0/4070449119 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6000baf0 con 0x7f4b60004d90 2023-09-21T00:18:11.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.737+0000 7f4b78dc0700 1 -- 172.21.15.59:0/4070449119 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6000bc60 con 0x7f4b60003c30 2023-09-21T00:18:11.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.737+0000 7f4b78dc0700 1 -- 172.21.15.59:0/4070449119 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6000be20 con 0x7f4b7406ae90 2023-09-21T00:18:11.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.737+0000 7f4b7a5c3700 1 --2- 172.21.15.59:0/4070449119 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b60004d90 0x7f4b60005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:11.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.737+0000 7f4b79dc2700 1 --2- 172.21.15.59:0/4070449119 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b60003c30 0x7f4b60004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:11.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.737+0000 7f4b795c1700 1 --2- 172.21.15.59:0/4070449119 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4b7406ae90 0x7f4b60004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:11.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.737+0000 7f4b7a5c3700 1 -- 172.21.15.59:0/4070449119 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4b7406ae90 msgr2=0x7f4b60004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:11.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.737+0000 7f4b7a5c3700 1 --2- 172.21.15.59:0/4070449119 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4b7406ae90 0x7f4b60004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:11.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.737+0000 7f4b7a5c3700 1 -- 172.21.15.59:0/4070449119 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b60003c30 msgr2=0x7f4b60004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:11.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.737+0000 7f4b7a5c3700 1 --2- 172.21.15.59:0/4070449119 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b60003c30 0x7f4b60004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:11.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.737+0000 7f4b7a5c3700 1 -- 172.21.15.59:0/4070449119 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b600035b0 con 0x7f4b60004d90 2023-09-21T00:18:11.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.737+0000 7f4b7a5c3700 1 --2- 172.21.15.59:0/4070449119 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b60004d90 0x7f4b60005210 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4b7415dbe0 tx=0x7f4b60005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8cea37ba9678732 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:11.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.737+0000 7f4b78dc0700 1 -- 172.21.15.59:0/4070449119 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c00ebd0 con 0x7f4b60004d90 2023-09-21T00:18:11.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.737+0000 7f4b78dc0700 1 -- 172.21.15.59:0/4070449119 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6c00f040 con 0x7f4b60004d90 2023-09-21T00:18:11.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.737+0000 7f4b78dc0700 1 -- 172.21.15.59:0/4070449119 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c014480 con 0x7f4b60004d90 2023-09-21T00:18:11.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.738+0000 7f4b7c026700 1 -- 172.21.15.59:0/4070449119 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b60004d90 msgr2=0x7f4b60005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:11.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.738+0000 7f4b7c026700 1 --2- 172.21.15.59:0/4070449119 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b60004d90 0x7f4b60005210 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4b7415dbe0 tx=0x7f4b60005880 comp rx=0 tx=0).stop 2023-09-21T00:18:11.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.738+0000 7f4b7a5c3700 1 -- 172.21.15.59:0/4070449119 reap_dead start 2023-09-21T00:18:11.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.738+0000 7f4b7c026700 1 -- 172.21.15.59:0/4070449119 shutdown_connections 2023-09-21T00:18:11.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.738+0000 7f4b7c026700 1 -- 172.21.15.59:0/4070449119 >> 172.21.15.59:0/4070449119 conn(0x7f4b740d0140 msgr2=0x7f4b740d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:11.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.738+0000 7f4b7c026700 1 -- 172.21.15.59:0/4070449119 shutdown_connections 2023-09-21T00:18:11.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.738+0000 7f4b7c026700 1 -- 172.21.15.59:0/4070449119 wait complete. 2023-09-21T00:18:11.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.739+0000 7f4b7c026700 1 Processor -- start 2023-09-21T00:18:11.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.739+0000 7f4b7c026700 1 -- start start 2023-09-21T00:18:11.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.740+0000 7f4b7c026700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b740c9080 0x7f4b740b5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:11.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.740+0000 7f4b7c026700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b740b18f0 0x7f4b740c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:11.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.740+0000 7f4b7c026700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4b740c84b0 0x7f4b7406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:11.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.740+0000 7f4b7c026700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b741581c0 con 0x7f4b740c9080 2023-09-21T00:18:11.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.740+0000 7f4b7c026700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b740c9460 con 0x7f4b740b18f0 2023-09-21T00:18:11.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.740+0000 7f4b7c026700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b740b2420 con 0x7f4b740c84b0 2023-09-21T00:18:11.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.740+0000 7f4b79dc2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b740c9080 0x7f4b740b5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:11.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.740+0000 7f4b79dc2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b740c9080 0x7f4b740b5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52946/0 (socket says 172.21.15.59:52946) 2023-09-21T00:18:11.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.740+0000 7f4b79dc2700 1 -- 172.21.15.59:0/1198567176 learned_addr learned my addr 172.21.15.59:0/1198567176 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:11.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.740+0000 7f4b7a5c3700 1 --2- 172.21.15.59:0/1198567176 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4b740c84b0 0x7f4b7406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:11.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.740+0000 7f4b795c1700 1 --2- 172.21.15.59:0/1198567176 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b740b18f0 0x7f4b740c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:11.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.740+0000 7f4b79dc2700 1 -- 172.21.15.59:0/1198567176 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4b740c84b0 msgr2=0x7f4b7406f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:11.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.740+0000 7f4b79dc2700 1 --2- 172.21.15.59:0/1198567176 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4b740c84b0 0x7f4b7406f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:11.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.740+0000 7f4b79dc2700 1 -- 172.21.15.59:0/1198567176 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b740b18f0 msgr2=0x7f4b740c7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:11.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.740+0000 7f4b79dc2700 1 --2- 172.21.15.59:0/1198567176 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b740b18f0 0x7f4b740c7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:11.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.740+0000 7f4b79dc2700 1 -- 172.21.15.59:0/1198567176 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b740b1e60 con 0x7f4b740c9080 2023-09-21T00:18:11.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.740+0000 7f4b795c1700 1 --2- 172.21.15.59:0/1198567176 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b740b18f0 0x7f4b740c7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:18:11.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.741+0000 7f4b79dc2700 1 --2- 172.21.15.59:0/1198567176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b740c9080 0x7f4b740b5470 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4b6400f840 tx=0x7f4b6400fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:11.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.741+0000 7f4b6a7fc700 1 -- 172.21.15.59:0/1198567176 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b640052e0 con 0x7f4b740c9080 2023-09-21T00:18:11.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.741+0000 7f4b6a7fc700 1 -- 172.21.15.59:0/1198567176 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b64005480 con 0x7f4b740c9080 2023-09-21T00:18:11.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.741+0000 7f4b7c026700 1 -- 172.21.15.59:0/1198567176 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b740b2140 con 0x7f4b740c9080 2023-09-21T00:18:11.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.741+0000 7f4b6a7fc700 1 -- 172.21.15.59:0/1198567176 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b640038c0 con 0x7f4b740c9080 2023-09-21T00:18:11.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.741+0000 7f4b7c026700 1 -- 172.21.15.59:0/1198567176 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b74158760 con 0x7f4b740c9080 2023-09-21T00:18:11.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.742+0000 7f4b7c026700 1 -- 172.21.15.59:0/1198567176 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b74067e50 con 0x7f4b740c9080 2023-09-21T00:18:11.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.742+0000 7f4b6a7fc700 1 -- 172.21.15.59:0/1198567176 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f4b64003a20 con 0x7f4b740c9080 2023-09-21T00:18:11.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.742+0000 7f4b6a7fc700 1 --2- 172.21.15.59:0/1198567176 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f4b5806ae00 0x7f4b5806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:11.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.743+0000 7f4b6a7fc700 1 -- 172.21.15.59:0/1198567176 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f4b640897e0 con 0x7f4b740c9080 2023-09-21T00:18:11.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.743+0000 7f4b795c1700 1 --2- 172.21.15.59:0/1198567176 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f4b5806ae00 0x7f4b5806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:11.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.743+0000 7f4b795c1700 1 --2- 172.21.15.59:0/1198567176 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f4b5806ae00 0x7f4b5806d2c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4b740b1150 tx=0x7f4b70009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:11.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.747+0000 7f4b6a7fc700 1 -- 172.21.15.59:0/1198567176 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f4b64054580 con 0x7f4b740c9080 2023-09-21T00:18:11.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.949+0000 7f4b7c026700 1 -- 172.21.15.59:0/1198567176 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b74070040 con 0x7f4b740c9080 2023-09-21T00:18:11.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.950+0000 7f4b6a7fc700 1 -- 172.21.15.59:0/1198567176 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18792 (secure 0 0 0) 0x7f4b64057ba0 con 0x7f4b740c9080 2023-09-21T00:18:11.953 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:18:11.953 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":26,"fsid":"dd69925c-6e25-42fe-880b-2f60fc6f384b","created":"2023-09-21T00:16:43.074489+0000","modified":"2023-09-21T00:17:50.090179+0000","last_up_change":"2023-09-21T00:16:54.740101+0000","last_in_change":"2023-09-21T00:16:45.987089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T00:16:54.796248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-21T00:17:04.167102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-21T00:17:05.313188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-21T00:17:08.977609+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d4b18344-74c0-4f75-920b-7a9247e48914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6809","nonce":2418314235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6811","nonce":2418314235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6815","nonce":2418314235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6813","nonce":2418314235}]},"public_addr":"172.21.15.59:6809/2418314235","cluster_addr":"172.21.15.59:6811/2418314235","heartbeat_back_addr":"172.21.15.59:6815/2418314235","heartbeat_front_addr":"172.21.15.59:6813/2418314235","state":["exists","up"]},{"osd":1,"uuid":"80940d50-a248-4e64-a282-7ffcdad790ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6801","nonce":869668251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6803","nonce":869668251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6807","nonce":869668251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6805","nonce":869668251}]},"public_addr":"172.21.15.59:6801/869668251","cluster_addr":"172.21.15.59:6803/869668251","heartbeat_back_addr":"172.21.15.59:6807/869668251","heartbeat_front_addr":"172.21.15.59:6805/869668251","state":["exists","up"]},{"osd":2,"uuid":"55f2eceb-c54a-4879-a6ce-968c1c548b5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6817","nonce":372517778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6819","nonce":372517778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6823","nonce":372517778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6821","nonce":372517778}]},"public_addr":"172.21.15.59:6817/372517778","cluster_addr":"172.21.15.59:6819/372517778","heartbeat_back_addr":"172.21.15.59:6823/372517778","heartbeat_front_addr":"172.21.15.59:6821/372517778","state":["exists","up"]},{"osd":3,"uuid":"92b89cd0-869c-49b9-a9f9-97ac8423f304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6825","nonce":575188498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6827","nonce":575188498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6831","nonce":575188498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6829","nonce":575188498}]},"public_addr":"172.21.15.59:6825/575188498","cluster_addr":"172.21.15.59:6827/575188498","heartbeat_back_addr":"172.21.15.59:6831/575188498","heartbeat_front_addr":"172.21.15.59:6829/575188498","state":["exists","up"]},{"osd":4,"uuid":"25b80e94-e0e6-403d-b69f-61542f289637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6803","nonce":1741219098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6805","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6807","nonce":1741219098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6815","nonce":1741219098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6811","nonce":1741219098}]},"public_addr":"172.21.15.83:6803/1741219098","cluster_addr":"172.21.15.83:6807/1741219098","heartbeat_back_addr":"172.21.15.83:6815/1741219098","heartbeat_front_addr":"172.21.15.83:6811/1741219098","state":["exists","up"]},{"osd":5,"uuid":"5498d9ab-1086-4796-a199-9051e6dfea91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6817","nonce":156730565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6819","nonce":156730565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6823","nonce":156730565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6821","nonce":156730565}]},"public_addr":"172.21.15.83:6817/156730565","cluster_addr":"172.21.15.83:6819/156730565","heartbeat_back_addr":"172.21.15.83:6823/156730565","heartbeat_front_addr":"172.21.15.83:6821/156730565","state":["exists","up"]},{"osd":6,"uuid":"cfd810c0-5015-4d60-9a75-7efc93a32e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6801","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6800","nonce":1337723778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6806","nonce":1337723778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6814","nonce":1337723778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6810","nonce":1337723778}]},"public_addr":"172.21.15.83:6800/1337723778","cluster_addr":"172.21.15.83:6806/1337723778","heartbeat_back_addr":"172.21.15.83:6814/1337723778","heartbeat_front_addr":"172.21.15.83:6810/1337723778","state":["exists","up"]},{"osd":7,"uuid":"e992c8fa-0a3d-4b3c-85b5-2c511223dee4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6825","nonce":4204859272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6827","nonce":4204859272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6831","nonce":4204859272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6829","nonce":4204859272}]},"public_addr":"172.21.15.83:6825/4204859272","cluster_addr":"172.21.15.83:6827/4204859272","heartbeat_back_addr":"172.21.15.83:6831/4204859272","heartbeat_front_addr":"172.21.15.83:6829/4204859272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.156498+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.882707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.093978+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.158565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.173933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.888606+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.135525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.149712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":3,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.34","mappings":[{"from":4,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":6}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T00:18:11.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.952+0000 7f4b7c026700 1 -- 172.21.15.59:0/1198567176 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f4b5806ae00 msgr2=0x7f4b5806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:11.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.952+0000 7f4b7c026700 1 --2- 172.21.15.59:0/1198567176 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f4b5806ae00 0x7f4b5806d2c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4b740b1150 tx=0x7f4b70009040 comp rx=0 tx=0).stop 2023-09-21T00:18:11.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.952+0000 7f4b7c026700 1 -- 172.21.15.59:0/1198567176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b740c9080 msgr2=0x7f4b740b5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:11.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.952+0000 7f4b7c026700 1 --2- 172.21.15.59:0/1198567176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b740c9080 0x7f4b740b5470 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4b6400f840 tx=0x7f4b6400fc00 comp rx=0 tx=0).stop 2023-09-21T00:18:11.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.952+0000 7f4b7c026700 1 -- 172.21.15.59:0/1198567176 shutdown_connections 2023-09-21T00:18:11.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.952+0000 7f4b7c026700 1 --2- 172.21.15.59:0/1198567176 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f4b5806ae00 0x7f4b5806d2c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:11.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.952+0000 7f4b7c026700 1 --2- 172.21.15.59:0/1198567176 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4b740c84b0 0x7f4b7406f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:11.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.952+0000 7f4b7c026700 1 --2- 172.21.15.59:0/1198567176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b740c9080 0x7f4b740b5470 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:11.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.952+0000 7f4b7c026700 1 --2- 172.21.15.59:0/1198567176 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b740b18f0 0x7f4b740c7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:11.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.952+0000 7f4b7c026700 1 -- 172.21.15.59:0/1198567176 >> 172.21.15.59:0/1198567176 conn(0x7f4b740d0140 msgr2=0x7f4b7415a370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:11.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.952+0000 7f4b7c026700 1 -- 172.21.15.59:0/1198567176 shutdown_connections 2023-09-21T00:18:11.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:11.952+0000 7f4b7c026700 1 -- 172.21.15.59:0/1198567176 wait complete. 2023-09-21T00:18:11.967 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-21T00:16:54.796248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-21T00:17:04.167102+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-21T00:17:05.313188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-21T00:17:08.977609+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-21T00:18:11.968 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-21T00:18:12.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.094+0000 7fc1f9d9f700 1 Processor -- start 2023-09-21T00:18:12.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.094+0000 7fc1f9d9f700 1 -- start start 2023-09-21T00:18:12.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.094+0000 7fc1f9d9f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc1f415b480 0x7fc1f406f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:12.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.094+0000 7fc1f9d9f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f40b4030 con 0x7fc1f40d0820 2023-09-21T00:18:12.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.094+0000 7fc1f9d9f700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f40cb8d0 con 0x7fc1f40708f0 2023-09-21T00:18:12.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.094+0000 7fc1f9d9f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f40cbb40 con 0x7fc1f415b480 2023-09-21T00:18:12.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.095+0000 7fc1f37fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc1f415b480 0x7fc1f406f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:12.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.095+0000 7fc1eaffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc1f40d0820 0x7fc1f40701e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58524/0 (socket says 172.21.15.59:58524) 2023-09-21T00:18:12.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.095+0000 7fc1eaffd700 1 -- 172.21.15.59:0/2543121046 learned_addr learned my addr 172.21.15.59:0/2543121046 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:12.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.095+0000 7fc1f37fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc1f415b480 0x7fc1f406f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52954/0 (socket says 172.21.15.59:52954) 2023-09-21T00:18:12.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.095+0000 7fc1f37fe700 1 -- 172.21.15.59:0/2543121046 >> v1:172.21.15.83:6789/0 conn(0x7fc1f40708f0 legacy=0x7fc1f40b44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:12.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.095+0000 7fc1f37fe700 1 -- 172.21.15.59:0/2543121046 >> v1:172.21.15.59:6789/0 conn(0x7fc1f40d0820 legacy=0x7fc1f40701e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:12.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.095+0000 7fc1f37fe700 1 -- 172.21.15.59:0/2543121046 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f40cbe20 con 0x7fc1f415b480 2023-09-21T00:18:12.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.095+0000 7fc1f2ffd700 1 -- 172.21.15.59:0/2543121046 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 141616318 0 0) 0x7fc1f40b4030 con 0x7fc1f40d0820 2023-09-21T00:18:12.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.095+0000 7fc1f37fe700 1 --2- 172.21.15.59:0/2543121046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1f415b480 0x7fc1f406f400 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4009840 tx=0x7fc1e4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e6662a52e15a25d server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:12.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.095+0000 7fc1f2ffd700 1 -- 172.21.15.59:0/2543121046 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e4004230 con 0x7fc1f415b480 2023-09-21T00:18:12.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.095+0000 7fc1f2ffd700 1 -- 172.21.15.59:0/2543121046 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e4004390 con 0x7fc1f415b480 2023-09-21T00:18:12.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.095+0000 7fc1f2ffd700 1 -- 172.21.15.59:0/2543121046 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e40036a0 con 0x7fc1f415b480 2023-09-21T00:18:12.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.096+0000 7fc1f9d9f700 1 -- 172.21.15.59:0/2543121046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1f415b480 msgr2=0x7fc1f406f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:12.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.096+0000 7fc1f9d9f700 1 --2- 172.21.15.59:0/2543121046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1f415b480 0x7fc1f406f400 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4009840 tx=0x7fc1e4009b50 comp rx=0 tx=0).stop 2023-09-21T00:18:12.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.096+0000 7fc1f9d9f700 1 -- 172.21.15.59:0/2543121046 shutdown_connections 2023-09-21T00:18:12.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.096+0000 7fc1f9d9f700 1 --2- 172.21.15.59:0/2543121046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1f415b480 0x7fc1f406f400 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:12.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.096+0000 7fc1f9d9f700 1 -- 172.21.15.59:0/2543121046 >> 172.21.15.59:0/2543121046 conn(0x7fc1f40d11e0 msgr2=0x7fc1f40d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:12.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.096+0000 7fc1f9d9f700 1 -- 172.21.15.59:0/2543121046 shutdown_connections 2023-09-21T00:18:12.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.096+0000 7fc1f9d9f700 1 -- 172.21.15.59:0/2543121046 wait complete. 2023-09-21T00:18:12.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.097+0000 7fc1f9d9f700 1 Processor -- start 2023-09-21T00:18:12.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.097+0000 7fc1f9d9f700 1 -- start start 2023-09-21T00:18:12.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.098+0000 7fc1f9d9f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1f40708f0 0x7fc1f40cac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:12.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.098+0000 7fc1f9d9f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1f40d0820 0x7fc1f40c4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:12.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.098+0000 7fc1f9d9f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc1f415b480 0x7fc1f40c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:12.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.098+0000 7fc1f9d9f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f40c8890 con 0x7fc1f40708f0 2023-09-21T00:18:12.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.098+0000 7fc1f9d9f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f40c9130 con 0x7fc1f415b480 2023-09-21T00:18:12.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.098+0000 7fc1f9d9f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f40c7a90 con 0x7fc1f40d0820 2023-09-21T00:18:12.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.098+0000 7fc1f37fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1f40708f0 0x7fc1f40cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:12.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.098+0000 7fc1f37fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1f40708f0 0x7fc1f40cac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52960/0 (socket says 172.21.15.59:52960) 2023-09-21T00:18:12.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.098+0000 7fc1f37fe700 1 -- 172.21.15.59:0/642006006 learned_addr learned my addr 172.21.15.59:0/642006006 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:12.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.098+0000 7fc1eaffd700 1 --2- 172.21.15.59:0/642006006 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1f40d0820 0x7fc1f40c4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:12.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.098+0000 7fc1f3fff700 1 --2- 172.21.15.59:0/642006006 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc1f415b480 0x7fc1f40c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:12.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.098+0000 7fc1f37fe700 1 -- 172.21.15.59:0/642006006 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1f40d0820 msgr2=0x7fc1f40c4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:12.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.098+0000 7fc1f37fe700 1 --2- 172.21.15.59:0/642006006 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1f40d0820 0x7fc1f40c4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:12.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.098+0000 7fc1f37fe700 1 -- 172.21.15.59:0/642006006 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc1f415b480 msgr2=0x7fc1f40c95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:12.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.098+0000 7fc1f37fe700 1 --2- 172.21.15.59:0/642006006 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc1f415b480 0x7fc1f40c95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:12.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.098+0000 7fc1f37fe700 1 -- 172.21.15.59:0/642006006 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e40094a0 con 0x7fc1f40708f0 2023-09-21T00:18:12.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.098+0000 7fc1f3fff700 1 --2- 172.21.15.59:0/642006006 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc1f415b480 0x7fc1f40c95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:18:12.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.098+0000 7fc1eaffd700 1 --2- 172.21.15.59:0/642006006 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1f40d0820 0x7fc1f40c4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:18:12.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.099+0000 7fc1f37fe700 1 --2- 172.21.15.59:0/642006006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1f40708f0 0x7fc1f40cac10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc1f406f9d0 tx=0x7fc1e4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:12.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.099+0000 7fc1f0ff9700 1 -- 172.21.15.59:0/642006006 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e4011630 con 0x7fc1f40708f0 2023-09-21T00:18:12.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.099+0000 7fc1f0ff9700 1 -- 172.21.15.59:0/642006006 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e401e070 con 0x7fc1f40708f0 2023-09-21T00:18:12.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.099+0000 7fc1f0ff9700 1 -- 172.21.15.59:0/642006006 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e40119b0 con 0x7fc1f40708f0 2023-09-21T00:18:12.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.099+0000 7fc1f9d9f700 1 -- 172.21.15.59:0/642006006 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1f415b9e0 con 0x7fc1f40708f0 2023-09-21T00:18:12.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.099+0000 7fc1f9d9f700 1 -- 172.21.15.59:0/642006006 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1f40c8dc0 con 0x7fc1f40708f0 2023-09-21T00:18:12.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.100+0000 7fc1f9d9f700 1 -- 172.21.15.59:0/642006006 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1f4067e50 con 0x7fc1f40708f0 2023-09-21T00:18:12.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.100+0000 7fc1f0ff9700 1 -- 172.21.15.59:0/642006006 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fc1e4011b10 con 0x7fc1f40708f0 2023-09-21T00:18:12.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.101+0000 7fc1f0ff9700 1 --2- 172.21.15.59:0/642006006 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fc1d406ae00 0x7fc1d406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:12.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.101+0000 7fc1f0ff9700 1 -- 172.21.15.59:0/642006006 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fc1e408acd0 con 0x7fc1f40708f0 2023-09-21T00:18:12.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.101+0000 7fc1eaffd700 1 --2- 172.21.15.59:0/642006006 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fc1d406ae00 0x7fc1d406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:12.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.101+0000 7fc1eaffd700 1 --2- 172.21.15.59:0/642006006 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fc1d406ae00 0x7fc1d406d2c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc1f41f4030 tx=0x7fc1dc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:12.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.105+0000 7fc1f0ff9700 1 -- 172.21.15.59:0/642006006 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fc1e4055a70 con 0x7fc1f40708f0 2023-09-21T00:18:12.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.306+0000 7fc1f9d9f700 1 -- 172.21.15.59:0/642006006 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc1f40d0410 con 0x7fc1f40708f0 2023-09-21T00:18:12.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.307+0000 7fc1f0ff9700 1 -- 172.21.15.59:0/642006006 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc1e4020020 con 0x7fc1f40708f0 2023-09-21T00:18:12.309 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-09-21T00:18:12.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.309+0000 7fc1f9d9f700 1 -- 172.21.15.59:0/642006006 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fc1d406ae00 msgr2=0x7fc1d406d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:12.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.309+0000 7fc1f9d9f700 1 --2- 172.21.15.59:0/642006006 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fc1d406ae00 0x7fc1d406d2c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc1f41f4030 tx=0x7fc1dc009040 comp rx=0 tx=0).stop 2023-09-21T00:18:12.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.309+0000 7fc1f9d9f700 1 -- 172.21.15.59:0/642006006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1f40708f0 msgr2=0x7fc1f40cac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:12.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.309+0000 7fc1f9d9f700 1 --2- 172.21.15.59:0/642006006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1f40708f0 0x7fc1f40cac10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc1f406f9d0 tx=0x7fc1e4004750 comp rx=0 tx=0).stop 2023-09-21T00:18:12.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.309+0000 7fc1f9d9f700 1 -- 172.21.15.59:0/642006006 shutdown_connections 2023-09-21T00:18:12.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.309+0000 7fc1f9d9f700 1 --2- 172.21.15.59:0/642006006 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc1f415b480 0x7fc1f40c95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:12.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.309+0000 7fc1f9d9f700 1 --2- 172.21.15.59:0/642006006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1f40708f0 0x7fc1f40cac10 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:12.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.309+0000 7fc1f9d9f700 1 --2- 172.21.15.59:0/642006006 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fc1d406ae00 0x7fc1d406d2c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:12.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.309+0000 7fc1f9d9f700 1 --2- 172.21.15.59:0/642006006 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc1f40d0820 0x7fc1f40c4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:12.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.309+0000 7fc1f9d9f700 1 -- 172.21.15.59:0/642006006 >> 172.21.15.59:0/642006006 conn(0x7fc1f40d11e0 msgr2=0x7fc1f406ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:12.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.309+0000 7fc1f9d9f700 1 -- 172.21.15.59:0/642006006 shutdown_connections 2023-09-21T00:18:12.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.309+0000 7fc1f9d9f700 1 -- 172.21.15.59:0/642006006 wait complete. 2023-09-21T00:18:12.323 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-21T00:18:12.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.449+0000 7fe8b2d16700 1 Processor -- start 2023-09-21T00:18:12.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.449+0000 7fe8b2d16700 1 -- start start 2023-09-21T00:18:12.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.450+0000 7fe8b2d16700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe8ac06d290 0x7fe8ac0cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:12.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.450+0000 7fe8b2d16700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe8ac06d770 0x7fe8ac161140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:12.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.450+0000 7fe8b2d16700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8ac0ca2f0 con 0x7fe8ac160be0 2023-09-21T00:18:12.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.450+0000 7fe8b2d16700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8ac06ce70 con 0x7fe8ac06d290 2023-09-21T00:18:12.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.450+0000 7fe8b2d16700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8ac0cafe0 con 0x7fe8ac06d770 2023-09-21T00:18:12.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.450+0000 7fe8abfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe8ac06d290 0x7fe8ac0cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:12.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.450+0000 7fe8b0ab2700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe8ac160be0 0x7fe8ac0cc290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58536/0 (socket says 172.21.15.59:58536) 2023-09-21T00:18:12.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.450+0000 7fe8abfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe8ac06d290 0x7fe8ac0cc9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52968/0 (socket says 172.21.15.59:52968) 2023-09-21T00:18:12.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.450+0000 7fe8b0ab2700 1 -- 172.21.15.59:0/1636871710 learned_addr learned my addr 172.21.15.59:0/1636871710 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:12.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.451+0000 7fe8b12b3700 1 --2- 172.21.15.59:0/1636871710 >> v2:172.21.15.83:3300/0 conn(0x7fe8ac06d770 0x7fe8ac161140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:12.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.451+0000 7fe8abfff700 1 -- 172.21.15.59:0/1636871710 >> v2:172.21.15.83:3300/0 conn(0x7fe8ac06d770 msgr2=0x7fe8ac161140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:12.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.451+0000 7fe8abfff700 1 --2- 172.21.15.59:0/1636871710 >> v2:172.21.15.83:3300/0 conn(0x7fe8ac06d770 0x7fe8ac161140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:12.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.451+0000 7fe8abfff700 1 -- 172.21.15.59:0/1636871710 >> v1:172.21.15.59:6789/0 conn(0x7fe8ac160be0 legacy=0x7fe8ac0cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:12.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.451+0000 7fe8ab7fe700 1 -- 172.21.15.59:0/1636871710 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 90321005 0 0) 0x7fe8ac0ca2f0 con 0x7fe8ac160be0 2023-09-21T00:18:12.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.451+0000 7fe8abfff700 1 -- 172.21.15.59:0/1636871710 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8ac072050 con 0x7fe8ac06d290 2023-09-21T00:18:12.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.451+0000 7fe8abfff700 1 --2- 172.21.15.59:0/1636871710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8ac06d290 0x7fe8ac0cc9a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac1621e0 tx=0x7fe898009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4da6fa17643fa78b server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:12.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.451+0000 7fe8ab7fe700 1 -- 172.21.15.59:0/1636871710 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe898011830 con 0x7fe8ac06d290 2023-09-21T00:18:12.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.451+0000 7fe8ab7fe700 1 -- 172.21.15.59:0/1636871710 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe898011990 con 0x7fe8ac06d290 2023-09-21T00:18:12.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.451+0000 7fe8ab7fe700 1 -- 172.21.15.59:0/1636871710 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe898011d20 con 0x7fe8ac06d290 2023-09-21T00:18:12.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.452+0000 7fe8b2d16700 1 -- 172.21.15.59:0/1636871710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8ac06d290 msgr2=0x7fe8ac0cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:12.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.452+0000 7fe8b2d16700 1 --2- 172.21.15.59:0/1636871710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8ac06d290 0x7fe8ac0cc9a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac1621e0 tx=0x7fe898009b20 comp rx=0 tx=0).stop 2023-09-21T00:18:12.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.452+0000 7fe8b2d16700 1 -- 172.21.15.59:0/1636871710 shutdown_connections 2023-09-21T00:18:12.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.452+0000 7fe8b2d16700 1 --2- 172.21.15.59:0/1636871710 >> v2:172.21.15.83:3300/0 conn(0x7fe8ac06d770 0x7fe8ac161140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:12.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.452+0000 7fe8b2d16700 1 --2- 172.21.15.59:0/1636871710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8ac06d290 0x7fe8ac0cc9a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:12.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.452+0000 7fe8b2d16700 1 -- 172.21.15.59:0/1636871710 >> 172.21.15.59:0/1636871710 conn(0x7fe8ac06a780 msgr2=0x7fe8ac06ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:12.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.452+0000 7fe8b2d16700 1 -- 172.21.15.59:0/1636871710 shutdown_connections 2023-09-21T00:18:12.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.452+0000 7fe8b2d16700 1 -- 172.21.15.59:0/1636871710 wait complete. 2023-09-21T00:18:12.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.453+0000 7fe8b2d16700 1 Processor -- start 2023-09-21T00:18:12.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.453+0000 7fe8b2d16700 1 -- start start 2023-09-21T00:18:12.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.454+0000 7fe8b2d16700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe8ac06d290 0x7fe8ac0b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:12.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.454+0000 7fe8b2d16700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8ac06d770 0x7fe8ac1f3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:12.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.454+0000 7fe8b2d16700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8ac160be0 0x7fe8ac1f3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:12.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.454+0000 7fe8b2d16700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ac0af500 con 0x7fe8ac160be0 2023-09-21T00:18:12.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.454+0000 7fe8b2d16700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ac15bb00 con 0x7fe8ac06d770 2023-09-21T00:18:12.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.454+0000 7fe8b2d16700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ac0b23c0 con 0x7fe8ac06d290 2023-09-21T00:18:12.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.454+0000 7fe8b12b3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8ac160be0 0x7fe8ac1f3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:12.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.454+0000 7fe8b12b3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8ac160be0 0x7fe8ac1f3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52978/0 (socket says 172.21.15.59:52978) 2023-09-21T00:18:12.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.454+0000 7fe8b12b3700 1 -- 172.21.15.59:0/532598468 learned_addr learned my addr 172.21.15.59:0/532598468 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:12.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.454+0000 7fe8abfff700 1 --2- 172.21.15.59:0/532598468 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8ac06d770 0x7fe8ac1f3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:12.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.454+0000 7fe8b0ab2700 1 --2- 172.21.15.59:0/532598468 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe8ac06d290 0x7fe8ac0b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:12.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.454+0000 7fe8b12b3700 1 -- 172.21.15.59:0/532598468 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe8ac06d290 msgr2=0x7fe8ac0b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:12.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.454+0000 7fe8b12b3700 1 --2- 172.21.15.59:0/532598468 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe8ac06d290 0x7fe8ac0b1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:12.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.454+0000 7fe8b12b3700 1 -- 172.21.15.59:0/532598468 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8ac06d770 msgr2=0x7fe8ac1f3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:12.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.454+0000 7fe8b12b3700 1 --2- 172.21.15.59:0/532598468 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8ac06d770 0x7fe8ac1f3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:12.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.454+0000 7fe8b12b3700 1 -- 172.21.15.59:0/532598468 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8980094a0 con 0x7fe8ac160be0 2023-09-21T00:18:12.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.454+0000 7fe8abfff700 1 --2- 172.21.15.59:0/532598468 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8ac06d770 0x7fe8ac1f3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:18:12.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.454+0000 7fe8b12b3700 1 --2- 172.21.15.59:0/532598468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8ac160be0 0x7fe8ac1f3fe0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe8a400efc0 tx=0x7fe8a400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:12.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.455+0000 7fe8a97fa700 1 -- 172.21.15.59:0/532598468 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a400cd40 con 0x7fe8ac160be0 2023-09-21T00:18:12.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.455+0000 7fe8a97fa700 1 -- 172.21.15.59:0/532598468 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a400f040 con 0x7fe8ac160be0 2023-09-21T00:18:12.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.455+0000 7fe8a97fa700 1 -- 172.21.15.59:0/532598468 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a40146c0 con 0x7fe8ac160be0 2023-09-21T00:18:12.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.455+0000 7fe8b2d16700 1 -- 172.21.15.59:0/532598468 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8ac15ac50 con 0x7fe8ac160be0 2023-09-21T00:18:12.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.455+0000 7fe8b2d16700 1 -- 172.21.15.59:0/532598468 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8ac15b1d0 con 0x7fe8ac160be0 2023-09-21T00:18:12.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.456+0000 7fe8b2d16700 1 -- 172.21.15.59:0/532598468 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8ac15bc70 con 0x7fe8ac160be0 2023-09-21T00:18:12.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.456+0000 7fe8a97fa700 1 -- 172.21.15.59:0/532598468 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fe8a4014820 con 0x7fe8ac160be0 2023-09-21T00:18:12.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.456+0000 7fe8a97fa700 1 --2- 172.21.15.59:0/532598468 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fe89006ae00 0x7fe89006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:12.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.457+0000 7fe8a97fa700 1 -- 172.21.15.59:0/532598468 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fe8a408a320 con 0x7fe8ac160be0 2023-09-21T00:18:12.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.457+0000 7fe8b0ab2700 1 --2- 172.21.15.59:0/532598468 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fe89006ae00 0x7fe89006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:12.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.457+0000 7fe8b0ab2700 1 --2- 172.21.15.59:0/532598468 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fe89006ae00 0x7fe89006d2c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe8a0000f60 tx=0x7fe8a0007c90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:12.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.461+0000 7fe8a97fa700 1 -- 172.21.15.59:0/532598468 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fe8a40550e0 con 0x7fe8ac160be0 2023-09-21T00:18:12.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.662+0000 7fe8b2d16700 1 -- 172.21.15.59:0/532598468 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe8ac067e50 con 0x7fe8ac160be0 2023-09-21T00:18:12.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.662+0000 7fe8a97fa700 1 -- 172.21.15.59:0/532598468 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe8a400cea0 con 0x7fe8ac160be0 2023-09-21T00:18:12.664 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-09-21T00:18:12.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.664+0000 7fe8b2d16700 1 -- 172.21.15.59:0/532598468 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fe89006ae00 msgr2=0x7fe89006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:12.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.664+0000 7fe8b2d16700 1 --2- 172.21.15.59:0/532598468 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fe89006ae00 0x7fe89006d2c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe8a0000f60 tx=0x7fe8a0007c90 comp rx=0 tx=0).stop 2023-09-21T00:18:12.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.664+0000 7fe8b2d16700 1 -- 172.21.15.59:0/532598468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8ac160be0 msgr2=0x7fe8ac1f3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:12.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.664+0000 7fe8b2d16700 1 --2- 172.21.15.59:0/532598468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8ac160be0 0x7fe8ac1f3fe0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe8a400efc0 tx=0x7fe8a400c3a0 comp rx=0 tx=0).stop 2023-09-21T00:18:12.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.664+0000 7fe8b2d16700 1 -- 172.21.15.59:0/532598468 shutdown_connections 2023-09-21T00:18:12.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.664+0000 7fe8b2d16700 1 --2- 172.21.15.59:0/532598468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8ac160be0 0x7fe8ac1f3fe0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:12.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.664+0000 7fe8b2d16700 1 --2- 172.21.15.59:0/532598468 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fe89006ae00 0x7fe89006d2c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:12.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.664+0000 7fe8b2d16700 1 --2- 172.21.15.59:0/532598468 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe8ac06d290 0x7fe8ac0b1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:12.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.664+0000 7fe8b2d16700 1 --2- 172.21.15.59:0/532598468 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8ac06d770 0x7fe8ac1f3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:12.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.664+0000 7fe8b2d16700 1 -- 172.21.15.59:0/532598468 >> 172.21.15.59:0/532598468 conn(0x7fe8ac06a780 msgr2=0x7fe8ac161960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:12.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.664+0000 7fe8b2d16700 1 -- 172.21.15.59:0/532598468 shutdown_connections 2023-09-21T00:18:12.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.664+0000 7fe8b2d16700 1 -- 172.21.15.59:0/532598468 wait complete. 2023-09-21T00:18:12.678 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-21T00:18:12.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.804+0000 7f8005f1f700 1 Processor -- start 2023-09-21T00:18:12.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.804+0000 7f8005f1f700 1 -- start start 2023-09-21T00:18:12.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.805+0000 7f8005f1f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f800015b480 0x7f800006f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:12.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.805+0000 7f8005f1f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f80000708f0 0x7f80000b44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:12.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.805+0000 7f8005f1f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80000b4030 con 0x7f80000d0820 2023-09-21T00:18:12.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.805+0000 7f8005f1f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80000cb8d0 con 0x7f80000708f0 2023-09-21T00:18:12.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.805+0000 7f8005f1f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80000cbb40 con 0x7f800015b480 2023-09-21T00:18:12.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.805+0000 7f7ffffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f80000708f0 0x7f80000b44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:12.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.805+0000 7f7ffffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f80000708f0 0x7f80000b44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52986/0 (socket says 172.21.15.59:52986) 2023-09-21T00:18:12.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.805+0000 7f7ffffff700 1 -- 172.21.15.59:0/2620659577 learned_addr learned my addr 172.21.15.59:0/2620659577 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:12.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.805+0000 7f7ffeffd700 1 --1- 172.21.15.59:0/2620659577 >> v1:172.21.15.59:6789/0 conn(0x7f80000d0820 0x7f80000701e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58552/0 (socket says 172.21.15.59:58552) 2023-09-21T00:18:12.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.806+0000 7f7fff7fe700 1 --2- 172.21.15.59:0/2620659577 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f800015b480 0x7f800006f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:12.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.806+0000 7f7ffffff700 1 -- 172.21.15.59:0/2620659577 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f800015b480 msgr2=0x7f800006f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:12.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.806+0000 7f7ffffff700 1 --2- 172.21.15.59:0/2620659577 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f800015b480 0x7f800006f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:12.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.806+0000 7f7ffffff700 1 -- 172.21.15.59:0/2620659577 >> v1:172.21.15.59:6789/0 conn(0x7f80000d0820 legacy=0x7f80000701e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:12.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.806+0000 7f7ffffff700 1 -- 172.21.15.59:0/2620659577 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80000cbe20 con 0x7f80000708f0 2023-09-21T00:18:12.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.806+0000 7f7ffe7fc700 1 -- 172.21.15.59:0/2620659577 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3025342306 0 0) 0x7f80000b4030 con 0x7f80000d0820 2023-09-21T00:18:12.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.806+0000 7f7fff7fe700 1 --2- 172.21.15.59:0/2620659577 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f800015b480 0x7f800006f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:18:12.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.806+0000 7f7ffffff700 1 --2- 172.21.15.59:0/2620659577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80000708f0 0x7f80000b44c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8009e50 tx=0x7f7ff800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc2fcd7dfbfc425b server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:12.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.806+0000 7f7ffe7fc700 1 -- 172.21.15.59:0/2620659577 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff800e070 con 0x7f80000708f0 2023-09-21T00:18:12.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.806+0000 7f7ffe7fc700 1 -- 172.21.15.59:0/2620659577 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff800b9c0 con 0x7f80000708f0 2023-09-21T00:18:12.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.806+0000 7f7ffe7fc700 1 -- 172.21.15.59:0/2620659577 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff800bd70 con 0x7f80000708f0 2023-09-21T00:18:12.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.807+0000 7f8005f1f700 1 -- 172.21.15.59:0/2620659577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80000708f0 msgr2=0x7f80000b44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:12.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.807+0000 7f8005f1f700 1 --2- 172.21.15.59:0/2620659577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80000708f0 0x7f80000b44c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8009e50 tx=0x7f7ff800b330 comp rx=0 tx=0).stop 2023-09-21T00:18:12.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.807+0000 7f8005f1f700 1 -- 172.21.15.59:0/2620659577 shutdown_connections 2023-09-21T00:18:12.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.807+0000 7f8005f1f700 1 --2- 172.21.15.59:0/2620659577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80000708f0 0x7f80000b44c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:12.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.807+0000 7f8005f1f700 1 --2- 172.21.15.59:0/2620659577 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f800015b480 0x7f800006f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:12.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.807+0000 7f8005f1f700 1 -- 172.21.15.59:0/2620659577 >> 172.21.15.59:0/2620659577 conn(0x7f80000d11e0 msgr2=0x7f80000d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:12.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.807+0000 7f8005f1f700 1 -- 172.21.15.59:0/2620659577 shutdown_connections 2023-09-21T00:18:12.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.807+0000 7f8005f1f700 1 -- 172.21.15.59:0/2620659577 wait complete. 2023-09-21T00:18:12.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.808+0000 7f8005f1f700 1 Processor -- start 2023-09-21T00:18:12.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.808+0000 7f8005f1f700 1 -- start start 2023-09-21T00:18:12.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.809+0000 7f8005f1f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80000708f0 0x7f80000c5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:12.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.809+0000 7f8005f1f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80000d0820 0x7f80000c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:12.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.809+0000 7f8005f1f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f800015b480 0x7f80000c72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:12.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.809+0000 7f8005f1f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80001f0840 con 0x7f80000d0820 2023-09-21T00:18:12.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.809+0000 7f8005f1f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8000153d80 con 0x7f80000708f0 2023-09-21T00:18:12.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.809+0000 7f8005f1f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80000c90c0 con 0x7f800015b480 2023-09-21T00:18:12.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.810+0000 7f7ffeffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80000d0820 0x7f80000c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:12.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.810+0000 7f7ffeffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80000d0820 0x7f80000c8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52990/0 (socket says 172.21.15.59:52990) 2023-09-21T00:18:12.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.810+0000 7f7ffeffd700 1 -- 172.21.15.59:0/3717135167 learned_addr learned my addr 172.21.15.59:0/3717135167 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:12.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.810+0000 7f7fff7fe700 1 --2- 172.21.15.59:0/3717135167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80000708f0 0x7f80000c5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:12.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.810+0000 7f7ffeffd700 1 -- 172.21.15.59:0/3717135167 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f800015b480 msgr2=0x7f80000c72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:12.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.810+0000 7f7ffffff700 1 --2- 172.21.15.59:0/3717135167 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f800015b480 0x7f80000c72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:12.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.810+0000 7f7ffeffd700 1 --2- 172.21.15.59:0/3717135167 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f800015b480 0x7f80000c72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:12.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.810+0000 7f7ffeffd700 1 -- 172.21.15.59:0/3717135167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80000708f0 msgr2=0x7f80000c5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:12.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.810+0000 7f7ffeffd700 1 --2- 172.21.15.59:0/3717135167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80000708f0 0x7f80000c5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:12.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.810+0000 7f7ffeffd700 1 -- 172.21.15.59:0/3717135167 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff8009b30 con 0x7f80000d0820 2023-09-21T00:18:12.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.810+0000 7f7fff7fe700 1 --2- 172.21.15.59:0/3717135167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80000708f0 0x7f80000c5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:18:12.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.810+0000 7f7ffffff700 1 --2- 172.21.15.59:0/3717135167 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f800015b480 0x7f80000c72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:18:12.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.810+0000 7f7ffeffd700 1 --2- 172.21.15.59:0/3717135167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80000d0820 0x7f80000c8b80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7fe80011e0 tx=0x7f7fe800cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:12.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.810+0000 7f7ff7fff700 1 -- 172.21.15.59:0/3717135167 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe8004c80 con 0x7f80000d0820 2023-09-21T00:18:12.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.810+0000 7f7ff7fff700 1 -- 172.21.15.59:0/3717135167 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe8004e00 con 0x7f80000d0820 2023-09-21T00:18:12.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.810+0000 7f8005f1f700 1 -- 172.21.15.59:0/3717135167 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f800015b9e0 con 0x7f80000d0820 2023-09-21T00:18:12.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.810+0000 7f7ff7fff700 1 -- 172.21.15.59:0/3717135167 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe8007310 con 0x7f80000d0820 2023-09-21T00:18:12.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.810+0000 7f8005f1f700 1 -- 172.21.15.59:0/3717135167 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80000b3730 con 0x7f80000d0820 2023-09-21T00:18:12.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.811+0000 7f8005f1f700 1 -- 172.21.15.59:0/3717135167 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80001f0980 con 0x7f80000d0820 2023-09-21T00:18:12.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.812+0000 7f7ff7fff700 1 -- 172.21.15.59:0/3717135167 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f7fe8007470 con 0x7f80000d0820 2023-09-21T00:18:12.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.812+0000 7f7ff7fff700 1 --2- 172.21.15.59:0/3717135167 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f7fe006ae00 0x7f7fe006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:12.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.812+0000 7f7ff7fff700 1 -- 172.21.15.59:0/3717135167 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f7fe80896f0 con 0x7f80000d0820 2023-09-21T00:18:12.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.812+0000 7f7fff7fe700 1 --2- 172.21.15.59:0/3717135167 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f7fe006ae00 0x7f7fe006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:12.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.813+0000 7f7fff7fe700 1 --2- 172.21.15.59:0/3717135167 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f7fe006ae00 0x7f7fe006d2c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0008910 tx=0x7f7ff0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:12.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:12.816+0000 7f7ff7fff700 1 -- 172.21.15.59:0/3717135167 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f80001f0980 con 0x7f80000d0820 2023-09-21T00:18:13.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.017+0000 7f8005f1f700 1 -- 172.21.15.59:0/3717135167 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f80001f0980 con 0x7f80000d0820 2023-09-21T00:18:13.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.017+0000 7f7ff7fff700 1 -- 172.21.15.59:0/3717135167 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f80001f0980 con 0x7f80000d0820 2023-09-21T00:18:13.020 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-09-21T00:18:13.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.020+0000 7f8005f1f700 1 -- 172.21.15.59:0/3717135167 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f7fe006ae00 msgr2=0x7f7fe006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:13.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.020+0000 7f8005f1f700 1 --2- 172.21.15.59:0/3717135167 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f7fe006ae00 0x7f7fe006d2c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0008910 tx=0x7f7ff0008040 comp rx=0 tx=0).stop 2023-09-21T00:18:13.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.020+0000 7f8005f1f700 1 -- 172.21.15.59:0/3717135167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80000d0820 msgr2=0x7f80000c8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:13.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.020+0000 7f8005f1f700 1 --2- 172.21.15.59:0/3717135167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80000d0820 0x7f80000c8b80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7fe80011e0 tx=0x7f7fe800cae0 comp rx=0 tx=0).stop 2023-09-21T00:18:13.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.020+0000 7f8005f1f700 1 -- 172.21.15.59:0/3717135167 shutdown_connections 2023-09-21T00:18:13.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.020+0000 7f8005f1f700 1 --2- 172.21.15.59:0/3717135167 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f7fe006ae00 0x7f7fe006d2c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:13.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.020+0000 7f8005f1f700 1 --2- 172.21.15.59:0/3717135167 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f800015b480 0x7f80000c72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:13.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.020+0000 7f8005f1f700 1 --2- 172.21.15.59:0/3717135167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f80000708f0 0x7f80000c5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:13.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.020+0000 7f8005f1f700 1 --2- 172.21.15.59:0/3717135167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80000d0820 0x7f80000c8b80 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:13.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.020+0000 7f8005f1f700 1 -- 172.21.15.59:0/3717135167 >> 172.21.15.59:0/3717135167 conn(0x7f80000d11e0 msgr2=0x7f800015d480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:13.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.020+0000 7f8005f1f700 1 -- 172.21.15.59:0/3717135167 shutdown_connections 2023-09-21T00:18:13.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.020+0000 7f8005f1f700 1 -- 172.21.15.59:0/3717135167 wait complete. 2023-09-21T00:18:13.034 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-21T00:18:13.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.160+0000 7f4120d0a700 1 Processor -- start 2023-09-21T00:18:13.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.160+0000 7f4120d0a700 1 -- start start 2023-09-21T00:18:13.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.161+0000 7f4120d0a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f411c0ce420 0x7f411c0cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:13.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.161+0000 7f4120d0a700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f411c06a780 0x7f411c06abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:13.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.161+0000 7f4120d0a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f411c06b110 con 0x7f411c15b2b0 2023-09-21T00:18:13.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.161+0000 7f4120d0a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f411c0ce250 con 0x7f411c0ce420 2023-09-21T00:18:13.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.161+0000 7f4120d0a700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f411c1618a0 con 0x7f411c06a780 2023-09-21T00:18:13.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.162+0000 7f4119d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f411c0ce420 0x7f411c0cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:13.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.162+0000 7f411a59c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f411c15b2b0 0x7f411c161190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58564/0 (socket says 172.21.15.59:58564) 2023-09-21T00:18:13.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.162+0000 7f411a59c700 1 -- 172.21.15.59:0/2959960492 learned_addr learned my addr 172.21.15.59:0/2959960492 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:13.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.162+0000 7f411ad9d700 1 --2- 172.21.15.59:0/2959960492 >> v2:172.21.15.83:3300/0 conn(0x7f411c06a780 0x7f411c06abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:13.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.162+0000 7f4119d9b700 1 -- 172.21.15.59:0/2959960492 >> v2:172.21.15.83:3300/0 conn(0x7f411c06a780 msgr2=0x7f411c06abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:13.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.162+0000 7f4119d9b700 1 --2- 172.21.15.59:0/2959960492 >> v2:172.21.15.83:3300/0 conn(0x7f411c06a780 0x7f411c06abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:13.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.162+0000 7f4119d9b700 1 -- 172.21.15.59:0/2959960492 >> v1:172.21.15.59:6789/0 conn(0x7f411c15b2b0 legacy=0x7f411c161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:13.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.162+0000 7f411959a700 1 -- 172.21.15.59:0/2959960492 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4000680430 0 0) 0x7f410c001110 con 0x7f411c15b2b0 2023-09-21T00:18:13.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.162+0000 7f4119d9b700 1 -- 172.21.15.59:0/2959960492 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f411c0cfee0 con 0x7f411c0ce420 2023-09-21T00:18:13.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.162+0000 7f4119d9b700 1 --2- 172.21.15.59:0/2959960492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f411c0ce420 0x7f411c0cdd10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f411c0cbf10 tx=0x7f4104009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b055f3dcf4b01c3 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:13.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.162+0000 7f411959a700 1 -- 172.21.15.59:0/2959960492 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4104011830 con 0x7f411c0ce420 2023-09-21T00:18:13.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.162+0000 7f411959a700 1 -- 172.21.15.59:0/2959960492 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4104011990 con 0x7f411c0ce420 2023-09-21T00:18:13.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.162+0000 7f411959a700 1 -- 172.21.15.59:0/2959960492 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4104011d20 con 0x7f411c0ce420 2023-09-21T00:18:13.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.163+0000 7f4120d0a700 1 -- 172.21.15.59:0/2959960492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f411c0ce420 msgr2=0x7f411c0cdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:13.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.163+0000 7f4120d0a700 1 --2- 172.21.15.59:0/2959960492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f411c0ce420 0x7f411c0cdd10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f411c0cbf10 tx=0x7f4104009b20 comp rx=0 tx=0).stop 2023-09-21T00:18:13.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.163+0000 7f4120d0a700 1 -- 172.21.15.59:0/2959960492 shutdown_connections 2023-09-21T00:18:13.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.163+0000 7f4120d0a700 1 --2- 172.21.15.59:0/2959960492 >> v2:172.21.15.83:3300/0 conn(0x7f411c06a780 0x7f411c06abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:13.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.163+0000 7f4120d0a700 1 --2- 172.21.15.59:0/2959960492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f411c0ce420 0x7f411c0cdd10 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:13.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.163+0000 7f4120d0a700 1 -- 172.21.15.59:0/2959960492 >> 172.21.15.59:0/2959960492 conn(0x7f411c0d0140 msgr2=0x7f411c0d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:13.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.163+0000 7f4120d0a700 1 -- 172.21.15.59:0/2959960492 shutdown_connections 2023-09-21T00:18:13.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.163+0000 7f4120d0a700 1 -- 172.21.15.59:0/2959960492 wait complete. 2023-09-21T00:18:13.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.164+0000 7f4120d0a700 1 Processor -- start 2023-09-21T00:18:13.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.164+0000 7f4120d0a700 1 -- start start 2023-09-21T00:18:13.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.165+0000 7f4120d0a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f411c06a780 0x7f411c150190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:13.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.165+0000 7f4120d0a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f411c0ce420 0x7f411c1e7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:13.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.165+0000 7f4120d0a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f411c15b2b0 0x7f411c1e8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:13.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.165+0000 7f4120d0a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411c150d90 con 0x7f411c15b2b0 2023-09-21T00:18:13.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.165+0000 7f4120d0a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411c150fe0 con 0x7f411c0ce420 2023-09-21T00:18:13.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.165+0000 7f4120d0a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f411c1512c0 con 0x7f411c06a780 2023-09-21T00:18:13.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.165+0000 7f411ad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f411c15b2b0 0x7f411c1e8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:13.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.165+0000 7f411ad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f411c15b2b0 0x7f411c1e8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53006/0 (socket says 172.21.15.59:53006) 2023-09-21T00:18:13.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.165+0000 7f411ad9d700 1 -- 172.21.15.59:0/1950235648 learned_addr learned my addr 172.21.15.59:0/1950235648 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:13.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.165+0000 7f4119d9b700 1 --2- 172.21.15.59:0/1950235648 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f411c0ce420 0x7f411c1e7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:13.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.165+0000 7f411ad9d700 1 -- 172.21.15.59:0/1950235648 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f411c06a780 msgr2=0x7f411c150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:13.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.165+0000 7f411ad9d700 1 --2- 172.21.15.59:0/1950235648 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f411c06a780 0x7f411c150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:13.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.165+0000 7f411ad9d700 1 -- 172.21.15.59:0/1950235648 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f411c0ce420 msgr2=0x7f411c1e7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:13.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.165+0000 7f411ad9d700 1 --2- 172.21.15.59:0/1950235648 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f411c0ce420 0x7f411c1e7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:13.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.166+0000 7f411ad9d700 1 -- 172.21.15.59:0/1950235648 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41040094a0 con 0x7f411c15b2b0 2023-09-21T00:18:13.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.166+0000 7f4119d9b700 1 --2- 172.21.15.59:0/1950235648 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f411c0ce420 0x7f411c1e7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:18:13.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.166+0000 7f411ad9d700 1 --2- 172.21.15.59:0/1950235648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f411c15b2b0 0x7f411c1e8190 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f411400efc0 tx=0x7f411400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:13.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.166+0000 7f4112ffd700 1 -- 172.21.15.59:0/1950235648 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411400cd40 con 0x7f411c15b2b0 2023-09-21T00:18:13.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.166+0000 7f4112ffd700 1 -- 172.21.15.59:0/1950235648 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f411400f040 con 0x7f411c15b2b0 2023-09-21T00:18:13.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.166+0000 7f4120d0a700 1 -- 172.21.15.59:0/1950235648 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f411c1515a0 con 0x7f411c15b2b0 2023-09-21T00:18:13.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.166+0000 7f4112ffd700 1 -- 172.21.15.59:0/1950235648 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41140146c0 con 0x7f411c15b2b0 2023-09-21T00:18:13.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.166+0000 7f4120d0a700 1 -- 172.21.15.59:0/1950235648 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f411c151b60 con 0x7f411c15b2b0 2023-09-21T00:18:13.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.167+0000 7f4120d0a700 1 -- 172.21.15.59:0/1950235648 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f411c151d50 con 0x7f411c15b2b0 2023-09-21T00:18:13.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.167+0000 7f4112ffd700 1 -- 172.21.15.59:0/1950235648 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f4114014820 con 0x7f411c15b2b0 2023-09-21T00:18:13.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.168+0000 7f4112ffd700 1 --2- 172.21.15.59:0/1950235648 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f40fc06ae00 0x7f40fc06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:13.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.168+0000 7f4112ffd700 1 -- 172.21.15.59:0/1950235648 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f411408a310 con 0x7f411c15b2b0 2023-09-21T00:18:13.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.168+0000 7f411a59c700 1 --2- 172.21.15.59:0/1950235648 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f40fc06ae00 0x7f40fc06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:13.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.169+0000 7f411a59c700 1 --2- 172.21.15.59:0/1950235648 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f40fc06ae00 0x7f40fc06d2c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f410c001610 tx=0x7f410c0079f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:13.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.173+0000 7f4112ffd700 1 -- 172.21.15.59:0/1950235648 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f4114054f90 con 0x7f411c15b2b0 2023-09-21T00:18:13.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.372+0000 7f4120d0a700 1 -- 172.21.15.59:0/1950235648 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f411c067e50 con 0x7f411c15b2b0 2023-09-21T00:18:13.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.372+0000 7f4112ffd700 1 -- 172.21.15.59:0/1950235648 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f41140180a0 con 0x7f411c15b2b0 2023-09-21T00:18:13.374 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-09-21T00:18:13.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.374+0000 7f4120d0a700 1 -- 172.21.15.59:0/1950235648 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f40fc06ae00 msgr2=0x7f40fc06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:13.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.374+0000 7f4120d0a700 1 --2- 172.21.15.59:0/1950235648 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f40fc06ae00 0x7f40fc06d2c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f410c001610 tx=0x7f410c0079f0 comp rx=0 tx=0).stop 2023-09-21T00:18:13.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.374+0000 7f4120d0a700 1 -- 172.21.15.59:0/1950235648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f411c15b2b0 msgr2=0x7f411c1e8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:13.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.374+0000 7f4120d0a700 1 --2- 172.21.15.59:0/1950235648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f411c15b2b0 0x7f411c1e8190 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f411400efc0 tx=0x7f411400c3a0 comp rx=0 tx=0).stop 2023-09-21T00:18:13.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.374+0000 7f4120d0a700 1 -- 172.21.15.59:0/1950235648 shutdown_connections 2023-09-21T00:18:13.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.374+0000 7f4120d0a700 1 --2- 172.21.15.59:0/1950235648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f411c15b2b0 0x7f411c1e8190 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:13.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.374+0000 7f4120d0a700 1 --2- 172.21.15.59:0/1950235648 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f40fc06ae00 0x7f40fc06d2c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:13.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.374+0000 7f4120d0a700 1 --2- 172.21.15.59:0/1950235648 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f411c06a780 0x7f411c150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:13.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.374+0000 7f4120d0a700 1 --2- 172.21.15.59:0/1950235648 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f411c0ce420 0x7f411c1e7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:13.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.374+0000 7f4120d0a700 1 -- 172.21.15.59:0/1950235648 >> 172.21.15.59:0/1950235648 conn(0x7f411c0d0140 msgr2=0x7f411c0d0520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:13.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.374+0000 7f4120d0a700 1 -- 172.21.15.59:0/1950235648 shutdown_connections 2023-09-21T00:18:13.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.374+0000 7f4120d0a700 1 -- 172.21.15.59:0/1950235648 wait complete. 2023-09-21T00:18:13.388 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T00:18:13.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.512+0000 7f9c0e4cc700 1 Processor -- start 2023-09-21T00:18:13.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.512+0000 7f9c0e4cc700 1 -- start start 2023-09-21T00:18:13.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.513+0000 7f9c0e4cc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9c0815a230 0x7f9c0815e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:13.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.513+0000 7f9c0e4cc700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9c080ca790 0x7f9c08071680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:13.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.513+0000 7f9c0e4cc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c080cac20 0x7f9c08071bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:13.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.513+0000 7f9c0e4cc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c080cb780 con 0x7f9c0815a230 2023-09-21T00:18:13.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.513+0000 7f9c0e4cc700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c080cb1c0 con 0x7f9c080ca790 2023-09-21T00:18:13.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.513+0000 7f9c0e4cc700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c080cb4a0 con 0x7f9c080cac20 2023-09-21T00:18:13.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.513+0000 7f9c07fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9c0815a230 0x7f9c0815e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:13.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.513+0000 7f9c07fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9c0815a230 0x7f9c0815e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53010/0 (socket says 172.21.15.59:53010) 2023-09-21T00:18:13.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.513+0000 7f9c07fff700 1 -- 172.21.15.59:0/3214740909 learned_addr learned my addr 172.21.15.59:0/3214740909 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:13.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.513+0000 7f9c0ca69700 1 --2- 172.21.15.59:0/3214740909 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c080cac20 0x7f9c08071bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:13.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.513+0000 7f9c077fe700 1 --2- 172.21.15.59:0/3214740909 >> v2:172.21.15.83:3300/0 conn(0x7f9c080ca790 0x7f9c08071680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:13.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.513+0000 7f9c07fff700 1 -- 172.21.15.59:0/3214740909 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c080cac20 msgr2=0x7f9c08071bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:13.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.513+0000 7f9c07fff700 1 --2- 172.21.15.59:0/3214740909 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c080cac20 0x7f9c08071bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:13.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.513+0000 7f9c07fff700 1 -- 172.21.15.59:0/3214740909 >> v2:172.21.15.83:3300/0 conn(0x7f9c080ca790 msgr2=0x7f9c08071680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:13.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.513+0000 7f9c07fff700 1 --2- 172.21.15.59:0/3214740909 >> v2:172.21.15.83:3300/0 conn(0x7f9c080ca790 0x7f9c08071680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:13.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.513+0000 7f9c07fff700 1 -- 172.21.15.59:0/3214740909 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c0815e0b0 con 0x7f9c0815a230 2023-09-21T00:18:13.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.513+0000 7f9c07fff700 1 --2- 172.21.15.59:0/3214740909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c0815a230 0x7f9c0815e8b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9c080b6280 tx=0x7f9bf8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d69517a6d236b7df server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:13.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.514+0000 7f9c06ffd700 1 -- 172.21.15.59:0/3214740909 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf8011830 con 0x7f9c0815a230 2023-09-21T00:18:13.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.514+0000 7f9c06ffd700 1 -- 172.21.15.59:0/3214740909 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf8011990 con 0x7f9c0815a230 2023-09-21T00:18:13.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.514+0000 7f9c06ffd700 1 -- 172.21.15.59:0/3214740909 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf8011d20 con 0x7f9c0815a230 2023-09-21T00:18:13.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.514+0000 7f9c0e4cc700 1 -- 172.21.15.59:0/3214740909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c0815a230 msgr2=0x7f9c0815e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:13.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.514+0000 7f9c0e4cc700 1 --2- 172.21.15.59:0/3214740909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c0815a230 0x7f9c0815e8b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9c080b6280 tx=0x7f9bf8009bd0 comp rx=0 tx=0).stop 2023-09-21T00:18:13.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.514+0000 7f9c0e4cc700 1 -- 172.21.15.59:0/3214740909 shutdown_connections 2023-09-21T00:18:13.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.514+0000 7f9c0e4cc700 1 --2- 172.21.15.59:0/3214740909 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c080cac20 0x7f9c08071bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:13.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.514+0000 7f9c0e4cc700 1 --2- 172.21.15.59:0/3214740909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c0815a230 0x7f9c0815e8b0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:13.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.514+0000 7f9c0e4cc700 1 --2- 172.21.15.59:0/3214740909 >> v2:172.21.15.83:3300/0 conn(0x7f9c080ca790 0x7f9c08071680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:13.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.514+0000 7f9c0e4cc700 1 -- 172.21.15.59:0/3214740909 >> 172.21.15.59:0/3214740909 conn(0x7f9c080d0140 msgr2=0x7f9c080d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:13.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.514+0000 7f9c0e4cc700 1 -- 172.21.15.59:0/3214740909 shutdown_connections 2023-09-21T00:18:13.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.514+0000 7f9c0e4cc700 1 -- 172.21.15.59:0/3214740909 wait complete. 2023-09-21T00:18:13.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.515+0000 7f9c0e4cc700 1 Processor -- start 2023-09-21T00:18:13.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.516+0000 7f9c0e4cc700 1 -- start start 2023-09-21T00:18:13.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.516+0000 7f9c0e4cc700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c080ca790 0x7f9c08165e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:13.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.516+0000 7f9c0e4cc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c080cac20 0x7f9c08163380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:13.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.516+0000 7f9c0e4cc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c0815a230 0x7f9c080b1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:13.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.516+0000 7f9c0e4cc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c08164a10 con 0x7f9c0815a230 2023-09-21T00:18:13.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.516+0000 7f9c0e4cc700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c08163e00 con 0x7f9c080cac20 2023-09-21T00:18:13.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.516+0000 7f9c0e4cc700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c081640e0 con 0x7f9c080ca790 2023-09-21T00:18:13.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.516+0000 7f9c0ca69700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c0815a230 0x7f9c080b1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:13.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.516+0000 7f9c0ca69700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c0815a230 0x7f9c080b1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53020/0 (socket says 172.21.15.59:53020) 2023-09-21T00:18:13.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.516+0000 7f9c0ca69700 1 -- 172.21.15.59:0/3832972825 learned_addr learned my addr 172.21.15.59:0/3832972825 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:13.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.517+0000 7f9c077fe700 1 --2- 172.21.15.59:0/3832972825 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c080cac20 0x7f9c08163380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:13.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.517+0000 7f9c07fff700 1 --2- 172.21.15.59:0/3832972825 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c080ca790 0x7f9c08165e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:13.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.517+0000 7f9c0ca69700 1 -- 172.21.15.59:0/3832972825 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c080ca790 msgr2=0x7f9c08165e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:13.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.517+0000 7f9c0ca69700 1 --2- 172.21.15.59:0/3832972825 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c080ca790 0x7f9c08165e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:13.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.517+0000 7f9c0ca69700 1 -- 172.21.15.59:0/3832972825 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c080cac20 msgr2=0x7f9c08163380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:13.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.517+0000 7f9c0ca69700 1 --2- 172.21.15.59:0/3832972825 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c080cac20 0x7f9c08163380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:13.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.517+0000 7f9c0ca69700 1 -- 172.21.15.59:0/3832972825 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf8009550 con 0x7f9c0815a230 2023-09-21T00:18:13.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.517+0000 7f9c077fe700 1 --2- 172.21.15.59:0/3832972825 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c080cac20 0x7f9c08163380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:18:13.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.517+0000 7f9c07fff700 1 --2- 172.21.15.59:0/3832972825 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c080ca790 0x7f9c08165e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:18:13.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.517+0000 7f9c0ca69700 1 --2- 172.21.15.59:0/3832972825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c0815a230 0x7f9c080b1120 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9c0000efc0 tx=0x7f9c0000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:13.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.517+0000 7f9c04ff9700 1 -- 172.21.15.59:0/3832972825 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0000cd40 con 0x7f9c0815a230 2023-09-21T00:18:13.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.517+0000 7f9c04ff9700 1 -- 172.21.15.59:0/3832972825 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c0000f040 con 0x7f9c0815a230 2023-09-21T00:18:13.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.517+0000 7f9c0e4cc700 1 -- 172.21.15.59:0/3832972825 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c081643c0 con 0x7f9c0815a230 2023-09-21T00:18:13.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.517+0000 7f9c04ff9700 1 -- 172.21.15.59:0/3832972825 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c000146c0 con 0x7f9c0815a230 2023-09-21T00:18:13.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.517+0000 7f9c0e4cc700 1 -- 172.21.15.59:0/3832972825 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c080b0e10 con 0x7f9c0815a230 2023-09-21T00:18:13.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.518+0000 7f9c0e4cc700 1 -- 172.21.15.59:0/3832972825 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c08164bc0 con 0x7f9c0815a230 2023-09-21T00:18:13.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.518+0000 7f9c04ff9700 1 -- 172.21.15.59:0/3832972825 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f9c00014820 con 0x7f9c0815a230 2023-09-21T00:18:13.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.519+0000 7f9c04ff9700 1 --2- 172.21.15.59:0/3832972825 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f9be806ae00 0x7f9be806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:13.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.519+0000 7f9c04ff9700 1 -- 172.21.15.59:0/3832972825 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f9c0008a630 con 0x7f9c0815a230 2023-09-21T00:18:13.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.519+0000 7f9c07fff700 1 --2- 172.21.15.59:0/3832972825 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f9be806ae00 0x7f9be806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:13.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.520+0000 7f9c07fff700 1 --2- 172.21.15.59:0/3832972825 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f9be806ae00 0x7f9be806d2c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8014040 tx=0x7f9bf8008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:13.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.524+0000 7f9c04ff9700 1 -- 172.21.15.59:0/3832972825 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f9c08164bc0 con 0x7f9c0815a230 2023-09-21T00:18:13.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.768+0000 7f9c0e4cc700 1 -- 172.21.15.59:0/3832972825 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9c08067e50 con 0x7f9c0815a230 2023-09-21T00:18:13.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.769+0000 7f9c04ff9700 1 -- 172.21.15.59:0/3832972825 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4903 (secure 0 0 0) 0x7f9c00058dd0 con 0x7f9c0815a230 2023-09-21T00:18:13.771 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:18:13.771 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/461673980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":461673980},{"type":"v1","addr":"172.21.15.59:6835","nonce":461673980}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/3148728526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3148728526},{"type":"v1","addr":"172.21.15.59:6834","nonce":3148728526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/3250481509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3250481509},{"type":"v1","addr":"172.21.15.83:6836","nonce":3250481509}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-21T00:17:06.338694+0000","modified":"2023-09-21T00:17:29.401478+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6837/792952552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":792952552},{"type":"v1","addr":"172.21.15.83:6837","nonce":792952552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-21T00:18:13.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.771+0000 7f9c0e4cc700 1 -- 172.21.15.59:0/3832972825 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f9be806ae00 msgr2=0x7f9be806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:13.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.771+0000 7f9c0e4cc700 1 --2- 172.21.15.59:0/3832972825 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f9be806ae00 0x7f9be806d2c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8014040 tx=0x7f9bf8008030 comp rx=0 tx=0).stop 2023-09-21T00:18:13.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.771+0000 7f9c0e4cc700 1 -- 172.21.15.59:0/3832972825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c0815a230 msgr2=0x7f9c080b1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:13.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.771+0000 7f9c0e4cc700 1 --2- 172.21.15.59:0/3832972825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c0815a230 0x7f9c080b1120 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9c0000efc0 tx=0x7f9c0000c3a0 comp rx=0 tx=0).stop 2023-09-21T00:18:13.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.771+0000 7f9c0e4cc700 1 -- 172.21.15.59:0/3832972825 shutdown_connections 2023-09-21T00:18:13.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.771+0000 7f9c0e4cc700 1 --2- 172.21.15.59:0/3832972825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c0815a230 0x7f9c080b1120 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:13.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.771+0000 7f9c0e4cc700 1 --2- 172.21.15.59:0/3832972825 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f9be806ae00 0x7f9be806d2c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:13.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.771+0000 7f9c0e4cc700 1 --2- 172.21.15.59:0/3832972825 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9c080ca790 0x7f9c08165e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:13.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.771+0000 7f9c0e4cc700 1 --2- 172.21.15.59:0/3832972825 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9c080cac20 0x7f9c08163380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:13.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.771+0000 7f9c0e4cc700 1 -- 172.21.15.59:0/3832972825 >> 172.21.15.59:0/3832972825 conn(0x7f9c080d0140 msgr2=0x7f9c081541f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:13.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.771+0000 7f9c0e4cc700 1 -- 172.21.15.59:0/3832972825 shutdown_connections 2023-09-21T00:18:13.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.771+0000 7f9c0e4cc700 1 -- 172.21.15.59:0/3832972825 wait complete. 2023-09-21T00:18:13.776 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 8 2023-09-21T00:18:13.785 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T00:18:13.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.908+0000 7f547f114700 1 Processor -- start 2023-09-21T00:18:13.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.908+0000 7f547f114700 1 -- start start 2023-09-21T00:18:13.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.909+0000 7f547f114700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f54780d0820 0x7f547806f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:13.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.909+0000 7f547f114700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54780b4030 con 0x7f54780708f0 2023-09-21T00:18:13.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.909+0000 7f547f114700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54780cb8d0 con 0x7f547815b480 2023-09-21T00:18:13.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.909+0000 7f547f114700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54780cbb40 con 0x7f54780d0820 2023-09-21T00:18:13.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.909+0000 7f5477fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f54780d0820 0x7f547806f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:13.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.909+0000 7f547d6b1700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f54780708f0 0x7f54780b44c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58596/0 (socket says 172.21.15.59:58596) 2023-09-21T00:18:13.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.909+0000 7f5477fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f54780d0820 0x7f547806f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53026/0 (socket says 172.21.15.59:53026) 2023-09-21T00:18:13.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.909+0000 7f547d6b1700 1 -- 172.21.15.59:0/692713644 learned_addr learned my addr 172.21.15.59:0/692713644 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:13.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.909+0000 7f5477fff700 1 -- 172.21.15.59:0/692713644 >> v1:172.21.15.83:6789/0 conn(0x7f547815b480 legacy=0x7f54780701e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:13.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.909+0000 7f5477fff700 1 -- 172.21.15.59:0/692713644 >> v1:172.21.15.59:6789/0 conn(0x7f54780708f0 legacy=0x7f54780b44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:13.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.910+0000 7f5477fff700 1 -- 172.21.15.59:0/692713644 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54780cbe20 con 0x7f54780d0820 2023-09-21T00:18:13.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.909+0000 7f54777fe700 1 -- 172.21.15.59:0/692713644 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2079360312 0 0) 0x7f54780b4030 con 0x7f54780708f0 2023-09-21T00:18:13.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.910+0000 7f5477fff700 1 --2- 172.21.15.59:0/692713644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54780d0820 0x7f547806f400 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5464009840 tx=0x7f5464009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf5b57b60e4c8fbb server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:13.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.910+0000 7f54777fe700 1 -- 172.21.15.59:0/692713644 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5464004230 con 0x7f54780d0820 2023-09-21T00:18:13.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.910+0000 7f54777fe700 1 -- 172.21.15.59:0/692713644 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5464004390 con 0x7f54780d0820 2023-09-21T00:18:13.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.910+0000 7f54777fe700 1 -- 172.21.15.59:0/692713644 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54640036a0 con 0x7f54780d0820 2023-09-21T00:18:13.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.910+0000 7f547f114700 1 -- 172.21.15.59:0/692713644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54780d0820 msgr2=0x7f547806f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:13.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.910+0000 7f547f114700 1 --2- 172.21.15.59:0/692713644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54780d0820 0x7f547806f400 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5464009840 tx=0x7f5464009b50 comp rx=0 tx=0).stop 2023-09-21T00:18:13.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.910+0000 7f547f114700 1 -- 172.21.15.59:0/692713644 shutdown_connections 2023-09-21T00:18:13.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.910+0000 7f547f114700 1 --2- 172.21.15.59:0/692713644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54780d0820 0x7f547806f400 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:13.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.910+0000 7f547f114700 1 -- 172.21.15.59:0/692713644 >> 172.21.15.59:0/692713644 conn(0x7f54780d11e0 msgr2=0x7f54780d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:13.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.910+0000 7f547f114700 1 -- 172.21.15.59:0/692713644 shutdown_connections 2023-09-21T00:18:13.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.910+0000 7f547f114700 1 -- 172.21.15.59:0/692713644 wait complete. 2023-09-21T00:18:13.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.912+0000 7f547f114700 1 Processor -- start 2023-09-21T00:18:13.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.912+0000 7f547f114700 1 -- start start 2023-09-21T00:18:13.920 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.913+0000 7f547f114700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54780708f0 0x7f547815dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:13.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.913+0000 7f547f114700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f54780d0820 0x7f547815e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:13.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.913+0000 7f547f114700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f547815b480 0x7f54781f6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:13.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.913+0000 7f547f114700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54780c9450 con 0x7f547815b480 2023-09-21T00:18:13.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.913+0000 7f547f114700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54780c8800 con 0x7f54780d0820 2023-09-21T00:18:13.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.913+0000 7f547f114700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54780c8ae0 con 0x7f54780708f0 2023-09-21T00:18:13.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.913+0000 7f547d6b1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f547815b480 0x7f54781f6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:13.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.913+0000 7f547d6b1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f547815b480 0x7f54781f6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53034/0 (socket says 172.21.15.59:53034) 2023-09-21T00:18:13.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.913+0000 7f547d6b1700 1 -- 172.21.15.59:0/3548297770 learned_addr learned my addr 172.21.15.59:0/3548297770 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:13.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.913+0000 7f5477fff700 1 --2- 172.21.15.59:0/3548297770 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f54780d0820 0x7f547815e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:13.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.914+0000 7f547ceb0700 1 --2- 172.21.15.59:0/3548297770 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54780708f0 0x7f547815dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:13.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.914+0000 7f547d6b1700 1 -- 172.21.15.59:0/3548297770 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54780708f0 msgr2=0x7f547815dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:13.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.914+0000 7f547d6b1700 1 --2- 172.21.15.59:0/3548297770 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54780708f0 0x7f547815dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:13.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.914+0000 7f547d6b1700 1 -- 172.21.15.59:0/3548297770 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f54780d0820 msgr2=0x7f547815e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:13.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.914+0000 7f547d6b1700 1 --2- 172.21.15.59:0/3548297770 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f54780d0820 0x7f547815e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:13.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.914+0000 7f547d6b1700 1 -- 172.21.15.59:0/3548297770 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54640094a0 con 0x7f547815b480 2023-09-21T00:18:13.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.914+0000 7f5477fff700 1 --2- 172.21.15.59:0/3548297770 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f54780d0820 0x7f547815e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:18:13.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.914+0000 7f547ceb0700 1 --2- 172.21.15.59:0/3548297770 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54780708f0 0x7f547815dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:18:13.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.914+0000 7f547d6b1700 1 --2- 172.21.15.59:0/3548297770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f547815b480 0x7f54781f6080 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f547000cb60 tx=0x7f547000cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:13.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.914+0000 7f54757fa700 1 -- 172.21.15.59:0/3548297770 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547000ab50 con 0x7f547815b480 2023-09-21T00:18:13.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.914+0000 7f54757fa700 1 -- 172.21.15.59:0/3548297770 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547000acb0 con 0x7f547815b480 2023-09-21T00:18:13.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.914+0000 7f547f114700 1 -- 172.21.15.59:0/3548297770 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f547815b9e0 con 0x7f547815b480 2023-09-21T00:18:13.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.914+0000 7f54757fa700 1 -- 172.21.15.59:0/3548297770 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5470007310 con 0x7f547815b480 2023-09-21T00:18:13.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.914+0000 7f547f114700 1 -- 172.21.15.59:0/3548297770 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54780c90a0 con 0x7f547815b480 2023-09-21T00:18:13.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.915+0000 7f547f114700 1 -- 172.21.15.59:0/3548297770 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54780c95c0 con 0x7f547815b480 2023-09-21T00:18:13.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.915+0000 7f54757fa700 1 -- 172.21.15.59:0/3548297770 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f5470007470 con 0x7f547815b480 2023-09-21T00:18:13.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.916+0000 7f54757fa700 1 --2- 172.21.15.59:0/3548297770 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f545c06ae00 0x7f545c06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:13.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.916+0000 7f54757fa700 1 -- 172.21.15.59:0/3548297770 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f54700894d0 con 0x7f547815b480 2023-09-21T00:18:13.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.916+0000 7f547ceb0700 1 --2- 172.21.15.59:0/3548297770 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f545c06ae00 0x7f545c06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:13.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.917+0000 7f547ceb0700 1 --2- 172.21.15.59:0/3548297770 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f545c06ae00 0x7f545c06d2c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f546c003fc0 tx=0x7f546c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:13.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:13.920+0000 7f54757fa700 1 -- 172.21.15.59:0/3548297770 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f54700541e0 con 0x7f547815b480 2023-09-21T00:18:14.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.121+0000 7f547f114700 1 -- 172.21.15.59:0/3548297770 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5478067e50 con 0x7f547815b480 2023-09-21T00:18:14.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.123+0000 7f54757fa700 1 -- 172.21.15.59:0/3548297770 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18792 (secure 0 0 0) 0x7f5470018090 con 0x7f547815b480 2023-09-21T00:18:14.125 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:18:14.125 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":26,"fsid":"dd69925c-6e25-42fe-880b-2f60fc6f384b","created":"2023-09-21T00:16:43.074489+0000","modified":"2023-09-21T00:17:50.090179+0000","last_up_change":"2023-09-21T00:16:54.740101+0000","last_in_change":"2023-09-21T00:16:45.987089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T00:16:54.796248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-21T00:17:04.167102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-21T00:17:05.313188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-21T00:17:08.977609+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d4b18344-74c0-4f75-920b-7a9247e48914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6809","nonce":2418314235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6811","nonce":2418314235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6815","nonce":2418314235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6813","nonce":2418314235}]},"public_addr":"172.21.15.59:6809/2418314235","cluster_addr":"172.21.15.59:6811/2418314235","heartbeat_back_addr":"172.21.15.59:6815/2418314235","heartbeat_front_addr":"172.21.15.59:6813/2418314235","state":["exists","up"]},{"osd":1,"uuid":"80940d50-a248-4e64-a282-7ffcdad790ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6801","nonce":869668251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6803","nonce":869668251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6807","nonce":869668251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6805","nonce":869668251}]},"public_addr":"172.21.15.59:6801/869668251","cluster_addr":"172.21.15.59:6803/869668251","heartbeat_back_addr":"172.21.15.59:6807/869668251","heartbeat_front_addr":"172.21.15.59:6805/869668251","state":["exists","up"]},{"osd":2,"uuid":"55f2eceb-c54a-4879-a6ce-968c1c548b5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6817","nonce":372517778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6819","nonce":372517778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6823","nonce":372517778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6821","nonce":372517778}]},"public_addr":"172.21.15.59:6817/372517778","cluster_addr":"172.21.15.59:6819/372517778","heartbeat_back_addr":"172.21.15.59:6823/372517778","heartbeat_front_addr":"172.21.15.59:6821/372517778","state":["exists","up"]},{"osd":3,"uuid":"92b89cd0-869c-49b9-a9f9-97ac8423f304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6825","nonce":575188498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6827","nonce":575188498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6831","nonce":575188498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6829","nonce":575188498}]},"public_addr":"172.21.15.59:6825/575188498","cluster_addr":"172.21.15.59:6827/575188498","heartbeat_back_addr":"172.21.15.59:6831/575188498","heartbeat_front_addr":"172.21.15.59:6829/575188498","state":["exists","up"]},{"osd":4,"uuid":"25b80e94-e0e6-403d-b69f-61542f289637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6803","nonce":1741219098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6805","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6807","nonce":1741219098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6815","nonce":1741219098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6811","nonce":1741219098}]},"public_addr":"172.21.15.83:6803/1741219098","cluster_addr":"172.21.15.83:6807/1741219098","heartbeat_back_addr":"172.21.15.83:6815/1741219098","heartbeat_front_addr":"172.21.15.83:6811/1741219098","state":["exists","up"]},{"osd":5,"uuid":"5498d9ab-1086-4796-a199-9051e6dfea91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6817","nonce":156730565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6819","nonce":156730565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6823","nonce":156730565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6821","nonce":156730565}]},"public_addr":"172.21.15.83:6817/156730565","cluster_addr":"172.21.15.83:6819/156730565","heartbeat_back_addr":"172.21.15.83:6823/156730565","heartbeat_front_addr":"172.21.15.83:6821/156730565","state":["exists","up"]},{"osd":6,"uuid":"cfd810c0-5015-4d60-9a75-7efc93a32e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6801","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6800","nonce":1337723778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6806","nonce":1337723778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6814","nonce":1337723778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6810","nonce":1337723778}]},"public_addr":"172.21.15.83:6800/1337723778","cluster_addr":"172.21.15.83:6806/1337723778","heartbeat_back_addr":"172.21.15.83:6814/1337723778","heartbeat_front_addr":"172.21.15.83:6810/1337723778","state":["exists","up"]},{"osd":7,"uuid":"e992c8fa-0a3d-4b3c-85b5-2c511223dee4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6825","nonce":4204859272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6827","nonce":4204859272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6831","nonce":4204859272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6829","nonce":4204859272}]},"public_addr":"172.21.15.83:6825/4204859272","cluster_addr":"172.21.15.83:6827/4204859272","heartbeat_back_addr":"172.21.15.83:6831/4204859272","heartbeat_front_addr":"172.21.15.83:6829/4204859272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.156498+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.882707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.093978+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.158565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.173933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.888606+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.135525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.149712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":3,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.34","mappings":[{"from":4,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":6}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T00:18:14.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.125+0000 7f547f114700 1 -- 172.21.15.59:0/3548297770 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f545c06ae00 msgr2=0x7f545c06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:14.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.125+0000 7f547f114700 1 --2- 172.21.15.59:0/3548297770 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f545c06ae00 0x7f545c06d2c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f546c003fc0 tx=0x7f546c009040 comp rx=0 tx=0).stop 2023-09-21T00:18:14.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.125+0000 7f547f114700 1 -- 172.21.15.59:0/3548297770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f547815b480 msgr2=0x7f54781f6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:14.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.125+0000 7f547f114700 1 --2- 172.21.15.59:0/3548297770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f547815b480 0x7f54781f6080 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f547000cb60 tx=0x7f547000cf20 comp rx=0 tx=0).stop 2023-09-21T00:18:14.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.125+0000 7f547f114700 1 -- 172.21.15.59:0/3548297770 shutdown_connections 2023-09-21T00:18:14.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.125+0000 7f547f114700 1 --2- 172.21.15.59:0/3548297770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f547815b480 0x7f54781f6080 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:14.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.125+0000 7f547f114700 1 --2- 172.21.15.59:0/3548297770 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f545c06ae00 0x7f545c06d2c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:14.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.125+0000 7f547f114700 1 --2- 172.21.15.59:0/3548297770 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54780708f0 0x7f547815dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:14.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.125+0000 7f547f114700 1 --2- 172.21.15.59:0/3548297770 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f54780d0820 0x7f547815e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:14.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.125+0000 7f547f114700 1 -- 172.21.15.59:0/3548297770 >> 172.21.15.59:0/3548297770 conn(0x7f54780d11e0 msgr2=0x7f547806c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:14.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.125+0000 7f547f114700 1 -- 172.21.15.59:0/3548297770 shutdown_connections 2023-09-21T00:18:14.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.125+0000 7f547f114700 1 -- 172.21.15.59:0/3548297770 wait complete. 2023-09-21T00:18:14.139 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-09-21T00:18:14.140 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T00:18:14.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.264+0000 7ff74dd72700 1 Processor -- start 2023-09-21T00:18:14.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.264+0000 7ff74dd72700 1 -- start start 2023-09-21T00:18:14.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.265+0000 7ff74dd72700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff74815b2b0 0x7ff7480cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:14.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.265+0000 7ff74dd72700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7481618a0 con 0x7ff74806a780 2023-09-21T00:18:14.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.265+0000 7ff74dd72700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7480cfee0 con 0x7ff7480ce420 2023-09-21T00:18:14.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.265+0000 7ff74dd72700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7480ce250 con 0x7ff74815b2b0 2023-09-21T00:18:14.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.265+0000 7ff747fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff74806a780 0x7ff74815e1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58610/0 (socket says 172.21.15.59:58610) 2023-09-21T00:18:14.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.265+0000 7ff747fff700 1 -- 172.21.15.59:0/762491994 learned_addr learned my addr 172.21.15.59:0/762491994 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:14.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.265+0000 7ff7477fe700 1 --2- 172.21.15.59:0/762491994 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff74815b2b0 0x7ff7480cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:14.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.265+0000 7ff7467fc700 1 -- 172.21.15.59:0/762491994 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2951819911 0 0) 0x7ff7481618a0 con 0x7ff74806a780 2023-09-21T00:18:14.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.265+0000 7ff7467fc700 1 -- 172.21.15.59:0/762491994 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7340035b0 con 0x7ff74806a780 2023-09-21T00:18:14.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.265+0000 7ff7467fc700 1 -- 172.21.15.59:0/762491994 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4246875877 0 0) 0x7ff7480cfee0 con 0x7ff7480ce420 2023-09-21T00:18:14.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.265+0000 7ff7467fc700 1 -- 172.21.15.59:0/762491994 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7481618a0 con 0x7ff7480ce420 2023-09-21T00:18:14.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.266+0000 7ff7477fe700 1 -- 172.21.15.59:0/762491994 >> v1:172.21.15.83:6789/0 conn(0x7ff7480ce420 legacy=0x7ff748161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:14.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.266+0000 7ff7467fc700 1 -- 172.21.15.59:0/762491994 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1794948095 0 0) 0x7ff7340035b0 con 0x7ff74806a780 2023-09-21T00:18:14.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.266+0000 7ff7477fe700 1 -- 172.21.15.59:0/762491994 >> v1:172.21.15.59:6789/0 conn(0x7ff74806a780 legacy=0x7ff74815e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:14.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.266+0000 7ff7477fe700 1 -- 172.21.15.59:0/762491994 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7480ce900 con 0x7ff74815b2b0 2023-09-21T00:18:14.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.266+0000 7ff7477fe700 1 --2- 172.21.15.59:0/762491994 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff74815b2b0 0x7ff7480cdd10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff738009870 tx=0x7ff738009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=341b9fb432b6406d server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:14.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.266+0000 7ff7467fc700 1 -- 172.21.15.59:0/762491994 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7400019f0 con 0x7ff74815b2b0 2023-09-21T00:18:14.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.266+0000 7ff7467fc700 1 -- 172.21.15.59:0/762491994 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff738004030 con 0x7ff74815b2b0 2023-09-21T00:18:14.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.266+0000 7ff7467fc700 1 -- 172.21.15.59:0/762491994 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7380043c0 con 0x7ff74815b2b0 2023-09-21T00:18:14.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.266+0000 7ff74dd72700 1 -- 172.21.15.59:0/762491994 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff74815b2b0 msgr2=0x7ff7480cdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:14.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.266+0000 7ff74dd72700 1 --2- 172.21.15.59:0/762491994 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff74815b2b0 0x7ff7480cdd10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff738009870 tx=0x7ff738009b80 comp rx=0 tx=0).stop 2023-09-21T00:18:14.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.266+0000 7ff74dd72700 1 -- 172.21.15.59:0/762491994 shutdown_connections 2023-09-21T00:18:14.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.266+0000 7ff74dd72700 1 --2- 172.21.15.59:0/762491994 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff74815b2b0 0x7ff7480cdd10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:14.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.266+0000 7ff74dd72700 1 -- 172.21.15.59:0/762491994 >> 172.21.15.59:0/762491994 conn(0x7ff7480d0140 msgr2=0x7ff7480d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:14.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.267+0000 7ff74dd72700 1 -- 172.21.15.59:0/762491994 shutdown_connections 2023-09-21T00:18:14.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.267+0000 7ff74dd72700 1 -- 172.21.15.59:0/762491994 wait complete. 2023-09-21T00:18:14.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.268+0000 7ff74dd72700 1 Processor -- start 2023-09-21T00:18:14.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.268+0000 7ff74dd72700 1 -- start start 2023-09-21T00:18:14.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.269+0000 7ff74dd72700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff74806a780 0x7ff7481f5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:14.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.269+0000 7ff74dd72700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff7480ce420 0x7ff7481f4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:14.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.269+0000 7ff74dd72700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff74815b2b0 0x7ff7481e8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:14.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.269+0000 7ff74dd72700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7480c7f30 con 0x7ff74806a780 2023-09-21T00:18:14.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.269+0000 7ff74dd72700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7480c72b0 con 0x7ff74815b2b0 2023-09-21T00:18:14.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.269+0000 7ff74dd72700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7480c7590 con 0x7ff7480ce420 2023-09-21T00:18:14.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.269+0000 7ff7477fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff74806a780 0x7ff7481f5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:14.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.269+0000 7ff7477fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff74806a780 0x7ff7481f5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53044/0 (socket says 172.21.15.59:53044) 2023-09-21T00:18:14.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.269+0000 7ff7477fe700 1 -- 172.21.15.59:0/1618992427 learned_addr learned my addr 172.21.15.59:0/1618992427 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:14.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.269+0000 7ff746ffd700 1 --2- 172.21.15.59:0/1618992427 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff7480ce420 0x7ff7481f4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:14.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.269+0000 7ff747fff700 1 --2- 172.21.15.59:0/1618992427 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff74815b2b0 0x7ff7481e8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:14.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.269+0000 7ff7477fe700 1 -- 172.21.15.59:0/1618992427 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff7480ce420 msgr2=0x7ff7481f4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:14.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.269+0000 7ff7477fe700 1 --2- 172.21.15.59:0/1618992427 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff7480ce420 0x7ff7481f4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:14.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.269+0000 7ff7477fe700 1 -- 172.21.15.59:0/1618992427 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff74815b2b0 msgr2=0x7ff7481e8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:14.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.269+0000 7ff7477fe700 1 --2- 172.21.15.59:0/1618992427 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff74815b2b0 0x7ff7481e8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:14.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.269+0000 7ff7477fe700 1 -- 172.21.15.59:0/1618992427 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7380094a0 con 0x7ff74806a780 2023-09-21T00:18:14.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.269+0000 7ff7477fe700 1 --2- 172.21.15.59:0/1618992427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff74806a780 0x7ff7481f5ed0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff738000c00 tx=0x7ff738004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:14.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.269+0000 7ff73ffff700 1 -- 172.21.15.59:0/1618992427 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff738003e60 con 0x7ff74806a780 2023-09-21T00:18:14.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.269+0000 7ff73ffff700 1 -- 172.21.15.59:0/1618992427 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73801f070 con 0x7ff74806a780 2023-09-21T00:18:14.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.269+0000 7ff74dd72700 1 -- 172.21.15.59:0/1618992427 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7480c7870 con 0x7ff74806a780 2023-09-21T00:18:14.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.270+0000 7ff73ffff700 1 -- 172.21.15.59:0/1618992427 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff738011850 con 0x7ff74806a780 2023-09-21T00:18:14.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.270+0000 7ff74dd72700 1 -- 172.21.15.59:0/1618992427 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7481f45b0 con 0x7ff74806a780 2023-09-21T00:18:14.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.270+0000 7ff74dd72700 1 -- 172.21.15.59:0/1618992427 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7481f4740 con 0x7ff74806a780 2023-09-21T00:18:14.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.271+0000 7ff73ffff700 1 -- 172.21.15.59:0/1618992427 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7ff7380119b0 con 0x7ff74806a780 2023-09-21T00:18:14.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.271+0000 7ff73ffff700 1 --2- 172.21.15.59:0/1618992427 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ff72806ae00 0x7ff72806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:14.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.271+0000 7ff73ffff700 1 -- 172.21.15.59:0/1618992427 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7ff738021070 con 0x7ff74806a780 2023-09-21T00:18:14.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.272+0000 7ff746ffd700 1 --2- 172.21.15.59:0/1618992427 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ff72806ae00 0x7ff72806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:14.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.272+0000 7ff746ffd700 1 --2- 172.21.15.59:0/1618992427 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ff72806ae00 0x7ff72806d2c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff74815ade0 tx=0x7ff730009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:14.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.276+0000 7ff73ffff700 1 -- 172.21.15.59:0/1618992427 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7ff7380bd9b0 con 0x7ff74806a780 2023-09-21T00:18:14.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.520+0000 7ff74dd72700 1 -- 172.21.15.59:0/1618992427 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff748067e50 con 0x7ff74806a780 2023-09-21T00:18:14.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.520+0000 7ff73ffff700 1 -- 172.21.15.59:0/1618992427 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4903 (secure 0 0 0) 0x7ff738055ee0 con 0x7ff74806a780 2023-09-21T00:18:14.523 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:18:14.523 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/461673980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":461673980},{"type":"v1","addr":"172.21.15.59:6835","nonce":461673980}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/3148728526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3148728526},{"type":"v1","addr":"172.21.15.59:6834","nonce":3148728526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/3250481509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3250481509},{"type":"v1","addr":"172.21.15.83:6836","nonce":3250481509}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-21T00:17:06.338694+0000","modified":"2023-09-21T00:17:29.401478+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6837/792952552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":792952552},{"type":"v1","addr":"172.21.15.83:6837","nonce":792952552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-21T00:18:14.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.522+0000 7ff74dd72700 1 -- 172.21.15.59:0/1618992427 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ff72806ae00 msgr2=0x7ff72806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:14.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.522+0000 7ff74dd72700 1 --2- 172.21.15.59:0/1618992427 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ff72806ae00 0x7ff72806d2c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff74815ade0 tx=0x7ff730009040 comp rx=0 tx=0).stop 2023-09-21T00:18:14.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.522+0000 7ff74dd72700 1 -- 172.21.15.59:0/1618992427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff74806a780 msgr2=0x7ff7481f5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:14.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.522+0000 7ff74dd72700 1 --2- 172.21.15.59:0/1618992427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff74806a780 0x7ff7481f5ed0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff738000c00 tx=0x7ff738004750 comp rx=0 tx=0).stop 2023-09-21T00:18:14.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.522+0000 7ff74dd72700 1 -- 172.21.15.59:0/1618992427 shutdown_connections 2023-09-21T00:18:14.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.522+0000 7ff74dd72700 1 --2- 172.21.15.59:0/1618992427 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff74815b2b0 0x7ff7481e8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:14.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.522+0000 7ff74dd72700 1 --2- 172.21.15.59:0/1618992427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff74806a780 0x7ff7481f5ed0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:14.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.522+0000 7ff74dd72700 1 --2- 172.21.15.59:0/1618992427 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ff72806ae00 0x7ff72806d2c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:14.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.522+0000 7ff74dd72700 1 --2- 172.21.15.59:0/1618992427 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff7480ce420 0x7ff7481f4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:14.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.522+0000 7ff74dd72700 1 -- 172.21.15.59:0/1618992427 >> 172.21.15.59:0/1618992427 conn(0x7ff7480d0140 msgr2=0x7ff7480c5c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:14.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.522+0000 7ff74dd72700 1 -- 172.21.15.59:0/1618992427 shutdown_connections 2023-09-21T00:18:14.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.522+0000 7ff74dd72700 1 -- 172.21.15.59:0/1618992427 wait complete. 2023-09-21T00:18:14.527 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 8 2023-09-21T00:18:14.537 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T00:18:14.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.660+0000 7f3619a23700 1 Processor -- start 2023-09-21T00:18:14.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.660+0000 7f3619a23700 1 -- start start 2023-09-21T00:18:14.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.661+0000 7f3619a23700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f36140d3f00 0x7f36140d1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:14.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.661+0000 7f3619a23700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36140d1720 con 0x7f36140d11b0 2023-09-21T00:18:14.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.661+0000 7f3619a23700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36140ce360 con 0x7f361415d7e0 2023-09-21T00:18:14.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.661+0000 7f3619a23700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36140ced00 con 0x7f36140d3f00 2023-09-21T00:18:14.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.661+0000 7f36127fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f36140d11b0 0x7f36140b2d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58620/0 (socket says 172.21.15.59:58620) 2023-09-21T00:18:14.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.661+0000 7f36127fc700 1 -- 172.21.15.59:0/642595409 learned_addr learned my addr 172.21.15.59:0/642595409 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:14.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.661+0000 7f36137fe700 1 --2- 172.21.15.59:0/642595409 >> v2:172.21.15.83:3300/0 conn(0x7f36140d3f00 0x7f36140d1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:14.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.661+0000 7f3611ffb700 1 -- 172.21.15.59:0/642595409 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3867271537 0 0) 0x7f36140d1720 con 0x7f36140d11b0 2023-09-21T00:18:14.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.661+0000 7f3611ffb700 1 -- 172.21.15.59:0/642595409 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35fc0035b0 con 0x7f36140d11b0 2023-09-21T00:18:14.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.661+0000 7f3611ffb700 1 -- 172.21.15.59:0/642595409 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 663768826 0 0) 0x7f36140ce360 con 0x7f361415d7e0 2023-09-21T00:18:14.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.661+0000 7f3611ffb700 1 -- 172.21.15.59:0/642595409 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36140d1720 con 0x7f361415d7e0 2023-09-21T00:18:14.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.661+0000 7f36137fe700 1 -- 172.21.15.59:0/642595409 >> v1:172.21.15.83:6789/0 conn(0x7f361415d7e0 legacy=0x7f36140cf120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:14.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.661+0000 7f36137fe700 1 -- 172.21.15.59:0/642595409 >> v1:172.21.15.59:6789/0 conn(0x7f36140d11b0 legacy=0x7f36140b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:14.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.661+0000 7f3611ffb700 1 -- 172.21.15.59:0/642595409 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3748969174 0 0) 0x7f35fc0035b0 con 0x7f36140d11b0 2023-09-21T00:18:14.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.661+0000 7f36137fe700 1 -- 172.21.15.59:0/642595409 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36140ce640 con 0x7f36140d3f00 2023-09-21T00:18:14.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.662+0000 7f36137fe700 1 --2- 172.21.15.59:0/642595409 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36140d3f00 0x7f36140d1990 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f360c009d90 tx=0x7f360c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=656758c6b24eed23 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:14.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.662+0000 7f3611ffb700 1 -- 172.21.15.59:0/642595409 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360c00e070 con 0x7f36140d3f00 2023-09-21T00:18:14.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.662+0000 7f3611ffb700 1 -- 172.21.15.59:0/642595409 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f360c003a20 con 0x7f36140d3f00 2023-09-21T00:18:14.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.662+0000 7f3611ffb700 1 -- 172.21.15.59:0/642595409 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3604001670 con 0x7f36140d3f00 2023-09-21T00:18:14.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.662+0000 7f3619a23700 1 -- 172.21.15.59:0/642595409 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36140d3f00 msgr2=0x7f36140d1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:14.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.662+0000 7f3619a23700 1 --2- 172.21.15.59:0/642595409 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36140d3f00 0x7f36140d1990 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f360c009d90 tx=0x7f360c00b330 comp rx=0 tx=0).stop 2023-09-21T00:18:14.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.662+0000 7f3619a23700 1 -- 172.21.15.59:0/642595409 shutdown_connections 2023-09-21T00:18:14.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.662+0000 7f3619a23700 1 --2- 172.21.15.59:0/642595409 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36140d3f00 0x7f36140d1990 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:14.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.662+0000 7f3619a23700 1 -- 172.21.15.59:0/642595409 >> 172.21.15.59:0/642595409 conn(0x7f361409c740 msgr2=0x7f36140d33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:14.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.662+0000 7f3619a23700 1 -- 172.21.15.59:0/642595409 shutdown_connections 2023-09-21T00:18:14.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.662+0000 7f3619a23700 1 -- 172.21.15.59:0/642595409 wait complete. 2023-09-21T00:18:14.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.664+0000 7f3619a23700 1 Processor -- start 2023-09-21T00:18:14.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.664+0000 7f3619a23700 1 -- start start 2023-09-21T00:18:14.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.664+0000 7f3619a23700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36140d11b0 0x7f36140b6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:14.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.664+0000 7f3619a23700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36140d3f00 0x7f3614145890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:14.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.664+0000 7f3619a23700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f361415d7e0 0x7f3614145dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:14.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.664+0000 7f3619a23700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36140b69d0 con 0x7f36140d3f00 2023-09-21T00:18:14.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.664+0000 7f3619a23700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36140b82b0 con 0x7f36140d11b0 2023-09-21T00:18:14.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.664+0000 7f3619a23700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36140b8590 con 0x7f361415d7e0 2023-09-21T00:18:14.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.665+0000 7f36127fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36140d3f00 0x7f3614145890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:14.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.665+0000 7f36127fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36140d3f00 0x7f3614145890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53060/0 (socket says 172.21.15.59:53060) 2023-09-21T00:18:14.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.665+0000 7f36127fc700 1 -- 172.21.15.59:0/1030834341 learned_addr learned my addr 172.21.15.59:0/1030834341 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:14.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.665+0000 7f36137fe700 1 --2- 172.21.15.59:0/1030834341 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f361415d7e0 0x7f3614145dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:14.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.665+0000 7f3612ffd700 1 --2- 172.21.15.59:0/1030834341 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36140d11b0 0x7f36140b6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:14.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.665+0000 7f36127fc700 1 -- 172.21.15.59:0/1030834341 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f361415d7e0 msgr2=0x7f3614145dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:14.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.665+0000 7f36127fc700 1 --2- 172.21.15.59:0/1030834341 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f361415d7e0 0x7f3614145dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:14.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.665+0000 7f36127fc700 1 -- 172.21.15.59:0/1030834341 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36140d11b0 msgr2=0x7f36140b6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:14.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.665+0000 7f36127fc700 1 --2- 172.21.15.59:0/1030834341 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36140d11b0 0x7f36140b6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:14.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.665+0000 7f36127fc700 1 -- 172.21.15.59:0/1030834341 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f360c009a70 con 0x7f36140d3f00 2023-09-21T00:18:14.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.665+0000 7f3612ffd700 1 --2- 172.21.15.59:0/1030834341 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36140d11b0 0x7f36140b6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:18:14.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.665+0000 7f36127fc700 1 --2- 172.21.15.59:0/1030834341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36140d3f00 0x7f3614145890 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f360400c6b0 tx=0x7f360400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:14.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.665+0000 7f35fbfff700 1 -- 172.21.15.59:0/1030834341 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3604007620 con 0x7f36140d3f00 2023-09-21T00:18:14.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.665+0000 7f35fbfff700 1 -- 172.21.15.59:0/1030834341 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3604004870 con 0x7f36140d3f00 2023-09-21T00:18:14.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.665+0000 7f35fbfff700 1 -- 172.21.15.59:0/1030834341 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3604004c00 con 0x7f36140d3f00 2023-09-21T00:18:14.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.665+0000 7f3619a23700 1 -- 172.21.15.59:0/1030834341 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36140b8870 con 0x7f36140d3f00 2023-09-21T00:18:14.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.665+0000 7f3619a23700 1 -- 172.21.15.59:0/1030834341 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36140b8e30 con 0x7f36140d3f00 2023-09-21T00:18:14.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.666+0000 7f3619a23700 1 -- 172.21.15.59:0/1030834341 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36140b2ba0 con 0x7f36140d3f00 2023-09-21T00:18:14.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.667+0000 7f35fbfff700 1 -- 172.21.15.59:0/1030834341 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f36040133c0 con 0x7f36140d3f00 2023-09-21T00:18:14.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.667+0000 7f35fbfff700 1 --2- 172.21.15.59:0/1030834341 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f360006ae00 0x7f360006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:14.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.667+0000 7f35fbfff700 1 -- 172.21.15.59:0/1030834341 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f36040896a0 con 0x7f36140d3f00 2023-09-21T00:18:14.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.667+0000 7f3612ffd700 1 --2- 172.21.15.59:0/1030834341 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f360006ae00 0x7f360006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:14.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.668+0000 7f3612ffd700 1 --2- 172.21.15.59:0/1030834341 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f360006ae00 0x7f360006d2c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3608001230 tx=0x7f3608009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:14.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.671+0000 7f35fbfff700 1 -- 172.21.15.59:0/1030834341 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f3604054440 con 0x7f36140d3f00 2023-09-21T00:18:14.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.916+0000 7f3619a23700 1 -- 172.21.15.59:0/1030834341 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36140b9050 con 0x7f36140d3f00 2023-09-21T00:18:14.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.917+0000 7f35fbfff700 1 -- 172.21.15.59:0/1030834341 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4903 (secure 0 0 0) 0x7f3604057a60 con 0x7f36140d3f00 2023-09-21T00:18:14.919 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:18:14.920 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/461673980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":461673980},{"type":"v1","addr":"172.21.15.59:6835","nonce":461673980}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/3148728526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3148728526},{"type":"v1","addr":"172.21.15.59:6834","nonce":3148728526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/3250481509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":3250481509},{"type":"v1","addr":"172.21.15.83:6836","nonce":3250481509}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-21T00:17:06.338694+0000","modified":"2023-09-21T00:17:29.401478+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6837/792952552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":792952552},{"type":"v1","addr":"172.21.15.83:6837","nonce":792952552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-21T00:18:14.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.919+0000 7f3619a23700 1 -- 172.21.15.59:0/1030834341 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f360006ae00 msgr2=0x7f360006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:14.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.919+0000 7f3619a23700 1 --2- 172.21.15.59:0/1030834341 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f360006ae00 0x7f360006d2c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3608001230 tx=0x7f3608009040 comp rx=0 tx=0).stop 2023-09-21T00:18:14.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.919+0000 7f3619a23700 1 -- 172.21.15.59:0/1030834341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36140d3f00 msgr2=0x7f3614145890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:14.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.919+0000 7f3619a23700 1 --2- 172.21.15.59:0/1030834341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36140d3f00 0x7f3614145890 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f360400c6b0 tx=0x7f360400c9c0 comp rx=0 tx=0).stop 2023-09-21T00:18:14.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.919+0000 7f3619a23700 1 -- 172.21.15.59:0/1030834341 shutdown_connections 2023-09-21T00:18:14.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.919+0000 7f3619a23700 1 --2- 172.21.15.59:0/1030834341 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f360006ae00 0x7f360006d2c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:14.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.919+0000 7f3619a23700 1 --2- 172.21.15.59:0/1030834341 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f361415d7e0 0x7f3614145dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:14.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.919+0000 7f3619a23700 1 --2- 172.21.15.59:0/1030834341 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36140d11b0 0x7f36140b6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:14.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.919+0000 7f3619a23700 1 --2- 172.21.15.59:0/1030834341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36140d3f00 0x7f3614145890 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:14.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.919+0000 7f3619a23700 1 -- 172.21.15.59:0/1030834341 >> 172.21.15.59:0/1030834341 conn(0x7f361409c740 msgr2=0x7f36140cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:14.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.919+0000 7f3619a23700 1 -- 172.21.15.59:0/1030834341 shutdown_connections 2023-09-21T00:18:14.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:14.919+0000 7f3619a23700 1 -- 172.21.15.59:0/1030834341 wait complete. 2023-09-21T00:18:14.924 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 8 2023-09-21T00:18:14.933 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T00:18:15.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.057+0000 7fcef9bec700 1 Processor -- start 2023-09-21T00:18:15.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.057+0000 7fcef9bec700 1 -- start start 2023-09-21T00:18:15.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.058+0000 7fcef9bec700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcef415a230 0x7fcef415e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:15.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.058+0000 7fcef9bec700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcef40ca790 0x7fcef4071680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:15.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.058+0000 7fcef9bec700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcef40cb1c0 con 0x7fcef40cabf0 2023-09-21T00:18:15.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.058+0000 7fcef9bec700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcef40cb780 con 0x7fcef415a230 2023-09-21T00:18:15.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.058+0000 7fcef9bec700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef40cb4a0 con 0x7fcef40ca790 2023-09-21T00:18:15.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.058+0000 7fcef37fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcef415a230 0x7fcef415e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:15.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.058+0000 7fcef3fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fcef40cabf0 0x7fcef406eaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58638/0 (socket says 172.21.15.59:58638) 2023-09-21T00:18:15.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.058+0000 7fcef37fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcef415a230 0x7fcef415e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53066/0 (socket says 172.21.15.59:53066) 2023-09-21T00:18:15.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.058+0000 7fcef3fff700 1 -- 172.21.15.59:0/4167277733 learned_addr learned my addr 172.21.15.59:0/4167277733 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:15.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.059+0000 7fcef2ffd700 1 --2- 172.21.15.59:0/4167277733 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcef40ca790 0x7fcef4071680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:15.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.059+0000 7fcef37fe700 1 -- 172.21.15.59:0/4167277733 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcef40ca790 msgr2=0x7fcef4071680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:15.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.059+0000 7fcef37fe700 1 --2- 172.21.15.59:0/4167277733 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcef40ca790 0x7fcef4071680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:15.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.059+0000 7fcef37fe700 1 -- 172.21.15.59:0/4167277733 >> v1:172.21.15.59:6789/0 conn(0x7fcef40cabf0 legacy=0x7fcef406eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:15.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.059+0000 7fcef37fe700 1 -- 172.21.15.59:0/4167277733 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef415e0b0 con 0x7fcef415a230 2023-09-21T00:18:15.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.059+0000 7fcef27fc700 1 -- 172.21.15.59:0/4167277733 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2549806650 0 0) 0x7fcef40cb1c0 con 0x7fcef40cabf0 2023-09-21T00:18:15.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.059+0000 7fcef2ffd700 1 --2- 172.21.15.59:0/4167277733 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcef40ca790 0x7fcef4071680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:18:15.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.059+0000 7fcef37fe700 1 --2- 172.21.15.59:0/4167277733 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcef415a230 0x7fcef415e8b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fcee400bae0 tx=0x7fcee400bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9fb55383f460c54 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:15.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.059+0000 7fcef27fc700 1 -- 172.21.15.59:0/4167277733 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee400dd30 con 0x7fcef415a230 2023-09-21T00:18:15.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.059+0000 7fcef27fc700 1 -- 172.21.15.59:0/4167277733 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee400de90 con 0x7fcef415a230 2023-09-21T00:18:15.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.059+0000 7fcef27fc700 1 -- 172.21.15.59:0/4167277733 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee4010690 con 0x7fcef415a230 2023-09-21T00:18:15.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.060+0000 7fcef9bec700 1 -- 172.21.15.59:0/4167277733 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcef415a230 msgr2=0x7fcef415e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:15.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.060+0000 7fcef9bec700 1 --2- 172.21.15.59:0/4167277733 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcef415a230 0x7fcef415e8b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fcee400bae0 tx=0x7fcee400bdf0 comp rx=0 tx=0).stop 2023-09-21T00:18:15.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.060+0000 7fcef9bec700 1 -- 172.21.15.59:0/4167277733 shutdown_connections 2023-09-21T00:18:15.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.060+0000 7fcef9bec700 1 --2- 172.21.15.59:0/4167277733 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcef415a230 0x7fcef415e8b0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:15.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.060+0000 7fcef9bec700 1 --2- 172.21.15.59:0/4167277733 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcef40ca790 0x7fcef4071680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:15.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.060+0000 7fcef9bec700 1 -- 172.21.15.59:0/4167277733 >> 172.21.15.59:0/4167277733 conn(0x7fcef40d0140 msgr2=0x7fcef40d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:15.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.060+0000 7fcef9bec700 1 -- 172.21.15.59:0/4167277733 shutdown_connections 2023-09-21T00:18:15.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.060+0000 7fcef9bec700 1 -- 172.21.15.59:0/4167277733 wait complete. 2023-09-21T00:18:15.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.061+0000 7fcef9bec700 1 Processor -- start 2023-09-21T00:18:15.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.061+0000 7fcef9bec700 1 -- start start 2023-09-21T00:18:15.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.062+0000 7fcef9bec700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcef40ca790 0x7fcef41f3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:15.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.062+0000 7fcef9bec700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcef40cabf0 0x7fcef406ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:15.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.062+0000 7fcef9bec700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcef415a230 0x7fcef41effe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:15.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.062+0000 7fcef9bec700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef40c81a0 con 0x7fcef40cabf0 2023-09-21T00:18:15.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.062+0000 7fcef9bec700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef41f40c0 con 0x7fcef415a230 2023-09-21T00:18:15.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.062+0000 7fcef9bec700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef40c7520 con 0x7fcef40ca790 2023-09-21T00:18:15.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.062+0000 7fcef2ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcef40cabf0 0x7fcef406ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:15.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.062+0000 7fcef2ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcef40cabf0 0x7fcef406ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53074/0 (socket says 172.21.15.59:53074) 2023-09-21T00:18:15.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.062+0000 7fcef2ffd700 1 -- 172.21.15.59:0/1310580664 learned_addr learned my addr 172.21.15.59:0/1310580664 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:15.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.062+0000 7fcef3fff700 1 --2- 172.21.15.59:0/1310580664 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcef415a230 0x7fcef41effe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:15.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.062+0000 7fcef37fe700 1 --2- 172.21.15.59:0/1310580664 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcef40ca790 0x7fcef41f3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:15.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.062+0000 7fcef2ffd700 1 -- 172.21.15.59:0/1310580664 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcef40ca790 msgr2=0x7fcef41f3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:15.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.062+0000 7fcef2ffd700 1 --2- 172.21.15.59:0/1310580664 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcef40ca790 0x7fcef41f3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:15.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.062+0000 7fcef2ffd700 1 -- 172.21.15.59:0/1310580664 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcef415a230 msgr2=0x7fcef41effe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:15.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.062+0000 7fcef2ffd700 1 --2- 172.21.15.59:0/1310580664 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcef415a230 0x7fcef41effe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:15.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.062+0000 7fcef2ffd700 1 -- 172.21.15.59:0/1310580664 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee400b740 con 0x7fcef40cabf0 2023-09-21T00:18:15.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.063+0000 7fcef2ffd700 1 --2- 172.21.15.59:0/1310580664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcef40cabf0 0x7fcef406ecd0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fcee800c750 tx=0x7fcee800ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:15.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.063+0000 7fcedbfff700 1 -- 172.21.15.59:0/1310580664 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee8011800 con 0x7fcef40cabf0 2023-09-21T00:18:15.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.063+0000 7fcedbfff700 1 -- 172.21.15.59:0/1310580664 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee8011960 con 0x7fcef40cabf0 2023-09-21T00:18:15.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.063+0000 7fcef9bec700 1 -- 172.21.15.59:0/1310580664 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcef40c7800 con 0x7fcef40cabf0 2023-09-21T00:18:15.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.063+0000 7fcedbfff700 1 -- 172.21.15.59:0/1310580664 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee8011cd0 con 0x7fcef40cabf0 2023-09-21T00:18:15.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.063+0000 7fcef9bec700 1 -- 172.21.15.59:0/1310580664 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcef40c7dc0 con 0x7fcef40cabf0 2023-09-21T00:18:15.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.064+0000 7fcef9bec700 1 -- 172.21.15.59:0/1310580664 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcef40c7270 con 0x7fcef40cabf0 2023-09-21T00:18:15.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.064+0000 7fcedbfff700 1 -- 172.21.15.59:0/1310580664 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fcee8021350 con 0x7fcef40cabf0 2023-09-21T00:18:15.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.064+0000 7fcedbfff700 1 --2- 172.21.15.59:0/1310580664 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fcee006ae00 0x7fcee006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:15.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.065+0000 7fcedbfff700 1 -- 172.21.15.59:0/1310580664 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fcee8089730 con 0x7fcef40cabf0 2023-09-21T00:18:15.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.065+0000 7fcef37fe700 1 --2- 172.21.15.59:0/1310580664 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fcee006ae00 0x7fcee006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:15.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.065+0000 7fcef37fe700 1 --2- 172.21.15.59:0/1310580664 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fcee006ae00 0x7fcee006d2c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fcee400b2c0 tx=0x7fcee401c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:15.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.069+0000 7fcedbfff700 1 -- 172.21.15.59:0/1310580664 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fcee80544d0 con 0x7fcef40cabf0 2023-09-21T00:18:15.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.272+0000 7fcef9bec700 1 -- 172.21.15.59:0/1310580664 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcef4067e50 con 0x7fcef40cabf0 2023-09-21T00:18:15.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.273+0000 7fcedbfff700 1 -- 172.21.15.59:0/1310580664 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18792 (secure 0 0 0) 0x7fcee8057af0 con 0x7fcef40cabf0 2023-09-21T00:18:15.275 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:18:15.275 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":26,"fsid":"dd69925c-6e25-42fe-880b-2f60fc6f384b","created":"2023-09-21T00:16:43.074489+0000","modified":"2023-09-21T00:17:50.090179+0000","last_up_change":"2023-09-21T00:16:54.740101+0000","last_in_change":"2023-09-21T00:16:45.987089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T00:16:54.796248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-21T00:17:04.167102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-21T00:17:05.313188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-21T00:17:08.977609+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d4b18344-74c0-4f75-920b-7a9247e48914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6809","nonce":2418314235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6811","nonce":2418314235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6815","nonce":2418314235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6813","nonce":2418314235}]},"public_addr":"172.21.15.59:6809/2418314235","cluster_addr":"172.21.15.59:6811/2418314235","heartbeat_back_addr":"172.21.15.59:6815/2418314235","heartbeat_front_addr":"172.21.15.59:6813/2418314235","state":["exists","up"]},{"osd":1,"uuid":"80940d50-a248-4e64-a282-7ffcdad790ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6801","nonce":869668251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6803","nonce":869668251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6807","nonce":869668251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6805","nonce":869668251}]},"public_addr":"172.21.15.59:6801/869668251","cluster_addr":"172.21.15.59:6803/869668251","heartbeat_back_addr":"172.21.15.59:6807/869668251","heartbeat_front_addr":"172.21.15.59:6805/869668251","state":["exists","up"]},{"osd":2,"uuid":"55f2eceb-c54a-4879-a6ce-968c1c548b5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6817","nonce":372517778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6819","nonce":372517778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6823","nonce":372517778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6821","nonce":372517778}]},"public_addr":"172.21.15.59:6817/372517778","cluster_addr":"172.21.15.59:6819/372517778","heartbeat_back_addr":"172.21.15.59:6823/372517778","heartbeat_front_addr":"172.21.15.59:6821/372517778","state":["exists","up"]},{"osd":3,"uuid":"92b89cd0-869c-49b9-a9f9-97ac8423f304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6825","nonce":575188498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6827","nonce":575188498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6831","nonce":575188498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6829","nonce":575188498}]},"public_addr":"172.21.15.59:6825/575188498","cluster_addr":"172.21.15.59:6827/575188498","heartbeat_back_addr":"172.21.15.59:6831/575188498","heartbeat_front_addr":"172.21.15.59:6829/575188498","state":["exists","up"]},{"osd":4,"uuid":"25b80e94-e0e6-403d-b69f-61542f289637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6803","nonce":1741219098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6805","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6807","nonce":1741219098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6815","nonce":1741219098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6811","nonce":1741219098}]},"public_addr":"172.21.15.83:6803/1741219098","cluster_addr":"172.21.15.83:6807/1741219098","heartbeat_back_addr":"172.21.15.83:6815/1741219098","heartbeat_front_addr":"172.21.15.83:6811/1741219098","state":["exists","up"]},{"osd":5,"uuid":"5498d9ab-1086-4796-a199-9051e6dfea91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6817","nonce":156730565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6819","nonce":156730565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6823","nonce":156730565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6821","nonce":156730565}]},"public_addr":"172.21.15.83:6817/156730565","cluster_addr":"172.21.15.83:6819/156730565","heartbeat_back_addr":"172.21.15.83:6823/156730565","heartbeat_front_addr":"172.21.15.83:6821/156730565","state":["exists","up"]},{"osd":6,"uuid":"cfd810c0-5015-4d60-9a75-7efc93a32e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6801","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6800","nonce":1337723778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6806","nonce":1337723778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6814","nonce":1337723778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6810","nonce":1337723778}]},"public_addr":"172.21.15.83:6800/1337723778","cluster_addr":"172.21.15.83:6806/1337723778","heartbeat_back_addr":"172.21.15.83:6814/1337723778","heartbeat_front_addr":"172.21.15.83:6810/1337723778","state":["exists","up"]},{"osd":7,"uuid":"e992c8fa-0a3d-4b3c-85b5-2c511223dee4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6825","nonce":4204859272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6827","nonce":4204859272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6831","nonce":4204859272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6829","nonce":4204859272}]},"public_addr":"172.21.15.83:6825/4204859272","cluster_addr":"172.21.15.83:6827/4204859272","heartbeat_back_addr":"172.21.15.83:6831/4204859272","heartbeat_front_addr":"172.21.15.83:6829/4204859272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.156498+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.882707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.093978+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.158565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.173933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.888606+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.135525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.149712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":3,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.34","mappings":[{"from":4,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":6}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T00:18:15.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.276+0000 7fcef9bec700 1 -- 172.21.15.59:0/1310580664 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fcee006ae00 msgr2=0x7fcee006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:15.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.276+0000 7fcef9bec700 1 --2- 172.21.15.59:0/1310580664 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fcee006ae00 0x7fcee006d2c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fcee400b2c0 tx=0x7fcee401c040 comp rx=0 tx=0).stop 2023-09-21T00:18:15.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.276+0000 7fcef9bec700 1 -- 172.21.15.59:0/1310580664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcef40cabf0 msgr2=0x7fcef406ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:15.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.276+0000 7fcef9bec700 1 --2- 172.21.15.59:0/1310580664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcef40cabf0 0x7fcef406ecd0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fcee800c750 tx=0x7fcee800ca60 comp rx=0 tx=0).stop 2023-09-21T00:18:15.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.276+0000 7fcef9bec700 1 -- 172.21.15.59:0/1310580664 shutdown_connections 2023-09-21T00:18:15.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.276+0000 7fcef9bec700 1 --2- 172.21.15.59:0/1310580664 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcef415a230 0x7fcef41effe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:15.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.276+0000 7fcef9bec700 1 --2- 172.21.15.59:0/1310580664 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fcee006ae00 0x7fcee006d2c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:15.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.276+0000 7fcef9bec700 1 --2- 172.21.15.59:0/1310580664 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcef40ca790 0x7fcef41f3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:15.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.276+0000 7fcef9bec700 1 --2- 172.21.15.59:0/1310580664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcef40cabf0 0x7fcef406ecd0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:15.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.276+0000 7fcef9bec700 1 -- 172.21.15.59:0/1310580664 >> 172.21.15.59:0/1310580664 conn(0x7fcef40d0140 msgr2=0x7fcef4157390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:15.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.276+0000 7fcef9bec700 1 -- 172.21.15.59:0/1310580664 shutdown_connections 2023-09-21T00:18:15.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.276+0000 7fcef9bec700 1 -- 172.21.15.59:0/1310580664 wait complete. 2023-09-21T00:18:15.290 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-09-21T00:18:15.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.414+0000 7fbdbaf45700 1 Processor -- start 2023-09-21T00:18:15.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.414+0000 7fbdbaf45700 1 -- start start 2023-09-21T00:18:15.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.415+0000 7fbdbaf45700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbdb406d560 0x7fbdb40aee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:15.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.415+0000 7fbdbaf45700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdb40cdaf0 con 0x7fbdb415a960 2023-09-21T00:18:15.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.415+0000 7fbdbaf45700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdb40b3720 con 0x7fbdb4071090 2023-09-21T00:18:15.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.415+0000 7fbdbaf45700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdb40b3a00 con 0x7fbdb406d560 2023-09-21T00:18:15.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.415+0000 7fbdb3fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fbdb415a960 0x7fbdb40cdf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58650/0 (socket says 172.21.15.59:58650) 2023-09-21T00:18:15.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.415+0000 7fbdb3fff700 1 -- 172.21.15.59:0/1079417387 learned_addr learned my addr 172.21.15.59:0/1079417387 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:15.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.415+0000 7fbdb94e2700 1 --2- 172.21.15.59:0/1079417387 >> v2:172.21.15.83:3300/0 conn(0x7fbdb406d560 0x7fbdb40aee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:15.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.415+0000 7fbdb37fe700 1 -- 172.21.15.59:0/1079417387 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3552741591 0 0) 0x7fbdb40cdaf0 con 0x7fbdb415a960 2023-09-21T00:18:15.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.415+0000 7fbdb37fe700 1 -- 172.21.15.59:0/1079417387 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbda40057c0 con 0x7fbdb415a960 2023-09-21T00:18:15.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.415+0000 7fbdb37fe700 1 -- 172.21.15.59:0/1079417387 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3263776426 0 0) 0x7fbda40057c0 con 0x7fbdb415a960 2023-09-21T00:18:15.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.415+0000 7fbdb37fe700 1 -- 172.21.15.59:0/1079417387 >> v2:172.21.15.83:3300/0 conn(0x7fbdb406d560 msgr2=0x7fbdb40aee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:15.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.415+0000 7fbdb37fe700 1 --2- 172.21.15.59:0/1079417387 >> v2:172.21.15.83:3300/0 conn(0x7fbdb406d560 0x7fbdb40aee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:15.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.415+0000 7fbdb37fe700 1 -- 172.21.15.59:0/1079417387 >> v1:172.21.15.83:6789/0 conn(0x7fbdb4071090 legacy=0x7fbdb415a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:15.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.415+0000 7fbdb37fe700 1 -- 172.21.15.59:0/1079417387 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb40b3ce0 con 0x7fbdb415a960 2023-09-21T00:18:15.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.415+0000 7fbdb37fe700 1 -- 172.21.15.59:0/1079417387 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 710825841 0 0) 0x7fbda0001670 con 0x7fbdb415a960 2023-09-21T00:18:15.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.415+0000 7fbdb37fe700 1 -- 172.21.15.59:0/1079417387 >> v1:172.21.15.59:6789/0 conn(0x7fbdb415a960 legacy=0x7fbdb40cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:15.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.415+0000 7fbdb37fe700 1 --2- 172.21.15.59:0/1079417387 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbda4005c10 0x7fbda4006030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:15.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.415+0000 7fbdb37fe700 1 --2- 172.21.15.59:0/1079417387 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbda4006a60 0x7fbda4006ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:15.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.415+0000 7fbdb37fe700 1 --2- 172.21.15.59:0/1079417387 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbda4007420 0x7fbda400dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:15.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.415+0000 7fbdb37fe700 1 -- 172.21.15.59:0/1079417387 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb40b3a00 con 0x7fbda4005c10 2023-09-21T00:18:15.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.415+0000 7fbdb37fe700 1 -- 172.21.15.59:0/1079417387 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda400e3c0 con 0x7fbda4007420 2023-09-21T00:18:15.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.415+0000 7fbdb37fe700 1 -- 172.21.15.59:0/1079417387 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda400e580 con 0x7fbda4006a60 2023-09-21T00:18:15.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.415+0000 7fbdb8ce1700 1 --2- 172.21.15.59:0/1079417387 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbda4005c10 0x7fbda4006030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:15.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.416+0000 7fbdb94e2700 1 --2- 172.21.15.59:0/1079417387 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbda4007420 0x7fbda400dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:15.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.416+0000 7fbdb3fff700 1 --2- 172.21.15.59:0/1079417387 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbda4006a60 0x7fbda4006ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:15.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.416+0000 7fbdb8ce1700 1 -- 172.21.15.59:0/1079417387 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbda4006a60 msgr2=0x7fbda4006ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:15.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.416+0000 7fbdb8ce1700 1 --2- 172.21.15.59:0/1079417387 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbda4006a60 0x7fbda4006ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:15.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.416+0000 7fbdb8ce1700 1 -- 172.21.15.59:0/1079417387 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbda4007420 msgr2=0x7fbda400dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:15.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.416+0000 7fbdb8ce1700 1 --2- 172.21.15.59:0/1079417387 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbda4007420 0x7fbda400dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:15.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.416+0000 7fbdb94e2700 1 -- 172.21.15.59:0/1079417387 reap_dead start 2023-09-21T00:18:15.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.416+0000 7fbdb8ce1700 1 -- 172.21.15.59:0/1079417387 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda40057c0 con 0x7fbda4005c10 2023-09-21T00:18:15.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.416+0000 7fbdb8ce1700 1 --2- 172.21.15.59:0/1079417387 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbda4005c10 0x7fbda4006030 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbda80017c0 tx=0x7fbda4007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c3e76e180f893d server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:15.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.416+0000 7fbdb37fe700 1 -- 172.21.15.59:0/1079417387 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda80052d0 con 0x7fbda4005c10 2023-09-21T00:18:15.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.416+0000 7fbdb37fe700 1 -- 172.21.15.59:0/1079417387 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda8005450 con 0x7fbda4005c10 2023-09-21T00:18:15.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.416+0000 7fbdb37fe700 1 -- 172.21.15.59:0/1079417387 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda80038c0 con 0x7fbda4005c10 2023-09-21T00:18:15.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.417+0000 7fbdbaf45700 1 -- 172.21.15.59:0/1079417387 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbda4005c10 msgr2=0x7fbda4006030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:15.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.417+0000 7fbdbaf45700 1 --2- 172.21.15.59:0/1079417387 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbda4005c10 0x7fbda4006030 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbda80017c0 tx=0x7fbda4007a90 comp rx=0 tx=0).stop 2023-09-21T00:18:15.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.417+0000 7fbdbaf45700 1 -- 172.21.15.59:0/1079417387 shutdown_connections 2023-09-21T00:18:15.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.417+0000 7fbdbaf45700 1 --2- 172.21.15.59:0/1079417387 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbda4005c10 0x7fbda4006030 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:15.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.417+0000 7fbdbaf45700 1 -- 172.21.15.59:0/1079417387 >> 172.21.15.59:0/1079417387 conn(0x7fbdb40b1430 msgr2=0x7fbdb40b1840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:15.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.417+0000 7fbdbaf45700 1 -- 172.21.15.59:0/1079417387 shutdown_connections 2023-09-21T00:18:15.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.417+0000 7fbdbaf45700 1 -- 172.21.15.59:0/1079417387 wait complete. 2023-09-21T00:18:15.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.418+0000 7fbdbaf45700 1 Processor -- start 2023-09-21T00:18:15.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.418+0000 7fbdbaf45700 1 -- start start 2023-09-21T00:18:15.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.419+0000 7fbdbaf45700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbda4005c10 0x7fbdb414d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:15.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.419+0000 7fbdbaf45700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbdb415beb0 0x7fbdb414ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:15.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.419+0000 7fbdbaf45700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbdb40b0190 0x7fbdb40b0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:15.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.419+0000 7fbdbaf45700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb40b0b50 con 0x7fbda4005c10 2023-09-21T00:18:15.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.419+0000 7fbdbaf45700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb414f910 con 0x7fbdb40b0190 2023-09-21T00:18:15.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.419+0000 7fbdbaf45700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb41501b0 con 0x7fbdb415beb0 2023-09-21T00:18:15.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.419+0000 7fbdb8ce1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbda4005c10 0x7fbdb414d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:15.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.419+0000 7fbdb8ce1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbda4005c10 0x7fbdb414d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53092/0 (socket says 172.21.15.59:53092) 2023-09-21T00:18:15.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.419+0000 7fbdb8ce1700 1 -- 172.21.15.59:0/4194945976 learned_addr learned my addr 172.21.15.59:0/4194945976 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:15.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.419+0000 7fbdb94e2700 1 --2- 172.21.15.59:0/4194945976 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbdb40b0190 0x7fbdb40b0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:15.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.419+0000 7fbdb3fff700 1 --2- 172.21.15.59:0/4194945976 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbdb415beb0 0x7fbdb414ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:15.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.419+0000 7fbdb8ce1700 1 -- 172.21.15.59:0/4194945976 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbdb415beb0 msgr2=0x7fbdb414ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:15.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.419+0000 7fbdb8ce1700 1 --2- 172.21.15.59:0/4194945976 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbdb415beb0 0x7fbdb414ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:15.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.419+0000 7fbdb8ce1700 1 -- 172.21.15.59:0/4194945976 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbdb40b0190 msgr2=0x7fbdb40b0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:15.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.419+0000 7fbdb8ce1700 1 --2- 172.21.15.59:0/4194945976 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbdb40b0190 0x7fbdb40b0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:15.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.419+0000 7fbdb8ce1700 1 -- 172.21.15.59:0/4194945976 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb415c420 con 0x7fbda4005c10 2023-09-21T00:18:15.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.419+0000 7fbdb8ce1700 1 --2- 172.21.15.59:0/4194945976 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbda4005c10 0x7fbdb414d940 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fbda8001db0 tx=0x7fbda8001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:15.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.419+0000 7fbdb17fa700 1 -- 172.21.15.59:0/4194945976 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda8001290 con 0x7fbda4005c10 2023-09-21T00:18:15.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.419+0000 7fbdb17fa700 1 -- 172.21.15.59:0/4194945976 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda8007040 con 0x7fbda4005c10 2023-09-21T00:18:15.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.419+0000 7fbdb17fa700 1 -- 172.21.15.59:0/4194945976 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda80073d0 con 0x7fbda4005c10 2023-09-21T00:18:15.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.419+0000 7fbdbaf45700 1 -- 172.21.15.59:0/4194945976 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdb414fb60 con 0x7fbda4005c10 2023-09-21T00:18:15.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.420+0000 7fbdbaf45700 1 -- 172.21.15.59:0/4194945976 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdb414f4d0 con 0x7fbda4005c10 2023-09-21T00:18:15.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.421+0000 7fbdbaf45700 1 -- 172.21.15.59:0/4194945976 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdb4067e50 con 0x7fbda4005c10 2023-09-21T00:18:15.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.421+0000 7fbdb17fa700 1 -- 172.21.15.59:0/4194945976 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fbda8007530 con 0x7fbda4005c10 2023-09-21T00:18:15.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.421+0000 7fbdb17fa700 1 --2- 172.21.15.59:0/4194945976 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fbd9806ae00 0x7fbd9806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:15.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.421+0000 7fbdb17fa700 1 -- 172.21.15.59:0/4194945976 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fbda808a240 con 0x7fbda4005c10 2023-09-21T00:18:15.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.422+0000 7fbdb3fff700 1 --2- 172.21.15.59:0/4194945976 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fbd9806ae00 0x7fbd9806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:15.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.422+0000 7fbdb3fff700 1 --2- 172.21.15.59:0/4194945976 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fbd9806ae00 0x7fbd9806d2c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4068710 tx=0x7fbda0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:15.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.427+0000 7fbdb17fa700 1 -- 172.21.15.59:0/4194945976 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fbda80550a0 con 0x7fbda4005c10 2023-09-21T00:18:15.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.672+0000 7fbdbaf45700 1 -- 172.21.15.59:0/4194945976 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fbdb4068a70 con 0x7fbda4005c10 2023-09-21T00:18:15.674 INFO:tasks.ceph.mon.a.smithi059.stderr:2023-09-21T00:18:15.672+0000 7fa1e0348700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-09-21T00:18:15.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.680+0000 7fbdb17fa700 1 -- 172.21.15.59:0/4194945976 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7fbda8021090 con 0x7fbda4005c10 2023-09-21T00:18:15.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.683+0000 7fbdbaf45700 1 -- 172.21.15.59:0/4194945976 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fbd9806ae00 msgr2=0x7fbd9806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:15.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.683+0000 7fbdbaf45700 1 --2- 172.21.15.59:0/4194945976 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fbd9806ae00 0x7fbd9806d2c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4068710 tx=0x7fbda0009040 comp rx=0 tx=0).stop 2023-09-21T00:18:15.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.683+0000 7fbdbaf45700 1 -- 172.21.15.59:0/4194945976 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbda4005c10 msgr2=0x7fbdb414d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:15.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.683+0000 7fbdbaf45700 1 --2- 172.21.15.59:0/4194945976 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbda4005c10 0x7fbdb414d940 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fbda8001db0 tx=0x7fbda8001120 comp rx=0 tx=0).stop 2023-09-21T00:18:15.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.683+0000 7fbdbaf45700 1 -- 172.21.15.59:0/4194945976 shutdown_connections 2023-09-21T00:18:15.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.683+0000 7fbdbaf45700 1 --2- 172.21.15.59:0/4194945976 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbdb40b0190 0x7fbdb40b0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:15.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.683+0000 7fbdbaf45700 1 --2- 172.21.15.59:0/4194945976 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbda4005c10 0x7fbdb414d940 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:15.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.683+0000 7fbdbaf45700 1 --2- 172.21.15.59:0/4194945976 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fbd9806ae00 0x7fbd9806d2c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:15.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.683+0000 7fbdbaf45700 1 --2- 172.21.15.59:0/4194945976 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbdb415beb0 0x7fbdb414ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:15.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.683+0000 7fbdbaf45700 1 -- 172.21.15.59:0/4194945976 >> 172.21.15.59:0/4194945976 conn(0x7fbdb40b1430 msgr2=0x7fbdb406e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:15.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.683+0000 7fbdbaf45700 1 -- 172.21.15.59:0/4194945976 shutdown_connections 2023-09-21T00:18:15.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.683+0000 7fbdbaf45700 1 -- 172.21.15.59:0/4194945976 wait complete. 2023-09-21T00:18:15.688 INFO:tasks.ceph.mds.b.smithi083.stderr: -5893> 2023-09-21T00:17:12.724+0000 7f2b5ccfd700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-21T00:18:15.688 INFO:teuthology.orchestra.run.smithi059.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-09-21T00:18:15.697 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-09-21T00:18:15.717 INFO:tasks.ceph.mds.b.smithi083.stdout:starting mds.b at 2023-09-21T00:18:15.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.823+0000 7f81ffd80700 1 Processor -- start 2023-09-21T00:18:15.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.823+0000 7f81ffd80700 1 -- start start 2023-09-21T00:18:15.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.824+0000 7f81ffd80700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f81f80cc880 0x7f81f81663f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:15.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.824+0000 7f81ffd80700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81f8159460 con 0x7f81f8159080 2023-09-21T00:18:15.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.824+0000 7f81ffd80700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81f815bd80 con 0x7f81f806ce80 2023-09-21T00:18:15.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.824+0000 7f81ffd80700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81f815c060 con 0x7f81f80cc880 2023-09-21T00:18:15.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.824+0000 7f81fe31d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f81f80cc880 0x7f81f81663f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:15.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.824+0000 7f81fe31d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f81f80cc880 0x7f81f81663f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53102/0 (socket says 172.21.15.59:53102) 2023-09-21T00:18:15.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.824+0000 7f81fdb1c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f81f8159080 0x7f81f8068590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58668/0 (socket says 172.21.15.59:58668) 2023-09-21T00:18:15.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.824+0000 7f81fe31d700 1 -- 172.21.15.59:0/3908088805 learned_addr learned my addr 172.21.15.59:0/3908088805 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:15.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.824+0000 7f81fe31d700 1 -- 172.21.15.59:0/3908088805 >> v1:172.21.15.83:6789/0 conn(0x7f81f806ce80 legacy=0x7f81f80cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:15.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.824+0000 7f81fe31d700 1 -- 172.21.15.59:0/3908088805 >> v1:172.21.15.59:6789/0 conn(0x7f81f8159080 legacy=0x7f81f8068590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:15.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.824+0000 7f81fcb1a700 1 -- 172.21.15.59:0/3908088805 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1344163916 0 0) 0x7f81f4001110 con 0x7f81f8159080 2023-09-21T00:18:15.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.824+0000 7f81fe31d700 1 -- 172.21.15.59:0/3908088805 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f815c340 con 0x7f81f80cc880 2023-09-21T00:18:15.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.824+0000 7f81fe31d700 1 --2- 172.21.15.59:0/3908088805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81f80cc880 0x7f81f81663f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f81f0009e50 tx=0x7f81f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc56017813a036c6 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:15.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.824+0000 7f81fcb1a700 1 -- 172.21.15.59:0/3908088805 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f000e070 con 0x7f81f80cc880 2023-09-21T00:18:15.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.824+0000 7f81fcb1a700 1 -- 172.21.15.59:0/3908088805 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f0003a20 con 0x7f81f80cc880 2023-09-21T00:18:15.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.824+0000 7f81fcb1a700 1 -- 172.21.15.59:0/3908088805 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f0003dd0 con 0x7f81f80cc880 2023-09-21T00:18:15.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.825+0000 7f81ffd80700 1 -- 172.21.15.59:0/3908088805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81f80cc880 msgr2=0x7f81f81663f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:15.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.825+0000 7f81ffd80700 1 --2- 172.21.15.59:0/3908088805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81f80cc880 0x7f81f81663f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f81f0009e50 tx=0x7f81f000b330 comp rx=0 tx=0).stop 2023-09-21T00:18:15.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.825+0000 7f81ffd80700 1 -- 172.21.15.59:0/3908088805 shutdown_connections 2023-09-21T00:18:15.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.825+0000 7f81ffd80700 1 --2- 172.21.15.59:0/3908088805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81f80cc880 0x7f81f81663f0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:15.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.825+0000 7f81ffd80700 1 -- 172.21.15.59:0/3908088805 >> 172.21.15.59:0/3908088805 conn(0x7f81f80b1430 msgr2=0x7f81f80b1840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:15.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.825+0000 7f81ffd80700 1 -- 172.21.15.59:0/3908088805 shutdown_connections 2023-09-21T00:18:15.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.825+0000 7f81ffd80700 1 -- 172.21.15.59:0/3908088805 wait complete. 2023-09-21T00:18:15.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.826+0000 7f81ffd80700 1 Processor -- start 2023-09-21T00:18:15.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.826+0000 7f81ffd80700 1 -- start start 2023-09-21T00:18:15.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.827+0000 7f81ffd80700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81f806ce80 0x7f81f8151230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:15.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.827+0000 7f81ffd80700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f81f80cc880 0x7f81f815f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:15.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.827+0000 7f81ffd80700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81f8159080 0x7f81f81f0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:15.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.827+0000 7f81ffd80700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f815f720 con 0x7f81f806ce80 2023-09-21T00:18:15.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.827+0000 7f81ffd80700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f8151930 con 0x7f81f8159080 2023-09-21T00:18:15.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.827+0000 7f81ffd80700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f8151c10 con 0x7f81f80cc880 2023-09-21T00:18:15.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.827+0000 7f81fdb1c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81f806ce80 0x7f81f8151230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:15.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.827+0000 7f81fdb1c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81f806ce80 0x7f81f8151230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53104/0 (socket says 172.21.15.59:53104) 2023-09-21T00:18:15.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.827+0000 7f81fdb1c700 1 -- 172.21.15.59:0/2914497887 learned_addr learned my addr 172.21.15.59:0/2914497887 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:15.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.827+0000 7f81fe31d700 1 --2- 172.21.15.59:0/2914497887 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81f8159080 0x7f81f81f0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:15.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.827+0000 7f81fd31b700 1 --2- 172.21.15.59:0/2914497887 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f81f80cc880 0x7f81f815f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:15.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.827+0000 7f81fdb1c700 1 -- 172.21.15.59:0/2914497887 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f81f80cc880 msgr2=0x7f81f815f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:15.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.827+0000 7f81fdb1c700 1 --2- 172.21.15.59:0/2914497887 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f81f80cc880 0x7f81f815f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:15.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.827+0000 7f81fdb1c700 1 -- 172.21.15.59:0/2914497887 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81f8159080 msgr2=0x7f81f81f0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:15.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.827+0000 7f81fdb1c700 1 --2- 172.21.15.59:0/2914497887 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81f8159080 0x7f81f81f0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:15.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.827+0000 7f81fdb1c700 1 -- 172.21.15.59:0/2914497887 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f0009b30 con 0x7f81f806ce80 2023-09-21T00:18:15.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.827+0000 7f81fd31b700 1 --2- 172.21.15.59:0/2914497887 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f81f80cc880 0x7f81f815f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:18:15.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.828+0000 7f81fdb1c700 1 --2- 172.21.15.59:0/2914497887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81f806ce80 0x7f81f8151230 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f81f400c730 tx=0x7f81f400caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:15.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.828+0000 7f81ee7fc700 1 -- 172.21.15.59:0/2914497887 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f4004c80 con 0x7f81f806ce80 2023-09-21T00:18:15.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.828+0000 7f81ee7fc700 1 -- 172.21.15.59:0/2914497887 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f4004e00 con 0x7f81f806ce80 2023-09-21T00:18:15.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.828+0000 7f81ffd80700 1 -- 172.21.15.59:0/2914497887 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81f8151ef0 con 0x7f81f806ce80 2023-09-21T00:18:15.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.828+0000 7f81ee7fc700 1 -- 172.21.15.59:0/2914497887 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f4007310 con 0x7f81f806ce80 2023-09-21T00:18:15.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.828+0000 7f81ffd80700 1 -- 172.21.15.59:0/2914497887 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f81f0ac0 con 0x7f81f806ce80 2023-09-21T00:18:15.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.829+0000 7f81ffd80700 1 -- 172.21.15.59:0/2914497887 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81f8067e50 con 0x7f81f806ce80 2023-09-21T00:18:15.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.829+0000 7f81ee7fc700 1 -- 172.21.15.59:0/2914497887 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f81f4007470 con 0x7f81f806ce80 2023-09-21T00:18:15.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.830+0000 7f81ee7fc700 1 --2- 172.21.15.59:0/2914497887 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f81dc06ae00 0x7f81dc06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:15.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.830+0000 7f81ee7fc700 1 -- 172.21.15.59:0/2914497887 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6836+0+0 (secure 0 0 0) 0x7f81f40895c0 con 0x7f81f806ce80 2023-09-21T00:18:15.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.830+0000 7f81fd31b700 1 --2- 172.21.15.59:0/2914497887 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f81dc06ae00 0x7f81dc06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:15.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.830+0000 7f81fd31b700 1 --2- 172.21.15.59:0/2914497887 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f81dc06ae00 0x7f81dc06d2c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f81e8006fd0 tx=0x7f81e8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:15.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:15.835+0000 7f81ee7fc700 1 -- 172.21.15.59:0/2914497887 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f81f4054270 con 0x7f81f806ce80 2023-09-21T00:18:16.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.081+0000 7f81ffd80700 1 -- 172.21.15.59:0/2914497887 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f81f815a5e0 con 0x7f81f806ce80 2023-09-21T00:18:16.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.683+0000 7f81ee7fc700 1 -- 172.21.15.59:0/2914497887 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f81f815a5e0 con 0x7f81f806ce80 2023-09-21T00:18:16.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.685+0000 7f81ffd80700 1 -- 172.21.15.59:0/2914497887 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f81dc06ae00 msgr2=0x7f81dc06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:16.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.685+0000 7f81ffd80700 1 --2- 172.21.15.59:0/2914497887 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f81dc06ae00 0x7f81dc06d2c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f81e8006fd0 tx=0x7f81e8008040 comp rx=0 tx=0).stop 2023-09-21T00:18:16.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.685+0000 7f81ffd80700 1 -- 172.21.15.59:0/2914497887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81f806ce80 msgr2=0x7f81f8151230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:16.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.685+0000 7f81ffd80700 1 --2- 172.21.15.59:0/2914497887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81f806ce80 0x7f81f8151230 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f81f400c730 tx=0x7f81f400caf0 comp rx=0 tx=0).stop 2023-09-21T00:18:16.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.685+0000 7f81ffd80700 1 -- 172.21.15.59:0/2914497887 shutdown_connections 2023-09-21T00:18:16.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.685+0000 7f81ffd80700 1 --2- 172.21.15.59:0/2914497887 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81f8159080 0x7f81f81f0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:16.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.685+0000 7f81ffd80700 1 --2- 172.21.15.59:0/2914497887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81f806ce80 0x7f81f8151230 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:16.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.685+0000 7f81ffd80700 1 --2- 172.21.15.59:0/2914497887 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f81dc06ae00 0x7f81dc06d2c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:16.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.685+0000 7f81ffd80700 1 --2- 172.21.15.59:0/2914497887 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f81f80cc880 0x7f81f815f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:16.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.685+0000 7f81ffd80700 1 -- 172.21.15.59:0/2914497887 >> 172.21.15.59:0/2914497887 conn(0x7f81f80b1430 msgr2=0x7f81f8068590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:16.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.685+0000 7f81ffd80700 1 -- 172.21.15.59:0/2914497887 shutdown_connections 2023-09-21T00:18:16.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.685+0000 7f81ffd80700 1 -- 172.21.15.59:0/2914497887 wait complete. 2023-09-21T00:18:16.701 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-09-21T00:18:16.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.838+0000 7fa18e543700 1 Processor -- start 2023-09-21T00:18:16.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.838+0000 7fa18e543700 1 -- start start 2023-09-21T00:18:16.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.839+0000 7fa18e543700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa1880cc130 0x7fa1880cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:16.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.839+0000 7fa18e543700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1880b6e90 0x7fa1880b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:16.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.839+0000 7fa18e543700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1880cc510 con 0x7fa1880b32c0 2023-09-21T00:18:16.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.839+0000 7fa18e543700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1880b3730 con 0x7fa1880cc130 2023-09-21T00:18:16.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.839+0000 7fa18e543700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa18815cb60 con 0x7fa1880b6e90 2023-09-21T00:18:16.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.839+0000 7fa18cae0700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa1880b32c0 0x7fa18815f210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58684/0 (socket says 172.21.15.59:58684) 2023-09-21T00:18:16.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.839+0000 7fa18cae0700 1 -- 172.21.15.59:0/293116241 learned_addr learned my addr 172.21.15.59:0/293116241 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:16.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.839+0000 7fa187fff700 1 --2- 172.21.15.59:0/293116241 >> v2:172.21.15.83:3300/0 conn(0x7fa1880cc130 0x7fa1880cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:16.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.839+0000 7fa1877fe700 1 --2- 172.21.15.59:0/293116241 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1880b6e90 0x7fa1880b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:16.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.840+0000 7fa186ffd700 1 -- 172.21.15.59:0/293116241 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3436514077 0 0) 0x7fa1880cc510 con 0x7fa1880b32c0 2023-09-21T00:18:16.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.840+0000 7fa186ffd700 1 -- 172.21.15.59:0/293116241 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1740035b0 con 0x7fa1880b32c0 2023-09-21T00:18:16.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.840+0000 7fa186ffd700 1 -- 172.21.15.59:0/293116241 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 386936116 0 0) 0x7fa1740035b0 con 0x7fa1880b32c0 2023-09-21T00:18:16.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.840+0000 7fa186ffd700 1 -- 172.21.15.59:0/293116241 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1880b6e90 msgr2=0x7fa1880b2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:16.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.840+0000 7fa186ffd700 1 --2- 172.21.15.59:0/293116241 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1880b6e90 0x7fa1880b2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:16.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.840+0000 7fa186ffd700 1 -- 172.21.15.59:0/293116241 >> v2:172.21.15.83:3300/0 conn(0x7fa1880cc130 msgr2=0x7fa1880cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:16.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.840+0000 7fa186ffd700 1 --2- 172.21.15.59:0/293116241 >> v2:172.21.15.83:3300/0 conn(0x7fa1880cc130 0x7fa1880cd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:16.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.840+0000 7fa186ffd700 1 -- 172.21.15.59:0/293116241 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa18815bfe0 con 0x7fa1880b32c0 2023-09-21T00:18:16.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.840+0000 7fa186ffd700 1 -- 172.21.15.59:0/293116241 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 710825841 0 0) 0x7fa1800019f0 con 0x7fa1880b32c0 2023-09-21T00:18:16.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.840+0000 7fa186ffd700 1 -- 172.21.15.59:0/293116241 >> v1:172.21.15.59:6789/0 conn(0x7fa1880b32c0 legacy=0x7fa18815f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:16.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.840+0000 7fa186ffd700 1 --2- 172.21.15.59:0/293116241 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa174003a70 0x7fa174003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:16.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.840+0000 7fa186ffd700 1 --2- 172.21.15.59:0/293116241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa174004850 0x7fa174004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:16.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.840+0000 7fa186ffd700 1 --2- 172.21.15.59:0/293116241 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa174005210 0x7fa17400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:16.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.840+0000 7fa186ffd700 1 -- 172.21.15.59:0/293116241 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1880b3730 con 0x7fa174004850 2023-09-21T00:18:16.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.840+0000 7fa186ffd700 1 -- 172.21.15.59:0/293116241 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18815cb60 con 0x7fa174003a70 2023-09-21T00:18:16.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.840+0000 7fa186ffd700 1 -- 172.21.15.59:0/293116241 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa17400bf50 con 0x7fa174005210 2023-09-21T00:18:16.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.840+0000 7fa1877fe700 1 --2- 172.21.15.59:0/293116241 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1880b6e90 0x7fa1880b2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T00:18:16.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.840+0000 7fa187fff700 1 --2- 172.21.15.59:0/293116241 >> v2:172.21.15.83:3300/0 conn(0x7fa1880cc130 0x7fa1880cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T00:18:16.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.840+0000 7fa1877fe700 1 --2- 172.21.15.59:0/293116241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa174004850 0x7fa174004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:16.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.840+0000 7fa18cae0700 1 --2- 172.21.15.59:0/293116241 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa174005210 0x7fa17400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:16.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.840+0000 7fa187fff700 1 --2- 172.21.15.59:0/293116241 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa174003a70 0x7fa174003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:16.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.841+0000 7fa1877fe700 1 -- 172.21.15.59:0/293116241 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa174005210 msgr2=0x7fa17400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:16.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.841+0000 7fa1877fe700 1 --2- 172.21.15.59:0/293116241 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa174005210 0x7fa17400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:16.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.841+0000 7fa1877fe700 1 -- 172.21.15.59:0/293116241 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa174003a70 msgr2=0x7fa174003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:16.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.841+0000 7fa1877fe700 1 --2- 172.21.15.59:0/293116241 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa174003a70 0x7fa174003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:16.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.841+0000 7fa1877fe700 1 -- 172.21.15.59:0/293116241 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1740035b0 con 0x7fa174004850 2023-09-21T00:18:16.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.841+0000 7fa1877fe700 1 --2- 172.21.15.59:0/293116241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa174004850 0x7fa174004cd0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa170009ba0 tx=0x7fa174005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b73039c02180ba98 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:16.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.841+0000 7fa186ffd700 1 -- 172.21.15.59:0/293116241 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa170004030 con 0x7fa174004850 2023-09-21T00:18:16.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.841+0000 7fa186ffd700 1 -- 172.21.15.59:0/293116241 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa170004190 con 0x7fa174004850 2023-09-21T00:18:16.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.841+0000 7fa186ffd700 1 -- 172.21.15.59:0/293116241 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa170004540 con 0x7fa174004850 2023-09-21T00:18:16.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.841+0000 7fa18e543700 1 -- 172.21.15.59:0/293116241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa174004850 msgr2=0x7fa174004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:16.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.841+0000 7fa18e543700 1 --2- 172.21.15.59:0/293116241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa174004850 0x7fa174004cd0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa170009ba0 tx=0x7fa174005880 comp rx=0 tx=0).stop 2023-09-21T00:18:16.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.841+0000 7fa18cae0700 1 -- 172.21.15.59:0/293116241 reap_dead start 2023-09-21T00:18:16.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.841+0000 7fa18e543700 1 -- 172.21.15.59:0/293116241 shutdown_connections 2023-09-21T00:18:16.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.841+0000 7fa18e543700 1 -- 172.21.15.59:0/293116241 >> 172.21.15.59:0/293116241 conn(0x7fa1880703e0 msgr2=0x7fa1880707c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:16.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.841+0000 7fa18e543700 1 -- 172.21.15.59:0/293116241 shutdown_connections 2023-09-21T00:18:16.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.842+0000 7fa18e543700 1 -- 172.21.15.59:0/293116241 wait complete. 2023-09-21T00:18:16.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.843+0000 7fa18e543700 1 Processor -- start 2023-09-21T00:18:16.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.843+0000 7fa18e543700 1 -- start start 2023-09-21T00:18:16.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.844+0000 7fa18e543700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa174004850 0x7fa1881f04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:16.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.844+0000 7fa18e543700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1881f09e0 0x7fa1880c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:16.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.844+0000 7fa18e543700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1880c8830 0x7fa1881f4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:16.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.844+0000 7fa18e543700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1880caae0 con 0x7fa1881f09e0 2023-09-21T00:18:16.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.844+0000 7fa18e543700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1881473f0 con 0x7fa174004850 2023-09-21T00:18:16.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.844+0000 7fa18e543700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1880c5e50 con 0x7fa1880c8830 2023-09-21T00:18:16.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.844+0000 7fa1877fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1881f09e0 0x7fa1880c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:16.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.844+0000 7fa1877fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1881f09e0 0x7fa1880c82f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53126/0 (socket says 172.21.15.59:53126) 2023-09-21T00:18:16.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.844+0000 7fa1877fe700 1 -- 172.21.15.59:0/2454418121 learned_addr learned my addr 172.21.15.59:0/2454418121 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:16.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.844+0000 7fa187fff700 1 --2- 172.21.15.59:0/2454418121 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa174004850 0x7fa1881f04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:16.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.844+0000 7fa18cae0700 1 --2- 172.21.15.59:0/2454418121 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1880c8830 0x7fa1881f4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:16.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.844+0000 7fa1877fe700 1 -- 172.21.15.59:0/2454418121 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1880c8830 msgr2=0x7fa1881f4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:16.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.844+0000 7fa1877fe700 1 --2- 172.21.15.59:0/2454418121 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1880c8830 0x7fa1881f4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:16.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.844+0000 7fa1877fe700 1 -- 172.21.15.59:0/2454418121 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa174004850 msgr2=0x7fa1881f04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:16.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.844+0000 7fa1877fe700 1 --2- 172.21.15.59:0/2454418121 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa174004850 0x7fa1881f04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:16.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.844+0000 7fa1877fe700 1 -- 172.21.15.59:0/2454418121 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa18814d9b0 con 0x7fa1881f09e0 2023-09-21T00:18:16.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.844+0000 7fa187fff700 1 --2- 172.21.15.59:0/2454418121 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa174004850 0x7fa1881f04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:18:16.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.844+0000 7fa1877fe700 1 --2- 172.21.15.59:0/2454418121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1881f09e0 0x7fa1880c82f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa17000ebc0 tx=0x7fa1700047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:16.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.844+0000 7fa184ff9700 1 -- 172.21.15.59:0/2454418121 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa170004030 con 0x7fa1881f09e0 2023-09-21T00:18:16.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.844+0000 7fa184ff9700 1 -- 172.21.15.59:0/2454418121 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa170003ab0 con 0x7fa1881f09e0 2023-09-21T00:18:16.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.844+0000 7fa18e543700 1 -- 172.21.15.59:0/2454418121 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1880cacc0 con 0x7fa1881f09e0 2023-09-21T00:18:16.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.844+0000 7fa184ff9700 1 -- 172.21.15.59:0/2454418121 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa170003e20 con 0x7fa1881f09e0 2023-09-21T00:18:16.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.844+0000 7fa18e543700 1 -- 172.21.15.59:0/2454418121 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1880cb280 con 0x7fa1881f09e0 2023-09-21T00:18:16.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.845+0000 7fa18e543700 1 -- 172.21.15.59:0/2454418121 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa188067e50 con 0x7fa1881f09e0 2023-09-21T00:18:16.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.846+0000 7fa184ff9700 1 -- 172.21.15.59:0/2454418121 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fa170013470 con 0x7fa1881f09e0 2023-09-21T00:18:16.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.846+0000 7fa184ff9700 1 --2- 172.21.15.59:0/2454418121 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa16806ae00 0x7fa16806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:16.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.846+0000 7fa184ff9700 1 -- 172.21.15.59:0/2454418121 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6836+0+0 (secure 0 0 0) 0x7fa17008b5a0 con 0x7fa1881f09e0 2023-09-21T00:18:16.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.846+0000 7fa187fff700 1 --2- 172.21.15.59:0/2454418121 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa16806ae00 0x7fa16806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:16.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.847+0000 7fa187fff700 1 --2- 172.21.15.59:0/2454418121 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa16806ae00 0x7fa16806d2c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa178009df0 tx=0x7fa178008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:16.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:16.851+0000 7fa184ff9700 1 -- 172.21.15.59:0/2454418121 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fa1700562e0 con 0x7fa1881f09e0 2023-09-21T00:18:17.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.049+0000 7fa18e543700 1 -- 172.21.15.59:0/2454418121 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa1880ce5b0 con 0x7fa1881f09e0 2023-09-21T00:18:17.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.693+0000 7fa184ff9700 1 -- 172.21.15.59:0/2454418121 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa170059900 con 0x7fa1881f09e0 2023-09-21T00:18:17.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.696+0000 7fa18e543700 1 -- 172.21.15.59:0/2454418121 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa16806ae00 msgr2=0x7fa16806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:17.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.696+0000 7fa18e543700 1 --2- 172.21.15.59:0/2454418121 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa16806ae00 0x7fa16806d2c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa178009df0 tx=0x7fa178008040 comp rx=0 tx=0).stop 2023-09-21T00:18:17.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.696+0000 7fa18e543700 1 -- 172.21.15.59:0/2454418121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1881f09e0 msgr2=0x7fa1880c82f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:17.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.696+0000 7fa18e543700 1 --2- 172.21.15.59:0/2454418121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1881f09e0 0x7fa1880c82f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa17000ebc0 tx=0x7fa1700047c0 comp rx=0 tx=0).stop 2023-09-21T00:18:17.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.696+0000 7fa18e543700 1 -- 172.21.15.59:0/2454418121 shutdown_connections 2023-09-21T00:18:17.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.696+0000 7fa18e543700 1 --2- 172.21.15.59:0/2454418121 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa16806ae00 0x7fa16806d2c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:17.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.696+0000 7fa18e543700 1 --2- 172.21.15.59:0/2454418121 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1880c8830 0x7fa1881f4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:17.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.696+0000 7fa18e543700 1 --2- 172.21.15.59:0/2454418121 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa174004850 0x7fa1881f04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:17.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.696+0000 7fa18e543700 1 --2- 172.21.15.59:0/2454418121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1881f09e0 0x7fa1880c82f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:17.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.696+0000 7fa18e543700 1 -- 172.21.15.59:0/2454418121 >> 172.21.15.59:0/2454418121 conn(0x7fa1880703e0 msgr2=0x7fa1880707c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:17.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.696+0000 7fa18e543700 1 -- 172.21.15.59:0/2454418121 shutdown_connections 2023-09-21T00:18:17.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.696+0000 7fa18e543700 1 -- 172.21.15.59:0/2454418121 wait complete. 2023-09-21T00:18:17.700 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' removed 2023-09-21T00:18:17.713 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-09-21T00:18:17.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.848+0000 7fd023a2e700 1 Processor -- start 2023-09-21T00:18:17.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.849+0000 7fd023a2e700 1 -- start start 2023-09-21T00:18:17.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.849+0000 7fd023a2e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd01c0cd720 0x7fd01c06eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:17.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.850+0000 7fd023a2e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd01c161690 con 0x7fd01c0cdd50 2023-09-21T00:18:17.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.850+0000 7fd023a2e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd01c158170 con 0x7fd01c161b20 2023-09-21T00:18:17.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.850+0000 7fd023a2e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd01c06f3d0 con 0x7fd01c0cd720 2023-09-21T00:18:17.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.850+0000 7fd020fc9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd01c0cd720 0x7fd01c06eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:17.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.850+0000 7fd0217ca700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd01c0cdd50 0x7fd01c0ce130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58700/0 (socket says 172.21.15.59:58700) 2023-09-21T00:18:17.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.850+0000 7fd0217ca700 1 -- 172.21.15.59:0/2794103523 learned_addr learned my addr 172.21.15.59:0/2794103523 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:17.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.850+0000 7fd020fc9700 1 --2- 172.21.15.59:0/2794103523 >> v2:172.21.15.59:3300/0 conn(0x7fd01c0cd720 0x7fd01c06eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53134/0 (socket says 172.21.15.59:53134) 2023-09-21T00:18:17.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.850+0000 7fd020fc9700 1 -- 172.21.15.59:0/2794103523 >> v1:172.21.15.83:6789/0 conn(0x7fd01c161b20 legacy=0x7fd01c15dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:17.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.850+0000 7fd020fc9700 1 -- 172.21.15.59:0/2794103523 >> v1:172.21.15.59:6789/0 conn(0x7fd01c0cdd50 legacy=0x7fd01c0ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:17.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.850+0000 7fd013fff700 1 -- 172.21.15.59:0/2794103523 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4237343061 0 0) 0x7fd01c161690 con 0x7fd01c0cdd50 2023-09-21T00:18:17.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.850+0000 7fd020fc9700 1 -- 172.21.15.59:0/2794103523 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd01c06f6b0 con 0x7fd01c0cd720 2023-09-21T00:18:17.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.850+0000 7fd020fc9700 1 --2- 172.21.15.59:0/2794103523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd01c0cd720 0x7fd01c06eb80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd00c009840 tx=0x7fd00c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4074d7846c3d430 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:17.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.850+0000 7fd013fff700 1 -- 172.21.15.59:0/2794103523 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00c004230 con 0x7fd01c0cd720 2023-09-21T00:18:17.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.850+0000 7fd013fff700 1 -- 172.21.15.59:0/2794103523 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd00c004390 con 0x7fd01c0cd720 2023-09-21T00:18:17.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.850+0000 7fd013fff700 1 -- 172.21.15.59:0/2794103523 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00c0036a0 con 0x7fd01c0cd720 2023-09-21T00:18:17.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.851+0000 7fd023a2e700 1 -- 172.21.15.59:0/2794103523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd01c0cd720 msgr2=0x7fd01c06eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:17.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.851+0000 7fd023a2e700 1 --2- 172.21.15.59:0/2794103523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd01c0cd720 0x7fd01c06eb80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd00c009840 tx=0x7fd00c009b50 comp rx=0 tx=0).stop 2023-09-21T00:18:17.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.851+0000 7fd023a2e700 1 -- 172.21.15.59:0/2794103523 shutdown_connections 2023-09-21T00:18:17.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.851+0000 7fd023a2e700 1 --2- 172.21.15.59:0/2794103523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd01c0cd720 0x7fd01c06eb80 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:17.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.851+0000 7fd023a2e700 1 -- 172.21.15.59:0/2794103523 >> 172.21.15.59:0/2794103523 conn(0x7fd01c0ccc00 msgr2=0x7fd01c0cd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:17.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.851+0000 7fd023a2e700 1 -- 172.21.15.59:0/2794103523 shutdown_connections 2023-09-21T00:18:17.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.851+0000 7fd023a2e700 1 -- 172.21.15.59:0/2794103523 wait complete. 2023-09-21T00:18:17.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.852+0000 7fd023a2e700 1 Processor -- start 2023-09-21T00:18:17.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.852+0000 7fd023a2e700 1 -- start start 2023-09-21T00:18:17.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.853+0000 7fd023a2e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd01c0cd720 0x7fd01c0ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:17.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.853+0000 7fd023a2e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd01c0cdd50 0x7fd01c0acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:17.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.853+0000 7fd023a2e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd01c161b20 0x7fd01c1f2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:17.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.853+0000 7fd023a2e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd01c146370 con 0x7fd01c161b20 2023-09-21T00:18:17.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.853+0000 7fd023a2e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd01c146610 con 0x7fd01c0cdd50 2023-09-21T00:18:17.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.853+0000 7fd023a2e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd01c1468f0 con 0x7fd01c0cd720 2023-09-21T00:18:17.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.853+0000 7fd021fcb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd01c161b20 0x7fd01c1f2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:17.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.853+0000 7fd021fcb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd01c161b20 0x7fd01c1f2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53142/0 (socket says 172.21.15.59:53142) 2023-09-21T00:18:17.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.853+0000 7fd021fcb700 1 -- 172.21.15.59:0/497103362 learned_addr learned my addr 172.21.15.59:0/497103362 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:17.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.853+0000 7fd0217ca700 1 --2- 172.21.15.59:0/497103362 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd01c0cd720 0x7fd01c0ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:17.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.853+0000 7fd020fc9700 1 --2- 172.21.15.59:0/497103362 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd01c0cdd50 0x7fd01c0acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:17.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.853+0000 7fd021fcb700 1 -- 172.21.15.59:0/497103362 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd01c0cd720 msgr2=0x7fd01c0ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:17.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.853+0000 7fd021fcb700 1 --2- 172.21.15.59:0/497103362 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd01c0cd720 0x7fd01c0ac890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:17.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.853+0000 7fd021fcb700 1 -- 172.21.15.59:0/497103362 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd01c0cdd50 msgr2=0x7fd01c0acdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:17.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.853+0000 7fd021fcb700 1 --2- 172.21.15.59:0/497103362 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd01c0cdd50 0x7fd01c0acdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:17.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.853+0000 7fd021fcb700 1 -- 172.21.15.59:0/497103362 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd00c0094a0 con 0x7fd01c161b20 2023-09-21T00:18:17.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.853+0000 7fd020fc9700 1 --2- 172.21.15.59:0/497103362 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd01c0cdd50 0x7fd01c0acdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:18:17.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.853+0000 7fd021fcb700 1 --2- 172.21.15.59:0/497103362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd01c161b20 0x7fd01c1f2f60 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd01400b970 tx=0x7fd01400bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:17.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.854+0000 7fd011ffb700 1 -- 172.21.15.59:0/497103362 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01400c930 con 0x7fd01c161b20 2023-09-21T00:18:17.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.854+0000 7fd011ffb700 1 -- 172.21.15.59:0/497103362 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd01400cad0 con 0x7fd01c161b20 2023-09-21T00:18:17.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.854+0000 7fd023a2e700 1 -- 172.21.15.59:0/497103362 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd01c146bd0 con 0x7fd01c161b20 2023-09-21T00:18:17.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.854+0000 7fd011ffb700 1 -- 172.21.15.59:0/497103362 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01400ce80 con 0x7fd01c161b20 2023-09-21T00:18:17.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.854+0000 7fd023a2e700 1 -- 172.21.15.59:0/497103362 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd01c1f2740 con 0x7fd01c161b20 2023-09-21T00:18:17.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.855+0000 7fd023a2e700 1 -- 172.21.15.59:0/497103362 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd01c1470f0 con 0x7fd01c161b20 2023-09-21T00:18:17.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.855+0000 7fd011ffb700 1 -- 172.21.15.59:0/497103362 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fd014014440 con 0x7fd01c161b20 2023-09-21T00:18:17.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.856+0000 7fd011ffb700 1 --2- 172.21.15.59:0/497103362 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd00006ae00 0x7fd00006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:17.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.856+0000 7fd011ffb700 1 -- 172.21.15.59:0/497103362 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6398+0+0 (secure 0 0 0) 0x7fd0140892a0 con 0x7fd01c161b20 2023-09-21T00:18:17.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.856+0000 7fd0217ca700 1 --2- 172.21.15.59:0/497103362 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd00006ae00 0x7fd00006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:17.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.856+0000 7fd0217ca700 1 --2- 172.21.15.59:0/497103362 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd00006ae00 0x7fd00006d2c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd018007fd0 tx=0x7fd018007de0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:17.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:17.860+0000 7fd011ffb700 1 -- 172.21.15.59:0/497103362 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fd01c1470f0 con 0x7fd01c161b20 2023-09-21T00:18:18.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:18.062+0000 7fd023a2e700 1 -- 172.21.15.59:0/497103362 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd01c1470f0 con 0x7fd01c161b20 2023-09-21T00:18:18.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:18.927+0000 7fd011ffb700 1 -- 172.21.15.59:0/497103362 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd01c1470f0 con 0x7fd01c161b20 2023-09-21T00:18:18.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:18.932+0000 7fd023a2e700 1 -- 172.21.15.59:0/497103362 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd00006ae00 msgr2=0x7fd00006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:18.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:18.932+0000 7fd023a2e700 1 --2- 172.21.15.59:0/497103362 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd00006ae00 0x7fd00006d2c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd018007fd0 tx=0x7fd018007de0 comp rx=0 tx=0).stop 2023-09-21T00:18:18.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:18.932+0000 7fd023a2e700 1 -- 172.21.15.59:0/497103362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd01c161b20 msgr2=0x7fd01c1f2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:18.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:18.932+0000 7fd023a2e700 1 --2- 172.21.15.59:0/497103362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd01c161b20 0x7fd01c1f2f60 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd01400b970 tx=0x7fd01400bc80 comp rx=0 tx=0).stop 2023-09-21T00:18:18.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:18.932+0000 7fd023a2e700 1 -- 172.21.15.59:0/497103362 shutdown_connections 2023-09-21T00:18:18.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:18.932+0000 7fd023a2e700 1 --2- 172.21.15.59:0/497103362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd01c161b20 0x7fd01c1f2f60 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:18.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:18.932+0000 7fd023a2e700 1 --2- 172.21.15.59:0/497103362 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd00006ae00 0x7fd00006d2c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:18.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:18.932+0000 7fd023a2e700 1 --2- 172.21.15.59:0/497103362 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd01c0cd720 0x7fd01c0ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:18.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:18.932+0000 7fd023a2e700 1 --2- 172.21.15.59:0/497103362 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd01c0cdd50 0x7fd01c0acdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:18.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:18.933+0000 7fd023a2e700 1 -- 172.21.15.59:0/497103362 >> 172.21.15.59:0/497103362 conn(0x7fd01c0ccc00 msgr2=0x7fd01c0ce130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:18.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:18.933+0000 7fd023a2e700 1 -- 172.21.15.59:0/497103362 shutdown_connections 2023-09-21T00:18:18.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:18.933+0000 7fd023a2e700 1 -- 172.21.15.59:0/497103362 wait complete. 2023-09-21T00:18:18.937 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' removed 2023-09-21T00:18:18.952 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-09-21T00:18:19.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.087+0000 7fece0265700 1 Processor -- start 2023-09-21T00:18:19.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.087+0000 7fece0265700 1 -- start start 2023-09-21T00:18:19.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.088+0000 7fece0265700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fecd8070e50 0x7fecd8071230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:19.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.088+0000 7fece0265700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fecd80cbc30 0x7fecd806ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:19.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.088+0000 7fece0265700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd8071770 con 0x7fecd80cb7d0 2023-09-21T00:18:19.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.088+0000 7fece0265700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecd80caa10 con 0x7fecd8070e50 2023-09-21T00:18:19.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.088+0000 7fece0265700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd80cacf0 con 0x7fecd80cbc30 2023-09-21T00:18:19.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.088+0000 7fecdd800700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fecd80cb7d0 0x7fecd80ce0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58714/0 (socket says 172.21.15.59:58714) 2023-09-21T00:18:19.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.088+0000 7fecdd800700 1 -- 172.21.15.59:0/3731321215 learned_addr learned my addr 172.21.15.59:0/3731321215 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:19.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.089+0000 7fecde001700 1 --2- 172.21.15.59:0/3731321215 >> v2:172.21.15.59:3300/0 conn(0x7fecd8070e50 0x7fecd8071230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:19.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.089+0000 7fecde802700 1 --2- 172.21.15.59:0/3731321215 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fecd80cbc30 0x7fecd806ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:19.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.089+0000 7fecdcfff700 1 -- 172.21.15.59:0/3731321215 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2809398677 0 0) 0x7fecd8071770 con 0x7fecd80cb7d0 2023-09-21T00:18:19.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.089+0000 7fecdcfff700 1 -- 172.21.15.59:0/3731321215 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecc40035b0 con 0x7fecd80cb7d0 2023-09-21T00:18:19.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.089+0000 7fecde001700 1 -- 172.21.15.59:0/3731321215 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fecd80cbc30 msgr2=0x7fecd806ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:19.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.089+0000 7fecde001700 1 --2- 172.21.15.59:0/3731321215 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fecd80cbc30 0x7fecd806ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:19.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.089+0000 7fecde001700 1 -- 172.21.15.59:0/3731321215 >> v1:172.21.15.59:6789/0 conn(0x7fecd80cb7d0 legacy=0x7fecd80ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:19.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.089+0000 7fecde001700 1 -- 172.21.15.59:0/3731321215 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd80cafd0 con 0x7fecd8070e50 2023-09-21T00:18:19.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.089+0000 7fecde001700 1 --2- 172.21.15.59:0/3731321215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecd8070e50 0x7fecd8071230 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fecd4009840 tx=0x7fecd4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ee5a0f22fbd616a server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:19.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.089+0000 7fecdcfff700 1 -- 172.21.15.59:0/3731321215 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd4011830 con 0x7fecd8070e50 2023-09-21T00:18:19.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.089+0000 7fecdcfff700 1 -- 172.21.15.59:0/3731321215 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd4011990 con 0x7fecd8070e50 2023-09-21T00:18:19.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.089+0000 7fecdcfff700 1 -- 172.21.15.59:0/3731321215 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd4011d20 con 0x7fecd8070e50 2023-09-21T00:18:19.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.090+0000 7fece0265700 1 -- 172.21.15.59:0/3731321215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecd8070e50 msgr2=0x7fecd8071230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:19.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.090+0000 7fece0265700 1 --2- 172.21.15.59:0/3731321215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecd8070e50 0x7fecd8071230 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fecd4009840 tx=0x7fecd4009b50 comp rx=0 tx=0).stop 2023-09-21T00:18:19.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.090+0000 7fece0265700 1 -- 172.21.15.59:0/3731321215 shutdown_connections 2023-09-21T00:18:19.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.090+0000 7fece0265700 1 --2- 172.21.15.59:0/3731321215 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fecd80cbc30 0x7fecd806ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:19.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.090+0000 7fece0265700 1 --2- 172.21.15.59:0/3731321215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecd8070e50 0x7fecd8071230 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:19.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.090+0000 7fece0265700 1 -- 172.21.15.59:0/3731321215 >> 172.21.15.59:0/3731321215 conn(0x7fecd80cf8f0 msgr2=0x7fecd80cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:19.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.090+0000 7fece0265700 1 -- 172.21.15.59:0/3731321215 shutdown_connections 2023-09-21T00:18:19.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.090+0000 7fece0265700 1 -- 172.21.15.59:0/3731321215 wait complete. 2023-09-21T00:18:19.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.091+0000 7fece0265700 1 Processor -- start 2023-09-21T00:18:19.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.091+0000 7fece0265700 1 -- start start 2023-09-21T00:18:19.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.092+0000 7fece0265700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fecd8070e50 0x7fecd80c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:19.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.092+0000 7fece0265700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fecd80cb7d0 0x7fecd80c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:19.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.092+0000 7fece0265700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecd80cbc30 0x7fecd81539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:19.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.092+0000 7fece0265700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd80c8100 con 0x7fecd80cbc30 2023-09-21T00:18:19.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.092+0000 7fece0265700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd80c83e0 con 0x7fecd8070e50 2023-09-21T00:18:19.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.092+0000 7fece0265700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd80c86c0 con 0x7fecd80cb7d0 2023-09-21T00:18:19.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.092+0000 7fecde802700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecd80cbc30 0x7fecd81539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:19.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.092+0000 7fecde802700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecd80cbc30 0x7fecd81539b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53156/0 (socket says 172.21.15.59:53156) 2023-09-21T00:18:19.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.092+0000 7fecde802700 1 -- 172.21.15.59:0/1730815960 learned_addr learned my addr 172.21.15.59:0/1730815960 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:19.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.092+0000 7fecdd800700 1 --2- 172.21.15.59:0/1730815960 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fecd80cb7d0 0x7fecd80c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:19.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.092+0000 7fecde001700 1 --2- 172.21.15.59:0/1730815960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fecd8070e50 0x7fecd80c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:19.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.092+0000 7fecde802700 1 -- 172.21.15.59:0/1730815960 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fecd80cb7d0 msgr2=0x7fecd80c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:19.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.092+0000 7fecde802700 1 --2- 172.21.15.59:0/1730815960 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fecd80cb7d0 0x7fecd80c5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:19.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.092+0000 7fecde802700 1 -- 172.21.15.59:0/1730815960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fecd8070e50 msgr2=0x7fecd80c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:19.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.092+0000 7fecde802700 1 --2- 172.21.15.59:0/1730815960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fecd8070e50 0x7fecd80c7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:19.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.092+0000 7fecde802700 1 -- 172.21.15.59:0/1730815960 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd40094a0 con 0x7fecd80cbc30 2023-09-21T00:18:19.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.093+0000 7fecde802700 1 --2- 172.21.15.59:0/1730815960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecd80cbc30 0x7fecd81539b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fecd000efc0 tx=0x7fecd000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:19.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.093+0000 7fecce7fc700 1 -- 172.21.15.59:0/1730815960 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd000cd40 con 0x7fecd80cbc30 2023-09-21T00:18:19.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.093+0000 7fecce7fc700 1 -- 172.21.15.59:0/1730815960 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd000f040 con 0x7fecd80cbc30 2023-09-21T00:18:19.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.093+0000 7fece0265700 1 -- 172.21.15.59:0/1730815960 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd80c89a0 con 0x7fecd80cbc30 2023-09-21T00:18:19.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.093+0000 7fecce7fc700 1 -- 172.21.15.59:0/1730815960 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd00146c0 con 0x7fecd80cbc30 2023-09-21T00:18:19.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.093+0000 7fece0265700 1 -- 172.21.15.59:0/1730815960 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd80b25d0 con 0x7fecd80cbc30 2023-09-21T00:18:19.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.094+0000 7fece0265700 1 -- 172.21.15.59:0/1730815960 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecd80c8ec0 con 0x7fecd80cbc30 2023-09-21T00:18:19.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.094+0000 7fecce7fc700 1 -- 172.21.15.59:0/1730815960 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fecd0014820 con 0x7fecd80cbc30 2023-09-21T00:18:19.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.095+0000 7fecce7fc700 1 --2- 172.21.15.59:0/1730815960 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fecbc06ae00 0x7fecbc06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:19.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.095+0000 7fecce7fc700 1 -- 172.21.15.59:0/1730815960 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5781+0+0 (secure 0 0 0) 0x7fecd0089e90 con 0x7fecd80cbc30 2023-09-21T00:18:19.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.095+0000 7fecde001700 1 --2- 172.21.15.59:0/1730815960 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fecbc06ae00 0x7fecbc06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:19.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.095+0000 7fecde001700 1 --2- 172.21.15.59:0/1730815960 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fecbc06ae00 0x7fecbc06d2c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fecd4000c00 tx=0x7fecd401c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:19.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.099+0000 7fecce7fc700 1 -- 172.21.15.59:0/1730815960 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fecd80c8ec0 con 0x7fecd80cbc30 2023-09-21T00:18:19.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.308+0000 7fece0265700 1 -- 172.21.15.59:0/1730815960 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fecd80c8ec0 con 0x7fecd80cbc30 2023-09-21T00:18:19.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.931+0000 7fecce7fc700 1 -- 172.21.15.59:0/1730815960 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) v1 ==== 178+0+0 (secure 0 0 0) 0x7fecd80c8ec0 con 0x7fecd80cbc30 2023-09-21T00:18:19.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.935+0000 7fece0265700 1 -- 172.21.15.59:0/1730815960 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fecbc06ae00 msgr2=0x7fecbc06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:19.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.935+0000 7fece0265700 1 --2- 172.21.15.59:0/1730815960 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fecbc06ae00 0x7fecbc06d2c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fecd4000c00 tx=0x7fecd401c040 comp rx=0 tx=0).stop 2023-09-21T00:18:19.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.935+0000 7fece0265700 1 -- 172.21.15.59:0/1730815960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecd80cbc30 msgr2=0x7fecd81539b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:19.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.935+0000 7fece0265700 1 --2- 172.21.15.59:0/1730815960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecd80cbc30 0x7fecd81539b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fecd000efc0 tx=0x7fecd000c3a0 comp rx=0 tx=0).stop 2023-09-21T00:18:19.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.935+0000 7fece0265700 1 -- 172.21.15.59:0/1730815960 shutdown_connections 2023-09-21T00:18:19.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.935+0000 7fece0265700 1 --2- 172.21.15.59:0/1730815960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecd80cbc30 0x7fecd81539b0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:19.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.935+0000 7fece0265700 1 --2- 172.21.15.59:0/1730815960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fecd8070e50 0x7fecd80c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:19.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.935+0000 7fece0265700 1 --2- 172.21.15.59:0/1730815960 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fecbc06ae00 0x7fecbc06d2c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:19.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.935+0000 7fece0265700 1 --2- 172.21.15.59:0/1730815960 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fecd80cb7d0 0x7fecd80c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:19.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.935+0000 7fece0265700 1 -- 172.21.15.59:0/1730815960 >> 172.21.15.59:0/1730815960 conn(0x7fecd80cf8f0 msgr2=0x7fecd80afe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:19.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.935+0000 7fece0265700 1 -- 172.21.15.59:0/1730815960 shutdown_connections 2023-09-21T00:18:19.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:19.935+0000 7fece0265700 1 -- 172.21.15.59:0/1730815960 wait complete. 2023-09-21T00:18:19.939 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data_ec' removed 2023-09-21T00:18:19.953 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-21T00:18:19.953 INFO:tasks.ceph.mds.a:Stopping old one... 2023-09-21T00:18:19.953 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-21T00:18:19.954 INFO:teuthology.orchestra.run:waiting for 300 2023-09-21T00:18:19.954 INFO:tasks.ceph.mds.c:Restarting daemon 2023-09-21T00:18:19.954 INFO:tasks.ceph.mds.c:Stopping old one... 2023-09-21T00:18:19.955 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-09-21T00:18:19.955 INFO:teuthology.orchestra.run:waiting for 300 2023-09-21T00:18:19.955 INFO:tasks.ceph.mds.b:Restarting daemon 2023-09-21T00:18:19.956 INFO:tasks.ceph.mds.b:Stopping old one... 2023-09-21T00:18:19.956 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-09-21T00:18:19.956 INFO:teuthology.orchestra.run:waiting for 300 2023-09-21T00:18:19.956 INFO:tasks.ceph.mds.d:Restarting daemon 2023-09-21T00:18:19.957 INFO:tasks.ceph.mds.d:Stopping old one... 2023-09-21T00:18:19.957 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-09-21T00:18:19.957 INFO:teuthology.orchestra.run:waiting for 300 2023-09-21T00:18:19.963 INFO:tasks.ceph.mds.a:Stopped 2023-09-21T00:18:19.964 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-21T00:18:19.965 INFO:tasks.ceph.mds.c:Stopped 2023-09-21T00:18:19.966 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-09-21T00:18:19.967 INFO:tasks.ceph.mds.b:Stopped 2023-09-21T00:18:19.968 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-09-21T00:18:19.969 INFO:tasks.ceph.mds.d:Stopped 2023-09-21T00:18:19.969 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-09-21T00:18:20.006 INFO:tasks.ceph.mds.a:Started 2023-09-21T00:18:20.007 DEBUG:teuthology.parallel:result is None 2023-09-21T00:18:20.008 INFO:tasks.ceph.mds.c:Started 2023-09-21T00:18:20.008 DEBUG:teuthology.parallel:result is None 2023-09-21T00:18:20.010 INFO:tasks.ceph.mds.b:Started 2023-09-21T00:18:20.011 DEBUG:teuthology.parallel:result is None 2023-09-21T00:18:20.012 INFO:tasks.ceph.mds.d:Started 2023-09-21T00:18:20.012 DEBUG:teuthology.parallel:result is None 2023-09-21T00:18:20.012 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-09-21T00:18:20.092 INFO:tasks.ceph.mds.b.smithi083.stdout:starting mds.b at 2023-09-21T00:18:20.092 INFO:tasks.ceph.mds.d.smithi083.stdout:starting mds.d at 2023-09-21T00:18:20.097 INFO:tasks.ceph.mds.c.smithi059.stdout:starting mds.c at 2023-09-21T00:18:20.098 INFO:tasks.ceph.mds.a.smithi059.stdout:starting mds.a at 2023-09-21T00:18:20.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.151+0000 7f11c7c6b700 1 Processor -- start 2023-09-21T00:18:20.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.151+0000 7f11c7c6b700 1 -- start start 2023-09-21T00:18:20.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.152+0000 7f11c7c6b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f11c00cf350 0x7f11c00cf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:20.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.152+0000 7f11c7c6b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11c00cd260 con 0x7f11c00b4f30 2023-09-21T00:18:20.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.152+0000 7f11c7c6b700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11c00cd540 con 0x7f11c015d9c0 2023-09-21T00:18:20.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.152+0000 7f11c7c6b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c006efa0 con 0x7f11c00cf350 2023-09-21T00:18:20.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.152+0000 7f11c5206700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f11c00b4f30 0x7f11c00cca50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58758/0 (socket says 172.21.15.59:58758) 2023-09-21T00:18:20.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.152+0000 7f11c5206700 1 -- 172.21.15.59:0/2717001392 learned_addr learned my addr 172.21.15.59:0/2717001392 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:20.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.152+0000 7f11c6208700 1 --2- 172.21.15.59:0/2717001392 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f11c00cf350 0x7f11c00cf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:20.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.152+0000 7f11c4a05700 1 -- 172.21.15.59:0/2717001392 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4211048754 0 0) 0x7f11c00cd260 con 0x7f11c00b4f30 2023-09-21T00:18:20.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.152+0000 7f11c4a05700 1 -- 172.21.15.59:0/2717001392 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11ac0035b0 con 0x7f11c00b4f30 2023-09-21T00:18:20.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.152+0000 7f11c4a05700 1 -- 172.21.15.59:0/2717001392 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1023211855 0 0) 0x7f11c00cd540 con 0x7f11c015d9c0 2023-09-21T00:18:20.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.152+0000 7f11c4a05700 1 -- 172.21.15.59:0/2717001392 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11c00cd260 con 0x7f11c015d9c0 2023-09-21T00:18:20.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.152+0000 7f11c6208700 1 -- 172.21.15.59:0/2717001392 >> v1:172.21.15.83:6789/0 conn(0x7f11c015d9c0 legacy=0x7f11c00716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:20.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.152+0000 7f11c6208700 1 -- 172.21.15.59:0/2717001392 >> v1:172.21.15.59:6789/0 conn(0x7f11c00b4f30 legacy=0x7f11c00cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:20.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.152+0000 7f11c6208700 1 -- 172.21.15.59:0/2717001392 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c00cd820 con 0x7f11c00cf350 2023-09-21T00:18:20.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.152+0000 7f11c6208700 1 --2- 172.21.15.59:0/2717001392 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f11c00cf350 0x7f11c00cf800 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f11b8009dc0 tx=0x7f11b800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f47846fc371b8764 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:20.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.153+0000 7f11c4a05700 1 -- 172.21.15.59:0/2717001392 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b800e070 con 0x7f11c00cf350 2023-09-21T00:18:20.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.153+0000 7f11c4a05700 1 -- 172.21.15.59:0/2717001392 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b800bb20 con 0x7f11c00cf350 2023-09-21T00:18:20.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.153+0000 7f11c4a05700 1 -- 172.21.15.59:0/2717001392 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b8012430 con 0x7f11c00cf350 2023-09-21T00:18:20.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.153+0000 7f11c7c6b700 1 -- 172.21.15.59:0/2717001392 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f11c00cf350 msgr2=0x7f11c00cf800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:20.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.153+0000 7f11c7c6b700 1 --2- 172.21.15.59:0/2717001392 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f11c00cf350 0x7f11c00cf800 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f11b8009dc0 tx=0x7f11b800b330 comp rx=0 tx=0).stop 2023-09-21T00:18:20.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.153+0000 7f11c7c6b700 1 -- 172.21.15.59:0/2717001392 shutdown_connections 2023-09-21T00:18:20.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.153+0000 7f11c7c6b700 1 --2- 172.21.15.59:0/2717001392 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f11c00cf350 0x7f11c00cf800 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:20.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.153+0000 7f11c7c6b700 1 -- 172.21.15.59:0/2717001392 >> 172.21.15.59:0/2717001392 conn(0x7f11c00b1cf0 msgr2=0x7f11c00b2100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:20.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.153+0000 7f11c7c6b700 1 -- 172.21.15.59:0/2717001392 shutdown_connections 2023-09-21T00:18:20.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.153+0000 7f11c7c6b700 1 -- 172.21.15.59:0/2717001392 wait complete. 2023-09-21T00:18:20.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.154+0000 7f11c7c6b700 1 Processor -- start 2023-09-21T00:18:20.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.155+0000 7f11c7c6b700 1 -- start start 2023-09-21T00:18:20.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.155+0000 7f11c7c6b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f11c00b4f30 0x7f11c0144b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:20.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.155+0000 7f11c7c6b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f11c00cf350 0x7f11c00b0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:20.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.155+0000 7f11c7c6b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11c015d9c0 0x7f11c00aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:20.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.155+0000 7f11c7c6b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c0145050 con 0x7f11c015d9c0 2023-09-21T00:18:20.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.155+0000 7f11c7c6b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c00b1380 con 0x7f11c00b4f30 2023-09-21T00:18:20.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.155+0000 7f11c7c6b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c00ade30 con 0x7f11c00cf350 2023-09-21T00:18:20.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.155+0000 7f11c6208700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11c015d9c0 0x7f11c00aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:20.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.155+0000 7f11c6208700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11c015d9c0 0x7f11c00aeed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53198/0 (socket says 172.21.15.59:53198) 2023-09-21T00:18:20.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.155+0000 7f11c6208700 1 -- 172.21.15.59:0/3144463305 learned_addr learned my addr 172.21.15.59:0/3144463305 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:20.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.155+0000 7f11c5a07700 1 --2- 172.21.15.59:0/3144463305 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f11c00b4f30 0x7f11c0144b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:20.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.155+0000 7f11c5206700 1 --2- 172.21.15.59:0/3144463305 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f11c00cf350 0x7f11c00b0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:20.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.156+0000 7f11c6208700 1 -- 172.21.15.59:0/3144463305 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f11c00cf350 msgr2=0x7f11c00b0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:20.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.156+0000 7f11c6208700 1 --2- 172.21.15.59:0/3144463305 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f11c00cf350 0x7f11c00b0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:20.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.156+0000 7f11c6208700 1 -- 172.21.15.59:0/3144463305 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f11c00b4f30 msgr2=0x7f11c0144b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:20.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.156+0000 7f11c6208700 1 --2- 172.21.15.59:0/3144463305 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f11c00b4f30 0x7f11c0144b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:20.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.156+0000 7f11c6208700 1 -- 172.21.15.59:0/3144463305 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b8009a70 con 0x7f11c015d9c0 2023-09-21T00:18:20.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.156+0000 7f11c6208700 1 --2- 172.21.15.59:0/3144463305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11c015d9c0 0x7f11c00aeed0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f11b8014040 tx=0x7f11b8004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:20.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.156+0000 7f11b67fc700 1 -- 172.21.15.59:0/3144463305 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b8012430 con 0x7f11c015d9c0 2023-09-21T00:18:20.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.156+0000 7f11b67fc700 1 -- 172.21.15.59:0/3144463305 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b8020070 con 0x7f11c015d9c0 2023-09-21T00:18:20.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.156+0000 7f11c7c6b700 1 -- 172.21.15.59:0/3144463305 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11c00ae110 con 0x7f11c015d9c0 2023-09-21T00:18:20.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.156+0000 7f11b67fc700 1 -- 172.21.15.59:0/3144463305 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b801ba90 con 0x7f11c015d9c0 2023-09-21T00:18:20.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.156+0000 7f11c7c6b700 1 -- 172.21.15.59:0/3144463305 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11c00ae6d0 con 0x7f11c015d9c0 2023-09-21T00:18:20.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.157+0000 7f11c7c6b700 1 -- 172.21.15.59:0/3144463305 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11c0067e50 con 0x7f11c015d9c0 2023-09-21T00:18:20.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.157+0000 7f11b67fc700 1 -- 172.21.15.59:0/3144463305 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f11b801bbf0 con 0x7f11c015d9c0 2023-09-21T00:18:20.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.158+0000 7f11b67fc700 1 --2- 172.21.15.59:0/3144463305 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f11a406ae00 0x7f11a406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:20.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.158+0000 7f11b67fc700 1 -- 172.21.15.59:0/3144463305 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f11b8022070 con 0x7f11c015d9c0 2023-09-21T00:18:20.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.158+0000 7f11c5a07700 1 --2- 172.21.15.59:0/3144463305 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f11a406ae00 0x7f11a406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:20.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.158+0000 7f11c5a07700 1 --2- 172.21.15.59:0/3144463305 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f11a406ae00 0x7f11a406d2c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f11bc001220 tx=0x7f11bc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:20.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.162+0000 7f11b67fc700 1 -- 172.21.15.59:0/3144463305 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f11b80568f0 con 0x7f11c015d9c0 2023-09-21T00:18:20.175 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-09-21T00:18:20.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.385+0000 7f11c7c6b700 1 -- 172.21.15.59:0/3144463305 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f11c0159360 con 0x7f11c015d9c0 2023-09-21T00:18:20.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.951+0000 7f11b67fc700 1 -- 172.21.15.59:0/3144463305 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v32) v1 ==== 97+0+0 (secure 0 0 0) 0x7f11b802c080 con 0x7f11c015d9c0 2023-09-21T00:18:20.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.954+0000 7f11c7c6b700 1 -- 172.21.15.59:0/3144463305 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f11a406ae00 msgr2=0x7f11a406d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:20.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.954+0000 7f11c7c6b700 1 --2- 172.21.15.59:0/3144463305 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f11a406ae00 0x7f11a406d2c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f11bc001220 tx=0x7f11bc009040 comp rx=0 tx=0).stop 2023-09-21T00:18:20.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.954+0000 7f11c7c6b700 1 -- 172.21.15.59:0/3144463305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11c015d9c0 msgr2=0x7f11c00aeed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:20.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.954+0000 7f11c7c6b700 1 --2- 172.21.15.59:0/3144463305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11c015d9c0 0x7f11c00aeed0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f11b8014040 tx=0x7f11b8004b20 comp rx=0 tx=0).stop 2023-09-21T00:18:20.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.954+0000 7f11c7c6b700 1 -- 172.21.15.59:0/3144463305 shutdown_connections 2023-09-21T00:18:20.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.954+0000 7f11c7c6b700 1 --2- 172.21.15.59:0/3144463305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11c015d9c0 0x7f11c00aeed0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:20.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.954+0000 7f11c7c6b700 1 --2- 172.21.15.59:0/3144463305 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f11c00b4f30 0x7f11c0144b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:20.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.954+0000 7f11c7c6b700 1 --2- 172.21.15.59:0/3144463305 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f11a406ae00 0x7f11a406d2c0 secure :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f11bc001220 tx=0x7f11bc009040 comp rx=0 tx=0).stop 2023-09-21T00:18:20.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.954+0000 7f11c7c6b700 1 --2- 172.21.15.59:0/3144463305 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f11c00cf350 0x7f11c00b0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:20.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.954+0000 7f11c7c6b700 1 -- 172.21.15.59:0/3144463305 >> 172.21.15.59:0/3144463305 conn(0x7f11c00b1cf0 msgr2=0x7f11c00b20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:20.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.954+0000 7f11c7c6b700 1 -- 172.21.15.59:0/3144463305 shutdown_connections 2023-09-21T00:18:20.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:20.954+0000 7f11c7c6b700 1 -- 172.21.15.59:0/3144463305 wait complete. 2023-09-21T00:18:20.958 INFO:teuthology.orchestra.run.smithi059.stderr: removed all blocklist entries 2023-09-21T00:18:20.971 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-09-21T00:18:21.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.102+0000 7f17d85ef700 1 Processor -- start 2023-09-21T00:18:21.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.102+0000 7f17d85ef700 1 -- start start 2023-09-21T00:18:21.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.103+0000 7f17d85ef700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f17d00cb980 0x7f17d00719d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:21.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.103+0000 7f17d85ef700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f17d015aeb0 0x7f17d015b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:21.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.103+0000 7f17d85ef700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17d0071540 con 0x7f17d006ce70 2023-09-21T00:18:21.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.103+0000 7f17d85ef700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17d0154c60 con 0x7f17d015aeb0 2023-09-21T00:18:21.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.103+0000 7f17d85ef700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17d00cc0f0 con 0x7f17d00cb980 2023-09-21T00:18:21.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.103+0000 7f17d6b8c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f17d015aeb0 0x7f17d015b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:21.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.103+0000 7f17d638b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f17d006ce70 0x7f17d006d250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58770/0 (socket says 172.21.15.59:58770) 2023-09-21T00:18:21.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.103+0000 7f17d638b700 1 -- 172.21.15.59:0/2837412152 learned_addr learned my addr 172.21.15.59:0/2837412152 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:21.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.103+0000 7f17d5b8a700 1 --2- 172.21.15.59:0/2837412152 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f17d00cb980 0x7f17d00719d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:21.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.103+0000 7f17d6b8c700 1 -- 172.21.15.59:0/2837412152 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f17d00cb980 msgr2=0x7f17d00719d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:21.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.103+0000 7f17d6b8c700 1 --2- 172.21.15.59:0/2837412152 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f17d00cb980 0x7f17d00719d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:21.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.103+0000 7f17d6b8c700 1 -- 172.21.15.59:0/2837412152 >> v1:172.21.15.59:6789/0 conn(0x7f17d006ce70 legacy=0x7f17d006d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:21.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.103+0000 7f17d5389700 1 -- 172.21.15.59:0/2837412152 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1196943589 0 0) 0x7f17d0071540 con 0x7f17d006ce70 2023-09-21T00:18:21.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.103+0000 7f17d6b8c700 1 -- 172.21.15.59:0/2837412152 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d00cbe10 con 0x7f17d015aeb0 2023-09-21T00:18:21.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.103+0000 7f17d6b8c700 1 --2- 172.21.15.59:0/2837412152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17d015aeb0 0x7f17d015b340 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f17c8009dc0 tx=0x7f17c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aefe6e66480d1dd2 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:21.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.104+0000 7f17d5389700 1 -- 172.21.15.59:0/2837412152 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c800e070 con 0x7f17d015aeb0 2023-09-21T00:18:21.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.104+0000 7f17d5389700 1 -- 172.21.15.59:0/2837412152 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17c800bb90 con 0x7f17d015aeb0 2023-09-21T00:18:21.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.104+0000 7f17d5389700 1 -- 172.21.15.59:0/2837412152 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c8012430 con 0x7f17d015aeb0 2023-09-21T00:18:21.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.104+0000 7f17d85ef700 1 -- 172.21.15.59:0/2837412152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17d015aeb0 msgr2=0x7f17d015b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:21.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.104+0000 7f17d85ef700 1 --2- 172.21.15.59:0/2837412152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17d015aeb0 0x7f17d015b340 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f17c8009dc0 tx=0x7f17c800b330 comp rx=0 tx=0).stop 2023-09-21T00:18:21.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.104+0000 7f17d85ef700 1 -- 172.21.15.59:0/2837412152 shutdown_connections 2023-09-21T00:18:21.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.104+0000 7f17d85ef700 1 --2- 172.21.15.59:0/2837412152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17d015aeb0 0x7f17d015b340 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:21.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.104+0000 7f17d85ef700 1 --2- 172.21.15.59:0/2837412152 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f17d00cb980 0x7f17d00719d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:21.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.104+0000 7f17d85ef700 1 -- 172.21.15.59:0/2837412152 >> 172.21.15.59:0/2837412152 conn(0x7f17d006a780 msgr2=0x7f17d006ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:21.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.104+0000 7f17d85ef700 1 -- 172.21.15.59:0/2837412152 shutdown_connections 2023-09-21T00:18:21.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.104+0000 7f17d85ef700 1 -- 172.21.15.59:0/2837412152 wait complete. 2023-09-21T00:18:21.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.106+0000 7f17d85ef700 1 Processor -- start 2023-09-21T00:18:21.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.106+0000 7f17d85ef700 1 -- start start 2023-09-21T00:18:21.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.107+0000 7f17d85ef700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17d006ce70 0x7f17d014c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:21.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.107+0000 7f17d85ef700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17d015aeb0 0x7f17d00cd500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:21.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.107+0000 7f17d85ef700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f17d00cda40 0x7f17d01f3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:21.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.107+0000 7f17d85ef700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d014cc90 con 0x7f17d015aeb0 2023-09-21T00:18:21.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.107+0000 7f17d85ef700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d01f4e60 con 0x7f17d006ce70 2023-09-21T00:18:21.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.107+0000 7f17d85ef700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17d01f48a0 con 0x7f17d00cda40 2023-09-21T00:18:21.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.107+0000 7f17d5b8a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17d015aeb0 0x7f17d00cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:21.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.107+0000 7f17d5b8a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17d015aeb0 0x7f17d00cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53210/0 (socket says 172.21.15.59:53210) 2023-09-21T00:18:21.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.107+0000 7f17d5b8a700 1 -- 172.21.15.59:0/97166404 learned_addr learned my addr 172.21.15.59:0/97166404 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:21.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.107+0000 7f17d638b700 1 --2- 172.21.15.59:0/97166404 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17d006ce70 0x7f17d014c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:21.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.107+0000 7f17d6b8c700 1 --2- 172.21.15.59:0/97166404 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f17d00cda40 0x7f17d01f3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:21.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.107+0000 7f17d5b8a700 1 -- 172.21.15.59:0/97166404 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f17d00cda40 msgr2=0x7f17d01f3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:21.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.107+0000 7f17d5b8a700 1 --2- 172.21.15.59:0/97166404 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f17d00cda40 0x7f17d01f3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:21.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.107+0000 7f17d5b8a700 1 -- 172.21.15.59:0/97166404 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17d006ce70 msgr2=0x7f17d014c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:21.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.107+0000 7f17d5b8a700 1 --2- 172.21.15.59:0/97166404 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17d006ce70 0x7f17d014c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:21.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.107+0000 7f17d5b8a700 1 -- 172.21.15.59:0/97166404 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c8009a70 con 0x7f17d015aeb0 2023-09-21T00:18:21.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.107+0000 7f17d638b700 1 --2- 172.21.15.59:0/97166404 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17d006ce70 0x7f17d014c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:18:21.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.107+0000 7f17d5b8a700 1 --2- 172.21.15.59:0/97166404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17d015aeb0 0x7f17d00cd500 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f17c000e810 tx=0x7f17c000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:21.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.108+0000 7f17c6ffd700 1 -- 172.21.15.59:0/97166404 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c0013610 con 0x7f17d015aeb0 2023-09-21T00:18:21.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.108+0000 7f17c6ffd700 1 -- 172.21.15.59:0/97166404 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17c0013770 con 0x7f17d015aeb0 2023-09-21T00:18:21.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.108+0000 7f17d85ef700 1 -- 172.21.15.59:0/97166404 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17d01f4b80 con 0x7f17d015aeb0 2023-09-21T00:18:21.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.108+0000 7f17c6ffd700 1 -- 172.21.15.59:0/97166404 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c0013b20 con 0x7f17d015aeb0 2023-09-21T00:18:21.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.108+0000 7f17d85ef700 1 -- 172.21.15.59:0/97166404 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17d0150800 con 0x7f17d015aeb0 2023-09-21T00:18:21.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.109+0000 7f17d85ef700 1 -- 172.21.15.59:0/97166404 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17d0150b70 con 0x7f17d015aeb0 2023-09-21T00:18:21.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.109+0000 7f17c6ffd700 1 -- 172.21.15.59:0/97166404 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f17c0013c80 con 0x7f17d015aeb0 2023-09-21T00:18:21.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.109+0000 7f17c6ffd700 1 --2- 172.21.15.59:0/97166404 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f17b406ae00 0x7f17b406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:21.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.109+0000 7f17c6ffd700 1 -- 172.21.15.59:0/97166404 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f17c0088fc0 con 0x7f17d015aeb0 2023-09-21T00:18:21.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.110+0000 7f17d638b700 1 --2- 172.21.15.59:0/97166404 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f17b406ae00 0x7f17b406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:21.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.110+0000 7f17d638b700 1 --2- 172.21.15.59:0/97166404 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f17b406ae00 0x7f17b406d2c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f17cc000f60 tx=0x7f17cc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:21.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.114+0000 7f17c6ffd700 1 -- 172.21.15.59:0/97166404 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f17c0054300 con 0x7f17d015aeb0 2023-09-21T00:18:21.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.396+0000 7f17d85ef700 1 -- 172.21.15.59:0/97166404 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f17d0150380 con 0x7f17d015aeb0 2023-09-21T00:18:21.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.397+0000 7f17c6ffd700 1 -- 172.21.15.59:0/97166404 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f17d0150380 con 0x7f17d015aeb0 2023-09-21T00:18:21.399 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:18:21.399 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-09-21T00:18:21.399 INFO:teuthology.orchestra.run.smithi059.stdout: "auth_dump": [ 2023-09-21T00:18:21.400 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-21T00:18:21.400 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.a", 2023-09-21T00:18:21.400 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQBJiwtlw0D+ChAAWfcndBINTMXjx+hl+CSizA==", 2023-09-21T00:18:21.400 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-09-21T00:18:21.400 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2023-09-21T00:18:21.401 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2023-09-21T00:18:21.401 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2023-09-21T00:18:21.401 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2023-09-21T00:18:21.401 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-21T00:18:21.401 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-21T00:18:21.402 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-21T00:18:21.402 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.b", 2023-09-21T00:18:21.402 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQBJiwtlCZZuFxAAUEckIhIAwgw2pM6+lr3evA==", 2023-09-21T00:18:21.402 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-09-21T00:18:21.403 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2023-09-21T00:18:21.403 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2023-09-21T00:18:21.403 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2023-09-21T00:18:21.403 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2023-09-21T00:18:21.403 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-21T00:18:21.404 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-21T00:18:21.404 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-21T00:18:21.404 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.c", 2023-09-21T00:18:21.404 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQBJiwtl4SZ2EhAAf597HcUEY3SYJsl63hTxlw==", 2023-09-21T00:18:21.404 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-09-21T00:18:21.405 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2023-09-21T00:18:21.405 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2023-09-21T00:18:21.405 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2023-09-21T00:18:21.405 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2023-09-21T00:18:21.405 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-21T00:18:21.406 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-21T00:18:21.406 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-21T00:18:21.406 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.d", 2023-09-21T00:18:21.406 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQBJiwtleyWzHhAA3sdBK+gE6tcuXwVflkkgqg==", 2023-09-21T00:18:21.407 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-09-21T00:18:21.407 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2023-09-21T00:18:21.407 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2023-09-21T00:18:21.407 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2023-09-21T00:18:21.408 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2023-09-21T00:18:21.408 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-21T00:18:21.408 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-21T00:18:21.408 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-21T00:18:21.409 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.0", 2023-09-21T00:18:21.409 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQBMiwtljCl3OxAAlNRfHJ4T3itWD1mIjDFbHw==", 2023-09-21T00:18:21.409 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-09-21T00:18:21.409 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2023-09-21T00:18:21.409 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2023-09-21T00:18:21.410 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2023-09-21T00:18:21.410 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-21T00:18:21.410 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-21T00:18:21.410 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-21T00:18:21.410 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.1", 2023-09-21T00:18:21.411 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQBPiwtlaqA0OxAA7e3B6okqEmKPgmROIWPjjQ==", 2023-09-21T00:18:21.411 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-09-21T00:18:21.411 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2023-09-21T00:18:21.411 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2023-09-21T00:18:21.412 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2023-09-21T00:18:21.412 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-21T00:18:21.412 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-21T00:18:21.412 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-21T00:18:21.413 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.2", 2023-09-21T00:18:21.413 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQBSiwtlhzwkOxAAuTVjW095MdBpNBwmiQ9jNA==", 2023-09-21T00:18:21.413 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-09-21T00:18:21.413 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2023-09-21T00:18:21.413 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2023-09-21T00:18:21.414 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2023-09-21T00:18:21.414 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-21T00:18:21.414 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-21T00:18:21.414 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-21T00:18:21.414 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.3", 2023-09-21T00:18:21.415 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQBViwtllM3+OhAANZQ3XCplUbMwMuwz1EzTOw==", 2023-09-21T00:18:21.415 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-09-21T00:18:21.415 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2023-09-21T00:18:21.415 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2023-09-21T00:18:21.415 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2023-09-21T00:18:21.416 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-21T00:18:21.416 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-21T00:18:21.416 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-21T00:18:21.416 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.4", 2023-09-21T00:18:21.416 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQBciwtlx8s1BRAABZhHLkVd3RqIuaGiUNvN5w==", 2023-09-21T00:18:21.417 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-09-21T00:18:21.417 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2023-09-21T00:18:21.417 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2023-09-21T00:18:21.417 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2023-09-21T00:18:21.418 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-21T00:18:21.418 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-21T00:18:21.418 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-21T00:18:21.418 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.5", 2023-09-21T00:18:21.418 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQBfiwtl4VgsBBAAcKu8F4OdWkgJTcyps7Q7Eg==", 2023-09-21T00:18:21.419 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-09-21T00:18:21.419 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2023-09-21T00:18:21.419 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2023-09-21T00:18:21.419 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2023-09-21T00:18:21.420 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-21T00:18:21.420 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-21T00:18:21.420 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-21T00:18:21.420 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.6", 2023-09-21T00:18:21.421 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQBiiwtlwvpyAxAATqz42Ry1jrYUNB/L0irmuA==", 2023-09-21T00:18:21.421 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-09-21T00:18:21.421 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2023-09-21T00:18:21.421 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2023-09-21T00:18:21.421 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2023-09-21T00:18:21.422 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-21T00:18:21.422 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-21T00:18:21.422 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-21T00:18:21.422 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.7", 2023-09-21T00:18:21.422 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQBliwtlxKqFAhAAwQLX/F6vM4vKGMrcHGhdbQ==", 2023-09-21T00:18:21.423 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-09-21T00:18:21.423 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2023-09-21T00:18:21.423 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2023-09-21T00:18:21.423 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2023-09-21T00:18:21.424 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-21T00:18:21.424 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-21T00:18:21.424 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-21T00:18:21.424 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.0", 2023-09-21T00:18:21.424 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQBJiwtlXkIrIxAAhtDnCTE6nihKV14aqR/afg==", 2023-09-21T00:18:21.425 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-09-21T00:18:21.425 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2023-09-21T00:18:21.425 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2023-09-21T00:18:21.425 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2023-09-21T00:18:21.425 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2023-09-21T00:18:21.426 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-21T00:18:21.426 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-21T00:18:21.426 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-21T00:18:21.426 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.1", 2023-09-21T00:18:21.427 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQBJiwtlUFb0KRAAcCweHS3wKHtVlWpG5YnRmw==", 2023-09-21T00:18:21.427 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-09-21T00:18:21.427 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2023-09-21T00:18:21.427 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2023-09-21T00:18:21.427 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2023-09-21T00:18:21.428 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2023-09-21T00:18:21.428 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-21T00:18:21.428 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-21T00:18:21.428 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-21T00:18:21.428 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.2", 2023-09-21T00:18:21.429 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQBJiwtlglecJhAAPPz7tn6HVHQPEuxtRq8BdQ==", 2023-09-21T00:18:21.429 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-09-21T00:18:21.429 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2023-09-21T00:18:21.429 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2023-09-21T00:18:21.429 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2023-09-21T00:18:21.430 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2023-09-21T00:18:21.430 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-21T00:18:21.430 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-21T00:18:21.430 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-21T00:18:21.431 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.3", 2023-09-21T00:18:21.431 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQBJiwtl78SdLxAA7Ub9eUe/K5DuRCQocyzOfw==", 2023-09-21T00:18:21.431 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-09-21T00:18:21.431 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2023-09-21T00:18:21.431 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2023-09-21T00:18:21.432 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2023-09-21T00:18:21.432 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2023-09-21T00:18:21.432 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-21T00:18:21.432 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-21T00:18:21.432 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-21T00:18:21.433 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.admin", 2023-09-21T00:18:21.433 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g==", 2023-09-21T00:18:21.433 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-09-21T00:18:21.433 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2023-09-21T00:18:21.433 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2023-09-21T00:18:21.434 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2023-09-21T00:18:21.434 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2023-09-21T00:18:21.434 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-21T00:18:21.434 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-21T00:18:21.435 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-21T00:18:21.435 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.bootstrap-mds", 2023-09-21T00:18:21.435 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQBriwtlwip4BBAAPeWIJ10fJ7csBWjPV9axow==", 2023-09-21T00:18:21.435 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-09-21T00:18:21.435 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile bootstrap-mds" 2023-09-21T00:18:21.436 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-21T00:18:21.436 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-21T00:18:21.436 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-21T00:18:21.436 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.bootstrap-mgr", 2023-09-21T00:18:21.436 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQBriwtlbDV4BBAAw2PpMhXw3z3RR0SlOmCzIw==", 2023-09-21T00:18:21.437 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-09-21T00:18:21.437 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile bootstrap-mgr" 2023-09-21T00:18:21.437 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-21T00:18:21.437 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-21T00:18:21.437 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-21T00:18:21.438 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.bootstrap-osd", 2023-09-21T00:18:21.438 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQBriwtliT94BBAAMPdffgT7aBpEV75+tOZk2g==", 2023-09-21T00:18:21.438 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-09-21T00:18:21.438 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile bootstrap-osd" 2023-09-21T00:18:21.438 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-21T00:18:21.439 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-21T00:18:21.439 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-21T00:18:21.439 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.bootstrap-rbd", 2023-09-21T00:18:21.439 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQBriwtl+kd4BBAA3mECuF57U47KGMbAdd45MQ==", 2023-09-21T00:18:21.439 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-09-21T00:18:21.440 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile bootstrap-rbd" 2023-09-21T00:18:21.440 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-21T00:18:21.440 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-21T00:18:21.440 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-21T00:18:21.441 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-09-21T00:18:21.441 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQBriwtlElJ4BBAA/lOjYwspmp6Vh1ahkHDUoQ==", 2023-09-21T00:18:21.441 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-09-21T00:18:21.441 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-09-21T00:18:21.441 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-21T00:18:21.442 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-21T00:18:21.442 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-21T00:18:21.442 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.bootstrap-rgw", 2023-09-21T00:18:21.442 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQBriwtlHFt4BBAAcwGJwQRm6/qrZzgxOrf62g==", 2023-09-21T00:18:21.443 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-09-21T00:18:21.443 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile bootstrap-rgw" 2023-09-21T00:18:21.443 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-21T00:18:21.443 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-21T00:18:21.443 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-21T00:18:21.444 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mgr.x", 2023-09-21T00:18:21.444 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQBJiwtlCfhmBxAAXsEbdz8lcIAeprDYoD11rw==", 2023-09-21T00:18:21.444 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-09-21T00:18:21.444 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2023-09-21T00:18:21.444 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile mgr", 2023-09-21T00:18:21.445 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2023-09-21T00:18:21.445 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-21T00:18:21.445 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-09-21T00:18:21.445 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-21T00:18:21.446 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mgr.y", 2023-09-21T00:18:21.446 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQBJiwtliA59AxAAY2guFGI8Yu3PZylz8SCj5g==", 2023-09-21T00:18:21.446 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-09-21T00:18:21.446 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2023-09-21T00:18:21.446 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile mgr", 2023-09-21T00:18:21.447 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2023-09-21T00:18:21.447 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-21T00:18:21.447 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-21T00:18:21.447 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-09-21T00:18:21.447 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-09-21T00:18:21.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.399+0000 7f17d85ef700 1 -- 172.21.15.59:0/97166404 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f17b406ae00 msgr2=0x7f17b406d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:21.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.399+0000 7f17d85ef700 1 --2- 172.21.15.59:0/97166404 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f17b406ae00 0x7f17b406d2c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f17cc000f60 tx=0x7f17cc009040 comp rx=0 tx=0).stop 2023-09-21T00:18:21.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.399+0000 7f17d85ef700 1 -- 172.21.15.59:0/97166404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17d015aeb0 msgr2=0x7f17d00cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:21.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.399+0000 7f17d85ef700 1 --2- 172.21.15.59:0/97166404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17d015aeb0 0x7f17d00cd500 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f17c000e810 tx=0x7f17c000ebd0 comp rx=0 tx=0).stop 2023-09-21T00:18:21.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.399+0000 7f17d85ef700 1 -- 172.21.15.59:0/97166404 shutdown_connections 2023-09-21T00:18:21.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.399+0000 7f17d85ef700 1 --2- 172.21.15.59:0/97166404 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f17b406ae00 0x7f17b406d2c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:21.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.399+0000 7f17d85ef700 1 --2- 172.21.15.59:0/97166404 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f17d00cda40 0x7f17d01f3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:21.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.399+0000 7f17d85ef700 1 --2- 172.21.15.59:0/97166404 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17d006ce70 0x7f17d014c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:21.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.399+0000 7f17d85ef700 1 --2- 172.21.15.59:0/97166404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17d015aeb0 0x7f17d00cd500 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:21.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.399+0000 7f17d85ef700 1 -- 172.21.15.59:0/97166404 >> 172.21.15.59:0/97166404 conn(0x7f17d006a780 msgr2=0x7f17d006d250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:21.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.399+0000 7f17d85ef700 1 -- 172.21.15.59:0/97166404 shutdown_connections 2023-09-21T00:18:21.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.399+0000 7f17d85ef700 1 -- 172.21.15.59:0/97166404 wait complete. 2023-09-21T00:18:21.452 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-09-21T00:18:21.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.578+0000 7f54caa4c700 1 Processor -- start 2023-09-21T00:18:21.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.578+0000 7f54caa4c700 1 -- start start 2023-09-21T00:18:21.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.579+0000 7f54caa4c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f54c415d520 0x7f54c40cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:21.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.579+0000 7f54caa4c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54c406a780 0x7f54c406ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:21.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.579+0000 7f54caa4c700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f54c4071920 0x7f54c4071db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:21.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.579+0000 7f54caa4c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c406b140 con 0x7f54c415d520 2023-09-21T00:18:21.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.579+0000 7f54caa4c700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c415d900 con 0x7f54c4071920 2023-09-21T00:18:21.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.579+0000 7f54caa4c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c40cdcb0 con 0x7f54c406a780 2023-09-21T00:18:21.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.579+0000 7f54c3fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f54c415d520 0x7f54c40cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:21.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.579+0000 7f54c3fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f54c415d520 0x7f54c40cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53216/0 (socket says 172.21.15.59:53216) 2023-09-21T00:18:21.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.579+0000 7f54c3fff700 1 -- 172.21.15.59:0/3022094151 learned_addr learned my addr 172.21.15.59:0/3022094151 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:21.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.579+0000 7f54c8fe9700 1 --2- 172.21.15.59:0/3022094151 >> v2:172.21.15.83:3300/0 conn(0x7f54c4071920 0x7f54c4071db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:21.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.579+0000 7f54c37fe700 1 --2- 172.21.15.59:0/3022094151 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54c406a780 0x7f54c406ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:21.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.579+0000 7f54c3fff700 1 -- 172.21.15.59:0/3022094151 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54c406a780 msgr2=0x7f54c406ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:21.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.579+0000 7f54c3fff700 1 --2- 172.21.15.59:0/3022094151 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54c406a780 0x7f54c406ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:21.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.580+0000 7f54c3fff700 1 -- 172.21.15.59:0/3022094151 >> v2:172.21.15.83:3300/0 conn(0x7f54c4071920 msgr2=0x7f54c4071db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:21.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.580+0000 7f54c3fff700 1 --2- 172.21.15.59:0/3022094151 >> v2:172.21.15.83:3300/0 conn(0x7f54c4071920 0x7f54c4071db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:21.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.580+0000 7f54c3fff700 1 -- 172.21.15.59:0/3022094151 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c40cdf90 con 0x7f54c415d520 2023-09-21T00:18:21.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.580+0000 7f54c8fe9700 1 --2- 172.21.15.59:0/3022094151 >> v2:172.21.15.83:3300/0 conn(0x7f54c4071920 0x7f54c4071db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:18:21.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.580+0000 7f54c3fff700 1 --2- 172.21.15.59:0/3022094151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54c415d520 0x7f54c40cea70 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f54c40afb30 tx=0x7f54ac009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f452a2d6e94e1f9 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:21.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.580+0000 7f54c2ffd700 1 -- 172.21.15.59:0/3022094151 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ac00b870 con 0x7f54c415d520 2023-09-21T00:18:21.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.580+0000 7f54c2ffd700 1 -- 172.21.15.59:0/3022094151 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54ac00b9d0 con 0x7f54c415d520 2023-09-21T00:18:21.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.580+0000 7f54c2ffd700 1 -- 172.21.15.59:0/3022094151 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ac00bd60 con 0x7f54c415d520 2023-09-21T00:18:21.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.580+0000 7f54caa4c700 1 -- 172.21.15.59:0/3022094151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54c415d520 msgr2=0x7f54c40cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:21.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.580+0000 7f54caa4c700 1 --2- 172.21.15.59:0/3022094151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54c415d520 0x7f54c40cea70 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f54c40afb30 tx=0x7f54ac009bd0 comp rx=0 tx=0).stop 2023-09-21T00:18:21.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.580+0000 7f54caa4c700 1 -- 172.21.15.59:0/3022094151 shutdown_connections 2023-09-21T00:18:21.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.580+0000 7f54caa4c700 1 --2- 172.21.15.59:0/3022094151 >> v2:172.21.15.83:3300/0 conn(0x7f54c4071920 0x7f54c4071db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:21.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.580+0000 7f54caa4c700 1 --2- 172.21.15.59:0/3022094151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54c415d520 0x7f54c40cea70 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:21.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.580+0000 7f54caa4c700 1 --2- 172.21.15.59:0/3022094151 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54c406a780 0x7f54c406ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:21.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.580+0000 7f54caa4c700 1 -- 172.21.15.59:0/3022094151 >> 172.21.15.59:0/3022094151 conn(0x7f54c40d0040 msgr2=0x7f54c40d0420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:21.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.581+0000 7f54caa4c700 1 -- 172.21.15.59:0/3022094151 shutdown_connections 2023-09-21T00:18:21.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.581+0000 7f54caa4c700 1 -- 172.21.15.59:0/3022094151 wait complete. 2023-09-21T00:18:21.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.582+0000 7f54caa4c700 1 Processor -- start 2023-09-21T00:18:21.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.582+0000 7f54caa4c700 1 -- start start 2023-09-21T00:18:21.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.583+0000 7f54caa4c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f54c406a780 0x7f54c40b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:21.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.583+0000 7f54caa4c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54c4071920 0x7f54c40adb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:21.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.583+0000 7f54caa4c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54c415d520 0x7f54c41f2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:21.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.583+0000 7f54caa4c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c40b5c00 con 0x7f54c415d520 2023-09-21T00:18:21.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.583+0000 7f54caa4c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c415ee30 con 0x7f54c406a780 2023-09-21T00:18:21.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.583+0000 7f54caa4c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c415f110 con 0x7f54c4071920 2023-09-21T00:18:21.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.583+0000 7f54c8fe9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54c415d520 0x7f54c41f2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:21.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.583+0000 7f54c8fe9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54c415d520 0x7f54c41f2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53226/0 (socket says 172.21.15.59:53226) 2023-09-21T00:18:21.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.583+0000 7f54c8fe9700 1 -- 172.21.15.59:0/244871500 learned_addr learned my addr 172.21.15.59:0/244871500 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:21.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.583+0000 7f54c3fff700 1 --2- 172.21.15.59:0/244871500 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f54c406a780 0x7f54c40b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:21.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.583+0000 7f54c37fe700 1 --2- 172.21.15.59:0/244871500 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54c4071920 0x7f54c40adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:21.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.583+0000 7f54c8fe9700 1 -- 172.21.15.59:0/244871500 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54c4071920 msgr2=0x7f54c40adb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:21.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.583+0000 7f54c8fe9700 1 --2- 172.21.15.59:0/244871500 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54c4071920 0x7f54c40adb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:21.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.583+0000 7f54c8fe9700 1 -- 172.21.15.59:0/244871500 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f54c406a780 msgr2=0x7f54c40b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:21.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.583+0000 7f54c8fe9700 1 --2- 172.21.15.59:0/244871500 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f54c406a780 0x7f54c40b56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:21.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.583+0000 7f54c8fe9700 1 -- 172.21.15.59:0/244871500 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ac009550 con 0x7f54c415d520 2023-09-21T00:18:21.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.583+0000 7f54c8fe9700 1 --2- 172.21.15.59:0/244871500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54c415d520 0x7f54c41f2560 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f54bc00cef0 tx=0x7f54bc00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:21.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.583+0000 7f54c0ff9700 1 -- 172.21.15.59:0/244871500 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc00ad00 con 0x7f54c415d520 2023-09-21T00:18:21.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.583+0000 7f54c0ff9700 1 -- 172.21.15.59:0/244871500 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54bc00ae60 con 0x7f54c415d520 2023-09-21T00:18:21.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.583+0000 7f54caa4c700 1 -- 172.21.15.59:0/244871500 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54c415f3f0 con 0x7f54c415d520 2023-09-21T00:18:21.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.583+0000 7f54c0ff9700 1 -- 172.21.15.59:0/244871500 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc015680 con 0x7f54c415d520 2023-09-21T00:18:21.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.583+0000 7f54caa4c700 1 -- 172.21.15.59:0/244871500 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c415f9b0 con 0x7f54c415d520 2023-09-21T00:18:21.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.584+0000 7f54caa4c700 1 -- 172.21.15.59:0/244871500 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54c4066fd0 con 0x7f54c415d520 2023-09-21T00:18:21.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.585+0000 7f54c0ff9700 1 -- 172.21.15.59:0/244871500 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f54bc00d430 con 0x7f54c415d520 2023-09-21T00:18:21.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.585+0000 7f54c0ff9700 1 --2- 172.21.15.59:0/244871500 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f54a406ae00 0x7f54a406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:21.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.586+0000 7f54c0ff9700 1 -- 172.21.15.59:0/244871500 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f54bc089780 con 0x7f54c415d520 2023-09-21T00:18:21.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.586+0000 7f54c3fff700 1 --2- 172.21.15.59:0/244871500 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f54a406ae00 0x7f54a406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:21.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.586+0000 7f54c3fff700 1 --2- 172.21.15.59:0/244871500 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f54a406ae00 0x7f54a406d2c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f54ac014040 tx=0x7f54ac008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:21.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.590+0000 7f54c0ff9700 1 -- 172.21.15.59:0/244871500 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f54bc054ab0 con 0x7f54c415d520 2023-09-21T00:18:21.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.871+0000 7f54caa4c700 1 -- 172.21.15.59:0/244871500 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f54c4067e50 con 0x7f54c415d520 2023-09-21T00:18:21.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.875+0000 7f54c0ff9700 1 -- 172.21.15.59:0/244871500 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) v1 ==== 90+0+0 (secure 0 0 0) 0x7f54bc01a0a0 con 0x7f54c415d520 2023-09-21T00:18:21.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.877+0000 7f54caa4c700 1 -- 172.21.15.59:0/244871500 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f54a406ae00 msgr2=0x7f54a406d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:21.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.877+0000 7f54caa4c700 1 --2- 172.21.15.59:0/244871500 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f54a406ae00 0x7f54a406d2c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f54ac014040 tx=0x7f54ac008030 comp rx=0 tx=0).stop 2023-09-21T00:18:21.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.877+0000 7f54caa4c700 1 -- 172.21.15.59:0/244871500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54c415d520 msgr2=0x7f54c41f2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:21.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.877+0000 7f54caa4c700 1 --2- 172.21.15.59:0/244871500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54c415d520 0x7f54c41f2560 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f54bc00cef0 tx=0x7f54bc00cf20 comp rx=0 tx=0).stop 2023-09-21T00:18:21.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.877+0000 7f54caa4c700 1 -- 172.21.15.59:0/244871500 shutdown_connections 2023-09-21T00:18:21.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.877+0000 7f54caa4c700 1 --2- 172.21.15.59:0/244871500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54c415d520 0x7f54c41f2560 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:21.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.877+0000 7f54caa4c700 1 --2- 172.21.15.59:0/244871500 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f54c406a780 0x7f54c40b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:21.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.877+0000 7f54caa4c700 1 --2- 172.21.15.59:0/244871500 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f54a406ae00 0x7f54a406d2c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:21.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.877+0000 7f54caa4c700 1 --2- 172.21.15.59:0/244871500 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f54c4071920 0x7f54c40adb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:21.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.877+0000 7f54caa4c700 1 -- 172.21.15.59:0/244871500 >> 172.21.15.59:0/244871500 conn(0x7f54c40d0040 msgr2=0x7f54c406daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:21.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.877+0000 7f54caa4c700 1 -- 172.21.15.59:0/244871500 shutdown_connections 2023-09-21T00:18:21.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:21.877+0000 7f54caa4c700 1 -- 172.21.15.59:0/244871500 wait complete. 2023-09-21T00:18:21.890 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-09-21T00:18:22.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.017+0000 7f2732964700 1 Processor -- start 2023-09-21T00:18:22.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.017+0000 7f2732964700 1 -- start start 2023-09-21T00:18:22.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.017+0000 7f2732964700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f272c15d550 0x7f272c0d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:22.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.017+0000 7f2732964700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f272c15d930 0x7f272c0cecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:22.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.017+0000 7f2732964700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f272c0cf500 con 0x7f272c0d3f90 2023-09-21T00:18:22.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.017+0000 7f2732964700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f272c0cf7e0 con 0x7f272c15d930 2023-09-21T00:18:22.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.017+0000 7f2732964700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272c0cfac0 con 0x7f272c15d550 2023-09-21T00:18:22.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.018+0000 7f272b7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f272c15d930 0x7f272c0cecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:22.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.018+0000 7f2730f01700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f272c0d3f90 0x7f272c161320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58806/0 (socket says 172.21.15.59:58806) 2023-09-21T00:18:22.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.018+0000 7f2730f01700 1 -- 172.21.15.59:0/2161263843 learned_addr learned my addr 172.21.15.59:0/2161263843 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:22.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.018+0000 7f272bfff700 1 --2- 172.21.15.59:0/2161263843 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f272c15d550 0x7f272c0d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:22.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.018+0000 7f272b7fe700 1 -- 172.21.15.59:0/2161263843 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f272c15d550 msgr2=0x7f272c0d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:22.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.018+0000 7f272b7fe700 1 --2- 172.21.15.59:0/2161263843 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f272c15d550 0x7f272c0d05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:22.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.018+0000 7f272b7fe700 1 -- 172.21.15.59:0/2161263843 >> v1:172.21.15.59:6789/0 conn(0x7f272c0d3f90 legacy=0x7f272c161320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:22.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.018+0000 7f272b7fe700 1 -- 172.21.15.59:0/2161263843 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272c0cfda0 con 0x7f272c15d930 2023-09-21T00:18:22.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.018+0000 7f272b7fe700 1 --2- 172.21.15.59:0/2161263843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f272c15d930 0x7f272c0cecd0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2720009840 tx=0x7f2720009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a3305170e5c96f3 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:22.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.018+0000 7f272affd700 1 -- 172.21.15.59:0/2161263843 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2720011830 con 0x7f272c15d930 2023-09-21T00:18:22.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.018+0000 7f272affd700 1 -- 172.21.15.59:0/2161263843 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2720011990 con 0x7f272c15d930 2023-09-21T00:18:22.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.018+0000 7f272affd700 1 -- 172.21.15.59:0/2161263843 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2720011d20 con 0x7f272c15d930 2023-09-21T00:18:22.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.019+0000 7f2732964700 1 -- 172.21.15.59:0/2161263843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f272c15d930 msgr2=0x7f272c0cecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:22.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.019+0000 7f2732964700 1 --2- 172.21.15.59:0/2161263843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f272c15d930 0x7f272c0cecd0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2720009840 tx=0x7f2720009b50 comp rx=0 tx=0).stop 2023-09-21T00:18:22.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.019+0000 7f2732964700 1 -- 172.21.15.59:0/2161263843 shutdown_connections 2023-09-21T00:18:22.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.019+0000 7f2732964700 1 --2- 172.21.15.59:0/2161263843 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f272c15d550 0x7f272c0d05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:22.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.019+0000 7f2732964700 1 --2- 172.21.15.59:0/2161263843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f272c15d930 0x7f272c0cecd0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:22.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.019+0000 7f2732964700 1 -- 172.21.15.59:0/2161263843 >> 172.21.15.59:0/2161263843 conn(0x7f272c09c740 msgr2=0x7f272c0d33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:22.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.019+0000 7f2732964700 1 -- 172.21.15.59:0/2161263843 shutdown_connections 2023-09-21T00:18:22.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.019+0000 7f2732964700 1 -- 172.21.15.59:0/2161263843 wait complete. 2023-09-21T00:18:22.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.020+0000 7f2732964700 1 Processor -- start 2023-09-21T00:18:22.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.020+0000 7f2732964700 1 -- start start 2023-09-21T00:18:22.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.021+0000 7f2732964700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f272c0d3f90 0x7f272c1f5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:22.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.021+0000 7f2732964700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f272c15d550 0x7f272c1f6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:22.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.021+0000 7f2732964700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f272c15d930 0x7f272c1f29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:22.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.021+0000 7f2732964700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272c1f42f0 con 0x7f272c15d550 2023-09-21T00:18:22.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.021+0000 7f2732964700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272c0b8910 con 0x7f272c15d930 2023-09-21T00:18:22.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.021+0000 7f2732964700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272c1f3c30 con 0x7f272c0d3f90 2023-09-21T00:18:22.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.021+0000 7f272b7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f272c15d550 0x7f272c1f6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:22.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.021+0000 7f272b7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f272c15d550 0x7f272c1f6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53242/0 (socket says 172.21.15.59:53242) 2023-09-21T00:18:22.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.021+0000 7f272b7fe700 1 -- 172.21.15.59:0/272370007 learned_addr learned my addr 172.21.15.59:0/272370007 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:22.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.021+0000 7f272bfff700 1 --2- 172.21.15.59:0/272370007 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f272c0d3f90 0x7f272c1f5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:22.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.021+0000 7f2730f01700 1 --2- 172.21.15.59:0/272370007 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f272c15d930 0x7f272c1f29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:22.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.021+0000 7f272b7fe700 1 -- 172.21.15.59:0/272370007 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f272c0d3f90 msgr2=0x7f272c1f5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:22.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.021+0000 7f272b7fe700 1 --2- 172.21.15.59:0/272370007 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f272c0d3f90 0x7f272c1f5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:22.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.021+0000 7f272b7fe700 1 -- 172.21.15.59:0/272370007 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f272c15d930 msgr2=0x7f272c1f29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:22.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.021+0000 7f272b7fe700 1 --2- 172.21.15.59:0/272370007 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f272c15d930 0x7f272c1f29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:22.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.021+0000 7f272b7fe700 1 -- 172.21.15.59:0/272370007 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27200094a0 con 0x7f272c15d550 2023-09-21T00:18:22.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.021+0000 7f272b7fe700 1 --2- 172.21.15.59:0/272370007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f272c15d550 0x7f272c1f6500 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2720009b90 tx=0x7f2720004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:22.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.022+0000 7f2728ff9700 1 -- 172.21.15.59:0/272370007 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27200038a0 con 0x7f272c15d550 2023-09-21T00:18:22.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.022+0000 7f2728ff9700 1 -- 172.21.15.59:0/272370007 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272001f070 con 0x7f272c15d550 2023-09-21T00:18:22.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.022+0000 7f2728ff9700 1 -- 172.21.15.59:0/272370007 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2720003c40 con 0x7f272c15d550 2023-09-21T00:18:22.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.022+0000 7f2732964700 1 -- 172.21.15.59:0/272370007 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f272c1f3f10 con 0x7f272c15d550 2023-09-21T00:18:22.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.022+0000 7f2732964700 1 -- 172.21.15.59:0/272370007 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f272c1f2f10 con 0x7f272c15d550 2023-09-21T00:18:22.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.023+0000 7f2732964700 1 -- 172.21.15.59:0/272370007 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f272c1f4430 con 0x7f272c15d550 2023-09-21T00:18:22.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.023+0000 7f2728ff9700 1 -- 172.21.15.59:0/272370007 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f2720026480 con 0x7f272c15d550 2023-09-21T00:18:22.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.023+0000 7f2728ff9700 1 --2- 172.21.15.59:0/272370007 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f271806ae00 0x7f271806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:22.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.024+0000 7f2728ff9700 1 -- 172.21.15.59:0/272370007 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f2720021070 con 0x7f272c15d550 2023-09-21T00:18:22.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.024+0000 7f272bfff700 1 --2- 172.21.15.59:0/272370007 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f271806ae00 0x7f271806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:22.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.024+0000 7f272bfff700 1 --2- 172.21.15.59:0/272370007 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f271806ae00 0x7f271806d2c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f271c006fd0 tx=0x7f271c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:22.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.028+0000 7f2728ff9700 1 -- 172.21.15.59:0/272370007 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f272c1f4430 con 0x7f272c15d550 2023-09-21T00:18:22.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.308+0000 7f2732964700 1 -- 172.21.15.59:0/272370007 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f272c1f4430 con 0x7f272c15d550 2023-09-21T00:18:22.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.312+0000 7f2728ff9700 1 -- 172.21.15.59:0/272370007 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) v1 ==== 90+0+0 (secure 0 0 0) 0x7f272c1f4430 con 0x7f272c15d550 2023-09-21T00:18:22.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.314+0000 7f2732964700 1 -- 172.21.15.59:0/272370007 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f271806ae00 msgr2=0x7f271806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:22.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.314+0000 7f2732964700 1 --2- 172.21.15.59:0/272370007 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f271806ae00 0x7f271806d2c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f271c006fd0 tx=0x7f271c008040 comp rx=0 tx=0).stop 2023-09-21T00:18:22.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.314+0000 7f2732964700 1 -- 172.21.15.59:0/272370007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f272c15d550 msgr2=0x7f272c1f6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:22.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.314+0000 7f2732964700 1 --2- 172.21.15.59:0/272370007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f272c15d550 0x7f272c1f6500 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2720009b90 tx=0x7f2720004750 comp rx=0 tx=0).stop 2023-09-21T00:18:22.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.314+0000 7f2732964700 1 -- 172.21.15.59:0/272370007 shutdown_connections 2023-09-21T00:18:22.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.314+0000 7f2732964700 1 --2- 172.21.15.59:0/272370007 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f272c15d930 0x7f272c1f29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:22.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.314+0000 7f2732964700 1 --2- 172.21.15.59:0/272370007 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f271806ae00 0x7f271806d2c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:22.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.314+0000 7f2732964700 1 --2- 172.21.15.59:0/272370007 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f272c0d3f90 0x7f272c1f5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:22.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.314+0000 7f2732964700 1 --2- 172.21.15.59:0/272370007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f272c15d550 0x7f272c1f6500 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:22.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.314+0000 7f2732964700 1 -- 172.21.15.59:0/272370007 >> 172.21.15.59:0/272370007 conn(0x7f272c09c740 msgr2=0x7f272c06cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:22.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.314+0000 7f2732964700 1 -- 172.21.15.59:0/272370007 shutdown_connections 2023-09-21T00:18:22.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.314+0000 7f2732964700 1 -- 172.21.15.59:0/272370007 wait complete. 2023-09-21T00:18:22.328 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-09-21T00:18:22.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.452+0000 7f2353306700 1 Processor -- start 2023-09-21T00:18:22.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.452+0000 7f2353306700 1 -- start start 2023-09-21T00:18:22.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.453+0000 7f2353306700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f234c160c20 0x7f234c071830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:22.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.453+0000 7f2353306700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f234c0cc980 0x7f234c0cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:22.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.453+0000 7f2353306700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f234c161000 con 0x7f234c0b4320 2023-09-21T00:18:22.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.453+0000 7f2353306700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f234c0b4ac0 con 0x7f234c0cc980 2023-09-21T00:18:22.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.453+0000 7f2353306700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f234c0b2e90 con 0x7f234c160c20 2023-09-21T00:18:22.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.453+0000 7f23518a3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f234c0cc980 0x7f234c0cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:22.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.453+0000 7f23508a1700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f234c0b4320 0x7f234c0cc270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58816/0 (socket says 172.21.15.59:58816) 2023-09-21T00:18:22.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.453+0000 7f23518a3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f234c0cc980 0x7f234c0cdb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53252/0 (socket says 172.21.15.59:53252) 2023-09-21T00:18:22.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.453+0000 7f23508a1700 1 -- 172.21.15.59:0/552355011 learned_addr learned my addr 172.21.15.59:0/552355011 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:22.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.454+0000 7f23510a2700 1 --2- 172.21.15.59:0/552355011 >> v2:172.21.15.83:3300/0 conn(0x7f234c160c20 0x7f234c071830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:22.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.454+0000 7f23518a3700 1 -- 172.21.15.59:0/552355011 >> v2:172.21.15.83:3300/0 conn(0x7f234c160c20 msgr2=0x7f234c071830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:22.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.454+0000 7f23518a3700 1 --2- 172.21.15.59:0/552355011 >> v2:172.21.15.83:3300/0 conn(0x7f234c160c20 0x7f234c071830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:22.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.454+0000 7f23518a3700 1 -- 172.21.15.59:0/552355011 >> v1:172.21.15.59:6789/0 conn(0x7f234c0b4320 legacy=0x7f234c0cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:22.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.454+0000 7f2343fff700 1 -- 172.21.15.59:0/552355011 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1397819100 0 0) 0x7f234c161000 con 0x7f234c0b4320 2023-09-21T00:18:22.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.454+0000 7f23518a3700 1 -- 172.21.15.59:0/552355011 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f234c0cc010 con 0x7f234c0cc980 2023-09-21T00:18:22.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.454+0000 7f23518a3700 1 --2- 172.21.15.59:0/552355011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f234c0cc980 0x7f234c0cdb60 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f234c070a00 tx=0x7f234400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5321ab9ac28d47ad server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:22.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.454+0000 7f2343fff700 1 -- 172.21.15.59:0/552355011 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f234400e070 con 0x7f234c0cc980 2023-09-21T00:18:22.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.454+0000 7f2343fff700 1 -- 172.21.15.59:0/552355011 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f234400bb20 con 0x7f234c0cc980 2023-09-21T00:18:22.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.454+0000 7f2343fff700 1 -- 172.21.15.59:0/552355011 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2344012430 con 0x7f234c0cc980 2023-09-21T00:18:22.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.455+0000 7f2353306700 1 -- 172.21.15.59:0/552355011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f234c0cc980 msgr2=0x7f234c0cdb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:22.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.455+0000 7f2353306700 1 --2- 172.21.15.59:0/552355011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f234c0cc980 0x7f234c0cdb60 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f234c070a00 tx=0x7f234400b330 comp rx=0 tx=0).stop 2023-09-21T00:18:22.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.455+0000 7f2353306700 1 -- 172.21.15.59:0/552355011 shutdown_connections 2023-09-21T00:18:22.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.455+0000 7f2353306700 1 --2- 172.21.15.59:0/552355011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f234c0cc980 0x7f234c0cdb60 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:22.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.455+0000 7f2353306700 1 --2- 172.21.15.59:0/552355011 >> v2:172.21.15.83:3300/0 conn(0x7f234c160c20 0x7f234c071830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:22.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.455+0000 7f2353306700 1 -- 172.21.15.59:0/552355011 >> 172.21.15.59:0/552355011 conn(0x7f234c0b1430 msgr2=0x7f234c0b1840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:22.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.455+0000 7f2353306700 1 -- 172.21.15.59:0/552355011 shutdown_connections 2023-09-21T00:18:22.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.455+0000 7f2353306700 1 -- 172.21.15.59:0/552355011 wait complete. 2023-09-21T00:18:22.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.456+0000 7f2353306700 1 Processor -- start 2023-09-21T00:18:22.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.456+0000 7f2353306700 1 -- start start 2023-09-21T00:18:22.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.457+0000 7f2353306700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f234c0b4320 0x7f234c158230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:22.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.457+0000 7f2353306700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f234c0cc980 0x7f234c0aca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:22.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.457+0000 7f2353306700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f234c160c20 0x7f234c1495f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:22.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.457+0000 7f2353306700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234c0acf80 con 0x7f234c0b4320 2023-09-21T00:18:22.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.457+0000 7f2353306700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234c159540 con 0x7f234c160c20 2023-09-21T00:18:22.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.457+0000 7f2353306700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f234c149b30 con 0x7f234c0cc980 2023-09-21T00:18:22.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.457+0000 7f23510a2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f234c0b4320 0x7f234c158230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:22.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.457+0000 7f23510a2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f234c0b4320 0x7f234c158230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53254/0 (socket says 172.21.15.59:53254) 2023-09-21T00:18:22.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.457+0000 7f23510a2700 1 -- 172.21.15.59:0/637997637 learned_addr learned my addr 172.21.15.59:0/637997637 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:22.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.457+0000 7f23518a3700 1 --2- 172.21.15.59:0/637997637 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f234c160c20 0x7f234c1495f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:22.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.457+0000 7f23510a2700 1 -- 172.21.15.59:0/637997637 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f234c0cc980 msgr2=0x7f234c0aca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:22.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.457+0000 7f23508a1700 1 --2- 172.21.15.59:0/637997637 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f234c0cc980 0x7f234c0aca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:22.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.457+0000 7f23510a2700 1 --2- 172.21.15.59:0/637997637 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f234c0cc980 0x7f234c0aca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:22.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.457+0000 7f23510a2700 1 -- 172.21.15.59:0/637997637 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f234c160c20 msgr2=0x7f234c1495f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:22.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.457+0000 7f23510a2700 1 --2- 172.21.15.59:0/637997637 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f234c160c20 0x7f234c1495f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:22.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.457+0000 7f23510a2700 1 -- 172.21.15.59:0/637997637 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2344009a70 con 0x7f234c0b4320 2023-09-21T00:18:22.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.457+0000 7f23518a3700 1 --2- 172.21.15.59:0/637997637 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f234c160c20 0x7f234c1495f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:18:22.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.457+0000 7f23510a2700 1 --2- 172.21.15.59:0/637997637 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f234c0b4320 0x7f234c158230 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f233c00e870 tx=0x7f233c00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:22.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.457+0000 7f2341ffb700 1 -- 172.21.15.59:0/637997637 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c009590 con 0x7f234c0b4320 2023-09-21T00:18:22.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.458+0000 7f2341ffb700 1 -- 172.21.15.59:0/637997637 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233c00ee70 con 0x7f234c0b4320 2023-09-21T00:18:22.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.458+0000 7f2341ffb700 1 -- 172.21.15.59:0/637997637 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c00ca50 con 0x7f234c0b4320 2023-09-21T00:18:22.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.458+0000 7f2353306700 1 -- 172.21.15.59:0/637997637 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f234c158930 con 0x7f234c0b4320 2023-09-21T00:18:22.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.458+0000 7f2353306700 1 -- 172.21.15.59:0/637997637 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f234c158ef0 con 0x7f234c0b4320 2023-09-21T00:18:22.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.459+0000 7f2353306700 1 -- 172.21.15.59:0/637997637 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f234c067e50 con 0x7f234c0b4320 2023-09-21T00:18:22.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.459+0000 7f2341ffb700 1 -- 172.21.15.59:0/637997637 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f233c00cbb0 con 0x7f234c0b4320 2023-09-21T00:18:22.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.460+0000 7f2341ffb700 1 --2- 172.21.15.59:0/637997637 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f233006ae30 0x7f233006d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:22.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.460+0000 7f2341ffb700 1 -- 172.21.15.59:0/637997637 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f233c089390 con 0x7f234c0b4320 2023-09-21T00:18:22.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.460+0000 7f23508a1700 1 --2- 172.21.15.59:0/637997637 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f233006ae30 0x7f233006d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:22.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.460+0000 7f23508a1700 1 --2- 172.21.15.59:0/637997637 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f233006ae30 0x7f233006d2f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f234c14d270 tx=0x7f2348009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:22.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.464+0000 7f2341ffb700 1 -- 172.21.15.59:0/637997637 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f233c054630 con 0x7f234c0b4320 2023-09-21T00:18:22.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.748+0000 7f2353306700 1 -- 172.21.15.59:0/637997637 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f234c0cd460 con 0x7f234c0b4320 2023-09-21T00:18:22.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.752+0000 7f2341ffb700 1 -- 172.21.15.59:0/637997637 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f233c00ce60 con 0x7f234c0b4320 2023-09-21T00:18:22.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.754+0000 7f2353306700 1 -- 172.21.15.59:0/637997637 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f233006ae30 msgr2=0x7f233006d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:22.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.754+0000 7f2353306700 1 --2- 172.21.15.59:0/637997637 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f233006ae30 0x7f233006d2f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f234c14d270 tx=0x7f2348009040 comp rx=0 tx=0).stop 2023-09-21T00:18:22.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.754+0000 7f2353306700 1 -- 172.21.15.59:0/637997637 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f234c0b4320 msgr2=0x7f234c158230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:22.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.754+0000 7f2353306700 1 --2- 172.21.15.59:0/637997637 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f234c0b4320 0x7f234c158230 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f233c00e870 tx=0x7f233c00ec30 comp rx=0 tx=0).stop 2023-09-21T00:18:22.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.754+0000 7f2353306700 1 -- 172.21.15.59:0/637997637 shutdown_connections 2023-09-21T00:18:22.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.754+0000 7f2353306700 1 --2- 172.21.15.59:0/637997637 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f234c160c20 0x7f234c1495f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:22.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.754+0000 7f2353306700 1 --2- 172.21.15.59:0/637997637 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f234c0b4320 0x7f234c158230 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:22.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.754+0000 7f2353306700 1 --2- 172.21.15.59:0/637997637 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f233006ae30 0x7f233006d2f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:22.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.754+0000 7f2353306700 1 --2- 172.21.15.59:0/637997637 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f234c0cc980 0x7f234c0aca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:22.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.754+0000 7f2353306700 1 -- 172.21.15.59:0/637997637 >> 172.21.15.59:0/637997637 conn(0x7f234c0b1430 msgr2=0x7f234c0cfed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:22.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.754+0000 7f2353306700 1 -- 172.21.15.59:0/637997637 shutdown_connections 2023-09-21T00:18:22.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.754+0000 7f2353306700 1 -- 172.21.15.59:0/637997637 wait complete. 2023-09-21T00:18:22.767 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-09-21T00:18:22.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.893+0000 7f2b38d9a700 1 Processor -- start 2023-09-21T00:18:22.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.893+0000 7f2b38d9a700 1 -- start start 2023-09-21T00:18:22.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.894+0000 7f2b38d9a700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2b340b32f0 0x7f2b340cbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:22.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.894+0000 7f2b38d9a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b3406edc0 con 0x7f2b340ceeb0 2023-09-21T00:18:22.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.894+0000 7f2b38d9a700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b340cf470 con 0x7f2b3415b730 2023-09-21T00:18:22.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.894+0000 7f2b38d9a700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b3415bb10 con 0x7f2b340b32f0 2023-09-21T00:18:22.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.894+0000 7f2b32d9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2b340ceeb0 0x7f2b340cc120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58832/0 (socket says 172.21.15.59:58832) 2023-09-21T00:18:22.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.895+0000 7f2b32d9d700 1 -- 172.21.15.59:0/1025962794 learned_addr learned my addr 172.21.15.59:0/1025962794 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:22.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.895+0000 7f2b31d9b700 1 --2- 172.21.15.59:0/1025962794 >> v2:172.21.15.83:3300/0 conn(0x7f2b340b32f0 0x7f2b340cbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:22.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.895+0000 7f2b3159a700 1 -- 172.21.15.59:0/1025962794 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 380377271 0 0) 0x7f2b3406edc0 con 0x7f2b340ceeb0 2023-09-21T00:18:22.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.895+0000 7f2b3159a700 1 -- 172.21.15.59:0/1025962794 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b200035b0 con 0x7f2b340ceeb0 2023-09-21T00:18:22.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.895+0000 7f2b3159a700 1 -- 172.21.15.59:0/1025962794 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 815212363 0 0) 0x7f2b200035b0 con 0x7f2b340ceeb0 2023-09-21T00:18:22.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.895+0000 7f2b3159a700 1 -- 172.21.15.59:0/1025962794 >> v2:172.21.15.83:3300/0 conn(0x7f2b340b32f0 msgr2=0x7f2b340cbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:22.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.895+0000 7f2b3159a700 1 --2- 172.21.15.59:0/1025962794 >> v2:172.21.15.83:3300/0 conn(0x7f2b340b32f0 0x7f2b340cbbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:22.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.895+0000 7f2b3159a700 1 -- 172.21.15.59:0/1025962794 >> v1:172.21.15.83:6789/0 conn(0x7f2b3415b730 legacy=0x7f2b340b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:22.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.895+0000 7f2b3159a700 1 -- 172.21.15.59:0/1025962794 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b3406e490 con 0x7f2b340ceeb0 2023-09-21T00:18:22.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.895+0000 7f2b3159a700 1 -- 172.21.15.59:0/1025962794 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 710825841 0 0) 0x7f2b2c0019f0 con 0x7f2b340ceeb0 2023-09-21T00:18:22.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.895+0000 7f2b3159a700 1 -- 172.21.15.59:0/1025962794 >> v1:172.21.15.59:6789/0 conn(0x7f2b340ceeb0 legacy=0x7f2b340cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:22.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.895+0000 7f2b3159a700 1 --2- 172.21.15.59:0/1025962794 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2b20003a00 0x7f2b20003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:22.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.895+0000 7f2b3159a700 1 --2- 172.21.15.59:0/1025962794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b20004850 0x7f2b20004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:22.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.895+0000 7f2b3159a700 1 --2- 172.21.15.59:0/1025962794 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b20005330 0x7f2b2000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:22.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.895+0000 7f2b3159a700 1 -- 172.21.15.59:0/1025962794 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3415bb10 con 0x7f2b20004850 2023-09-21T00:18:22.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.895+0000 7f2b3159a700 1 -- 172.21.15.59:0/1025962794 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2000c200 con 0x7f2b20005330 2023-09-21T00:18:22.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.895+0000 7f2b3159a700 1 -- 172.21.15.59:0/1025962794 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2000c3c0 con 0x7f2b20003a00 2023-09-21T00:18:22.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.895+0000 7f2b31d9b700 1 --2- 172.21.15.59:0/1025962794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b20004850 0x7f2b20004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:22.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.895+0000 7f2b3259c700 1 --2- 172.21.15.59:0/1025962794 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2b20003a00 0x7f2b20003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:22.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.895+0000 7f2b32d9d700 1 --2- 172.21.15.59:0/1025962794 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b20005330 0x7f2b2000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:22.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.896+0000 7f2b31d9b700 1 -- 172.21.15.59:0/1025962794 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2b20003a00 msgr2=0x7f2b20003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:22.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.896+0000 7f2b31d9b700 1 --2- 172.21.15.59:0/1025962794 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2b20003a00 0x7f2b20003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:22.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.896+0000 7f2b31d9b700 1 -- 172.21.15.59:0/1025962794 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b20005330 msgr2=0x7f2b2000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:22.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.896+0000 7f2b31d9b700 1 --2- 172.21.15.59:0/1025962794 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b20005330 0x7f2b2000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:22.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.896+0000 7f2b31d9b700 1 -- 172.21.15.59:0/1025962794 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b200035b0 con 0x7f2b20004850 2023-09-21T00:18:22.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.896+0000 7f2b32d9d700 1 --2- 172.21.15.59:0/1025962794 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b20005330 0x7f2b2000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:18:22.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.896+0000 7f2b32d9d700 1 -- 172.21.15.59:0/1025962794 reap_dead start 2023-09-21T00:18:22.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.896+0000 7f2b31d9b700 1 --2- 172.21.15.59:0/1025962794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b20004850 0x7f2b20004cd0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c009b30 tx=0x7f2b20005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d84ac486c8315260 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:22.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.896+0000 7f2b3159a700 1 -- 172.21.15.59:0/1025962794 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c00e6c0 con 0x7f2b20004850 2023-09-21T00:18:22.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.896+0000 7f2b3159a700 1 -- 172.21.15.59:0/1025962794 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b1c00e820 con 0x7f2b20004850 2023-09-21T00:18:22.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.896+0000 7f2b3159a700 1 -- 172.21.15.59:0/1025962794 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c00eb90 con 0x7f2b20004850 2023-09-21T00:18:22.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.896+0000 7f2b38d9a700 1 -- 172.21.15.59:0/1025962794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b20004850 msgr2=0x7f2b20004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:22.905 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.896+0000 7f2b38d9a700 1 --2- 172.21.15.59:0/1025962794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b20004850 0x7f2b20004cd0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c009b30 tx=0x7f2b20005880 comp rx=0 tx=0).stop 2023-09-21T00:18:22.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.896+0000 7f2b38d9a700 1 -- 172.21.15.59:0/1025962794 shutdown_connections 2023-09-21T00:18:22.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.896+0000 7f2b38d9a700 1 --2- 172.21.15.59:0/1025962794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b20004850 0x7f2b20004cd0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:22.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.896+0000 7f2b38d9a700 1 -- 172.21.15.59:0/1025962794 >> 172.21.15.59:0/1025962794 conn(0x7f2b340d1160 msgr2=0x7f2b340d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:22.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.897+0000 7f2b38d9a700 1 -- 172.21.15.59:0/1025962794 shutdown_connections 2023-09-21T00:18:22.906 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.897+0000 7f2b38d9a700 1 -- 172.21.15.59:0/1025962794 wait complete. 2023-09-21T00:18:22.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.898+0000 7f2b38d9a700 1 Processor -- start 2023-09-21T00:18:22.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.898+0000 7f2b38d9a700 1 -- start start 2023-09-21T00:18:22.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.899+0000 7f2b38d9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b20004850 0x7f2b341493c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:22.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.899+0000 7f2b38d9a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b3415e550 0x7f2b340ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:22.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.899+0000 7f2b38d9a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2b340cd130 0x7f2b3415be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:22.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.899+0000 7f2b38d9a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b340cd5e0 con 0x7f2b20004850 2023-09-21T00:18:22.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.899+0000 7f2b38d9a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b34149900 con 0x7f2b3415e550 2023-09-21T00:18:22.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.899+0000 7f2b38d9a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3415cbb0 con 0x7f2b340cd130 2023-09-21T00:18:22.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.899+0000 7f2b3259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b20004850 0x7f2b341493c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:22.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.899+0000 7f2b3259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b20004850 0x7f2b341493c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53272/0 (socket says 172.21.15.59:53272) 2023-09-21T00:18:22.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.899+0000 7f2b3259c700 1 -- 172.21.15.59:0/3970157726 learned_addr learned my addr 172.21.15.59:0/3970157726 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:22.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.899+0000 7f2b32d9d700 1 --2- 172.21.15.59:0/3970157726 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2b340cd130 0x7f2b3415be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:22.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.899+0000 7f2b31d9b700 1 --2- 172.21.15.59:0/3970157726 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b3415e550 0x7f2b340ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:22.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.899+0000 7f2b3259c700 1 -- 172.21.15.59:0/3970157726 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2b340cd130 msgr2=0x7f2b3415be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:22.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.899+0000 7f2b3259c700 1 --2- 172.21.15.59:0/3970157726 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2b340cd130 0x7f2b3415be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:22.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.899+0000 7f2b3259c700 1 -- 172.21.15.59:0/3970157726 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b3415e550 msgr2=0x7f2b340ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:22.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.899+0000 7f2b3259c700 1 --2- 172.21.15.59:0/3970157726 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b3415e550 0x7f2b340ccbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:22.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.899+0000 7f2b3259c700 1 -- 172.21.15.59:0/3970157726 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b3415da70 con 0x7f2b20004850 2023-09-21T00:18:22.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.899+0000 7f2b3259c700 1 --2- 172.21.15.59:0/3970157726 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b20004850 0x7f2b341493c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2b2400f7a0 tx=0x7f2b2400fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:22.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.899+0000 7f2b2affd700 1 -- 172.21.15.59:0/3970157726 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b240052e0 con 0x7f2b20004850 2023-09-21T00:18:22.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.900+0000 7f2b2affd700 1 -- 172.21.15.59:0/3970157726 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b24005440 con 0x7f2b20004850 2023-09-21T00:18:22.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.900+0000 7f2b2affd700 1 -- 172.21.15.59:0/3970157726 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b240038f0 con 0x7f2b20004850 2023-09-21T00:18:22.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.900+0000 7f2b38d9a700 1 -- 172.21.15.59:0/3970157726 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b3415dd50 con 0x7f2b20004850 2023-09-21T00:18:22.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.900+0000 7f2b38d9a700 1 -- 172.21.15.59:0/3970157726 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b3415d710 con 0x7f2b20004850 2023-09-21T00:18:22.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.901+0000 7f2b38d9a700 1 -- 172.21.15.59:0/3970157726 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b3415d8d0 con 0x7f2b20004850 2023-09-21T00:18:22.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.901+0000 7f2b2affd700 1 -- 172.21.15.59:0/3970157726 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f2b24003a50 con 0x7f2b20004850 2023-09-21T00:18:22.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.902+0000 7f2b2affd700 1 --2- 172.21.15.59:0/3970157726 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f2b1406ae00 0x7f2b1406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:22.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.902+0000 7f2b2affd700 1 -- 172.21.15.59:0/3970157726 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f2b24088ed0 con 0x7f2b20004850 2023-09-21T00:18:22.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.902+0000 7f2b31d9b700 1 --2- 172.21.15.59:0/3970157726 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f2b1406ae00 0x7f2b1406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:22.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.902+0000 7f2b31d9b700 1 --2- 172.21.15.59:0/3970157726 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f2b1406ae00 0x7f2b1406d2c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c0090b0 tx=0x7f2b1c01e040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:22.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:22.906+0000 7f2b2affd700 1 -- 172.21.15.59:0/3970157726 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f2b3415d8d0 con 0x7f2b20004850 2023-09-21T00:18:23.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.190+0000 7f2b38d9a700 1 -- 172.21.15.59:0/3970157726 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f2b3415d8d0 con 0x7f2b20004850 2023-09-21T00:18:23.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.196+0000 7f2b2affd700 1 -- 172.21.15.59:0/3970157726 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2b3415d8d0 con 0x7f2b20004850 2023-09-21T00:18:23.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.198+0000 7f2b38d9a700 1 -- 172.21.15.59:0/3970157726 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f2b1406ae00 msgr2=0x7f2b1406d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:23.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.198+0000 7f2b38d9a700 1 --2- 172.21.15.59:0/3970157726 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f2b1406ae00 0x7f2b1406d2c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c0090b0 tx=0x7f2b1c01e040 comp rx=0 tx=0).stop 2023-09-21T00:18:23.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.198+0000 7f2b38d9a700 1 -- 172.21.15.59:0/3970157726 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b20004850 msgr2=0x7f2b341493c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:23.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.198+0000 7f2b38d9a700 1 --2- 172.21.15.59:0/3970157726 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b20004850 0x7f2b341493c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2b2400f7a0 tx=0x7f2b2400fab0 comp rx=0 tx=0).stop 2023-09-21T00:18:23.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.198+0000 7f2b38d9a700 1 -- 172.21.15.59:0/3970157726 shutdown_connections 2023-09-21T00:18:23.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.198+0000 7f2b38d9a700 1 --2- 172.21.15.59:0/3970157726 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f2b1406ae00 0x7f2b1406d2c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:23.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.198+0000 7f2b38d9a700 1 --2- 172.21.15.59:0/3970157726 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2b340cd130 0x7f2b3415be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:23.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.198+0000 7f2b38d9a700 1 --2- 172.21.15.59:0/3970157726 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b20004850 0x7f2b341493c0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:23.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.198+0000 7f2b38d9a700 1 --2- 172.21.15.59:0/3970157726 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b3415e550 0x7f2b340ccbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:23.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.198+0000 7f2b38d9a700 1 -- 172.21.15.59:0/3970157726 >> 172.21.15.59:0/3970157726 conn(0x7f2b340d1160 msgr2=0x7f2b340c4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:23.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.198+0000 7f2b38d9a700 1 -- 172.21.15.59:0/3970157726 shutdown_connections 2023-09-21T00:18:23.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.198+0000 7f2b38d9a700 1 -- 172.21.15.59:0/3970157726 wait complete. 2023-09-21T00:18:23.211 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-09-21T00:18:23.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.336+0000 7f72a0bc1700 1 Processor -- start 2023-09-21T00:18:23.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.336+0000 7f72a0bc1700 1 -- start start 2023-09-21T00:18:23.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.337+0000 7f72a0bc1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f729c15b730 0x7f729c0b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:23.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.337+0000 7f72a0bc1700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f729c0ccbf0 0x7f729c0b3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:23.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.337+0000 7f72a0bc1700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f729c06edc0 con 0x7f729c0ceeb0 2023-09-21T00:18:23.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.337+0000 7f72a0bc1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f729c0cd080 con 0x7f729c15b730 2023-09-21T00:18:23.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.337+0000 7f72a0bc1700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f729c15bb10 con 0x7f729c0ccbf0 2023-09-21T00:18:23.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.337+0000 7f729a59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f729c15b730 0x7f729c0b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:23.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.338+0000 7f729a59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f729c15b730 0x7f729c0b2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53280/0 (socket says 172.21.15.59:53280) 2023-09-21T00:18:23.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.338+0000 7f729a59c700 1 -- 172.21.15.59:0/1442566061 learned_addr learned my addr 172.21.15.59:0/1442566061 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:23.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.338+0000 7f729ad9d700 1 --2- 172.21.15.59:0/1442566061 >> v2:172.21.15.83:3300/0 conn(0x7f729c0ccbf0 0x7f729c0b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:23.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.338+0000 7f729a59c700 1 -- 172.21.15.59:0/1442566061 >> v2:172.21.15.83:3300/0 conn(0x7f729c0ccbf0 msgr2=0x7f729c0b3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:23.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.338+0000 7f729a59c700 1 --2- 172.21.15.59:0/1442566061 >> v2:172.21.15.83:3300/0 conn(0x7f729c0ccbf0 0x7f729c0b3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:23.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.338+0000 7f729a59c700 1 -- 172.21.15.59:0/1442566061 >> v1:172.21.15.83:6789/0 conn(0x7f729c0ceeb0 legacy=0x7f729c06f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:23.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.338+0000 7f729a59c700 1 -- 172.21.15.59:0/1442566061 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f729c0cf470 con 0x7f729c15b730 2023-09-21T00:18:23.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.338+0000 7f729a59c700 1 --2- 172.21.15.59:0/1442566061 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f729c15b730 0x7f729c0b2be0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f729c072b50 tx=0x7f728c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=520ac235387edeb8 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:23.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.338+0000 7f729959a700 1 -- 172.21.15.59:0/1442566061 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728c005e30 con 0x7f729c15b730 2023-09-21T00:18:23.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.338+0000 7f729959a700 1 -- 172.21.15.59:0/1442566061 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f728c006030 con 0x7f729c15b730 2023-09-21T00:18:23.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.338+0000 7f729959a700 1 -- 172.21.15.59:0/1442566061 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728c0063c0 con 0x7f729c15b730 2023-09-21T00:18:23.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.339+0000 7f72a0bc1700 1 -- 172.21.15.59:0/1442566061 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f729c15b730 msgr2=0x7f729c0b2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:23.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.339+0000 7f72a0bc1700 1 --2- 172.21.15.59:0/1442566061 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f729c15b730 0x7f729c0b2be0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f729c072b50 tx=0x7f728c009bd0 comp rx=0 tx=0).stop 2023-09-21T00:18:23.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.339+0000 7f72a0bc1700 1 -- 172.21.15.59:0/1442566061 shutdown_connections 2023-09-21T00:18:23.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.339+0000 7f72a0bc1700 1 --2- 172.21.15.59:0/1442566061 >> v2:172.21.15.83:3300/0 conn(0x7f729c0ccbf0 0x7f729c0b3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:23.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.339+0000 7f72a0bc1700 1 --2- 172.21.15.59:0/1442566061 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f729c15b730 0x7f729c0b2be0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:23.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.339+0000 7f72a0bc1700 1 -- 172.21.15.59:0/1442566061 >> 172.21.15.59:0/1442566061 conn(0x7f729c0d1160 msgr2=0x7f729c0d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:23.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.339+0000 7f72a0bc1700 1 -- 172.21.15.59:0/1442566061 shutdown_connections 2023-09-21T00:18:23.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.339+0000 7f72a0bc1700 1 -- 172.21.15.59:0/1442566061 wait complete. 2023-09-21T00:18:23.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.340+0000 7f72a0bc1700 1 Processor -- start 2023-09-21T00:18:23.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.340+0000 7f72a0bc1700 1 -- start start 2023-09-21T00:18:23.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.341+0000 7f72a0bc1700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f729c0ccbf0 0x7f729c152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:23.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.341+0000 7f72a0bc1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f729c0ceeb0 0x7f729c152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:23.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.341+0000 7f72a0bc1700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f729c15b730 0x7f729c153500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:23.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.341+0000 7f72a0bc1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f729c0c7720 con 0x7f729c0ceeb0 2023-09-21T00:18:23.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.341+0000 7f72a0bc1700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f729c0ca3c0 con 0x7f729c15b730 2023-09-21T00:18:23.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.341+0000 7f72a0bc1700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f729c0c97b0 con 0x7f729c0ccbf0 2023-09-21T00:18:23.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.341+0000 7f7299d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f729c0ceeb0 0x7f729c152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:23.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.341+0000 7f7299d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f729c0ceeb0 0x7f729c152fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53288/0 (socket says 172.21.15.59:53288) 2023-09-21T00:18:23.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.341+0000 7f7299d9b700 1 -- 172.21.15.59:0/4242236105 learned_addr learned my addr 172.21.15.59:0/4242236105 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:23.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.341+0000 7f729ad9d700 1 --2- 172.21.15.59:0/4242236105 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f729c15b730 0x7f729c153500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:23.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.341+0000 7f729a59c700 1 --2- 172.21.15.59:0/4242236105 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f729c0ccbf0 0x7f729c152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:23.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.341+0000 7f7299d9b700 1 -- 172.21.15.59:0/4242236105 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f729c0ccbf0 msgr2=0x7f729c152580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:23.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.341+0000 7f7299d9b700 1 --2- 172.21.15.59:0/4242236105 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f729c0ccbf0 0x7f729c152580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:23.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.341+0000 7f7299d9b700 1 -- 172.21.15.59:0/4242236105 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f729c15b730 msgr2=0x7f729c153500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:23.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.341+0000 7f7299d9b700 1 --2- 172.21.15.59:0/4242236105 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f729c15b730 0x7f729c153500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:23.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.341+0000 7f7299d9b700 1 -- 172.21.15.59:0/4242236105 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f728c009500 con 0x7f729c0ceeb0 2023-09-21T00:18:23.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.342+0000 7f7299d9b700 1 --2- 172.21.15.59:0/4242236105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f729c0ceeb0 0x7f729c152fc0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f728400b4a0 tx=0x7f728400b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:23.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.342+0000 7f7292ffd700 1 -- 172.21.15.59:0/4242236105 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7284011830 con 0x7f729c0ceeb0 2023-09-21T00:18:23.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.342+0000 7f7292ffd700 1 -- 172.21.15.59:0/4242236105 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7284011990 con 0x7f729c0ceeb0 2023-09-21T00:18:23.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.342+0000 7f72a0bc1700 1 -- 172.21.15.59:0/4242236105 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f729c0c9a90 con 0x7f729c0ceeb0 2023-09-21T00:18:23.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.342+0000 7f7292ffd700 1 -- 172.21.15.59:0/4242236105 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7284011d40 con 0x7f729c0ceeb0 2023-09-21T00:18:23.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.342+0000 7f72a0bc1700 1 -- 172.21.15.59:0/4242236105 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f729c0ca050 con 0x7f729c0ceeb0 2023-09-21T00:18:23.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.343+0000 7f72a0bc1700 1 -- 172.21.15.59:0/4242236105 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f729c068c50 con 0x7f729c0ceeb0 2023-09-21T00:18:23.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.343+0000 7f7292ffd700 1 -- 172.21.15.59:0/4242236105 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f728401a400 con 0x7f729c0ceeb0 2023-09-21T00:18:23.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.343+0000 7f7292ffd700 1 --2- 172.21.15.59:0/4242236105 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f727c06ae00 0x7f727c06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:23.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.344+0000 7f7292ffd700 1 -- 172.21.15.59:0/4242236105 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f72840890b0 con 0x7f729c0ceeb0 2023-09-21T00:18:23.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.344+0000 7f729a59c700 1 --2- 172.21.15.59:0/4242236105 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f727c06ae00 0x7f727c06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:23.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.344+0000 7f729a59c700 1 --2- 172.21.15.59:0/4242236105 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f727c06ae00 0x7f727c06d2c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f728c000c00 tx=0x7f728c008070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:23.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.348+0000 7f7292ffd700 1 -- 172.21.15.59:0/4242236105 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f7284054360 con 0x7f729c0ceeb0 2023-09-21T00:18:23.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.634+0000 7f72a0bc1700 1 -- 172.21.15.59:0/4242236105 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f729c067e50 con 0x7f729c0ceeb0 2023-09-21T00:18:23.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.640+0000 7f7292ffd700 1 -- 172.21.15.59:0/4242236105 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7284057980 con 0x7f729c0ceeb0 2023-09-21T00:18:23.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.642+0000 7f72a0bc1700 1 -- 172.21.15.59:0/4242236105 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f727c06ae00 msgr2=0x7f727c06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:23.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.642+0000 7f72a0bc1700 1 --2- 172.21.15.59:0/4242236105 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f727c06ae00 0x7f727c06d2c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f728c000c00 tx=0x7f728c008070 comp rx=0 tx=0).stop 2023-09-21T00:18:23.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.642+0000 7f72a0bc1700 1 -- 172.21.15.59:0/4242236105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f729c0ceeb0 msgr2=0x7f729c152fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:23.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.642+0000 7f72a0bc1700 1 --2- 172.21.15.59:0/4242236105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f729c0ceeb0 0x7f729c152fc0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f728400b4a0 tx=0x7f728400b7b0 comp rx=0 tx=0).stop 2023-09-21T00:18:23.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.642+0000 7f72a0bc1700 1 -- 172.21.15.59:0/4242236105 shutdown_connections 2023-09-21T00:18:23.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.642+0000 7f72a0bc1700 1 --2- 172.21.15.59:0/4242236105 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f729c15b730 0x7f729c153500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:23.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.642+0000 7f72a0bc1700 1 --2- 172.21.15.59:0/4242236105 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f727c06ae00 0x7f727c06d2c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:23.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.642+0000 7f72a0bc1700 1 --2- 172.21.15.59:0/4242236105 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f729c0ccbf0 0x7f729c152580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:23.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.642+0000 7f72a0bc1700 1 --2- 172.21.15.59:0/4242236105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f729c0ceeb0 0x7f729c152fc0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:23.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.642+0000 7f72a0bc1700 1 -- 172.21.15.59:0/4242236105 >> 172.21.15.59:0/4242236105 conn(0x7f729c0d1160 msgr2=0x7f729c06f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:23.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.642+0000 7f72a0bc1700 1 -- 172.21.15.59:0/4242236105 shutdown_connections 2023-09-21T00:18:23.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.642+0000 7f72a0bc1700 1 -- 172.21.15.59:0/4242236105 wait complete. 2023-09-21T00:18:23.655 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-09-21T00:18:23.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.781+0000 7f34efb93700 1 Processor -- start 2023-09-21T00:18:23.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.781+0000 7f34efb93700 1 -- start start 2023-09-21T00:18:23.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.782+0000 7f34efb93700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f34e8160cd0 0x7f34e80cb720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:23.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.782+0000 7f34efb93700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f34e806f780 0x7f34e80b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:23.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.782+0000 7f34efb93700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f34e80b0690 0x7f34e80b3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:23.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.782+0000 7f34efb93700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34e81610b0 con 0x7f34e80b0690 2023-09-21T00:18:23.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.782+0000 7f34efb93700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34e80cf6a0 con 0x7f34e8160cd0 2023-09-21T00:18:23.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.782+0000 7f34efb93700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e80b00d0 con 0x7f34e806f780 2023-09-21T00:18:23.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.782+0000 7f34ee130700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f34e80b0690 0x7f34e80b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:23.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.782+0000 7f34ee130700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f34e80b0690 0x7f34e80b3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53298/0 (socket says 172.21.15.59:53298) 2023-09-21T00:18:23.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.782+0000 7f34ee130700 1 -- 172.21.15.59:0/1855592705 learned_addr learned my addr 172.21.15.59:0/1855592705 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:23.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.783+0000 7f34ed92f700 1 --2- 172.21.15.59:0/1855592705 >> v2:172.21.15.83:3300/0 conn(0x7f34e8160cd0 0x7f34e80cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:23.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.783+0000 7f34ed12e700 1 --2- 172.21.15.59:0/1855592705 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f34e806f780 0x7f34e80b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:23.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.783+0000 7f34ee130700 1 -- 172.21.15.59:0/1855592705 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f34e806f780 msgr2=0x7f34e80b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:23.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.783+0000 7f34ee130700 1 --2- 172.21.15.59:0/1855592705 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f34e806f780 0x7f34e80b2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:23.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.783+0000 7f34ee130700 1 -- 172.21.15.59:0/1855592705 >> v2:172.21.15.83:3300/0 conn(0x7f34e8160cd0 msgr2=0x7f34e80cb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:23.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.783+0000 7f34ee130700 1 --2- 172.21.15.59:0/1855592705 >> v2:172.21.15.83:3300/0 conn(0x7f34e8160cd0 0x7f34e80cb720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:23.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.783+0000 7f34ee130700 1 -- 172.21.15.59:0/1855592705 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e806e610 con 0x7f34e80b0690 2023-09-21T00:18:23.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.783+0000 7f34ed92f700 1 --2- 172.21.15.59:0/1855592705 >> v2:172.21.15.83:3300/0 conn(0x7f34e8160cd0 0x7f34e80cb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:18:23.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.783+0000 7f34ee130700 1 --2- 172.21.15.59:0/1855592705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34e80b0690 0x7f34e80b3120 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f34e808b680 tx=0x7f34e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c996967c54a15a5 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:23.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.783+0000 7f34ec92d700 1 -- 172.21.15.59:0/1855592705 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e000e070 con 0x7f34e80b0690 2023-09-21T00:18:23.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.783+0000 7f34ec92d700 1 -- 172.21.15.59:0/1855592705 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e000b9c0 con 0x7f34e80b0690 2023-09-21T00:18:23.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.783+0000 7f34ec92d700 1 -- 172.21.15.59:0/1855592705 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e000bd70 con 0x7f34e80b0690 2023-09-21T00:18:23.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.784+0000 7f34efb93700 1 -- 172.21.15.59:0/1855592705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34e80b0690 msgr2=0x7f34e80b3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:23.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.784+0000 7f34efb93700 1 --2- 172.21.15.59:0/1855592705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34e80b0690 0x7f34e80b3120 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f34e808b680 tx=0x7f34e000b330 comp rx=0 tx=0).stop 2023-09-21T00:18:23.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.784+0000 7f34efb93700 1 -- 172.21.15.59:0/1855592705 shutdown_connections 2023-09-21T00:18:23.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.784+0000 7f34efb93700 1 --2- 172.21.15.59:0/1855592705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34e80b0690 0x7f34e80b3120 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:23.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.784+0000 7f34efb93700 1 --2- 172.21.15.59:0/1855592705 >> v2:172.21.15.83:3300/0 conn(0x7f34e8160cd0 0x7f34e80cb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:23.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.784+0000 7f34efb93700 1 --2- 172.21.15.59:0/1855592705 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f34e806f780 0x7f34e80b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:23.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.784+0000 7f34efb93700 1 -- 172.21.15.59:0/1855592705 >> 172.21.15.59:0/1855592705 conn(0x7f34e80d1160 msgr2=0x7f34e80d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:23.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.784+0000 7f34efb93700 1 -- 172.21.15.59:0/1855592705 shutdown_connections 2023-09-21T00:18:23.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.784+0000 7f34efb93700 1 -- 172.21.15.59:0/1855592705 wait complete. 2023-09-21T00:18:23.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.785+0000 7f34efb93700 1 Processor -- start 2023-09-21T00:18:23.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.785+0000 7f34efb93700 1 -- start start 2023-09-21T00:18:23.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.786+0000 7f34efb93700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f34e806f780 0x7f34e815a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:23.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.786+0000 7f34efb93700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f34e80b0690 0x7f34e80c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:23.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.786+0000 7f34efb93700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34e8160cd0 0x7f34e80c6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:23.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.786+0000 7f34efb93700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e80c8f20 con 0x7f34e8160cd0 2023-09-21T00:18:23.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.786+0000 7f34efb93700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e80c5940 con 0x7f34e80b0690 2023-09-21T00:18:23.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.786+0000 7f34efb93700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e81f30e0 con 0x7f34e806f780 2023-09-21T00:18:23.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.786+0000 7f34ee130700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34e8160cd0 0x7f34e80c6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:23.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.786+0000 7f34ee130700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34e8160cd0 0x7f34e80c6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53304/0 (socket says 172.21.15.59:53304) 2023-09-21T00:18:23.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.787+0000 7f34ee130700 1 -- 172.21.15.59:0/361260496 learned_addr learned my addr 172.21.15.59:0/361260496 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:23.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.787+0000 7f34ed92f700 1 --2- 172.21.15.59:0/361260496 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f34e806f780 0x7f34e815a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:23.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.787+0000 7f34ed12e700 1 --2- 172.21.15.59:0/361260496 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f34e80b0690 0x7f34e80c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:23.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.787+0000 7f34ee130700 1 -- 172.21.15.59:0/361260496 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f34e806f780 msgr2=0x7f34e815a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:23.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.787+0000 7f34ee130700 1 --2- 172.21.15.59:0/361260496 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f34e806f780 0x7f34e815a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:23.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.787+0000 7f34ee130700 1 -- 172.21.15.59:0/361260496 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f34e80b0690 msgr2=0x7f34e80c89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:23.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.787+0000 7f34ee130700 1 --2- 172.21.15.59:0/361260496 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f34e80b0690 0x7f34e80c89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:23.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.787+0000 7f34ee130700 1 -- 172.21.15.59:0/361260496 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e0009b30 con 0x7f34e8160cd0 2023-09-21T00:18:23.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.787+0000 7f34ee130700 1 --2- 172.21.15.59:0/361260496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34e8160cd0 0x7f34e80c6d90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f34e808b9e0 tx=0x7f34e0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:23.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.787+0000 7f34de7fc700 1 -- 172.21.15.59:0/361260496 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e00099b0 con 0x7f34e8160cd0 2023-09-21T00:18:23.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.787+0000 7f34de7fc700 1 -- 172.21.15.59:0/361260496 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e0004250 con 0x7f34e8160cd0 2023-09-21T00:18:23.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.787+0000 7f34efb93700 1 -- 172.21.15.59:0/361260496 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34e81f33c0 con 0x7f34e8160cd0 2023-09-21T00:18:23.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.787+0000 7f34de7fc700 1 -- 172.21.15.59:0/361260496 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e0004600 con 0x7f34e8160cd0 2023-09-21T00:18:23.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.787+0000 7f34efb93700 1 -- 172.21.15.59:0/361260496 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34e81f3980 con 0x7f34e8160cd0 2023-09-21T00:18:23.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.788+0000 7f34efb93700 1 -- 172.21.15.59:0/361260496 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34e8067e50 con 0x7f34e8160cd0 2023-09-21T00:18:23.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.789+0000 7f34de7fc700 1 -- 172.21.15.59:0/361260496 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f34e0004760 con 0x7f34e8160cd0 2023-09-21T00:18:23.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.789+0000 7f34de7fc700 1 --2- 172.21.15.59:0/361260496 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f34cc06ae00 0x7f34cc06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:23.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.789+0000 7f34de7fc700 1 -- 172.21.15.59:0/361260496 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f34e008a6c0 con 0x7f34e8160cd0 2023-09-21T00:18:23.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.789+0000 7f34ed92f700 1 --2- 172.21.15.59:0/361260496 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f34cc06ae00 0x7f34cc06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:23.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.790+0000 7f34ed92f700 1 --2- 172.21.15.59:0/361260496 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f34cc06ae00 0x7f34cc06d2c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f34d800c960 tx=0x7f34d8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:23.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:23.793+0000 7f34de7fc700 1 -- 172.21.15.59:0/361260496 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f34e0055b30 con 0x7f34e8160cd0 2023-09-21T00:18:24.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.076+0000 7f34efb93700 1 -- 172.21.15.59:0/361260496 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f34e80cb1d0 con 0x7f34e8160cd0 2023-09-21T00:18:24.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.079+0000 7f34de7fc700 1 -- 172.21.15.59:0/361260496 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f34e00200a0 con 0x7f34e8160cd0 2023-09-21T00:18:24.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.081+0000 7f34efb93700 1 -- 172.21.15.59:0/361260496 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f34cc06ae00 msgr2=0x7f34cc06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:24.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.081+0000 7f34efb93700 1 --2- 172.21.15.59:0/361260496 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f34cc06ae00 0x7f34cc06d2c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f34d800c960 tx=0x7f34d8008040 comp rx=0 tx=0).stop 2023-09-21T00:18:24.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.081+0000 7f34efb93700 1 -- 172.21.15.59:0/361260496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34e8160cd0 msgr2=0x7f34e80c6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:24.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.081+0000 7f34efb93700 1 --2- 172.21.15.59:0/361260496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34e8160cd0 0x7f34e80c6d90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f34e808b9e0 tx=0x7f34e0004ad0 comp rx=0 tx=0).stop 2023-09-21T00:18:24.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.082+0000 7f34efb93700 1 -- 172.21.15.59:0/361260496 shutdown_connections 2023-09-21T00:18:24.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.082+0000 7f34efb93700 1 --2- 172.21.15.59:0/361260496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34e8160cd0 0x7f34e80c6d90 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:24.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.082+0000 7f34efb93700 1 --2- 172.21.15.59:0/361260496 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f34cc06ae00 0x7f34cc06d2c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:24.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.082+0000 7f34efb93700 1 --2- 172.21.15.59:0/361260496 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f34e806f780 0x7f34e815a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:24.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.082+0000 7f34efb93700 1 --2- 172.21.15.59:0/361260496 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f34e80b0690 0x7f34e80c89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:24.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.082+0000 7f34efb93700 1 -- 172.21.15.59:0/361260496 >> 172.21.15.59:0/361260496 conn(0x7f34e80d1160 msgr2=0x7f34e815b490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:24.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.082+0000 7f34efb93700 1 -- 172.21.15.59:0/361260496 shutdown_connections 2023-09-21T00:18:24.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.082+0000 7f34efb93700 1 -- 172.21.15.59:0/361260496 wait complete. 2023-09-21T00:18:24.095 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T00:18:24.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.219+0000 7f5dbb6c6700 1 Processor -- start 2023-09-21T00:18:24.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.219+0000 7f5dbb6c6700 1 -- start start 2023-09-21T00:18:24.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.220+0000 7f5dbb6c6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5db415b2b0 0x7f5db40cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:24.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.220+0000 7f5dbb6c6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5db406a780 0x7f5db406abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:24.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.220+0000 7f5dbb6c6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5db406b110 con 0x7f5db40ce420 2023-09-21T00:18:24.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.220+0000 7f5dbb6c6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5db40ce250 con 0x7f5db406a780 2023-09-21T00:18:24.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.220+0000 7f5dbb6c6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5db41618a0 con 0x7f5db415b2b0 2023-09-21T00:18:24.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.220+0000 7f5db9c63700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5db406a780 0x7f5db406abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:24.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.220+0000 7f5db8c61700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5db40ce420 0x7f5db4161190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58876/0 (socket says 172.21.15.59:58876) 2023-09-21T00:18:24.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.220+0000 7f5db8c61700 1 -- 172.21.15.59:0/3133316835 learned_addr learned my addr 172.21.15.59:0/3133316835 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:24.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.220+0000 7f5db9462700 1 --2- 172.21.15.59:0/3133316835 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5db415b2b0 0x7f5db40cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:24.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.220+0000 7f5db9c63700 1 -- 172.21.15.59:0/3133316835 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5db415b2b0 msgr2=0x7f5db40cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:24.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.220+0000 7f5db9c63700 1 --2- 172.21.15.59:0/3133316835 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5db415b2b0 0x7f5db40cdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:24.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.220+0000 7f5db9c63700 1 -- 172.21.15.59:0/3133316835 >> v1:172.21.15.59:6789/0 conn(0x7f5db40ce420 legacy=0x7f5db4161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:24.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.220+0000 7f5dabfff700 1 -- 172.21.15.59:0/3133316835 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1352966911 0 0) 0x7f5db0001110 con 0x7f5db40ce420 2023-09-21T00:18:24.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.220+0000 7f5db9c63700 1 -- 172.21.15.59:0/3133316835 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db40cfee0 con 0x7f5db406a780 2023-09-21T00:18:24.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.220+0000 7f5db9462700 1 --2- 172.21.15.59:0/3133316835 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5db415b2b0 0x7f5db40cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:18:24.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.221+0000 7f5db9c63700 1 --2- 172.21.15.59:0/3133316835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5db406a780 0x7f5db406abd0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f5dac009d90 tx=0x7f5dac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3678a4c97b3379eb server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:24.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.221+0000 7f5dabfff700 1 -- 172.21.15.59:0/3133316835 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dac00e070 con 0x7f5db406a780 2023-09-21T00:18:24.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.221+0000 7f5dabfff700 1 -- 172.21.15.59:0/3133316835 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dac00bbd0 con 0x7f5db406a780 2023-09-21T00:18:24.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.221+0000 7f5dabfff700 1 -- 172.21.15.59:0/3133316835 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dac012430 con 0x7f5db406a780 2023-09-21T00:18:24.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.221+0000 7f5dbb6c6700 1 -- 172.21.15.59:0/3133316835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5db406a780 msgr2=0x7f5db406abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:24.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.221+0000 7f5dbb6c6700 1 --2- 172.21.15.59:0/3133316835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5db406a780 0x7f5db406abd0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f5dac009d90 tx=0x7f5dac00b330 comp rx=0 tx=0).stop 2023-09-21T00:18:24.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.221+0000 7f5dbb6c6700 1 -- 172.21.15.59:0/3133316835 shutdown_connections 2023-09-21T00:18:24.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.221+0000 7f5dbb6c6700 1 --2- 172.21.15.59:0/3133316835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5db406a780 0x7f5db406abd0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:24.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.221+0000 7f5dbb6c6700 1 --2- 172.21.15.59:0/3133316835 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5db415b2b0 0x7f5db40cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:24.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.221+0000 7f5dbb6c6700 1 -- 172.21.15.59:0/3133316835 >> 172.21.15.59:0/3133316835 conn(0x7f5db40d0140 msgr2=0x7f5db40d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:24.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.221+0000 7f5dbb6c6700 1 -- 172.21.15.59:0/3133316835 shutdown_connections 2023-09-21T00:18:24.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.221+0000 7f5dbb6c6700 1 -- 172.21.15.59:0/3133316835 wait complete. 2023-09-21T00:18:24.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.223+0000 7f5dbb6c6700 1 Processor -- start 2023-09-21T00:18:24.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.223+0000 7f5dbb6c6700 1 -- start start 2023-09-21T00:18:24.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.223+0000 7f5dbb6c6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5db406a780 0x7f5db40aee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:24.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.223+0000 7f5dbb6c6700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5db40ce420 0x7f5db40c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:24.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.223+0000 7f5dbb6c6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5db415b2b0 0x7f5db40c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:24.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.223+0000 7f5dbb6c6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db4147d70 con 0x7f5db415b2b0 2023-09-21T00:18:24.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.223+0000 7f5dbb6c6700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db40c9020 con 0x7f5db406a780 2023-09-21T00:18:24.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.223+0000 7f5dbb6c6700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5db40c9300 con 0x7f5db40ce420 2023-09-21T00:18:24.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.224+0000 7f5db9c63700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5db415b2b0 0x7f5db40c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:24.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.224+0000 7f5db9c63700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5db415b2b0 0x7f5db40c5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53318/0 (socket says 172.21.15.59:53318) 2023-09-21T00:18:24.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.224+0000 7f5db9c63700 1 -- 172.21.15.59:0/1120320618 learned_addr learned my addr 172.21.15.59:0/1120320618 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:24.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.224+0000 7f5db8c61700 1 --2- 172.21.15.59:0/1120320618 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5db40ce420 0x7f5db40c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:24.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.224+0000 7f5db9462700 1 --2- 172.21.15.59:0/1120320618 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5db406a780 0x7f5db40aee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:24.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.224+0000 7f5db9c63700 1 -- 172.21.15.59:0/1120320618 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5db40ce420 msgr2=0x7f5db40c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:24.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.224+0000 7f5db9c63700 1 --2- 172.21.15.59:0/1120320618 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5db40ce420 0x7f5db40c8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:24.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.224+0000 7f5db9c63700 1 -- 172.21.15.59:0/1120320618 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5db406a780 msgr2=0x7f5db40aee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:24.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.224+0000 7f5db9c63700 1 --2- 172.21.15.59:0/1120320618 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5db406a780 0x7f5db40aee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:24.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.224+0000 7f5db9c63700 1 -- 172.21.15.59:0/1120320618 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dac009a70 con 0x7f5db415b2b0 2023-09-21T00:18:24.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.224+0000 7f5db9462700 1 --2- 172.21.15.59:0/1120320618 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5db406a780 0x7f5db40aee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:18:24.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.224+0000 7f5db9c63700 1 --2- 172.21.15.59:0/1120320618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5db415b2b0 0x7f5db40c5ec0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5db40728c0 tx=0x7f5dac004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:24.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.224+0000 7f5da9ffb700 1 -- 172.21.15.59:0/1120320618 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dac012430 con 0x7f5db415b2b0 2023-09-21T00:18:24.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.224+0000 7f5da9ffb700 1 -- 172.21.15.59:0/1120320618 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dac020070 con 0x7f5db415b2b0 2023-09-21T00:18:24.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.224+0000 7f5dbb6c6700 1 -- 172.21.15.59:0/1120320618 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5db40c95e0 con 0x7f5db415b2b0 2023-09-21T00:18:24.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.224+0000 7f5da9ffb700 1 -- 172.21.15.59:0/1120320618 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dac003ea0 con 0x7f5db415b2b0 2023-09-21T00:18:24.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.225+0000 7f5dbb6c6700 1 -- 172.21.15.59:0/1120320618 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5db414ab30 con 0x7f5db415b2b0 2023-09-21T00:18:24.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.225+0000 7f5dbb6c6700 1 -- 172.21.15.59:0/1120320618 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5db4067e50 con 0x7f5db415b2b0 2023-09-21T00:18:24.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.226+0000 7f5da9ffb700 1 -- 172.21.15.59:0/1120320618 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f5dac004280 con 0x7f5db415b2b0 2023-09-21T00:18:24.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.226+0000 7f5da9ffb700 1 --2- 172.21.15.59:0/1120320618 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f5d9806ae00 0x7f5d9806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:24.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.226+0000 7f5da9ffb700 1 -- 172.21.15.59:0/1120320618 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f5dac022070 con 0x7f5db415b2b0 2023-09-21T00:18:24.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.227+0000 7f5db9462700 1 --2- 172.21.15.59:0/1120320618 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f5d9806ae00 0x7f5d9806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:24.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.227+0000 7f5db9462700 1 --2- 172.21.15.59:0/1120320618 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f5d9806ae00 0x7f5d9806d2c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5da400aa20 tx=0x7f5da4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:24.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.231+0000 7f5da9ffb700 1 -- 172.21.15.59:0/1120320618 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f5dac056740 con 0x7f5db415b2b0 2023-09-21T00:18:24.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.431+0000 7f5dbb6c6700 1 -- 172.21.15.59:0/1120320618 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5db4070040 con 0x7f5db415b2b0 2023-09-21T00:18:24.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.432+0000 7f5da9ffb700 1 -- 172.21.15.59:0/1120320618 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+12978 (secure 0 0 0) 0x7f5dac059d60 con 0x7f5db415b2b0 2023-09-21T00:18:24.433 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:18:24.433 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":34,"fsid":"dd69925c-6e25-42fe-880b-2f60fc6f384b","created":"2023-09-21T00:16:43.074489+0000","modified":"2023-09-21T00:18:20.956161+0000","last_up_change":"2023-09-21T00:16:54.740101+0000","last_in_change":"2023-09-21T00:16:45.987089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T00:16:54.796248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d4b18344-74c0-4f75-920b-7a9247e48914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6809","nonce":2418314235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6811","nonce":2418314235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6815","nonce":2418314235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6813","nonce":2418314235}]},"public_addr":"172.21.15.59:6809/2418314235","cluster_addr":"172.21.15.59:6811/2418314235","heartbeat_back_addr":"172.21.15.59:6815/2418314235","heartbeat_front_addr":"172.21.15.59:6813/2418314235","state":["exists","up"]},{"osd":1,"uuid":"80940d50-a248-4e64-a282-7ffcdad790ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6801","nonce":869668251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6803","nonce":869668251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6807","nonce":869668251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6805","nonce":869668251}]},"public_addr":"172.21.15.59:6801/869668251","cluster_addr":"172.21.15.59:6803/869668251","heartbeat_back_addr":"172.21.15.59:6807/869668251","heartbeat_front_addr":"172.21.15.59:6805/869668251","state":["exists","up"]},{"osd":2,"uuid":"55f2eceb-c54a-4879-a6ce-968c1c548b5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6817","nonce":372517778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6819","nonce":372517778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6823","nonce":372517778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6821","nonce":372517778}]},"public_addr":"172.21.15.59:6817/372517778","cluster_addr":"172.21.15.59:6819/372517778","heartbeat_back_addr":"172.21.15.59:6823/372517778","heartbeat_front_addr":"172.21.15.59:6821/372517778","state":["exists","up"]},{"osd":3,"uuid":"92b89cd0-869c-49b9-a9f9-97ac8423f304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6825","nonce":575188498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6827","nonce":575188498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6831","nonce":575188498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6829","nonce":575188498}]},"public_addr":"172.21.15.59:6825/575188498","cluster_addr":"172.21.15.59:6827/575188498","heartbeat_back_addr":"172.21.15.59:6831/575188498","heartbeat_front_addr":"172.21.15.59:6829/575188498","state":["exists","up"]},{"osd":4,"uuid":"25b80e94-e0e6-403d-b69f-61542f289637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6803","nonce":1741219098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6805","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6807","nonce":1741219098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6815","nonce":1741219098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6811","nonce":1741219098}]},"public_addr":"172.21.15.83:6803/1741219098","cluster_addr":"172.21.15.83:6807/1741219098","heartbeat_back_addr":"172.21.15.83:6815/1741219098","heartbeat_front_addr":"172.21.15.83:6811/1741219098","state":["exists","up"]},{"osd":5,"uuid":"5498d9ab-1086-4796-a199-9051e6dfea91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6817","nonce":156730565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6819","nonce":156730565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6823","nonce":156730565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6821","nonce":156730565}]},"public_addr":"172.21.15.83:6817/156730565","cluster_addr":"172.21.15.83:6819/156730565","heartbeat_back_addr":"172.21.15.83:6823/156730565","heartbeat_front_addr":"172.21.15.83:6821/156730565","state":["exists","up"]},{"osd":6,"uuid":"cfd810c0-5015-4d60-9a75-7efc93a32e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6801","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6800","nonce":1337723778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6806","nonce":1337723778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6814","nonce":1337723778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6810","nonce":1337723778}]},"public_addr":"172.21.15.83:6800/1337723778","cluster_addr":"172.21.15.83:6806/1337723778","heartbeat_back_addr":"172.21.15.83:6814/1337723778","heartbeat_front_addr":"172.21.15.83:6810/1337723778","state":["exists","up"]},{"osd":7,"uuid":"e992c8fa-0a3d-4b3c-85b5-2c511223dee4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6825","nonce":4204859272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6827","nonce":4204859272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6831","nonce":4204859272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6829","nonce":4204859272}]},"public_addr":"172.21.15.83:6825/4204859272","cluster_addr":"172.21.15.83:6827/4204859272","heartbeat_back_addr":"172.21.15.83:6831/4204859272","heartbeat_front_addr":"172.21.15.83:6829/4204859272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.156498+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.882707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.093978+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.158565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.173933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.888606+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.135525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.149712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T00:18:24.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.434+0000 7f5dbb6c6700 1 -- 172.21.15.59:0/1120320618 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f5d9806ae00 msgr2=0x7f5d9806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:24.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.434+0000 7f5dbb6c6700 1 --2- 172.21.15.59:0/1120320618 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f5d9806ae00 0x7f5d9806d2c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5da400aa20 tx=0x7f5da4008040 comp rx=0 tx=0).stop 2023-09-21T00:18:24.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.434+0000 7f5dbb6c6700 1 -- 172.21.15.59:0/1120320618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5db415b2b0 msgr2=0x7f5db40c5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:24.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.434+0000 7f5dbb6c6700 1 --2- 172.21.15.59:0/1120320618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5db415b2b0 0x7f5db40c5ec0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5db40728c0 tx=0x7f5dac004ad0 comp rx=0 tx=0).stop 2023-09-21T00:18:24.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.434+0000 7f5dbb6c6700 1 -- 172.21.15.59:0/1120320618 shutdown_connections 2023-09-21T00:18:24.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.434+0000 7f5dbb6c6700 1 --2- 172.21.15.59:0/1120320618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5db415b2b0 0x7f5db40c5ec0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:24.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.434+0000 7f5dbb6c6700 1 --2- 172.21.15.59:0/1120320618 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5db406a780 0x7f5db40aee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:24.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.434+0000 7f5dbb6c6700 1 --2- 172.21.15.59:0/1120320618 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f5d9806ae00 0x7f5d9806d2c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:24.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.434+0000 7f5dbb6c6700 1 --2- 172.21.15.59:0/1120320618 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5db40ce420 0x7f5db40c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:24.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.434+0000 7f5dbb6c6700 1 -- 172.21.15.59:0/1120320618 >> 172.21.15.59:0/1120320618 conn(0x7f5db40d0140 msgr2=0x7f5db415a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:24.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.434+0000 7f5dbb6c6700 1 -- 172.21.15.59:0/1120320618 shutdown_connections 2023-09-21T00:18:24.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.434+0000 7f5dbb6c6700 1 -- 172.21.15.59:0/1120320618 wait complete. 2023-09-21T00:18:24.447 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-21T00:16:54.796248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-21T00:18:24.448 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-21T00:18:24.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.576+0000 7fd2ec18b700 1 Processor -- start 2023-09-21T00:18:24.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.576+0000 7fd2ec18b700 1 -- start start 2023-09-21T00:18:24.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.577+0000 7fd2ec18b700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd2e415b2b0 0x7fd2e40cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:24.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.577+0000 7fd2ec18b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2e406a780 0x7fd2e406abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:24.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.577+0000 7fd2ec18b700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e406b110 con 0x7fd2e40ce420 2023-09-21T00:18:24.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.577+0000 7fd2ec18b700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2e40ce250 con 0x7fd2e415b2b0 2023-09-21T00:18:24.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.577+0000 7fd2ec18b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e41618a0 con 0x7fd2e406a780 2023-09-21T00:18:24.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.577+0000 7fd2e9f27700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd2e415b2b0 0x7fd2e40cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:24.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.577+0000 7fd2e9726700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fd2e40ce420 0x7fd2e4161190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.59:49392/0 (socket says 172.21.15.59:49392) 2023-09-21T00:18:24.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.577+0000 7fd2e9f27700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd2e415b2b0 0x7fd2e40cdd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.59:39438/0 (socket says 172.21.15.59:39438) 2023-09-21T00:18:24.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.577+0000 7fd2e9726700 1 -- 172.21.15.59:0/683549667 learned_addr learned my addr 172.21.15.59:0/683549667 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:24.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.577+0000 7fd2ea728700 1 --2- 172.21.15.59:0/683549667 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2e406a780 0x7fd2e406abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:24.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.578+0000 7fd2e9f27700 1 -- 172.21.15.59:0/683549667 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2e406a780 msgr2=0x7fd2e406abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:24.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.578+0000 7fd2e9f27700 1 --2- 172.21.15.59:0/683549667 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2e406a780 0x7fd2e406abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:24.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.578+0000 7fd2e9f27700 1 -- 172.21.15.59:0/683549667 >> v1:172.21.15.83:6789/0 conn(0x7fd2e40ce420 legacy=0x7fd2e4161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:24.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.578+0000 7fd2e8f25700 1 -- 172.21.15.59:0/683549667 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1081028163 0 0) 0x7fd2d4001110 con 0x7fd2e40ce420 2023-09-21T00:18:24.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.578+0000 7fd2e9f27700 1 -- 172.21.15.59:0/683549667 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e40cfee0 con 0x7fd2e415b2b0 2023-09-21T00:18:24.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.578+0000 7fd2e9f27700 1 --2- 172.21.15.59:0/683549667 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2e415b2b0 0x7fd2e40cdd10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0009840 tx=0x7fd2e0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98c93f3025847dc9 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:24.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.578+0000 7fd2e8f25700 1 -- 172.21.15.59:0/683549667 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e0011830 con 0x7fd2e415b2b0 2023-09-21T00:18:24.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.578+0000 7fd2e8f25700 1 -- 172.21.15.59:0/683549667 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e0011990 con 0x7fd2e415b2b0 2023-09-21T00:18:24.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.578+0000 7fd2e8f25700 1 -- 172.21.15.59:0/683549667 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e0011d20 con 0x7fd2e415b2b0 2023-09-21T00:18:24.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.579+0000 7fd2ec18b700 1 -- 172.21.15.59:0/683549667 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2e415b2b0 msgr2=0x7fd2e40cdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:24.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.579+0000 7fd2ec18b700 1 --2- 172.21.15.59:0/683549667 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2e415b2b0 0x7fd2e40cdd10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0009840 tx=0x7fd2e0009b50 comp rx=0 tx=0).stop 2023-09-21T00:18:24.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.579+0000 7fd2ec18b700 1 -- 172.21.15.59:0/683549667 shutdown_connections 2023-09-21T00:18:24.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.579+0000 7fd2ec18b700 1 --2- 172.21.15.59:0/683549667 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2e406a780 0x7fd2e406abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:24.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.579+0000 7fd2ec18b700 1 --2- 172.21.15.59:0/683549667 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2e415b2b0 0x7fd2e40cdd10 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:24.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.579+0000 7fd2ec18b700 1 -- 172.21.15.59:0/683549667 >> 172.21.15.59:0/683549667 conn(0x7fd2e40d0140 msgr2=0x7fd2e40d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:24.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.579+0000 7fd2ec18b700 1 -- 172.21.15.59:0/683549667 shutdown_connections 2023-09-21T00:18:24.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.579+0000 7fd2ec18b700 1 -- 172.21.15.59:0/683549667 wait complete. 2023-09-21T00:18:24.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.580+0000 7fd2ec18b700 1 Processor -- start 2023-09-21T00:18:24.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.580+0000 7fd2ec18b700 1 -- start start 2023-09-21T00:18:24.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.581+0000 7fd2ec18b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2e406a780 0x7fd2e4159290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:24.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.581+0000 7fd2ec18b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2e40ce420 0x7fd2e40c5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:24.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.581+0000 7fd2ec18b700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2e415b2b0 0x7fd2e40c5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:24.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.581+0000 7fd2ec18b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e4160990 con 0x7fd2e40ce420 2023-09-21T00:18:24.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.581+0000 7fd2ec18b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e4159c20 con 0x7fd2e406a780 2023-09-21T00:18:24.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.581+0000 7fd2ec18b700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e40c67c0 con 0x7fd2e415b2b0 2023-09-21T00:18:24.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.581+0000 7fd2e9726700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2e40ce420 0x7fd2e40c5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:24.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.581+0000 7fd2e9726700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2e40ce420 0x7fd2e40c5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53330/0 (socket says 172.21.15.59:53330) 2023-09-21T00:18:24.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.581+0000 7fd2e9726700 1 -- 172.21.15.59:0/3846933839 learned_addr learned my addr 172.21.15.59:0/3846933839 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:24.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.581+0000 7fd2ea728700 1 --2- 172.21.15.59:0/3846933839 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2e415b2b0 0x7fd2e40c5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:24.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.581+0000 7fd2e9f27700 1 --2- 172.21.15.59:0/3846933839 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2e406a780 0x7fd2e4159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:24.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.581+0000 7fd2e9726700 1 -- 172.21.15.59:0/3846933839 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2e415b2b0 msgr2=0x7fd2e40c5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:24.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.581+0000 7fd2e9726700 1 --2- 172.21.15.59:0/3846933839 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2e415b2b0 0x7fd2e40c5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:24.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.581+0000 7fd2e9726700 1 -- 172.21.15.59:0/3846933839 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2e406a780 msgr2=0x7fd2e4159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:24.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.581+0000 7fd2e9726700 1 --2- 172.21.15.59:0/3846933839 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2e406a780 0x7fd2e4159290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:24.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.581+0000 7fd2e9726700 1 -- 172.21.15.59:0/3846933839 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e00094a0 con 0x7fd2e40ce420 2023-09-21T00:18:24.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.581+0000 7fd2e9726700 1 --2- 172.21.15.59:0/3846933839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2e40ce420 0x7fd2e40c5800 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd2d400c550 tx=0x7fd2d400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:24.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.582+0000 7fd2da7fc700 1 -- 172.21.15.59:0/3846933839 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d4004c80 con 0x7fd2e40ce420 2023-09-21T00:18:24.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.582+0000 7fd2da7fc700 1 -- 172.21.15.59:0/3846933839 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d4004e00 con 0x7fd2e40ce420 2023-09-21T00:18:24.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.582+0000 7fd2da7fc700 1 -- 172.21.15.59:0/3846933839 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d4007310 con 0x7fd2e40ce420 2023-09-21T00:18:24.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.582+0000 7fd2ec18b700 1 -- 172.21.15.59:0/3846933839 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2e41602d0 con 0x7fd2e40ce420 2023-09-21T00:18:24.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.582+0000 7fd2ec18b700 1 -- 172.21.15.59:0/3846933839 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2e40c6aa0 con 0x7fd2e40ce420 2023-09-21T00:18:24.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.583+0000 7fd2ec18b700 1 -- 172.21.15.59:0/3846933839 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2e4067e50 con 0x7fd2e40ce420 2023-09-21T00:18:24.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.583+0000 7fd2da7fc700 1 -- 172.21.15.59:0/3846933839 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fd2d4007470 con 0x7fd2e40ce420 2023-09-21T00:18:24.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.583+0000 7fd2da7fc700 1 --2- 172.21.15.59:0/3846933839 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd2c806ae00 0x7fd2c806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:24.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.584+0000 7fd2da7fc700 1 -- 172.21.15.59:0/3846933839 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fd2d4088d60 con 0x7fd2e40ce420 2023-09-21T00:18:24.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.584+0000 7fd2e9f27700 1 --2- 172.21.15.59:0/3846933839 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd2c806ae00 0x7fd2c806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:24.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.584+0000 7fd2e9f27700 1 --2- 172.21.15.59:0/3846933839 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd2c806ae00 0x7fd2c806d2c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0009fd0 tx=0x7fd2e001c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:24.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.588+0000 7fd2da7fc700 1 -- 172.21.15.59:0/3846933839 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fd2d4054120 con 0x7fd2e40ce420 2023-09-21T00:18:24.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.789+0000 7fd2ec18b700 1 -- 172.21.15.59:0/3846933839 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd2e406b110 con 0x7fd2e40ce420 2023-09-21T00:18:24.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.789+0000 7fd2da7fc700 1 -- 172.21.15.59:0/3846933839 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd2e406b110 con 0x7fd2e40ce420 2023-09-21T00:18:24.791 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-09-21T00:18:24.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.791+0000 7fd2ec18b700 1 -- 172.21.15.59:0/3846933839 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd2c806ae00 msgr2=0x7fd2c806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:24.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.791+0000 7fd2ec18b700 1 --2- 172.21.15.59:0/3846933839 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd2c806ae00 0x7fd2c806d2c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0009fd0 tx=0x7fd2e001c040 comp rx=0 tx=0).stop 2023-09-21T00:18:24.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.791+0000 7fd2ec18b700 1 -- 172.21.15.59:0/3846933839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2e40ce420 msgr2=0x7fd2e40c5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:24.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.791+0000 7fd2ec18b700 1 --2- 172.21.15.59:0/3846933839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2e40ce420 0x7fd2e40c5800 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd2d400c550 tx=0x7fd2d400c860 comp rx=0 tx=0).stop 2023-09-21T00:18:24.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.791+0000 7fd2ec18b700 1 -- 172.21.15.59:0/3846933839 shutdown_connections 2023-09-21T00:18:24.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.791+0000 7fd2ec18b700 1 --2- 172.21.15.59:0/3846933839 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd2c806ae00 0x7fd2c806d2c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:24.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.791+0000 7fd2ec18b700 1 --2- 172.21.15.59:0/3846933839 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd2e415b2b0 0x7fd2e40c5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:24.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.791+0000 7fd2ec18b700 1 --2- 172.21.15.59:0/3846933839 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2e406a780 0x7fd2e4159290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:24.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.791+0000 7fd2ec18b700 1 --2- 172.21.15.59:0/3846933839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2e40ce420 0x7fd2e40c5800 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:24.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.791+0000 7fd2ec18b700 1 -- 172.21.15.59:0/3846933839 >> 172.21.15.59:0/3846933839 conn(0x7fd2e40d0140 msgr2=0x7fd2e406ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:24.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.791+0000 7fd2ec18b700 1 -- 172.21.15.59:0/3846933839 shutdown_connections 2023-09-21T00:18:24.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.791+0000 7fd2ec18b700 1 -- 172.21.15.59:0/3846933839 wait complete. 2023-09-21T00:18:24.805 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-21T00:18:24.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.930+0000 7f30f818a700 1 Processor -- start 2023-09-21T00:18:24.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.930+0000 7f30f818a700 1 -- start start 2023-09-21T00:18:24.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.931+0000 7f30f818a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f30f015b2b0 0x7f30f00cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:24.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.931+0000 7f30f818a700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f30f006a780 0x7f30f006abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:24.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.931+0000 7f30f818a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30f006b110 con 0x7f30f00ce420 2023-09-21T00:18:24.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.931+0000 7f30f818a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30f00ce250 con 0x7f30f015b2b0 2023-09-21T00:18:24.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.931+0000 7f30f818a700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30f01618a0 con 0x7f30f006a780 2023-09-21T00:18:24.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.931+0000 7f30f5f26700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f30f015b2b0 0x7f30f00cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:24.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.931+0000 7f30f5725700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f30f00ce420 0x7f30f0161190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58904/0 (socket says 172.21.15.59:58904) 2023-09-21T00:18:24.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.931+0000 7f30f5725700 1 -- 172.21.15.59:0/439680997 learned_addr learned my addr 172.21.15.59:0/439680997 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:24.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.931+0000 7f30f6727700 1 --2- 172.21.15.59:0/439680997 >> v2:172.21.15.83:3300/0 conn(0x7f30f006a780 0x7f30f006abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:24.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.932+0000 7f30f5f26700 1 -- 172.21.15.59:0/439680997 >> v2:172.21.15.83:3300/0 conn(0x7f30f006a780 msgr2=0x7f30f006abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:24.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.932+0000 7f30f5f26700 1 --2- 172.21.15.59:0/439680997 >> v2:172.21.15.83:3300/0 conn(0x7f30f006a780 0x7f30f006abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:24.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.932+0000 7f30f5f26700 1 -- 172.21.15.59:0/439680997 >> v1:172.21.15.59:6789/0 conn(0x7f30f00ce420 legacy=0x7f30f0161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:24.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.932+0000 7f30f5f26700 1 -- 172.21.15.59:0/439680997 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f00cfee0 con 0x7f30f015b2b0 2023-09-21T00:18:24.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.932+0000 7f30f4f24700 1 -- 172.21.15.59:0/439680997 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2186008462 0 0) 0x7f30e0001110 con 0x7f30f00ce420 2023-09-21T00:18:24.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.932+0000 7f30f5f26700 1 --2- 172.21.15.59:0/439680997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30f015b2b0 0x7f30f00cdd10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f30f00cbf10 tx=0x7f30ec009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5317353764f2245f server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:24.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.932+0000 7f30f4f24700 1 -- 172.21.15.59:0/439680997 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ec011830 con 0x7f30f015b2b0 2023-09-21T00:18:24.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.932+0000 7f30f4f24700 1 -- 172.21.15.59:0/439680997 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30ec011990 con 0x7f30f015b2b0 2023-09-21T00:18:24.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.932+0000 7f30f4f24700 1 -- 172.21.15.59:0/439680997 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ec011d20 con 0x7f30f015b2b0 2023-09-21T00:18:24.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.932+0000 7f30f818a700 1 -- 172.21.15.59:0/439680997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30f015b2b0 msgr2=0x7f30f00cdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:24.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.932+0000 7f30f818a700 1 --2- 172.21.15.59:0/439680997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30f015b2b0 0x7f30f00cdd10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f30f00cbf10 tx=0x7f30ec009b20 comp rx=0 tx=0).stop 2023-09-21T00:18:24.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.932+0000 7f30f818a700 1 -- 172.21.15.59:0/439680997 shutdown_connections 2023-09-21T00:18:24.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.932+0000 7f30f818a700 1 --2- 172.21.15.59:0/439680997 >> v2:172.21.15.83:3300/0 conn(0x7f30f006a780 0x7f30f006abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:24.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.932+0000 7f30f818a700 1 --2- 172.21.15.59:0/439680997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30f015b2b0 0x7f30f00cdd10 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:24.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.932+0000 7f30f818a700 1 -- 172.21.15.59:0/439680997 >> 172.21.15.59:0/439680997 conn(0x7f30f00d0140 msgr2=0x7f30f00d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:24.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.933+0000 7f30f818a700 1 -- 172.21.15.59:0/439680997 shutdown_connections 2023-09-21T00:18:24.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.933+0000 7f30f818a700 1 -- 172.21.15.59:0/439680997 wait complete. 2023-09-21T00:18:24.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.934+0000 7f30f818a700 1 Processor -- start 2023-09-21T00:18:24.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.934+0000 7f30f818a700 1 -- start start 2023-09-21T00:18:24.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.935+0000 7f30f818a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f30f006a780 0x7f30f01f3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:24.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.935+0000 7f30f818a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30f00ce420 0x7f30f00c5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:24.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.935+0000 7f30f818a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30f015b2b0 0x7f30f00c5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:24.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.935+0000 7f30f818a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f0160480 con 0x7f30f00ce420 2023-09-21T00:18:24.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.935+0000 7f30f818a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f0160610 con 0x7f30f015b2b0 2023-09-21T00:18:24.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.935+0000 7f30f818a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f01f39a0 con 0x7f30f006a780 2023-09-21T00:18:24.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.935+0000 7f30f5725700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30f00ce420 0x7f30f00c5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:24.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.935+0000 7f30f5725700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30f00ce420 0x7f30f00c5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53344/0 (socket says 172.21.15.59:53344) 2023-09-21T00:18:24.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.935+0000 7f30f5725700 1 -- 172.21.15.59:0/1814978483 learned_addr learned my addr 172.21.15.59:0/1814978483 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:24.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.935+0000 7f30f6727700 1 --2- 172.21.15.59:0/1814978483 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30f015b2b0 0x7f30f00c5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:24.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.935+0000 7f30f5f26700 1 --2- 172.21.15.59:0/1814978483 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f30f006a780 0x7f30f01f3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:24.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.935+0000 7f30f5725700 1 -- 172.21.15.59:0/1814978483 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f30f006a780 msgr2=0x7f30f01f3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:24.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.935+0000 7f30f5725700 1 --2- 172.21.15.59:0/1814978483 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f30f006a780 0x7f30f01f3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:24.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.935+0000 7f30f5725700 1 -- 172.21.15.59:0/1814978483 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30f015b2b0 msgr2=0x7f30f00c5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:24.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.935+0000 7f30f5725700 1 --2- 172.21.15.59:0/1814978483 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30f015b2b0 0x7f30f00c5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:24.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.935+0000 7f30f5725700 1 -- 172.21.15.59:0/1814978483 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30ec0094a0 con 0x7f30f00ce420 2023-09-21T00:18:24.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.935+0000 7f30f6727700 1 --2- 172.21.15.59:0/1814978483 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30f015b2b0 0x7f30f00c5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:18:24.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.935+0000 7f30f5725700 1 --2- 172.21.15.59:0/1814978483 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30f00ce420 0x7f30f00c5800 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f30e000c550 tx=0x7f30e000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:24.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.935+0000 7f30e67fc700 1 -- 172.21.15.59:0/1814978483 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e0004c80 con 0x7f30f00ce420 2023-09-21T00:18:24.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.935+0000 7f30e67fc700 1 -- 172.21.15.59:0/1814978483 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e0004e00 con 0x7f30f00ce420 2023-09-21T00:18:24.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.935+0000 7f30f818a700 1 -- 172.21.15.59:0/1814978483 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30f01f6fd0 con 0x7f30f00ce420 2023-09-21T00:18:24.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.935+0000 7f30e67fc700 1 -- 172.21.15.59:0/1814978483 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e0007310 con 0x7f30f00ce420 2023-09-21T00:18:24.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.935+0000 7f30f818a700 1 -- 172.21.15.59:0/1814978483 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30f01f7590 con 0x7f30f00ce420 2023-09-21T00:18:24.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.936+0000 7f30f818a700 1 -- 172.21.15.59:0/1814978483 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30f0067e50 con 0x7f30f00ce420 2023-09-21T00:18:24.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.937+0000 7f30e67fc700 1 -- 172.21.15.59:0/1814978483 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f30e0007470 con 0x7f30f00ce420 2023-09-21T00:18:24.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.937+0000 7f30e67fc700 1 --2- 172.21.15.59:0/1814978483 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f30d406ae00 0x7f30d406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:24.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.937+0000 7f30e67fc700 1 -- 172.21.15.59:0/1814978483 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f30e0088f20 con 0x7f30f00ce420 2023-09-21T00:18:24.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.938+0000 7f30f5f26700 1 --2- 172.21.15.59:0/1814978483 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f30d406ae00 0x7f30d406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:24.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.938+0000 7f30f5f26700 1 --2- 172.21.15.59:0/1814978483 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f30d406ae00 0x7f30d406d2c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f30ec0090b0 tx=0x7f30ec01c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:24.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:24.942+0000 7f30e67fc700 1 -- 172.21.15.59:0/1814978483 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f30e0054250 con 0x7f30f00ce420 2023-09-21T00:18:25.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.145+0000 7f30f818a700 1 -- 172.21.15.59:0/1814978483 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f30f006b110 con 0x7f30f00ce420 2023-09-21T00:18:25.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.145+0000 7f30e67fc700 1 -- 172.21.15.59:0/1814978483 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v34) v1 ==== 84+0+65 (secure 0 0 0) 0x7f30f006b110 con 0x7f30f00ce420 2023-09-21T00:18:25.147 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:18:25.147 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2023-09-21T00:18:25.147 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-09-21T00:18:25.147 INFO:teuthology.orchestra.run.smithi059.stdout: "poolnum": 1, 2023-09-21T00:18:25.148 INFO:teuthology.orchestra.run.smithi059.stdout: "poolname": ".mgr" 2023-09-21T00:18:25.148 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-09-21T00:18:25.148 INFO:teuthology.orchestra.run.smithi059.stdout:] 2023-09-21T00:18:25.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.147+0000 7f30f818a700 1 -- 172.21.15.59:0/1814978483 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f30d406ae00 msgr2=0x7f30d406d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:25.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.147+0000 7f30f818a700 1 --2- 172.21.15.59:0/1814978483 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f30d406ae00 0x7f30d406d2c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f30ec0090b0 tx=0x7f30ec01c040 comp rx=0 tx=0).stop 2023-09-21T00:18:25.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.147+0000 7f30f818a700 1 -- 172.21.15.59:0/1814978483 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30f00ce420 msgr2=0x7f30f00c5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:25.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.147+0000 7f30f818a700 1 --2- 172.21.15.59:0/1814978483 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30f00ce420 0x7f30f00c5800 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f30e000c550 tx=0x7f30e000c910 comp rx=0 tx=0).stop 2023-09-21T00:18:25.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.147+0000 7f30f818a700 1 -- 172.21.15.59:0/1814978483 shutdown_connections 2023-09-21T00:18:25.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.147+0000 7f30f818a700 1 --2- 172.21.15.59:0/1814978483 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f30f015b2b0 0x7f30f00c5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:25.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.147+0000 7f30f818a700 1 --2- 172.21.15.59:0/1814978483 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f30d406ae00 0x7f30d406d2c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:25.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.147+0000 7f30f818a700 1 --2- 172.21.15.59:0/1814978483 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f30f006a780 0x7f30f01f3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:25.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.147+0000 7f30f818a700 1 --2- 172.21.15.59:0/1814978483 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30f00ce420 0x7f30f00c5800 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:25.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.147+0000 7f30f818a700 1 -- 172.21.15.59:0/1814978483 >> 172.21.15.59:0/1814978483 conn(0x7f30f00d0140 msgr2=0x7f30f006f690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:25.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.147+0000 7f30f818a700 1 -- 172.21.15.59:0/1814978483 shutdown_connections 2023-09-21T00:18:25.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.147+0000 7f30f818a700 1 -- 172.21.15.59:0/1814978483 wait complete. 2023-09-21T00:18:25.161 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-21T00:18:25.161 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-21T00:18:25.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.290+0000 7f62ffb68700 1 Processor -- start 2023-09-21T00:18:25.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.290+0000 7f62ffb68700 1 -- start start 2023-09-21T00:18:25.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.291+0000 7f62ffb68700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f62f8151270 0x7f62f815b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:25.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.291+0000 7f62ffb68700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f62f8071db0 0x7f62f80ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:25.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.291+0000 7f62ffb68700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62f806fb30 con 0x7f62f8151650 2023-09-21T00:18:25.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.291+0000 7f62ffb68700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62f806ffc0 con 0x7f62f8151270 2023-09-21T00:18:25.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.291+0000 7f62ffb68700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62f815b8e0 con 0x7f62f8071db0 2023-09-21T00:18:25.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.291+0000 7f62fd103700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f62f8151650 0x7f62f80716a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58920/0 (socket says 172.21.15.59:58920) 2023-09-21T00:18:25.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.291+0000 7f62fd904700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f62f8151270 0x7f62f815b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:25.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.291+0000 7f62fd103700 1 -- 172.21.15.59:0/2178167673 learned_addr learned my addr 172.21.15.59:0/2178167673 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:25.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.291+0000 7f62fe105700 1 --2- 172.21.15.59:0/2178167673 >> v2:172.21.15.83:3300/0 conn(0x7f62f8071db0 0x7f62f80ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:25.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.291+0000 7f62fc902700 1 -- 172.21.15.59:0/2178167673 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 331886429 0 0) 0x7f62f806fb30 con 0x7f62f8151650 2023-09-21T00:18:25.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.291+0000 7f62fc902700 1 -- 172.21.15.59:0/2178167673 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62e40057c0 con 0x7f62f8151650 2023-09-21T00:18:25.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.291+0000 7f62fd904700 1 -- 172.21.15.59:0/2178167673 >> v2:172.21.15.83:3300/0 conn(0x7f62f8071db0 msgr2=0x7f62f80ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:25.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.291+0000 7f62fd904700 1 --2- 172.21.15.59:0/2178167673 >> v2:172.21.15.83:3300/0 conn(0x7f62f8071db0 0x7f62f80ced60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:25.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.291+0000 7f62fd904700 1 -- 172.21.15.59:0/2178167673 >> v1:172.21.15.59:6789/0 conn(0x7f62f8151650 legacy=0x7f62f80716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:25.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.291+0000 7f62fd904700 1 -- 172.21.15.59:0/2178167673 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f806ef20 con 0x7f62f8151270 2023-09-21T00:18:25.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.291+0000 7f62fd904700 1 --2- 172.21.15.59:0/2178167673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62f8151270 0x7f62f815b3a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f62f81584f0 tx=0x7f62e8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26c3326617376e8b server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:25.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.292+0000 7f62fc902700 1 -- 172.21.15.59:0/2178167673 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e8011830 con 0x7f62f8151270 2023-09-21T00:18:25.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.292+0000 7f62fc902700 1 -- 172.21.15.59:0/2178167673 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e8011990 con 0x7f62f8151270 2023-09-21T00:18:25.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.292+0000 7f62fc902700 1 -- 172.21.15.59:0/2178167673 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e8011d20 con 0x7f62f8151270 2023-09-21T00:18:25.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.292+0000 7f62ffb68700 1 -- 172.21.15.59:0/2178167673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62f8151270 msgr2=0x7f62f815b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:25.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.292+0000 7f62ffb68700 1 --2- 172.21.15.59:0/2178167673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62f8151270 0x7f62f815b3a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f62f81584f0 tx=0x7f62e8009b20 comp rx=0 tx=0).stop 2023-09-21T00:18:25.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.292+0000 7f62ffb68700 1 -- 172.21.15.59:0/2178167673 shutdown_connections 2023-09-21T00:18:25.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.292+0000 7f62ffb68700 1 --2- 172.21.15.59:0/2178167673 >> v2:172.21.15.83:3300/0 conn(0x7f62f8071db0 0x7f62f80ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:25.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.292+0000 7f62ffb68700 1 --2- 172.21.15.59:0/2178167673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62f8151270 0x7f62f815b3a0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:25.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.292+0000 7f62ffb68700 1 -- 172.21.15.59:0/2178167673 >> 172.21.15.59:0/2178167673 conn(0x7f62f80ccc00 msgr2=0x7f62f80cd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:25.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.292+0000 7f62ffb68700 1 -- 172.21.15.59:0/2178167673 shutdown_connections 2023-09-21T00:18:25.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.292+0000 7f62ffb68700 1 -- 172.21.15.59:0/2178167673 wait complete. 2023-09-21T00:18:25.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.294+0000 7f62ffb68700 1 Processor -- start 2023-09-21T00:18:25.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.294+0000 7f62ffb68700 1 -- start start 2023-09-21T00:18:25.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.295+0000 7f62ffb68700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f62f8071db0 0x7f62f81534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:25.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.295+0000 7f62ffb68700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f62f8151270 0x7f62f80ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:25.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.295+0000 7f62ffb68700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62f80c5ac0 0x7f62f8150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:25.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.295+0000 7f62ffb68700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f81547d0 con 0x7f62f80c5ac0 2023-09-21T00:18:25.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.295+0000 7f62ffb68700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f80c6b00 con 0x7f62f8071db0 2023-09-21T00:18:25.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.295+0000 7f62ffb68700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f81539e0 con 0x7f62f8151270 2023-09-21T00:18:25.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.295+0000 7f62fe105700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62f80c5ac0 0x7f62f8150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:25.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.295+0000 7f62fe105700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62f80c5ac0 0x7f62f8150280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53360/0 (socket says 172.21.15.59:53360) 2023-09-21T00:18:25.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.295+0000 7f62fe105700 1 -- 172.21.15.59:0/1709219943 learned_addr learned my addr 172.21.15.59:0/1709219943 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:25.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.295+0000 7f62fd904700 1 --2- 172.21.15.59:0/1709219943 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f62f8071db0 0x7f62f81534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:25.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.295+0000 7f62fd103700 1 --2- 172.21.15.59:0/1709219943 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f62f8151270 0x7f62f80ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:25.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.295+0000 7f62fe105700 1 -- 172.21.15.59:0/1709219943 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f62f8151270 msgr2=0x7f62f80ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:25.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.295+0000 7f62fe105700 1 --2- 172.21.15.59:0/1709219943 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f62f8151270 0x7f62f80ce6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:25.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.295+0000 7f62fe105700 1 -- 172.21.15.59:0/1709219943 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f62f8071db0 msgr2=0x7f62f81534a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:25.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.295+0000 7f62fe105700 1 --2- 172.21.15.59:0/1709219943 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f62f8071db0 0x7f62f81534a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:25.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.295+0000 7f62fe105700 1 -- 172.21.15.59:0/1709219943 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e80094a0 con 0x7f62f80c5ac0 2023-09-21T00:18:25.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.296+0000 7f62fe105700 1 --2- 172.21.15.59:0/1709219943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62f80c5ac0 0x7f62f8150280 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f62f000efc0 tx=0x7f62f000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:25.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.296+0000 7f62ee7fc700 1 -- 172.21.15.59:0/1709219943 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f0009ea0 con 0x7f62f80c5ac0 2023-09-21T00:18:25.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.296+0000 7f62ee7fc700 1 -- 172.21.15.59:0/1709219943 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f000f040 con 0x7f62f80c5ac0 2023-09-21T00:18:25.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.296+0000 7f62ee7fc700 1 -- 172.21.15.59:0/1709219943 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f000ced0 con 0x7f62f80c5ac0 2023-09-21T00:18:25.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.296+0000 7f62ffb68700 1 -- 172.21.15.59:0/1709219943 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62f80c5f80 con 0x7f62f80c5ac0 2023-09-21T00:18:25.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.296+0000 7f62ffb68700 1 -- 172.21.15.59:0/1709219943 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62f80c6540 con 0x7f62f80c5ac0 2023-09-21T00:18:25.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.297+0000 7f62ffb68700 1 -- 172.21.15.59:0/1709219943 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62f80c3d40 con 0x7f62f80c5ac0 2023-09-21T00:18:25.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.297+0000 7f62ee7fc700 1 -- 172.21.15.59:0/1709219943 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f62f0014480 con 0x7f62f80c5ac0 2023-09-21T00:18:25.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.297+0000 7f62ee7fc700 1 --2- 172.21.15.59:0/1709219943 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f62dc06ae00 0x7f62dc06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:25.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.298+0000 7f62ee7fc700 1 -- 172.21.15.59:0/1709219943 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f62f0089af0 con 0x7f62f80c5ac0 2023-09-21T00:18:25.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.298+0000 7f62fd904700 1 --2- 172.21.15.59:0/1709219943 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f62dc06ae00 0x7f62dc06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:25.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.298+0000 7f62fd904700 1 --2- 172.21.15.59:0/1709219943 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f62dc06ae00 0x7f62dc06d2c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f62e80090b0 tx=0x7f62e8008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:25.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.302+0000 7f62ee7fc700 1 -- 172.21.15.59:0/1709219943 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f62f80c3d40 con 0x7f62f80c5ac0 2023-09-21T00:18:25.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:25.503+0000 7f62ffb68700 1 -- 172.21.15.59:0/1709219943 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f62f80c3d40 con 0x7f62f80c5ac0 2023-09-21T00:18:26.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.088+0000 7f62ee7fc700 1 -- 172.21.15.59:0/1709219943 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v35) v1 ==== 138+0+0 (secure 0 0 0) 0x7f62f80c3d40 con 0x7f62f80c5ac0 2023-09-21T00:18:26.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.093+0000 7f62ffb68700 1 -- 172.21.15.59:0/1709219943 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f62dc06ae00 msgr2=0x7f62dc06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:26.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.093+0000 7f62ffb68700 1 --2- 172.21.15.59:0/1709219943 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f62dc06ae00 0x7f62dc06d2c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f62e80090b0 tx=0x7f62e8008030 comp rx=0 tx=0).stop 2023-09-21T00:18:26.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.093+0000 7f62ffb68700 1 -- 172.21.15.59:0/1709219943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62f80c5ac0 msgr2=0x7f62f8150280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:26.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.093+0000 7f62ffb68700 1 --2- 172.21.15.59:0/1709219943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62f80c5ac0 0x7f62f8150280 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f62f000efc0 tx=0x7f62f000c3a0 comp rx=0 tx=0).stop 2023-09-21T00:18:26.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.093+0000 7f62ffb68700 1 -- 172.21.15.59:0/1709219943 shutdown_connections 2023-09-21T00:18:26.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.093+0000 7f62ffb68700 1 --2- 172.21.15.59:0/1709219943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62f80c5ac0 0x7f62f8150280 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:26.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.093+0000 7f62ffb68700 1 --2- 172.21.15.59:0/1709219943 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f62f8071db0 0x7f62f81534a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:26.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.093+0000 7f62ffb68700 1 --2- 172.21.15.59:0/1709219943 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f62dc06ae00 0x7f62dc06d2c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:26.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.093+0000 7f62ffb68700 1 --2- 172.21.15.59:0/1709219943 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f62f8151270 0x7f62f80ce6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:26.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.093+0000 7f62ffb68700 1 -- 172.21.15.59:0/1709219943 >> 172.21.15.59:0/1709219943 conn(0x7f62f80ccc00 msgr2=0x7f62f80cf690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:26.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.094+0000 7f62ffb68700 1 -- 172.21.15.59:0/1709219943 shutdown_connections 2023-09-21T00:18:26.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.094+0000 7f62ffb68700 1 -- 172.21.15.59:0/1709219943 wait complete. 2023-09-21T00:18:26.097 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' created 2023-09-21T00:18:26.112 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-09-21T00:18:26.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.250+0000 7f2f9dfef700 1 Processor -- start 2023-09-21T00:18:26.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.250+0000 7f2f9dfef700 1 -- start start 2023-09-21T00:18:26.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.251+0000 7f2f9dfef700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2f9815a230 0x7f2f9815e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:26.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.251+0000 7f2f9dfef700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2f980ca790 0x7f2f98071680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:26.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.251+0000 7f2f9dfef700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f980cb1c0 con 0x7f2f980cabf0 2023-09-21T00:18:26.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.251+0000 7f2f9dfef700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f980cb780 con 0x7f2f980ca790 2023-09-21T00:18:26.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.251+0000 7f2f9dfef700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f980cb4a0 con 0x7f2f9815a230 2023-09-21T00:18:26.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.251+0000 7f2f97fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2f980cabf0 0x7f2f9806eaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58936/0 (socket says 172.21.15.59:58936) 2023-09-21T00:18:26.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.251+0000 7f2f97fff700 1 -- 172.21.15.59:0/335278009 learned_addr learned my addr 172.21.15.59:0/335278009 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:26.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.251+0000 7f2f96ffd700 1 --2- 172.21.15.59:0/335278009 >> v2:172.21.15.83:3300/0 conn(0x7f2f980ca790 0x7f2f98071680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:26.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.251+0000 7f2f977fe700 1 --2- 172.21.15.59:0/335278009 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2f9815a230 0x7f2f9815e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:26.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.251+0000 7f2f967fc700 1 -- 172.21.15.59:0/335278009 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2913473272 0 0) 0x7f2f980cb1c0 con 0x7f2f980cabf0 2023-09-21T00:18:26.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.251+0000 7f2f967fc700 1 -- 172.21.15.59:0/335278009 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f840035b0 con 0x7f2f980cabf0 2023-09-21T00:18:26.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.252+0000 7f2f967fc700 1 -- 172.21.15.59:0/335278009 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3227273444 0 0) 0x7f2f840035b0 con 0x7f2f980cabf0 2023-09-21T00:18:26.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.252+0000 7f2f967fc700 1 -- 172.21.15.59:0/335278009 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2f9815a230 msgr2=0x7f2f9815e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:26.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.252+0000 7f2f967fc700 1 --2- 172.21.15.59:0/335278009 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2f9815a230 0x7f2f9815e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:26.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.252+0000 7f2f967fc700 1 -- 172.21.15.59:0/335278009 >> v2:172.21.15.83:3300/0 conn(0x7f2f980ca790 msgr2=0x7f2f98071680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:26.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.252+0000 7f2f967fc700 1 --2- 172.21.15.59:0/335278009 >> v2:172.21.15.83:3300/0 conn(0x7f2f980ca790 0x7f2f98071680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:26.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.252+0000 7f2f967fc700 1 -- 172.21.15.59:0/335278009 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f9815e0b0 con 0x7f2f980cabf0 2023-09-21T00:18:26.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.252+0000 7f2f967fc700 1 -- 172.21.15.59:0/335278009 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 710825841 0 0) 0x7f2f900019f0 con 0x7f2f980cabf0 2023-09-21T00:18:26.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.252+0000 7f2f967fc700 1 -- 172.21.15.59:0/335278009 >> v1:172.21.15.59:6789/0 conn(0x7f2f980cabf0 legacy=0x7f2f9806eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:26.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.252+0000 7f2f967fc700 1 --2- 172.21.15.59:0/335278009 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f84003a00 0x7f2f84003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:26.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.252+0000 7f2f967fc700 1 --2- 172.21.15.59:0/335278009 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f84004850 0x7f2f84004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:26.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.252+0000 7f2f967fc700 1 --2- 172.21.15.59:0/335278009 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2f9815a230 0x7f2f84005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:26.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.252+0000 7f2f967fc700 1 -- 172.21.15.59:0/335278009 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f980cb780 con 0x7f2f84003a00 2023-09-21T00:18:26.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.252+0000 7f2f967fc700 1 -- 172.21.15.59:0/335278009 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f980cb4a0 con 0x7f2f84004850 2023-09-21T00:18:26.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.252+0000 7f2f967fc700 1 -- 172.21.15.59:0/335278009 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8400ba10 con 0x7f2f9815a230 2023-09-21T00:18:26.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.252+0000 7f2f977fe700 1 --2- 172.21.15.59:0/335278009 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f84003a00 0x7f2f84003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:26.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.252+0000 7f2f96ffd700 1 --2- 172.21.15.59:0/335278009 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f84004850 0x7f2f84004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:26.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.252+0000 7f2f97fff700 1 --2- 172.21.15.59:0/335278009 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2f9815a230 0x7f2f84005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:26.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.252+0000 7f2f977fe700 1 -- 172.21.15.59:0/335278009 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2f9815a230 msgr2=0x7f2f84005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:26.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.252+0000 7f2f977fe700 1 --2- 172.21.15.59:0/335278009 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2f9815a230 0x7f2f84005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:26.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.252+0000 7f2f977fe700 1 -- 172.21.15.59:0/335278009 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f84004850 msgr2=0x7f2f84004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:26.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.252+0000 7f2f977fe700 1 --2- 172.21.15.59:0/335278009 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f84004850 0x7f2f84004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:26.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.252+0000 7f2f977fe700 1 -- 172.21.15.59:0/335278009 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f840035b0 con 0x7f2f84003a00 2023-09-21T00:18:26.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.252+0000 7f2f977fe700 1 --2- 172.21.15.59:0/335278009 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f84003a00 0x7f2f84003e20 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f2f80009b60 tx=0x7f2f84005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97ff7a582b770e8a server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:26.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.252+0000 7f2f967fc700 1 -- 172.21.15.59:0/335278009 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8000e6c0 con 0x7f2f84003a00 2023-09-21T00:18:26.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.252+0000 7f2f967fc700 1 -- 172.21.15.59:0/335278009 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8000e820 con 0x7f2f84003a00 2023-09-21T00:18:26.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.252+0000 7f2f967fc700 1 -- 172.21.15.59:0/335278009 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8000eb90 con 0x7f2f84003a00 2023-09-21T00:18:26.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.253+0000 7f2f9dfef700 1 -- 172.21.15.59:0/335278009 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f84003a00 msgr2=0x7f2f84003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:26.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.253+0000 7f2f9dfef700 1 --2- 172.21.15.59:0/335278009 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f84003a00 0x7f2f84003e20 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f2f80009b60 tx=0x7f2f84005880 comp rx=0 tx=0).stop 2023-09-21T00:18:26.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.253+0000 7f2f97fff700 1 -- 172.21.15.59:0/335278009 reap_dead start 2023-09-21T00:18:26.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.253+0000 7f2f9dfef700 1 -- 172.21.15.59:0/335278009 shutdown_connections 2023-09-21T00:18:26.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.253+0000 7f2f9dfef700 1 -- 172.21.15.59:0/335278009 >> 172.21.15.59:0/335278009 conn(0x7f2f980d0140 msgr2=0x7f2f980d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:26.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.253+0000 7f2f9dfef700 1 -- 172.21.15.59:0/335278009 shutdown_connections 2023-09-21T00:18:26.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.253+0000 7f2f9dfef700 1 -- 172.21.15.59:0/335278009 wait complete. 2023-09-21T00:18:26.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.255+0000 7f2f9dfef700 1 Processor -- start 2023-09-21T00:18:26.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.255+0000 7f2f9dfef700 1 -- start start 2023-09-21T00:18:26.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.256+0000 7f2f9dfef700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f84003a00 0x7f2f9814b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:26.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.256+0000 7f2f9dfef700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f98148110 0x7f2f980b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:26.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.256+0000 7f2f9dfef700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2f980b54c0 0x7f2f980c7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:26.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.256+0000 7f2f9dfef700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f980b5970 con 0x7f2f84003a00 2023-09-21T00:18:26.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.256+0000 7f2f9dfef700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f98158bb0 con 0x7f2f98148110 2023-09-21T00:18:26.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.256+0000 7f2f9dfef700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f981e51c0 con 0x7f2f980b54c0 2023-09-21T00:18:26.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.256+0000 7f2f977fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f84003a00 0x7f2f9814b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:26.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.256+0000 7f2f977fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f84003a00 0x7f2f9814b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53376/0 (socket says 172.21.15.59:53376) 2023-09-21T00:18:26.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.256+0000 7f2f977fe700 1 -- 172.21.15.59:0/2560842184 learned_addr learned my addr 172.21.15.59:0/2560842184 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:26.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.256+0000 7f2f96ffd700 1 --2- 172.21.15.59:0/2560842184 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f98148110 0x7f2f980b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:26.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.256+0000 7f2f977fe700 1 -- 172.21.15.59:0/2560842184 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2f980b54c0 msgr2=0x7f2f980c7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:26.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.256+0000 7f2f977fe700 1 --2- 172.21.15.59:0/2560842184 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2f980b54c0 0x7f2f980c7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:26.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.256+0000 7f2f977fe700 1 -- 172.21.15.59:0/2560842184 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f98148110 msgr2=0x7f2f980b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:26.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.256+0000 7f2f977fe700 1 --2- 172.21.15.59:0/2560842184 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f98148110 0x7f2f980b4f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:26.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.256+0000 7f2f977fe700 1 -- 172.21.15.59:0/2560842184 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f981e54a0 con 0x7f2f84003a00 2023-09-21T00:18:26.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.256+0000 7f2f977fe700 1 --2- 172.21.15.59:0/2560842184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f84003a00 0x7f2f9814b170 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f2f8000e4b0 tx=0x7f2f800047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:26.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.256+0000 7f2f8ffff700 1 -- 172.21.15.59:0/2560842184 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8000e6c0 con 0x7f2f84003a00 2023-09-21T00:18:26.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.257+0000 7f2f8ffff700 1 -- 172.21.15.59:0/2560842184 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f80003ab0 con 0x7f2f84003a00 2023-09-21T00:18:26.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.257+0000 7f2f8ffff700 1 -- 172.21.15.59:0/2560842184 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f80003e60 con 0x7f2f84003a00 2023-09-21T00:18:26.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.257+0000 7f2f9dfef700 1 -- 172.21.15.59:0/2560842184 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f981e5780 con 0x7f2f84003a00 2023-09-21T00:18:26.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.257+0000 7f2f9dfef700 1 -- 172.21.15.59:0/2560842184 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f981e5d40 con 0x7f2f84003a00 2023-09-21T00:18:26.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.258+0000 7f2f9dfef700 1 -- 172.21.15.59:0/2560842184 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f981e5f00 con 0x7f2f84003a00 2023-09-21T00:18:26.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.258+0000 7f2f8ffff700 1 -- 172.21.15.59:0/2560842184 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f2f80013470 con 0x7f2f84003a00 2023-09-21T00:18:26.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.259+0000 7f2f8ffff700 1 --2- 172.21.15.59:0/2560842184 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f2f7806ae00 0x7f2f7806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:26.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.259+0000 7f2f8ffff700 1 -- 172.21.15.59:0/2560842184 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5547+0+0 (secure 0 0 0) 0x7f2f8008ae60 con 0x7f2f84003a00 2023-09-21T00:18:26.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.259+0000 7f2f96ffd700 1 --2- 172.21.15.59:0/2560842184 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f2f7806ae00 0x7f2f7806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:26.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.259+0000 7f2f96ffd700 1 --2- 172.21.15.59:0/2560842184 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f2f7806ae00 0x7f2f7806d2c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2f980c93f0 tx=0x7f2f88008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:26.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.263+0000 7f2f8ffff700 1 -- 172.21.15.59:0/2560842184 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f2f800561d0 con 0x7f2f84003a00 2023-09-21T00:18:26.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:26.463+0000 7f2f9dfef700 1 -- 172.21.15.59:0/2560842184 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2f980b5910 con 0x7f2f84003a00 2023-09-21T00:18:26.889 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-09-21T00:18:27.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.095+0000 7f2f8ffff700 1 -- 172.21.15.59:0/2560842184 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v36) v1 ==== 170+0+0 (secure 0 0 0) 0x7f2f980b5910 con 0x7f2f84003a00 2023-09-21T00:18:27.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.100+0000 7f2f9dfef700 1 -- 172.21.15.59:0/2560842184 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f2f7806ae00 msgr2=0x7f2f7806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:27.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.100+0000 7f2f9dfef700 1 --2- 172.21.15.59:0/2560842184 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f2f7806ae00 0x7f2f7806d2c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2f980c93f0 tx=0x7f2f88008040 comp rx=0 tx=0).stop 2023-09-21T00:18:27.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.100+0000 7f2f9dfef700 1 -- 172.21.15.59:0/2560842184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f84003a00 msgr2=0x7f2f9814b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:27.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.100+0000 7f2f9dfef700 1 --2- 172.21.15.59:0/2560842184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f84003a00 0x7f2f9814b170 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f2f8000e4b0 tx=0x7f2f800047c0 comp rx=0 tx=0).stop 2023-09-21T00:18:27.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.101+0000 7f2f9dfef700 1 -- 172.21.15.59:0/2560842184 shutdown_connections 2023-09-21T00:18:27.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.101+0000 7f2f9dfef700 1 --2- 172.21.15.59:0/2560842184 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f2f7806ae00 0x7f2f7806d2c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:27.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.101+0000 7f2f9dfef700 1 --2- 172.21.15.59:0/2560842184 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2f980b54c0 0x7f2f980c7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:27.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.101+0000 7f2f9dfef700 1 --2- 172.21.15.59:0/2560842184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f84003a00 0x7f2f9814b170 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:27.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.101+0000 7f2f9dfef700 1 --2- 172.21.15.59:0/2560842184 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2f98148110 0x7f2f980b4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:27.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.101+0000 7f2f9dfef700 1 -- 172.21.15.59:0/2560842184 >> 172.21.15.59:0/2560842184 conn(0x7f2f980d0140 msgr2=0x7f2f980c9420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:27.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.102+0000 7f2f9dfef700 1 -- 172.21.15.59:0/2560842184 shutdown_connections 2023-09-21T00:18:27.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.103+0000 7f2f9dfef700 1 -- 172.21.15.59:0/2560842184 wait complete. 2023-09-21T00:18:27.107 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' created 2023-09-21T00:18:27.126 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-21T00:18:27.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.259+0000 7f83583db700 1 Processor -- start 2023-09-21T00:18:27.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.259+0000 7f83583db700 1 -- start start 2023-09-21T00:18:27.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.260+0000 7f83583db700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f835015b4f0 0x7f83500cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:27.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.260+0000 7f83583db700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f83500cac80 0x7f835006a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:27.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.260+0000 7f83583db700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f835006acc0 0x7f8350071680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:27.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.260+0000 7f83583db700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f835006b170 con 0x7f835015b4f0 2023-09-21T00:18:27.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.260+0000 7f83583db700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83500b3030 con 0x7f835006acc0 2023-09-21T00:18:27.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.260+0000 7f83583db700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83500cb180 con 0x7f83500cac80 2023-09-21T00:18:27.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.260+0000 7f8356177700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f835015b4f0 0x7f83500cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:27.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.260+0000 7f8356177700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f835015b4f0 0x7f83500cc410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53384/0 (socket says 172.21.15.59:53384) 2023-09-21T00:18:27.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.260+0000 7f8356177700 1 -- 172.21.15.59:0/24764121 learned_addr learned my addr 172.21.15.59:0/24764121 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:27.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.260+0000 7f8356978700 1 --2- 172.21.15.59:0/24764121 >> v2:172.21.15.83:3300/0 conn(0x7f835006acc0 0x7f8350071680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:27.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.260+0000 7f8355976700 1 --2- 172.21.15.59:0/24764121 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f83500cac80 0x7f835006a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:27.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.260+0000 7f8356177700 1 -- 172.21.15.59:0/24764121 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f83500cac80 msgr2=0x7f835006a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:27.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.260+0000 7f8356177700 1 --2- 172.21.15.59:0/24764121 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f83500cac80 0x7f835006a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:27.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.260+0000 7f8356177700 1 -- 172.21.15.59:0/24764121 >> v2:172.21.15.83:3300/0 conn(0x7f835006acc0 msgr2=0x7f8350071680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:27.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.260+0000 7f8356177700 1 --2- 172.21.15.59:0/24764121 >> v2:172.21.15.83:3300/0 conn(0x7f835006acc0 0x7f8350071680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:27.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.260+0000 7f8356177700 1 -- 172.21.15.59:0/24764121 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83500cb460 con 0x7f835015b4f0 2023-09-21T00:18:27.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.260+0000 7f8356177700 1 --2- 172.21.15.59:0/24764121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f835015b4f0 0x7f83500cc410 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8350067380 tx=0x7f834c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e7a4863a264dc4b server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:27.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.260+0000 7f8355175700 1 -- 172.21.15.59:0/24764121 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834c00b870 con 0x7f835015b4f0 2023-09-21T00:18:27.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.261+0000 7f8355175700 1 -- 172.21.15.59:0/24764121 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834c00b9d0 con 0x7f835015b4f0 2023-09-21T00:18:27.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.261+0000 7f8355175700 1 -- 172.21.15.59:0/24764121 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834c00bd60 con 0x7f835015b4f0 2023-09-21T00:18:27.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.261+0000 7f83583db700 1 -- 172.21.15.59:0/24764121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f835015b4f0 msgr2=0x7f83500cc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:27.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.261+0000 7f83583db700 1 --2- 172.21.15.59:0/24764121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f835015b4f0 0x7f83500cc410 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8350067380 tx=0x7f834c009bd0 comp rx=0 tx=0).stop 2023-09-21T00:18:27.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.261+0000 7f83583db700 1 -- 172.21.15.59:0/24764121 shutdown_connections 2023-09-21T00:18:27.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.261+0000 7f83583db700 1 --2- 172.21.15.59:0/24764121 >> v2:172.21.15.83:3300/0 conn(0x7f835006acc0 0x7f8350071680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:27.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.261+0000 7f83583db700 1 --2- 172.21.15.59:0/24764121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f835015b4f0 0x7f83500cc410 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:27.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.261+0000 7f83583db700 1 --2- 172.21.15.59:0/24764121 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f83500cac80 0x7f835006a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:27.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.261+0000 7f83583db700 1 -- 172.21.15.59:0/24764121 >> 172.21.15.59:0/24764121 conn(0x7f83500d0140 msgr2=0x7f83500d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:27.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.261+0000 7f83583db700 1 -- 172.21.15.59:0/24764121 shutdown_connections 2023-09-21T00:18:27.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.261+0000 7f83583db700 1 -- 172.21.15.59:0/24764121 wait complete. 2023-09-21T00:18:27.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.262+0000 7f83583db700 1 Processor -- start 2023-09-21T00:18:27.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.262+0000 7f83583db700 1 -- start start 2023-09-21T00:18:27.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.263+0000 7f83583db700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f835006acc0 0x7f835014d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:27.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.263+0000 7f83583db700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f83500cac80 0x7f83500c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:27.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.263+0000 7f83583db700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f835015b4f0 0x7f83500b5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:27.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.263+0000 7f83583db700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835014db60 con 0x7f835006acc0 2023-09-21T00:18:27.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.263+0000 7f83583db700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83500c7210 con 0x7f835015b4f0 2023-09-21T00:18:27.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.263+0000 7f83583db700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83500ce250 con 0x7f83500cac80 2023-09-21T00:18:27.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.263+0000 7f8356177700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f835006acc0 0x7f835014d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:27.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.263+0000 7f8356177700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f835006acc0 0x7f835014d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53390/0 (socket says 172.21.15.59:53390) 2023-09-21T00:18:27.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.263+0000 7f8356177700 1 -- 172.21.15.59:0/200682049 learned_addr learned my addr 172.21.15.59:0/200682049 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:27.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.263+0000 7f8355976700 1 --2- 172.21.15.59:0/200682049 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f83500cac80 0x7f83500c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:27.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.263+0000 7f8356978700 1 --2- 172.21.15.59:0/200682049 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f835015b4f0 0x7f83500b5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:27.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.264+0000 7f8356177700 1 -- 172.21.15.59:0/200682049 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f83500cac80 msgr2=0x7f83500c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:27.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.264+0000 7f8356177700 1 --2- 172.21.15.59:0/200682049 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f83500cac80 0x7f83500c9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:27.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.264+0000 7f8356177700 1 -- 172.21.15.59:0/200682049 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f835015b4f0 msgr2=0x7f83500b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:27.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.264+0000 7f8356177700 1 --2- 172.21.15.59:0/200682049 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f835015b4f0 0x7f83500b5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:27.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.264+0000 7f8356177700 1 -- 172.21.15.59:0/200682049 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f834c009550 con 0x7f835006acc0 2023-09-21T00:18:27.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.264+0000 7f8356177700 1 --2- 172.21.15.59:0/200682049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f835006acc0 0x7f835014d620 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8350067480 tx=0x7f834c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:27.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.264+0000 7f8346ffd700 1 -- 172.21.15.59:0/200682049 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834c004480 con 0x7f835006acc0 2023-09-21T00:18:27.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.264+0000 7f8346ffd700 1 -- 172.21.15.59:0/200682049 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834c0045e0 con 0x7f835006acc0 2023-09-21T00:18:27.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.264+0000 7f83583db700 1 -- 172.21.15.59:0/200682049 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83500ce810 con 0x7f835006acc0 2023-09-21T00:18:27.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.264+0000 7f8346ffd700 1 -- 172.21.15.59:0/200682049 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834c0038e0 con 0x7f835006acc0 2023-09-21T00:18:27.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.264+0000 7f83583db700 1 -- 172.21.15.59:0/200682049 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83500c7740 con 0x7f835006acc0 2023-09-21T00:18:27.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.265+0000 7f83583db700 1 -- 172.21.15.59:0/200682049 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8350067e50 con 0x7f835006acc0 2023-09-21T00:18:27.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.266+0000 7f8346ffd700 1 -- 172.21.15.59:0/200682049 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f834c021070 con 0x7f835006acc0 2023-09-21T00:18:27.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.266+0000 7f8346ffd700 1 --2- 172.21.15.59:0/200682049 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f833406ae30 0x7f833406d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:27.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.266+0000 7f8346ffd700 1 -- 172.21.15.59:0/200682049 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f834c08ac10 con 0x7f835006acc0 2023-09-21T00:18:27.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.266+0000 7f8355976700 1 --2- 172.21.15.59:0/200682049 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f833406ae30 0x7f833406d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:27.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.267+0000 7f8355976700 1 --2- 172.21.15.59:0/200682049 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f833406ae30 0x7f833406d2f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f83501f59c0 tx=0x7f8340008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:27.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.271+0000 7f8346ffd700 1 -- 172.21.15.59:0/200682049 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f834c055da0 con 0x7f835006acc0 2023-09-21T00:18:27.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:27.515+0000 7f83583db700 1 -- 172.21.15.59:0/200682049 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f835014dee0 con 0x7f835006acc0 2023-09-21T00:18:28.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.095+0000 7f8346ffd700 1 -- 172.21.15.59:0/200682049 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f834c015020 con 0x7f835006acc0 2023-09-21T00:18:28.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.102+0000 7f83583db700 1 -- 172.21.15.59:0/200682049 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f833406ae30 msgr2=0x7f833406d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:28.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.102+0000 7f83583db700 1 --2- 172.21.15.59:0/200682049 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f833406ae30 0x7f833406d2f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f83501f59c0 tx=0x7f8340008040 comp rx=0 tx=0).stop 2023-09-21T00:18:28.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.102+0000 7f83583db700 1 -- 172.21.15.59:0/200682049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f835006acc0 msgr2=0x7f835014d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:28.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.102+0000 7f83583db700 1 --2- 172.21.15.59:0/200682049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f835006acc0 0x7f835014d620 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8350067480 tx=0x7f834c004750 comp rx=0 tx=0).stop 2023-09-21T00:18:28.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.102+0000 7f83583db700 1 -- 172.21.15.59:0/200682049 shutdown_connections 2023-09-21T00:18:28.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.102+0000 7f83583db700 1 --2- 172.21.15.59:0/200682049 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f835015b4f0 0x7f83500b5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:28.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.102+0000 7f83583db700 1 --2- 172.21.15.59:0/200682049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f835006acc0 0x7f835014d620 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:28.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.102+0000 7f83583db700 1 --2- 172.21.15.59:0/200682049 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f833406ae30 0x7f833406d2f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:28.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.102+0000 7f83583db700 1 --2- 172.21.15.59:0/200682049 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f83500cac80 0x7f83500c9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:28.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.102+0000 7f83583db700 1 -- 172.21.15.59:0/200682049 >> 172.21.15.59:0/200682049 conn(0x7f83500d0140 msgr2=0x7f83500cc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:28.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.102+0000 7f83583db700 1 -- 172.21.15.59:0/200682049 shutdown_connections 2023-09-21T00:18:28.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.103+0000 7f83583db700 1 -- 172.21.15.59:0/200682049 wait complete. 2023-09-21T00:18:28.106 INFO:teuthology.orchestra.run.smithi059.stderr:new fs with metadata pool 5 and data pool 6 2023-09-21T00:18:28.119 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T00:18:28.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.247+0000 7ff38a7f3700 1 Processor -- start 2023-09-21T00:18:28.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.247+0000 7ff38a7f3700 1 -- start start 2023-09-21T00:18:28.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.248+0000 7ff38a7f3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff3840ce420 0x7ff3840cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:28.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.248+0000 7ff38a7f3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff38406a780 0x7ff38406abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:28.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.248+0000 7ff38a7f3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff38406b110 con 0x7ff38415b2b0 2023-09-21T00:18:28.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.248+0000 7ff38a7f3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3840ce250 con 0x7ff3840ce420 2023-09-21T00:18:28.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.248+0000 7ff38a7f3700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3841618a0 con 0x7ff38406a780 2023-09-21T00:18:28.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.248+0000 7ff3837fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff3840ce420 0x7ff3840cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:28.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.248+0000 7ff3837fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff3840ce420 0x7ff3840cdd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53416/0 (socket says 172.21.15.59:53416) 2023-09-21T00:18:28.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.248+0000 7ff3837fe700 1 -- 172.21.15.59:0/1344382041 learned_addr learned my addr 172.21.15.59:0/1344382041 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:28.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.248+0000 7ff383fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff38415b2b0 0x7ff384161190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58982/0 (socket says 172.21.15.59:58982) 2023-09-21T00:18:28.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.249+0000 7ff388d90700 1 --2- 172.21.15.59:0/1344382041 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff38406a780 0x7ff38406abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:28.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.249+0000 7ff3837fe700 1 -- 172.21.15.59:0/1344382041 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff38406a780 msgr2=0x7ff38406abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:28.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.249+0000 7ff3837fe700 1 --2- 172.21.15.59:0/1344382041 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff38406a780 0x7ff38406abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:28.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.249+0000 7ff3837fe700 1 -- 172.21.15.59:0/1344382041 >> v1:172.21.15.59:6789/0 conn(0x7ff38415b2b0 legacy=0x7ff384161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:28.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.249+0000 7ff3837fe700 1 -- 172.21.15.59:0/1344382041 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3840cfee0 con 0x7ff3840ce420 2023-09-21T00:18:28.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.249+0000 7ff382ffd700 1 -- 172.21.15.59:0/1344382041 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1678523279 0 0) 0x7ff374001110 con 0x7ff38415b2b0 2023-09-21T00:18:28.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.249+0000 7ff388d90700 1 --2- 172.21.15.59:0/1344382041 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff38406a780 0x7ff38406abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:18:28.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.249+0000 7ff3837fe700 1 --2- 172.21.15.59:0/1344382041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3840ce420 0x7ff3840cdd10 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff36c0098f0 tx=0x7ff36c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=386030cb04c6b8ce server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:28.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.249+0000 7ff382ffd700 1 -- 172.21.15.59:0/1344382041 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36c00b8a0 con 0x7ff3840ce420 2023-09-21T00:18:28.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.249+0000 7ff382ffd700 1 -- 172.21.15.59:0/1344382041 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36c00ba00 con 0x7ff3840ce420 2023-09-21T00:18:28.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.249+0000 7ff382ffd700 1 -- 172.21.15.59:0/1344382041 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36c00bd90 con 0x7ff3840ce420 2023-09-21T00:18:28.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.250+0000 7ff38a7f3700 1 -- 172.21.15.59:0/1344382041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3840ce420 msgr2=0x7ff3840cdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:28.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.250+0000 7ff38a7f3700 1 --2- 172.21.15.59:0/1344382041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3840ce420 0x7ff3840cdd10 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff36c0098f0 tx=0x7ff36c009c00 comp rx=0 tx=0).stop 2023-09-21T00:18:28.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.250+0000 7ff38a7f3700 1 -- 172.21.15.59:0/1344382041 shutdown_connections 2023-09-21T00:18:28.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.250+0000 7ff38a7f3700 1 --2- 172.21.15.59:0/1344382041 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff38406a780 0x7ff38406abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:28.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.250+0000 7ff38a7f3700 1 --2- 172.21.15.59:0/1344382041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3840ce420 0x7ff3840cdd10 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:28.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.250+0000 7ff38a7f3700 1 -- 172.21.15.59:0/1344382041 >> 172.21.15.59:0/1344382041 conn(0x7ff3840d0140 msgr2=0x7ff3840d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:28.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.250+0000 7ff38a7f3700 1 -- 172.21.15.59:0/1344382041 shutdown_connections 2023-09-21T00:18:28.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.250+0000 7ff38a7f3700 1 -- 172.21.15.59:0/1344382041 wait complete. 2023-09-21T00:18:28.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.251+0000 7ff38a7f3700 1 Processor -- start 2023-09-21T00:18:28.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.251+0000 7ff38a7f3700 1 -- start start 2023-09-21T00:18:28.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.252+0000 7ff38a7f3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff38406a780 0x7ff3840c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:28.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.252+0000 7ff38a7f3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3840ce420 0x7ff3840c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:28.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.252+0000 7ff38a7f3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff38415b2b0 0x7ff3840c9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:28.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.252+0000 7ff38a7f3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3840c4680 con 0x7ff38406a780 2023-09-21T00:18:28.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.252+0000 7ff38a7f3700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3840c48d0 con 0x7ff3840ce420 2023-09-21T00:18:28.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.252+0000 7ff38a7f3700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3840c4bb0 con 0x7ff38415b2b0 2023-09-21T00:18:28.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.252+0000 7ff383fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff38406a780 0x7ff3840c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:28.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.252+0000 7ff383fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff38406a780 0x7ff3840c5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53420/0 (socket says 172.21.15.59:53420) 2023-09-21T00:18:28.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.252+0000 7ff383fff700 1 -- 172.21.15.59:0/1523402217 learned_addr learned my addr 172.21.15.59:0/1523402217 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:28.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.252+0000 7ff388d90700 1 --2- 172.21.15.59:0/1523402217 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff38415b2b0 0x7ff3840c9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:28.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.252+0000 7ff3837fe700 1 --2- 172.21.15.59:0/1523402217 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3840ce420 0x7ff3840c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:28.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.252+0000 7ff383fff700 1 -- 172.21.15.59:0/1523402217 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff38415b2b0 msgr2=0x7ff3840c9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:28.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.252+0000 7ff383fff700 1 --2- 172.21.15.59:0/1523402217 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff38415b2b0 0x7ff3840c9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:28.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.252+0000 7ff383fff700 1 -- 172.21.15.59:0/1523402217 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3840ce420 msgr2=0x7ff3840c8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:28.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.252+0000 7ff383fff700 1 --2- 172.21.15.59:0/1523402217 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3840ce420 0x7ff3840c8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:28.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.252+0000 7ff383fff700 1 -- 172.21.15.59:0/1523402217 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff36c009550 con 0x7ff38406a780 2023-09-21T00:18:28.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.252+0000 7ff383fff700 1 --2- 172.21.15.59:0/1523402217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff38406a780 0x7ff3840c5ec0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff37400c550 tx=0x7ff37400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:28.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.253+0000 7ff380ff9700 1 -- 172.21.15.59:0/1523402217 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff374004c80 con 0x7ff38406a780 2023-09-21T00:18:28.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.253+0000 7ff380ff9700 1 -- 172.21.15.59:0/1523402217 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff374004e00 con 0x7ff38406a780 2023-09-21T00:18:28.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.253+0000 7ff38a7f3700 1 -- 172.21.15.59:0/1523402217 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3840c4e90 con 0x7ff38406a780 2023-09-21T00:18:28.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.253+0000 7ff380ff9700 1 -- 172.21.15.59:0/1523402217 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff374007310 con 0x7ff38406a780 2023-09-21T00:18:28.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.253+0000 7ff38a7f3700 1 -- 172.21.15.59:0/1523402217 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3840c6400 con 0x7ff38406a780 2023-09-21T00:18:28.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.254+0000 7ff38a7f3700 1 -- 172.21.15.59:0/1523402217 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3840c54a0 con 0x7ff38406a780 2023-09-21T00:18:28.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.254+0000 7ff380ff9700 1 -- 172.21.15.59:0/1523402217 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7ff374007470 con 0x7ff38406a780 2023-09-21T00:18:28.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.254+0000 7ff380ff9700 1 --2- 172.21.15.59:0/1523402217 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ff36406ae00 0x7ff36406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:28.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.255+0000 7ff380ff9700 1 -- 172.21.15.59:0/1523402217 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff3740892c0 con 0x7ff38406a780 2023-09-21T00:18:28.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.255+0000 7ff3837fe700 1 --2- 172.21.15.59:0/1523402217 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ff36406ae00 0x7ff36406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:28.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.255+0000 7ff3837fe700 1 --2- 172.21.15.59:0/1523402217 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ff36406ae00 0x7ff36406d2c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff3840ce830 tx=0x7ff36c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:28.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.259+0000 7ff380ff9700 1 -- 172.21.15.59:0/1523402217 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7ff374054200 con 0x7ff38406a780 2023-09-21T00:18:28.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.462+0000 7ff38a7f3700 1 -- 172.21.15.59:0/1523402217 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff38406b110 con 0x7ff38406a780 2023-09-21T00:18:28.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.463+0000 7ff380ff9700 1 -- 172.21.15.59:0/1523402217 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16703 (secure 0 0 0) 0x7ff38406b110 con 0x7ff38406a780 2023-09-21T00:18:28.464 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:18:28.464 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":37,"fsid":"dd69925c-6e25-42fe-880b-2f60fc6f384b","created":"2023-09-21T00:16:43.074489+0000","modified":"2023-09-21T00:18:27.516268+0000","last_up_change":"2023-09-21T00:16:54.740101+0000","last_in_change":"2023-09-21T00:16:45.987089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T00:16:54.796248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-09-21T00:18:25.534473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-09-21T00:18:26.494284+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d4b18344-74c0-4f75-920b-7a9247e48914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6809","nonce":2418314235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6811","nonce":2418314235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6815","nonce":2418314235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6813","nonce":2418314235}]},"public_addr":"172.21.15.59:6809/2418314235","cluster_addr":"172.21.15.59:6811/2418314235","heartbeat_back_addr":"172.21.15.59:6815/2418314235","heartbeat_front_addr":"172.21.15.59:6813/2418314235","state":["exists","up"]},{"osd":1,"uuid":"80940d50-a248-4e64-a282-7ffcdad790ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6801","nonce":869668251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6803","nonce":869668251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6807","nonce":869668251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6805","nonce":869668251}]},"public_addr":"172.21.15.59:6801/869668251","cluster_addr":"172.21.15.59:6803/869668251","heartbeat_back_addr":"172.21.15.59:6807/869668251","heartbeat_front_addr":"172.21.15.59:6805/869668251","state":["exists","up"]},{"osd":2,"uuid":"55f2eceb-c54a-4879-a6ce-968c1c548b5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6817","nonce":372517778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6819","nonce":372517778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6823","nonce":372517778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6821","nonce":372517778}]},"public_addr":"172.21.15.59:6817/372517778","cluster_addr":"172.21.15.59:6819/372517778","heartbeat_back_addr":"172.21.15.59:6823/372517778","heartbeat_front_addr":"172.21.15.59:6821/372517778","state":["exists","up"]},{"osd":3,"uuid":"92b89cd0-869c-49b9-a9f9-97ac8423f304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6825","nonce":575188498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6827","nonce":575188498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6831","nonce":575188498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6829","nonce":575188498}]},"public_addr":"172.21.15.59:6825/575188498","cluster_addr":"172.21.15.59:6827/575188498","heartbeat_back_addr":"172.21.15.59:6831/575188498","heartbeat_front_addr":"172.21.15.59:6829/575188498","state":["exists","up"]},{"osd":4,"uuid":"25b80e94-e0e6-403d-b69f-61542f289637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6803","nonce":1741219098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6805","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6807","nonce":1741219098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6815","nonce":1741219098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6811","nonce":1741219098}]},"public_addr":"172.21.15.83:6803/1741219098","cluster_addr":"172.21.15.83:6807/1741219098","heartbeat_back_addr":"172.21.15.83:6815/1741219098","heartbeat_front_addr":"172.21.15.83:6811/1741219098","state":["exists","up"]},{"osd":5,"uuid":"5498d9ab-1086-4796-a199-9051e6dfea91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6817","nonce":156730565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6819","nonce":156730565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6823","nonce":156730565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6821","nonce":156730565}]},"public_addr":"172.21.15.83:6817/156730565","cluster_addr":"172.21.15.83:6819/156730565","heartbeat_back_addr":"172.21.15.83:6823/156730565","heartbeat_front_addr":"172.21.15.83:6821/156730565","state":["exists","up"]},{"osd":6,"uuid":"cfd810c0-5015-4d60-9a75-7efc93a32e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6801","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6800","nonce":1337723778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6806","nonce":1337723778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6814","nonce":1337723778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6810","nonce":1337723778}]},"public_addr":"172.21.15.83:6800/1337723778","cluster_addr":"172.21.15.83:6806/1337723778","heartbeat_back_addr":"172.21.15.83:6814/1337723778","heartbeat_front_addr":"172.21.15.83:6810/1337723778","state":["exists","up"]},{"osd":7,"uuid":"e992c8fa-0a3d-4b3c-85b5-2c511223dee4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6825","nonce":4204859272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6827","nonce":4204859272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6831","nonce":4204859272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6829","nonce":4204859272}]},"public_addr":"172.21.15.83:6825/4204859272","cluster_addr":"172.21.15.83:6827/4204859272","heartbeat_back_addr":"172.21.15.83:6831/4204859272","heartbeat_front_addr":"172.21.15.83:6829/4204859272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.156498+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.882707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.093978+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.158565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.173933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.888606+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.135525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.149712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T00:18:28.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.465+0000 7ff38a7f3700 1 -- 172.21.15.59:0/1523402217 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ff36406ae00 msgr2=0x7ff36406d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:28.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.465+0000 7ff38a7f3700 1 --2- 172.21.15.59:0/1523402217 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ff36406ae00 0x7ff36406d2c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff3840ce830 tx=0x7ff36c008030 comp rx=0 tx=0).stop 2023-09-21T00:18:28.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.465+0000 7ff38a7f3700 1 -- 172.21.15.59:0/1523402217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff38406a780 msgr2=0x7ff3840c5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:28.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.465+0000 7ff38a7f3700 1 --2- 172.21.15.59:0/1523402217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff38406a780 0x7ff3840c5ec0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff37400c550 tx=0x7ff37400c910 comp rx=0 tx=0).stop 2023-09-21T00:18:28.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.465+0000 7ff38a7f3700 1 -- 172.21.15.59:0/1523402217 shutdown_connections 2023-09-21T00:18:28.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.465+0000 7ff38a7f3700 1 --2- 172.21.15.59:0/1523402217 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7ff36406ae00 0x7ff36406d2c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:28.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.465+0000 7ff38a7f3700 1 --2- 172.21.15.59:0/1523402217 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff38415b2b0 0x7ff3840c9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:28.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.465+0000 7ff38a7f3700 1 --2- 172.21.15.59:0/1523402217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff38406a780 0x7ff3840c5ec0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:28.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.465+0000 7ff38a7f3700 1 --2- 172.21.15.59:0/1523402217 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3840ce420 0x7ff3840c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:28.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.465+0000 7ff38a7f3700 1 -- 172.21.15.59:0/1523402217 >> 172.21.15.59:0/1523402217 conn(0x7ff3840d0140 msgr2=0x7ff38406e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:28.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.465+0000 7ff38a7f3700 1 -- 172.21.15.59:0/1523402217 shutdown_connections 2023-09-21T00:18:28.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.465+0000 7ff38a7f3700 1 -- 172.21.15.59:0/1523402217 wait complete. 2023-09-21T00:18:28.479 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T00:18:28.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.603+0000 7fef5af5a700 1 Processor -- start 2023-09-21T00:18:28.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.603+0000 7fef5af5a700 1 -- start start 2023-09-21T00:18:28.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.604+0000 7fef5af5a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fef54071d90 0x7fef5406eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:28.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.604+0000 7fef5af5a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef540cb1c0 con 0x7fef5415a230 2023-09-21T00:18:28.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.604+0000 7fef5af5a700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef540cb4a0 con 0x7fef540ca790 2023-09-21T00:18:28.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.604+0000 7fef5af5a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef540cb780 con 0x7fef54071d90 2023-09-21T00:18:28.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.605+0000 7fef58cf6700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fef5415a230 0x7fef5415e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58996/0 (socket says 172.21.15.59:58996) 2023-09-21T00:18:28.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.605+0000 7fef58cf6700 1 -- 172.21.15.59:0/2380286159 learned_addr learned my addr 172.21.15.59:0/2380286159 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:28.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.605+0000 7fef594f7700 1 --2- 172.21.15.59:0/2380286159 >> v2:172.21.15.59:3300/0 conn(0x7fef54071d90 0x7fef5406eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:28.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.605+0000 7fef537fe700 1 -- 172.21.15.59:0/2380286159 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 928440917 0 0) 0x7fef540cb1c0 con 0x7fef5415a230 2023-09-21T00:18:28.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.605+0000 7fef537fe700 1 -- 172.21.15.59:0/2380286159 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef440035b0 con 0x7fef5415a230 2023-09-21T00:18:28.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.605+0000 7fef594f7700 1 -- 172.21.15.59:0/2380286159 >> v1:172.21.15.83:6789/0 conn(0x7fef540ca790 legacy=0x7fef54071680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:28.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.605+0000 7fef594f7700 1 -- 172.21.15.59:0/2380286159 >> v1:172.21.15.59:6789/0 conn(0x7fef5415a230 legacy=0x7fef5415e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:28.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.605+0000 7fef594f7700 1 -- 172.21.15.59:0/2380286159 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef5415e0b0 con 0x7fef54071d90 2023-09-21T00:18:28.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.605+0000 7fef594f7700 1 --2- 172.21.15.59:0/2380286159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef54071d90 0x7fef5406eaa0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fef4c009d90 tx=0x7fef4c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8430e197b9940f6e server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:28.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.605+0000 7fef537fe700 1 -- 172.21.15.59:0/2380286159 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4c00e070 con 0x7fef54071d90 2023-09-21T00:18:28.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.605+0000 7fef537fe700 1 -- 172.21.15.59:0/2380286159 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4c00bb20 con 0x7fef54071d90 2023-09-21T00:18:28.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.605+0000 7fef537fe700 1 -- 172.21.15.59:0/2380286159 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4c00be90 con 0x7fef54071d90 2023-09-21T00:18:28.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.606+0000 7fef5af5a700 1 -- 172.21.15.59:0/2380286159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef54071d90 msgr2=0x7fef5406eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:28.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.606+0000 7fef5af5a700 1 --2- 172.21.15.59:0/2380286159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef54071d90 0x7fef5406eaa0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fef4c009d90 tx=0x7fef4c00b330 comp rx=0 tx=0).stop 2023-09-21T00:18:28.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.606+0000 7fef5af5a700 1 -- 172.21.15.59:0/2380286159 shutdown_connections 2023-09-21T00:18:28.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.606+0000 7fef5af5a700 1 --2- 172.21.15.59:0/2380286159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef54071d90 0x7fef5406eaa0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:28.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.606+0000 7fef5af5a700 1 -- 172.21.15.59:0/2380286159 >> 172.21.15.59:0/2380286159 conn(0x7fef540d0140 msgr2=0x7fef540d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:28.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.606+0000 7fef5af5a700 1 -- 172.21.15.59:0/2380286159 shutdown_connections 2023-09-21T00:18:28.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.606+0000 7fef5af5a700 1 -- 172.21.15.59:0/2380286159 wait complete. 2023-09-21T00:18:28.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.607+0000 7fef5af5a700 1 Processor -- start 2023-09-21T00:18:28.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.607+0000 7fef5af5a700 1 -- start start 2023-09-21T00:18:28.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.608+0000 7fef5af5a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef54071d90 0x7fef541567d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:28.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.608+0000 7fef5af5a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fef540ca790 0x7fef5415bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:28.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.608+0000 7fef5af5a700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fef5415a230 0x7fef541f3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:28.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.608+0000 7fef5af5a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef540ae390 con 0x7fef54071d90 2023-09-21T00:18:28.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.608+0000 7fef5af5a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef54156d10 con 0x7fef540ca790 2023-09-21T00:18:28.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.608+0000 7fef5af5a700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef540ad780 con 0x7fef5415a230 2023-09-21T00:18:28.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.608+0000 7fef58cf6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef54071d90 0x7fef541567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:28.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.608+0000 7fef58cf6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef54071d90 0x7fef541567d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53434/0 (socket says 172.21.15.59:53434) 2023-09-21T00:18:28.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.608+0000 7fef58cf6700 1 -- 172.21.15.59:0/1093280875 learned_addr learned my addr 172.21.15.59:0/1093280875 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:28.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.608+0000 7fef53fff700 1 --2- 172.21.15.59:0/1093280875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fef540ca790 0x7fef5415bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:28.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.608+0000 7fef594f7700 1 --2- 172.21.15.59:0/1093280875 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fef5415a230 0x7fef541f3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:28.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.608+0000 7fef58cf6700 1 -- 172.21.15.59:0/1093280875 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fef5415a230 msgr2=0x7fef541f3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:28.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.609+0000 7fef58cf6700 1 --2- 172.21.15.59:0/1093280875 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fef5415a230 0x7fef541f3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:28.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.609+0000 7fef58cf6700 1 -- 172.21.15.59:0/1093280875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fef540ca790 msgr2=0x7fef5415bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:28.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.609+0000 7fef58cf6700 1 --2- 172.21.15.59:0/1093280875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fef540ca790 0x7fef5415bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:28.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.609+0000 7fef58cf6700 1 -- 172.21.15.59:0/1093280875 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef4c009a70 con 0x7fef54071d90 2023-09-21T00:18:28.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.609+0000 7fef53fff700 1 --2- 172.21.15.59:0/1093280875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fef540ca790 0x7fef5415bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:18:28.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.609+0000 7fef58cf6700 1 --2- 172.21.15.59:0/1093280875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef54071d90 0x7fef541567d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fef48001eb0 tx=0x7fef4800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:28.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.609+0000 7fef517fa700 1 -- 172.21.15.59:0/1093280875 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef48005d70 con 0x7fef54071d90 2023-09-21T00:18:28.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.609+0000 7fef517fa700 1 -- 172.21.15.59:0/1093280875 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef480070d0 con 0x7fef54071d90 2023-09-21T00:18:28.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.609+0000 7fef5af5a700 1 -- 172.21.15.59:0/1093280875 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef540ada60 con 0x7fef54071d90 2023-09-21T00:18:28.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.609+0000 7fef517fa700 1 -- 172.21.15.59:0/1093280875 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef48007460 con 0x7fef54071d90 2023-09-21T00:18:28.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.609+0000 7fef5af5a700 1 -- 172.21.15.59:0/1093280875 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef540ae020 con 0x7fef54071d90 2023-09-21T00:18:28.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.610+0000 7fef5af5a700 1 -- 172.21.15.59:0/1093280875 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef54067e50 con 0x7fef54071d90 2023-09-21T00:18:28.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.610+0000 7fef517fa700 1 -- 172.21.15.59:0/1093280875 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fef480075c0 con 0x7fef54071d90 2023-09-21T00:18:28.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.611+0000 7fef517fa700 1 --2- 172.21.15.59:0/1093280875 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fef3806ae00 0x7fef3806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:28.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.611+0000 7fef517fa700 1 -- 172.21.15.59:0/1093280875 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fef48088c50 con 0x7fef54071d90 2023-09-21T00:18:28.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.611+0000 7fef53fff700 1 --2- 172.21.15.59:0/1093280875 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fef3806ae00 0x7fef3806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:28.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.612+0000 7fef53fff700 1 --2- 172.21.15.59:0/1093280875 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fef3806ae00 0x7fef3806d2c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fef540c3690 tx=0x7fef40009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:28.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.615+0000 7fef517fa700 1 -- 172.21.15.59:0/1093280875 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fef48053b90 con 0x7fef54071d90 2023-09-21T00:18:28.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.818+0000 7fef5af5a700 1 -- 172.21.15.59:0/1093280875 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef54070040 con 0x7fef54071d90 2023-09-21T00:18:28.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.819+0000 7fef517fa700 1 -- 172.21.15.59:0/1093280875 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16703 (secure 0 0 0) 0x7fef48017090 con 0x7fef54071d90 2023-09-21T00:18:28.821 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:18:28.821 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":37,"fsid":"dd69925c-6e25-42fe-880b-2f60fc6f384b","created":"2023-09-21T00:16:43.074489+0000","modified":"2023-09-21T00:18:27.516268+0000","last_up_change":"2023-09-21T00:16:54.740101+0000","last_in_change":"2023-09-21T00:16:45.987089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T00:16:54.796248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-09-21T00:18:25.534473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-09-21T00:18:26.494284+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d4b18344-74c0-4f75-920b-7a9247e48914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6809","nonce":2418314235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6811","nonce":2418314235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6815","nonce":2418314235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6813","nonce":2418314235}]},"public_addr":"172.21.15.59:6809/2418314235","cluster_addr":"172.21.15.59:6811/2418314235","heartbeat_back_addr":"172.21.15.59:6815/2418314235","heartbeat_front_addr":"172.21.15.59:6813/2418314235","state":["exists","up"]},{"osd":1,"uuid":"80940d50-a248-4e64-a282-7ffcdad790ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6801","nonce":869668251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6803","nonce":869668251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6807","nonce":869668251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6805","nonce":869668251}]},"public_addr":"172.21.15.59:6801/869668251","cluster_addr":"172.21.15.59:6803/869668251","heartbeat_back_addr":"172.21.15.59:6807/869668251","heartbeat_front_addr":"172.21.15.59:6805/869668251","state":["exists","up"]},{"osd":2,"uuid":"55f2eceb-c54a-4879-a6ce-968c1c548b5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6817","nonce":372517778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6819","nonce":372517778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6823","nonce":372517778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6821","nonce":372517778}]},"public_addr":"172.21.15.59:6817/372517778","cluster_addr":"172.21.15.59:6819/372517778","heartbeat_back_addr":"172.21.15.59:6823/372517778","heartbeat_front_addr":"172.21.15.59:6821/372517778","state":["exists","up"]},{"osd":3,"uuid":"92b89cd0-869c-49b9-a9f9-97ac8423f304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6825","nonce":575188498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6827","nonce":575188498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6831","nonce":575188498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6829","nonce":575188498}]},"public_addr":"172.21.15.59:6825/575188498","cluster_addr":"172.21.15.59:6827/575188498","heartbeat_back_addr":"172.21.15.59:6831/575188498","heartbeat_front_addr":"172.21.15.59:6829/575188498","state":["exists","up"]},{"osd":4,"uuid":"25b80e94-e0e6-403d-b69f-61542f289637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6803","nonce":1741219098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6805","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6807","nonce":1741219098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6815","nonce":1741219098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6811","nonce":1741219098}]},"public_addr":"172.21.15.83:6803/1741219098","cluster_addr":"172.21.15.83:6807/1741219098","heartbeat_back_addr":"172.21.15.83:6815/1741219098","heartbeat_front_addr":"172.21.15.83:6811/1741219098","state":["exists","up"]},{"osd":5,"uuid":"5498d9ab-1086-4796-a199-9051e6dfea91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6817","nonce":156730565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6819","nonce":156730565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6823","nonce":156730565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6821","nonce":156730565}]},"public_addr":"172.21.15.83:6817/156730565","cluster_addr":"172.21.15.83:6819/156730565","heartbeat_back_addr":"172.21.15.83:6823/156730565","heartbeat_front_addr":"172.21.15.83:6821/156730565","state":["exists","up"]},{"osd":6,"uuid":"cfd810c0-5015-4d60-9a75-7efc93a32e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6801","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6800","nonce":1337723778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6806","nonce":1337723778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6814","nonce":1337723778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6810","nonce":1337723778}]},"public_addr":"172.21.15.83:6800/1337723778","cluster_addr":"172.21.15.83:6806/1337723778","heartbeat_back_addr":"172.21.15.83:6814/1337723778","heartbeat_front_addr":"172.21.15.83:6810/1337723778","state":["exists","up"]},{"osd":7,"uuid":"e992c8fa-0a3d-4b3c-85b5-2c511223dee4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6825","nonce":4204859272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6827","nonce":4204859272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6831","nonce":4204859272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6829","nonce":4204859272}]},"public_addr":"172.21.15.83:6825/4204859272","cluster_addr":"172.21.15.83:6827/4204859272","heartbeat_back_addr":"172.21.15.83:6831/4204859272","heartbeat_front_addr":"172.21.15.83:6829/4204859272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.156498+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.882707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.093978+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.158565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.173933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.888606+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.135525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.149712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T00:18:28.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.822+0000 7fef5af5a700 1 -- 172.21.15.59:0/1093280875 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fef3806ae00 msgr2=0x7fef3806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:28.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.822+0000 7fef5af5a700 1 --2- 172.21.15.59:0/1093280875 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fef3806ae00 0x7fef3806d2c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fef540c3690 tx=0x7fef40009040 comp rx=0 tx=0).stop 2023-09-21T00:18:28.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.822+0000 7fef5af5a700 1 -- 172.21.15.59:0/1093280875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef54071d90 msgr2=0x7fef541567d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:28.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.822+0000 7fef5af5a700 1 --2- 172.21.15.59:0/1093280875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef54071d90 0x7fef541567d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fef48001eb0 tx=0x7fef4800c860 comp rx=0 tx=0).stop 2023-09-21T00:18:28.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.822+0000 7fef5af5a700 1 -- 172.21.15.59:0/1093280875 shutdown_connections 2023-09-21T00:18:28.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.822+0000 7fef5af5a700 1 --2- 172.21.15.59:0/1093280875 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fef3806ae00 0x7fef3806d2c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:28.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.822+0000 7fef5af5a700 1 --2- 172.21.15.59:0/1093280875 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fef5415a230 0x7fef541f3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:28.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.822+0000 7fef5af5a700 1 --2- 172.21.15.59:0/1093280875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef54071d90 0x7fef541567d0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:28.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.822+0000 7fef5af5a700 1 --2- 172.21.15.59:0/1093280875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fef540ca790 0x7fef5415bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:28.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.822+0000 7fef5af5a700 1 -- 172.21.15.59:0/1093280875 >> 172.21.15.59:0/1093280875 conn(0x7fef540d0140 msgr2=0x7fef54071580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:28.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.822+0000 7fef5af5a700 1 -- 172.21.15.59:0/1093280875 shutdown_connections 2023-09-21T00:18:28.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.822+0000 7fef5af5a700 1 -- 172.21.15.59:0/1093280875 wait complete. 2023-09-21T00:18:28.835 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-21T00:18:28.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.963+0000 7f4bd1f17700 1 Processor -- start 2023-09-21T00:18:28.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.963+0000 7f4bd1f17700 1 -- start start 2023-09-21T00:18:28.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.964+0000 7f4bd1f17700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4bcc160be0 0x7f4bcc0cc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:28.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.964+0000 7f4bd1f17700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bcc0ca2f0 con 0x7f4bcc06d290 2023-09-21T00:18:28.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.964+0000 7f4bd1f17700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bcc072050 con 0x7f4bcc06d770 2023-09-21T00:18:28.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.964+0000 7f4bd1f17700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc06ce70 con 0x7f4bcc160be0 2023-09-21T00:18:28.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.964+0000 7f4bcaffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4bcc06d290 0x7f4bcc0cc7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59010/0 (socket says 172.21.15.59:59010) 2023-09-21T00:18:28.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.964+0000 7f4bcaffd700 1 -- 172.21.15.59:0/3784542691 learned_addr learned my addr 172.21.15.59:0/3784542691 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:28.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.964+0000 7f4bcb7fe700 1 --2- 172.21.15.59:0/3784542691 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4bcc160be0 0x7f4bcc0cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:28.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.965+0000 7f4bca7fc700 1 -- 172.21.15.59:0/3784542691 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2980382116 0 0) 0x7f4bcc0ca2f0 con 0x7f4bcc06d290 2023-09-21T00:18:28.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.965+0000 7f4bca7fc700 1 -- 172.21.15.59:0/3784542691 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bb80035b0 con 0x7f4bcc06d290 2023-09-21T00:18:28.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.965+0000 7f4bca7fc700 1 -- 172.21.15.59:0/3784542691 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1104489824 0 0) 0x7f4bcc072050 con 0x7f4bcc06d770 2023-09-21T00:18:28.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.965+0000 7f4bca7fc700 1 -- 172.21.15.59:0/3784542691 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bcc0ca2f0 con 0x7f4bcc06d770 2023-09-21T00:18:28.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.965+0000 7f4bca7fc700 1 -- 172.21.15.59:0/3784542691 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2856913456 0 0) 0x7f4bb80035b0 con 0x7f4bcc06d290 2023-09-21T00:18:28.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.965+0000 7f4bca7fc700 1 -- 172.21.15.59:0/3784542691 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4bcc160be0 msgr2=0x7f4bcc0cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:28.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.965+0000 7f4bca7fc700 1 --2- 172.21.15.59:0/3784542691 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4bcc160be0 0x7f4bcc0cc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:28.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.965+0000 7f4bca7fc700 1 -- 172.21.15.59:0/3784542691 >> v1:172.21.15.83:6789/0 conn(0x7f4bcc06d770 legacy=0x7f4bcc161140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:28.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.965+0000 7f4bca7fc700 1 -- 172.21.15.59:0/3784542691 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bcc0ca010 con 0x7f4bcc06d290 2023-09-21T00:18:28.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.965+0000 7f4bca7fc700 1 -- 172.21.15.59:0/3784542691 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 710825841 0 0) 0x7f4bbc001670 con 0x7f4bcc06d290 2023-09-21T00:18:28.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.965+0000 7f4bca7fc700 1 -- 172.21.15.59:0/3784542691 >> v1:172.21.15.59:6789/0 conn(0x7f4bcc06d290 legacy=0x7f4bcc0cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:28.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.965+0000 7f4bca7fc700 1 --2- 172.21.15.59:0/3784542691 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4bcc160be0 0x7f4bb8003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:28.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.965+0000 7f4bca7fc700 1 --2- 172.21.15.59:0/3784542691 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4bb8004170 0x7f4bb8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:28.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.965+0000 7f4bca7fc700 1 --2- 172.21.15.59:0/3784542691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bb8004d90 0x7f4bb8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:28.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.965+0000 7f4bca7fc700 1 -- 172.21.15.59:0/3784542691 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc06ce70 con 0x7f4bb8004d90 2023-09-21T00:18:28.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.965+0000 7f4bca7fc700 1 -- 172.21.15.59:0/3784542691 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb800bb50 con 0x7f4bb8004170 2023-09-21T00:18:28.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.965+0000 7f4bca7fc700 1 -- 172.21.15.59:0/3784542691 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb800bd10 con 0x7f4bcc160be0 2023-09-21T00:18:28.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.965+0000 7f4bcbfff700 1 --2- 172.21.15.59:0/3784542691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bb8004d90 0x7f4bb8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:28.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.965+0000 7f4bcb7fe700 1 --2- 172.21.15.59:0/3784542691 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4bcc160be0 0x7f4bb8003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:28.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.965+0000 7f4bcaffd700 1 --2- 172.21.15.59:0/3784542691 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4bb8004170 0x7f4bb8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:28.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.965+0000 7f4bcbfff700 1 -- 172.21.15.59:0/3784542691 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4bcc160be0 msgr2=0x7f4bb8003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:28.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.965+0000 7f4bcbfff700 1 --2- 172.21.15.59:0/3784542691 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4bcc160be0 0x7f4bb8003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:28.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.965+0000 7f4bcbfff700 1 -- 172.21.15.59:0/3784542691 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4bb8004170 msgr2=0x7f4bb8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:28.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.965+0000 7f4bcbfff700 1 --2- 172.21.15.59:0/3784542691 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4bb8004170 0x7f4bb8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:28.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.965+0000 7f4bcbfff700 1 -- 172.21.15.59:0/3784542691 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb80035b0 con 0x7f4bb8004d90 2023-09-21T00:18:28.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.965+0000 7f4bcbfff700 1 --2- 172.21.15.59:0/3784542691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bb8004d90 0x7f4bb8005210 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4bc400c320 tx=0x7f4bb8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76b155a78e193ae9 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:28.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.966+0000 7f4bca7fc700 1 -- 172.21.15.59:0/3784542691 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc4001f20 con 0x7f4bb8004d90 2023-09-21T00:18:28.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.966+0000 7f4bca7fc700 1 -- 172.21.15.59:0/3784542691 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc4003a50 con 0x7f4bb8004d90 2023-09-21T00:18:28.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.966+0000 7f4bca7fc700 1 -- 172.21.15.59:0/3784542691 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc400cea0 con 0x7f4bb8004d90 2023-09-21T00:18:28.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.966+0000 7f4bd1f17700 1 -- 172.21.15.59:0/3784542691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bb8004d90 msgr2=0x7f4bb8005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:28.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.966+0000 7f4bd1f17700 1 --2- 172.21.15.59:0/3784542691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bb8004d90 0x7f4bb8005210 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4bc400c320 tx=0x7f4bb8005880 comp rx=0 tx=0).stop 2023-09-21T00:18:28.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.966+0000 7f4bcbfff700 1 -- 172.21.15.59:0/3784542691 reap_dead start 2023-09-21T00:18:28.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.966+0000 7f4bd1f17700 1 -- 172.21.15.59:0/3784542691 shutdown_connections 2023-09-21T00:18:28.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.966+0000 7f4bd1f17700 1 -- 172.21.15.59:0/3784542691 >> 172.21.15.59:0/3784542691 conn(0x7f4bcc06a780 msgr2=0x7f4bcc06ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:28.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.966+0000 7f4bd1f17700 1 -- 172.21.15.59:0/3784542691 shutdown_connections 2023-09-21T00:18:28.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.966+0000 7f4bd1f17700 1 -- 172.21.15.59:0/3784542691 wait complete. 2023-09-21T00:18:28.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.967+0000 7f4bd1f17700 1 Processor -- start 2023-09-21T00:18:28.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.968+0000 7f4bd1f17700 1 -- start start 2023-09-21T00:18:28.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.968+0000 7f4bd1f17700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4bcc151460 0x7f4bcc1535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:28.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.968+0000 7f4bd1f17700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bcc1f30f0 0x7f4bcc155960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:28.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.968+0000 7f4bd1f17700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4bcc155ea0 0x7f4bcc1f6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:28.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.968+0000 7f4bd1f17700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc156330 con 0x7f4bcc1f30f0 2023-09-21T00:18:28.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.968+0000 7f4bd1f17700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc153ee0 con 0x7f4bcc155ea0 2023-09-21T00:18:28.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.968+0000 7f4bd1f17700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc1541c0 con 0x7f4bcc151460 2023-09-21T00:18:28.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.969+0000 7f4bcaffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bcc1f30f0 0x7f4bcc155960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:28.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.969+0000 7f4bcaffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bcc1f30f0 0x7f4bcc155960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53456/0 (socket says 172.21.15.59:53456) 2023-09-21T00:18:28.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.969+0000 7f4bcaffd700 1 -- 172.21.15.59:0/2324123920 learned_addr learned my addr 172.21.15.59:0/2324123920 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:28.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.969+0000 7f4bcbfff700 1 --2- 172.21.15.59:0/2324123920 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4bcc155ea0 0x7f4bcc1f6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:28.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.969+0000 7f4bcb7fe700 1 --2- 172.21.15.59:0/2324123920 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4bcc151460 0x7f4bcc1535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:28.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.969+0000 7f4bcaffd700 1 -- 172.21.15.59:0/2324123920 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4bcc151460 msgr2=0x7f4bcc1535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:28.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.969+0000 7f4bcaffd700 1 --2- 172.21.15.59:0/2324123920 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4bcc151460 0x7f4bcc1535e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:28.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.969+0000 7f4bcaffd700 1 -- 172.21.15.59:0/2324123920 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4bcc155ea0 msgr2=0x7f4bcc1f6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:28.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.969+0000 7f4bcaffd700 1 --2- 172.21.15.59:0/2324123920 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4bcc155ea0 0x7f4bcc1f6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:28.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.969+0000 7f4bcaffd700 1 -- 172.21.15.59:0/2324123920 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bcc1544a0 con 0x7f4bcc1f30f0 2023-09-21T00:18:28.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.969+0000 7f4bcb7fe700 1 --2- 172.21.15.59:0/2324123920 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4bcc151460 0x7f4bcc1535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:18:28.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.969+0000 7f4bcaffd700 1 --2- 172.21.15.59:0/2324123920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bcc1f30f0 0x7f4bcc155960 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc007290 tx=0x7f4bbc0075a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:28.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.969+0000 7f4bc3fff700 1 -- 172.21.15.59:0/2324123920 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc00f6c0 con 0x7f4bcc1f30f0 2023-09-21T00:18:28.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.969+0000 7f4bc3fff700 1 -- 172.21.15.59:0/2324123920 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bbc00f820 con 0x7f4bcc1f30f0 2023-09-21T00:18:28.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.969+0000 7f4bd1f17700 1 -- 172.21.15.59:0/2324123920 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bcc154780 con 0x7f4bcc1f30f0 2023-09-21T00:18:28.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.969+0000 7f4bc3fff700 1 -- 172.21.15.59:0/2324123920 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc00fb90 con 0x7f4bcc1f30f0 2023-09-21T00:18:28.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.969+0000 7f4bd1f17700 1 -- 172.21.15.59:0/2324123920 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bcc151840 con 0x7f4bcc1f30f0 2023-09-21T00:18:28.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.970+0000 7f4bd1f17700 1 -- 172.21.15.59:0/2324123920 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bcc067e50 con 0x7f4bcc1f30f0 2023-09-21T00:18:28.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.971+0000 7f4bc3fff700 1 -- 172.21.15.59:0/2324123920 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f4bbc00fcf0 con 0x7f4bcc1f30f0 2023-09-21T00:18:28.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.971+0000 7f4bc3fff700 1 --2- 172.21.15.59:0/2324123920 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f4bac06ae00 0x7f4bac06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:28.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.971+0000 7f4bc3fff700 1 -- 172.21.15.59:0/2324123920 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4bbc089600 con 0x7f4bcc1f30f0 2023-09-21T00:18:28.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.971+0000 7f4bcb7fe700 1 --2- 172.21.15.59:0/2324123920 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f4bac06ae00 0x7f4bac06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:28.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.972+0000 7f4bcb7fe700 1 --2- 172.21.15.59:0/2324123920 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f4bac06ae00 0x7f4bac06d2c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4009c60 tx=0x7f4bb4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:28.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:28.976+0000 7f4bc3fff700 1 -- 172.21.15.59:0/2324123920 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f4bbc0545e0 con 0x7f4bcc1f30f0 2023-09-21T00:18:29.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:29.222+0000 7f4bd1f17700 1 -- 172.21.15.59:0/2324123920 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4bcc155740 con 0x7f4bcc1f30f0 2023-09-21T00:18:30.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.114+0000 7f4bc3fff700 1 -- 172.21.15.59:0/2324123920 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4bbc057c00 con 0x7f4bcc1f30f0 2023-09-21T00:18:30.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.116+0000 7f4bd1f17700 1 -- 172.21.15.59:0/2324123920 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f4bac06ae00 msgr2=0x7f4bac06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:30.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.116+0000 7f4bd1f17700 1 --2- 172.21.15.59:0/2324123920 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f4bac06ae00 0x7f4bac06d2c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4009c60 tx=0x7f4bb4008040 comp rx=0 tx=0).stop 2023-09-21T00:18:30.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.117+0000 7f4bd1f17700 1 -- 172.21.15.59:0/2324123920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bcc1f30f0 msgr2=0x7f4bcc155960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:30.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.117+0000 7f4bd1f17700 1 --2- 172.21.15.59:0/2324123920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bcc1f30f0 0x7f4bcc155960 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc007290 tx=0x7f4bbc0075a0 comp rx=0 tx=0).stop 2023-09-21T00:18:30.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.117+0000 7f4bd1f17700 1 -- 172.21.15.59:0/2324123920 shutdown_connections 2023-09-21T00:18:30.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.117+0000 7f4bd1f17700 1 --2- 172.21.15.59:0/2324123920 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4bcc155ea0 0x7f4bcc1f6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:30.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.117+0000 7f4bd1f17700 1 --2- 172.21.15.59:0/2324123920 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f4bac06ae00 0x7f4bac06d2c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:30.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.117+0000 7f4bd1f17700 1 --2- 172.21.15.59:0/2324123920 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4bcc151460 0x7f4bcc1535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:30.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.117+0000 7f4bd1f17700 1 --2- 172.21.15.59:0/2324123920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bcc1f30f0 0x7f4bcc155960 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:30.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.117+0000 7f4bd1f17700 1 -- 172.21.15.59:0/2324123920 >> 172.21.15.59:0/2324123920 conn(0x7f4bcc06a780 msgr2=0x7f4bcc0b43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:30.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.117+0000 7f4bd1f17700 1 -- 172.21.15.59:0/2324123920 shutdown_connections 2023-09-21T00:18:30.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.117+0000 7f4bd1f17700 1 -- 172.21.15.59:0/2324123920 wait complete. 2023-09-21T00:18:30.133 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-09-21T00:18:30.133 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-21T00:18:30.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.268+0000 7f7a589ce700 1 Processor -- start 2023-09-21T00:18:30.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.268+0000 7f7a589ce700 1 -- start start 2023-09-21T00:18:30.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.269+0000 7f7a589ce700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7a5415b420 0x7f7a540b2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:30.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.269+0000 7f7a589ce700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a5415c5d0 con 0x7f7a5406d180 2023-09-21T00:18:30.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.269+0000 7f7a589ce700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a5415bca0 con 0x7f7a5415b800 2023-09-21T00:18:30.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.269+0000 7f7a589ce700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a5415bf80 con 0x7f7a5415b420 2023-09-21T00:18:30.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.269+0000 7f7a5259c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7a5415b420 0x7f7a540b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:30.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.269+0000 7f7a52d9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7a5406d180 0x7f7a5415ef40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59030/0 (socket says 172.21.15.59:59030) 2023-09-21T00:18:30.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.269+0000 7f7a52d9d700 1 -- 172.21.15.59:0/298044297 learned_addr learned my addr 172.21.15.59:0/298044297 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:30.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.269+0000 7f7a5259c700 1 -- 172.21.15.59:0/298044297 >> v1:172.21.15.83:6789/0 conn(0x7f7a5415b800 legacy=0x7f7a540cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:30.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.270+0000 7f7a5259c700 1 -- 172.21.15.59:0/298044297 >> v1:172.21.15.59:6789/0 conn(0x7f7a5406d180 legacy=0x7f7a5415ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:30.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.270+0000 7f7a5259c700 1 -- 172.21.15.59:0/298044297 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a5415c260 con 0x7f7a5415b420 2023-09-21T00:18:30.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.270+0000 7f7a5159a700 1 -- 172.21.15.59:0/298044297 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1167082704 0 0) 0x7f7a5415c5d0 con 0x7f7a5406d180 2023-09-21T00:18:30.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.270+0000 7f7a5259c700 1 --2- 172.21.15.59:0/298044297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a5415b420 0x7f7a540b2810 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f7a48009840 tx=0x7f7a48009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=770c05bd906b63a2 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:30.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.270+0000 7f7a5159a700 1 -- 172.21.15.59:0/298044297 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a48011830 con 0x7f7a5415b420 2023-09-21T00:18:30.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.270+0000 7f7a5159a700 1 -- 172.21.15.59:0/298044297 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a48011990 con 0x7f7a5415b420 2023-09-21T00:18:30.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.270+0000 7f7a5159a700 1 -- 172.21.15.59:0/298044297 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a48011d20 con 0x7f7a5415b420 2023-09-21T00:18:30.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.270+0000 7f7a589ce700 1 -- 172.21.15.59:0/298044297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a5415b420 msgr2=0x7f7a540b2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:30.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.270+0000 7f7a589ce700 1 --2- 172.21.15.59:0/298044297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a5415b420 0x7f7a540b2810 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f7a48009840 tx=0x7f7a48009b50 comp rx=0 tx=0).stop 2023-09-21T00:18:30.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.270+0000 7f7a589ce700 1 -- 172.21.15.59:0/298044297 shutdown_connections 2023-09-21T00:18:30.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.271+0000 7f7a589ce700 1 --2- 172.21.15.59:0/298044297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a5415b420 0x7f7a540b2810 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:30.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.271+0000 7f7a589ce700 1 -- 172.21.15.59:0/298044297 >> 172.21.15.59:0/298044297 conn(0x7f7a5406a780 msgr2=0x7f7a5406ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:30.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.271+0000 7f7a589ce700 1 -- 172.21.15.59:0/298044297 shutdown_connections 2023-09-21T00:18:30.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.271+0000 7f7a589ce700 1 -- 172.21.15.59:0/298044297 wait complete. 2023-09-21T00:18:30.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.272+0000 7f7a589ce700 1 Processor -- start 2023-09-21T00:18:30.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.272+0000 7f7a589ce700 1 -- start start 2023-09-21T00:18:30.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.273+0000 7f7a589ce700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7a5406d180 0x7f7a5414f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:30.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.273+0000 7f7a589ce700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a5415b420 0x7f7a541f1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:30.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.273+0000 7f7a589ce700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a5415b800 0x7f7a5415ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:30.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.273+0000 7f7a589ce700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a541530f0 con 0x7f7a5415b420 2023-09-21T00:18:30.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.273+0000 7f7a589ce700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a541f1960 con 0x7f7a5415b800 2023-09-21T00:18:30.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.273+0000 7f7a589ce700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a54151530 con 0x7f7a5406d180 2023-09-21T00:18:30.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.273+0000 7f7a51d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a5415b420 0x7f7a541f1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:30.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.273+0000 7f7a51d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a5415b420 0x7f7a541f1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53470/0 (socket says 172.21.15.59:53470) 2023-09-21T00:18:30.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.273+0000 7f7a51d9b700 1 -- 172.21.15.59:0/515842729 learned_addr learned my addr 172.21.15.59:0/515842729 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:30.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.274+0000 7f7a5259c700 1 --2- 172.21.15.59:0/515842729 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7a5406d180 0x7f7a5414f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:30.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.274+0000 7f7a52d9d700 1 --2- 172.21.15.59:0/515842729 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a5415b800 0x7f7a5415ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:30.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.274+0000 7f7a51d9b700 1 -- 172.21.15.59:0/515842729 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7a5406d180 msgr2=0x7f7a5414f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:30.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.274+0000 7f7a51d9b700 1 --2- 172.21.15.59:0/515842729 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7a5406d180 0x7f7a5414f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:30.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.274+0000 7f7a51d9b700 1 -- 172.21.15.59:0/515842729 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a5415b800 msgr2=0x7f7a5415ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:30.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.274+0000 7f7a51d9b700 1 --2- 172.21.15.59:0/515842729 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a5415b800 0x7f7a5415ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:30.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.274+0000 7f7a51d9b700 1 -- 172.21.15.59:0/515842729 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a480094a0 con 0x7f7a5415b420 2023-09-21T00:18:30.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.274+0000 7f7a5259c700 1 --2- 172.21.15.59:0/515842729 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7a5406d180 0x7f7a5414f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:18:30.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.274+0000 7f7a52d9d700 1 --2- 172.21.15.59:0/515842729 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a5415b800 0x7f7a5415ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:18:30.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.274+0000 7f7a51d9b700 1 --2- 172.21.15.59:0/515842729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a5415b420 0x7f7a541f1420 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7a4400c420 tx=0x7f7a4400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:30.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.274+0000 7f7a42ffd700 1 -- 172.21.15.59:0/515842729 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a440052d0 con 0x7f7a5415b420 2023-09-21T00:18:30.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.274+0000 7f7a42ffd700 1 -- 172.21.15.59:0/515842729 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a44005430 con 0x7f7a5415b420 2023-09-21T00:18:30.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.274+0000 7f7a589ce700 1 -- 172.21.15.59:0/515842729 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a54151810 con 0x7f7a5415b420 2023-09-21T00:18:30.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.274+0000 7f7a42ffd700 1 -- 172.21.15.59:0/515842729 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a440038c0 con 0x7f7a5415b420 2023-09-21T00:18:30.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.274+0000 7f7a589ce700 1 -- 172.21.15.59:0/515842729 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a54151dd0 con 0x7f7a5415b420 2023-09-21T00:18:30.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.275+0000 7f7a589ce700 1 -- 172.21.15.59:0/515842729 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a54067e50 con 0x7f7a5415b420 2023-09-21T00:18:30.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.275+0000 7f7a42ffd700 1 -- 172.21.15.59:0/515842729 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f7a44003a20 con 0x7f7a5415b420 2023-09-21T00:18:30.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.276+0000 7f7a42ffd700 1 --2- 172.21.15.59:0/515842729 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f7a3406ae00 0x7f7a3406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:30.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.276+0000 7f7a42ffd700 1 -- 172.21.15.59:0/515842729 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7a44088a20 con 0x7f7a5415b420 2023-09-21T00:18:30.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.276+0000 7f7a5259c700 1 --2- 172.21.15.59:0/515842729 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f7a3406ae00 0x7f7a3406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:30.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.277+0000 7f7a5259c700 1 --2- 172.21.15.59:0/515842729 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f7a3406ae00 0x7f7a3406d2c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7a540cc910 tx=0x7f7a4801c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:30.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.281+0000 7f7a42ffd700 1 -- 172.21.15.59:0/515842729 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f7a44053a90 con 0x7f7a5415b420 2023-09-21T00:18:30.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:30.526+0000 7f7a589ce700 1 -- 172.21.15.59:0/515842729 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7a5414f960 con 0x7f7a5415b420 2023-09-21T00:18:31.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.123+0000 7f7a42ffd700 1 -- 172.21.15.59:0/515842729 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7a440170c0 con 0x7f7a5415b420 2023-09-21T00:18:31.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.126+0000 7f7a589ce700 1 -- 172.21.15.59:0/515842729 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f7a3406ae00 msgr2=0x7f7a3406d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:31.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.126+0000 7f7a589ce700 1 --2- 172.21.15.59:0/515842729 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f7a3406ae00 0x7f7a3406d2c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7a540cc910 tx=0x7f7a4801c040 comp rx=0 tx=0).stop 2023-09-21T00:18:31.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.126+0000 7f7a589ce700 1 -- 172.21.15.59:0/515842729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a5415b420 msgr2=0x7f7a541f1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:31.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.126+0000 7f7a589ce700 1 --2- 172.21.15.59:0/515842729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a5415b420 0x7f7a541f1420 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7a4400c420 tx=0x7f7a4400c7e0 comp rx=0 tx=0).stop 2023-09-21T00:18:31.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.126+0000 7f7a589ce700 1 -- 172.21.15.59:0/515842729 shutdown_connections 2023-09-21T00:18:31.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.126+0000 7f7a589ce700 1 --2- 172.21.15.59:0/515842729 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a5415b800 0x7f7a5415ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:31.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.126+0000 7f7a589ce700 1 --2- 172.21.15.59:0/515842729 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f7a3406ae00 0x7f7a3406d2c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:31.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.126+0000 7f7a589ce700 1 --2- 172.21.15.59:0/515842729 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7a5406d180 0x7f7a5414f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:31.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.126+0000 7f7a589ce700 1 --2- 172.21.15.59:0/515842729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a5415b420 0x7f7a541f1420 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:31.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.126+0000 7f7a589ce700 1 -- 172.21.15.59:0/515842729 >> 172.21.15.59:0/515842729 conn(0x7f7a5406a780 msgr2=0x7f7a5415dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:31.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.126+0000 7f7a589ce700 1 -- 172.21.15.59:0/515842729 shutdown_connections 2023-09-21T00:18:31.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.126+0000 7f7a589ce700 1 -- 172.21.15.59:0/515842729 wait complete. 2023-09-21T00:18:31.142 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-09-21T00:18:31.143 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T00:18:31.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.274+0000 7fa4c08e7700 1 Processor -- start 2023-09-21T00:18:31.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.274+0000 7fa4c08e7700 1 -- start start 2023-09-21T00:18:31.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.275+0000 7fa4c08e7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4bc15e950 0x7fa4bc0cd630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:31.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.275+0000 7fa4c08e7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4bc0708d0 con 0x7fa4bc070d60 2023-09-21T00:18:31.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.275+0000 7fa4c08e7700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4bc0d0ca0 con 0x7fa4bc06f100 2023-09-21T00:18:31.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.275+0000 7fa4c08e7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc15ed30 con 0x7fa4bc15e950 2023-09-21T00:18:31.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.275+0000 7fa4b9d9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa4bc070d60 0x7fa4bc06e9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59044/0 (socket says 172.21.15.59:59044) 2023-09-21T00:18:31.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.275+0000 7fa4b9d9b700 1 -- 172.21.15.59:0/287627431 learned_addr learned my addr 172.21.15.59:0/287627431 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:31.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.275+0000 7fa4ba59c700 1 --2- 172.21.15.59:0/287627431 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4bc15e950 0x7fa4bc0cd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:31.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.275+0000 7fa4b959a700 1 -- 172.21.15.59:0/287627431 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4277458893 0 0) 0x7fa4bc0708d0 con 0x7fa4bc070d60 2023-09-21T00:18:31.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.275+0000 7fa4b959a700 1 -- 172.21.15.59:0/287627431 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4a40035b0 con 0x7fa4bc070d60 2023-09-21T00:18:31.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.275+0000 7fa4b959a700 1 -- 172.21.15.59:0/287627431 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 238092633 0 0) 0x7fa4bc0d0ca0 con 0x7fa4bc06f100 2023-09-21T00:18:31.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.275+0000 7fa4b959a700 1 -- 172.21.15.59:0/287627431 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4bc0708d0 con 0x7fa4bc06f100 2023-09-21T00:18:31.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.275+0000 7fa4b959a700 1 -- 172.21.15.59:0/287627431 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3803746566 0 0) 0x7fa4a40035b0 con 0x7fa4bc070d60 2023-09-21T00:18:31.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.275+0000 7fa4b959a700 1 -- 172.21.15.59:0/287627431 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4bc15e950 msgr2=0x7fa4bc0cd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:31.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.275+0000 7fa4b959a700 1 --2- 172.21.15.59:0/287627431 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4bc15e950 0x7fa4bc0cd630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:31.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.275+0000 7fa4b959a700 1 -- 172.21.15.59:0/287627431 >> v1:172.21.15.83:6789/0 conn(0x7fa4bc06f100 legacy=0x7fa4bc15ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:31.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.275+0000 7fa4b959a700 1 -- 172.21.15.59:0/287627431 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4bc070280 con 0x7fa4bc070d60 2023-09-21T00:18:31.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.275+0000 7fa4b959a700 1 -- 172.21.15.59:0/287627431 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 710825841 0 0) 0x7fa4ac001670 con 0x7fa4bc070d60 2023-09-21T00:18:31.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.275+0000 7fa4b959a700 1 -- 172.21.15.59:0/287627431 >> v1:172.21.15.59:6789/0 conn(0x7fa4bc070d60 legacy=0x7fa4bc06e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:31.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.275+0000 7fa4b959a700 1 --2- 172.21.15.59:0/287627431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4a4003c30 0x7fa4a4004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:31.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.276+0000 7fa4b959a700 1 --2- 172.21.15.59:0/287627431 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4bc15e950 0x7fa4a4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:31.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.276+0000 7fa4b959a700 1 --2- 172.21.15.59:0/287627431 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4a4004d90 0x7fa4a4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:31.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.276+0000 7fa4b959a700 1 -- 172.21.15.59:0/287627431 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc15ed30 con 0x7fa4a4003c30 2023-09-21T00:18:31.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.276+0000 7fa4b959a700 1 -- 172.21.15.59:0/287627431 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a400bb40 con 0x7fa4a4004d90 2023-09-21T00:18:31.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.276+0000 7fa4b959a700 1 -- 172.21.15.59:0/287627431 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a400bd00 con 0x7fa4bc15e950 2023-09-21T00:18:31.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.276+0000 7fa4ba59c700 1 --2- 172.21.15.59:0/287627431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4a4003c30 0x7fa4a4004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:31.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.276+0000 7fa4b9d9b700 1 --2- 172.21.15.59:0/287627431 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4bc15e950 0x7fa4a4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:31.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.276+0000 7fa4bad9d700 1 --2- 172.21.15.59:0/287627431 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4a4004d90 0x7fa4a4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:31.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.276+0000 7fa4ba59c700 1 -- 172.21.15.59:0/287627431 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4bc15e950 msgr2=0x7fa4a4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:31.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.276+0000 7fa4ba59c700 1 --2- 172.21.15.59:0/287627431 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4bc15e950 0x7fa4a4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:31.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.276+0000 7fa4ba59c700 1 -- 172.21.15.59:0/287627431 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4a4004d90 msgr2=0x7fa4a4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:31.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.276+0000 7fa4ba59c700 1 --2- 172.21.15.59:0/287627431 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4a4004d90 0x7fa4a4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:31.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.276+0000 7fa4ba59c700 1 -- 172.21.15.59:0/287627431 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a40035b0 con 0x7fa4a4003c30 2023-09-21T00:18:31.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.276+0000 7fa4ba59c700 1 --2- 172.21.15.59:0/287627431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4a4003c30 0x7fa4a4004030 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0009b60 tx=0x7fa4a4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=639cc902863010a5 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:31.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.276+0000 7fa4b959a700 1 -- 172.21.15.59:0/287627431 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b000e6c0 con 0x7fa4a4003c30 2023-09-21T00:18:31.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.276+0000 7fa4b959a700 1 -- 172.21.15.59:0/287627431 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b000e820 con 0x7fa4a4003c30 2023-09-21T00:18:31.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.276+0000 7fa4b959a700 1 -- 172.21.15.59:0/287627431 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b000eb90 con 0x7fa4a4003c30 2023-09-21T00:18:31.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.277+0000 7fa4c08e7700 1 -- 172.21.15.59:0/287627431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4a4003c30 msgr2=0x7fa4a4004030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:31.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.277+0000 7fa4c08e7700 1 --2- 172.21.15.59:0/287627431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4a4003c30 0x7fa4a4004030 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0009b60 tx=0x7fa4a4005880 comp rx=0 tx=0).stop 2023-09-21T00:18:31.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.277+0000 7fa4bad9d700 1 -- 172.21.15.59:0/287627431 reap_dead start 2023-09-21T00:18:31.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.277+0000 7fa4c08e7700 1 -- 172.21.15.59:0/287627431 shutdown_connections 2023-09-21T00:18:31.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.277+0000 7fa4c08e7700 1 -- 172.21.15.59:0/287627431 >> 172.21.15.59:0/287627431 conn(0x7fa4bc0d11e0 msgr2=0x7fa4bc0d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:31.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.277+0000 7fa4c08e7700 1 -- 172.21.15.59:0/287627431 shutdown_connections 2023-09-21T00:18:31.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.277+0000 7fa4c08e7700 1 -- 172.21.15.59:0/287627431 wait complete. 2023-09-21T00:18:31.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.278+0000 7fa4c08e7700 1 Processor -- start 2023-09-21T00:18:31.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.278+0000 7fa4c08e7700 1 -- start start 2023-09-21T00:18:31.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.279+0000 7fa4c08e7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4a4003c30 0x7fa4bc1510b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:31.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.279+0000 7fa4c08e7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4bc0b4d80 0x7fa4bc0b5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:31.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.279+0000 7fa4c08e7700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4bc0b5740 0x7fa4bc0b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:31.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.279+0000 7fa4c08e7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc0c5200 con 0x7fa4bc0b4d80 2023-09-21T00:18:31.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.279+0000 7fa4c08e7700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc0b6250 con 0x7fa4a4003c30 2023-09-21T00:18:31.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.279+0000 7fa4c08e7700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc0b6530 con 0x7fa4bc0b5740 2023-09-21T00:18:31.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.279+0000 7fa4b9d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4bc0b4d80 0x7fa4bc0b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:31.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.279+0000 7fa4b9d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4bc0b4d80 0x7fa4bc0b5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53490/0 (socket says 172.21.15.59:53490) 2023-09-21T00:18:31.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.279+0000 7fa4b9d9b700 1 -- 172.21.15.59:0/4069176746 learned_addr learned my addr 172.21.15.59:0/4069176746 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:31.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.279+0000 7fa4ba59c700 1 --2- 172.21.15.59:0/4069176746 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4a4003c30 0x7fa4bc1510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:31.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.279+0000 7fa4bad9d700 1 --2- 172.21.15.59:0/4069176746 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4bc0b5740 0x7fa4bc0b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:31.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.279+0000 7fa4b9d9b700 1 -- 172.21.15.59:0/4069176746 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4bc0b5740 msgr2=0x7fa4bc0b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:31.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.279+0000 7fa4b9d9b700 1 --2- 172.21.15.59:0/4069176746 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4bc0b5740 0x7fa4bc0b5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:31.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.279+0000 7fa4b9d9b700 1 -- 172.21.15.59:0/4069176746 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4a4003c30 msgr2=0x7fa4bc1510b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:31.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.279+0000 7fa4b9d9b700 1 --2- 172.21.15.59:0/4069176746 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4a4003c30 0x7fa4bc1510b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:31.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.279+0000 7fa4b9d9b700 1 -- 172.21.15.59:0/4069176746 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4bc0b6810 con 0x7fa4bc0b4d80 2023-09-21T00:18:31.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.279+0000 7fa4ba59c700 1 --2- 172.21.15.59:0/4069176746 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4a4003c30 0x7fa4bc1510b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:18:31.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.279+0000 7fa4bad9d700 1 --2- 172.21.15.59:0/4069176746 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4bc0b5740 0x7fa4bc0b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:18:31.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.280+0000 7fa4b9d9b700 1 --2- 172.21.15.59:0/4069176746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4bc0b4d80 0x7fa4bc0b5200 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac001200 tx=0x7fa4ac00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:31.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.280+0000 7fa4aaffd700 1 -- 172.21.15.59:0/4069176746 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac00c540 con 0x7fa4bc0b4d80 2023-09-21T00:18:31.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.280+0000 7fa4aaffd700 1 -- 172.21.15.59:0/4069176746 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4ac00c6a0 con 0x7fa4bc0b4d80 2023-09-21T00:18:31.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.280+0000 7fa4c08e7700 1 -- 172.21.15.59:0/4069176746 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4bc0c5450 con 0x7fa4bc0b4d80 2023-09-21T00:18:31.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.280+0000 7fa4aaffd700 1 -- 172.21.15.59:0/4069176746 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac00ca30 con 0x7fa4bc0b4d80 2023-09-21T00:18:31.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.280+0000 7fa4c08e7700 1 -- 172.21.15.59:0/4069176746 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4bc1515f0 con 0x7fa4bc0b4d80 2023-09-21T00:18:31.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.281+0000 7fa4c08e7700 1 -- 172.21.15.59:0/4069176746 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4bc0c5690 con 0x7fa4bc0b4d80 2023-09-21T00:18:31.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.281+0000 7fa4aaffd700 1 -- 172.21.15.59:0/4069176746 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fa4ac00cb90 con 0x7fa4bc0b4d80 2023-09-21T00:18:31.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.282+0000 7fa4aaffd700 1 --2- 172.21.15.59:0/4069176746 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa49c06ae00 0x7fa49c06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:31.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.282+0000 7fa4aaffd700 1 -- 172.21.15.59:0/4069176746 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa4ac089340 con 0x7fa4bc0b4d80 2023-09-21T00:18:31.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.282+0000 7fa4ba59c700 1 --2- 172.21.15.59:0/4069176746 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa49c06ae00 0x7fa49c06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:31.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.282+0000 7fa4ba59c700 1 --2- 172.21.15.59:0/4069176746 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa49c06ae00 0x7fa49c06d2c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa4b00090b0 tx=0x7fa4b0008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:31.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.286+0000 7fa4aaffd700 1 -- 172.21.15.59:0/4069176746 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fa4bc0c5690 con 0x7fa4bc0b4d80 2023-09-21T00:18:31.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.534+0000 7fa4c08e7700 1 -- 172.21.15.59:0/4069176746 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4bc0c5690 con 0x7fa4bc0b4d80 2023-09-21T00:18:31.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.535+0000 7fa4aaffd700 1 -- 172.21.15.59:0/4069176746 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4913 (secure 0 0 0) 0x7fa4bc0c5690 con 0x7fa4bc0b4d80 2023-09-21T00:18:31.536 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:18:31.536 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4898,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/1114790703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1114790703},{"type":"v1","addr":"172.21.15.83:6836","nonce":1114790703}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4901,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/1202041805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":1202041805},{"type":"v1","addr":"172.21.15.83:6837","nonce":1202041805}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4907,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1175160979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1175160979},{"type":"v1","addr":"172.21.15.59:6834","nonce":1175160979}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-21T00:18:27.516592+0000","modified":"2023-09-21T00:18:30.527932+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5182},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5182":{"gid":5182,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.59:6835/1133941828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1133941828},{"type":"v1","addr":"172.21.15.59:6835","nonce":1133941828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-09-21T00:18:31.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.536+0000 7fa4c08e7700 1 -- 172.21.15.59:0/4069176746 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa49c06ae00 msgr2=0x7fa49c06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:31.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.536+0000 7fa4c08e7700 1 --2- 172.21.15.59:0/4069176746 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa49c06ae00 0x7fa49c06d2c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa4b00090b0 tx=0x7fa4b0008030 comp rx=0 tx=0).stop 2023-09-21T00:18:31.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.536+0000 7fa4c08e7700 1 -- 172.21.15.59:0/4069176746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4bc0b4d80 msgr2=0x7fa4bc0b5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:31.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.536+0000 7fa4c08e7700 1 --2- 172.21.15.59:0/4069176746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4bc0b4d80 0x7fa4bc0b5200 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac001200 tx=0x7fa4ac00ee80 comp rx=0 tx=0).stop 2023-09-21T00:18:31.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.537+0000 7fa4c08e7700 1 -- 172.21.15.59:0/4069176746 shutdown_connections 2023-09-21T00:18:31.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.537+0000 7fa4c08e7700 1 --2- 172.21.15.59:0/4069176746 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa49c06ae00 0x7fa49c06d2c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:31.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.537+0000 7fa4c08e7700 1 --2- 172.21.15.59:0/4069176746 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa4bc0b5740 0x7fa4bc0b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:31.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.537+0000 7fa4c08e7700 1 --2- 172.21.15.59:0/4069176746 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4a4003c30 0x7fa4bc1510b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:31.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.537+0000 7fa4c08e7700 1 --2- 172.21.15.59:0/4069176746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4bc0b4d80 0x7fa4bc0b5200 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:31.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.537+0000 7fa4c08e7700 1 -- 172.21.15.59:0/4069176746 >> 172.21.15.59:0/4069176746 conn(0x7fa4bc0d11e0 msgr2=0x7fa4bc0b1640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:31.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.537+0000 7fa4c08e7700 1 -- 172.21.15.59:0/4069176746 shutdown_connections 2023-09-21T00:18:31.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.537+0000 7fa4c08e7700 1 -- 172.21.15.59:0/4069176746 wait complete. 2023-09-21T00:18:31.541 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 17 2023-09-21T00:18:31.550 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T00:18:31.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.674+0000 7fa633da8700 1 Processor -- start 2023-09-21T00:18:31.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.674+0000 7fa633da8700 1 -- start start 2023-09-21T00:18:31.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.675+0000 7fa633da8700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa62c0b3fe0 0x7fa62c0ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:31.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.675+0000 7fa633da8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa62c15ef30 con 0x7fa62c15a470 2023-09-21T00:18:31.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.675+0000 7fa633da8700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa62c0b3b50 con 0x7fa62c0b4d90 2023-09-21T00:18:31.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.675+0000 7fa633da8700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa62c0b3220 con 0x7fa62c0b3fe0 2023-09-21T00:18:31.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.675+0000 7fa631b44700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa62c15a470 0x7fa62c0b4680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59064/0 (socket says 172.21.15.59:59064) 2023-09-21T00:18:31.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.675+0000 7fa631b44700 1 -- 172.21.15.59:0/1856181474 learned_addr learned my addr 172.21.15.59:0/1856181474 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:31.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.675+0000 7fa632345700 1 --2- 172.21.15.59:0/1856181474 >> v2:172.21.15.83:3300/0 conn(0x7fa62c0b3fe0 0x7fa62c0ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:31.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.675+0000 7fa630b42700 1 -- 172.21.15.59:0/1856181474 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 187147891 0 0) 0x7fa62c15ef30 con 0x7fa62c15a470 2023-09-21T00:18:31.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.675+0000 7fa630b42700 1 -- 172.21.15.59:0/1856181474 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6180035b0 con 0x7fa62c15a470 2023-09-21T00:18:31.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.675+0000 7fa630b42700 1 -- 172.21.15.59:0/1856181474 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1474765740 0 0) 0x7fa62c0b3b50 con 0x7fa62c0b4d90 2023-09-21T00:18:31.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.675+0000 7fa630b42700 1 -- 172.21.15.59:0/1856181474 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa62c15ef30 con 0x7fa62c0b4d90 2023-09-21T00:18:31.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.675+0000 7fa632345700 1 -- 172.21.15.59:0/1856181474 >> v1:172.21.15.83:6789/0 conn(0x7fa62c0b4d90 legacy=0x7fa62c0cdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:31.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.675+0000 7fa632345700 1 -- 172.21.15.59:0/1856181474 >> v1:172.21.15.59:6789/0 conn(0x7fa62c15a470 legacy=0x7fa62c0b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:31.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.676+0000 7fa632345700 1 -- 172.21.15.59:0/1856181474 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa62c0b3500 con 0x7fa62c0b3fe0 2023-09-21T00:18:31.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.676+0000 7fa632345700 1 --2- 172.21.15.59:0/1856181474 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa62c0b3fe0 0x7fa62c0ce4a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa624009d90 tx=0x7fa62400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbc4257fa5e72b63 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:31.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.676+0000 7fa630b42700 1 -- 172.21.15.59:0/1856181474 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62400e070 con 0x7fa62c0b3fe0 2023-09-21T00:18:31.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.676+0000 7fa630b42700 1 -- 172.21.15.59:0/1856181474 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa62400bb20 con 0x7fa62c0b3fe0 2023-09-21T00:18:31.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.676+0000 7fa630b42700 1 -- 172.21.15.59:0/1856181474 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa624012430 con 0x7fa62c0b3fe0 2023-09-21T00:18:31.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.676+0000 7fa633da8700 1 -- 172.21.15.59:0/1856181474 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa62c0b3fe0 msgr2=0x7fa62c0ce4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:31.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.676+0000 7fa633da8700 1 --2- 172.21.15.59:0/1856181474 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa62c0b3fe0 0x7fa62c0ce4a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa624009d90 tx=0x7fa62400b330 comp rx=0 tx=0).stop 2023-09-21T00:18:31.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.676+0000 7fa633da8700 1 -- 172.21.15.59:0/1856181474 shutdown_connections 2023-09-21T00:18:31.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.676+0000 7fa633da8700 1 --2- 172.21.15.59:0/1856181474 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa62c0b3fe0 0x7fa62c0ce4a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:31.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.676+0000 7fa633da8700 1 -- 172.21.15.59:0/1856181474 >> 172.21.15.59:0/1856181474 conn(0x7fa62c0b1d80 msgr2=0x7fa62c0b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:31.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.677+0000 7fa633da8700 1 -- 172.21.15.59:0/1856181474 shutdown_connections 2023-09-21T00:18:31.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.677+0000 7fa633da8700 1 -- 172.21.15.59:0/1856181474 wait complete. 2023-09-21T00:18:31.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.678+0000 7fa633da8700 1 Processor -- start 2023-09-21T00:18:31.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.678+0000 7fa633da8700 1 -- start start 2023-09-21T00:18:31.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.679+0000 7fa633da8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa62c0b3fe0 0x7fa62c149ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:31.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.679+0000 7fa633da8700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa62c0b4d90 0x7fa62c1580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:31.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.679+0000 7fa633da8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa62c15a470 0x7fa62c0d00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:31.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.679+0000 7fa633da8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c14a410 con 0x7fa62c0b3fe0 2023-09-21T00:18:31.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.679+0000 7fa633da8700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c0c5f00 con 0x7fa62c0b4d90 2023-09-21T00:18:31.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.679+0000 7fa633da8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c0c61e0 con 0x7fa62c15a470 2023-09-21T00:18:31.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.679+0000 7fa631b44700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa62c0b3fe0 0x7fa62c149ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:31.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.679+0000 7fa631b44700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa62c0b3fe0 0x7fa62c149ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53504/0 (socket says 172.21.15.59:53504) 2023-09-21T00:18:31.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.679+0000 7fa631b44700 1 -- 172.21.15.59:0/101188675 learned_addr learned my addr 172.21.15.59:0/101188675 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:31.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.679+0000 7fa632345700 1 --2- 172.21.15.59:0/101188675 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa62c15a470 0x7fa62c0d00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:31.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.679+0000 7fa631343700 1 --2- 172.21.15.59:0/101188675 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa62c0b4d90 0x7fa62c1580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:31.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.680+0000 7fa631b44700 1 -- 172.21.15.59:0/101188675 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa62c15a470 msgr2=0x7fa62c0d00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:31.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.680+0000 7fa631b44700 1 --2- 172.21.15.59:0/101188675 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa62c15a470 0x7fa62c0d00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:31.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.680+0000 7fa631b44700 1 -- 172.21.15.59:0/101188675 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa62c0b4d90 msgr2=0x7fa62c1580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:31.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.680+0000 7fa631b44700 1 --2- 172.21.15.59:0/101188675 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa62c0b4d90 0x7fa62c1580a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:31.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.680+0000 7fa631b44700 1 -- 172.21.15.59:0/101188675 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa624009a70 con 0x7fa62c0b3fe0 2023-09-21T00:18:31.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.680+0000 7fa632345700 1 --2- 172.21.15.59:0/101188675 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa62c15a470 0x7fa62c0d00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:18:31.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.680+0000 7fa631b44700 1 --2- 172.21.15.59:0/101188675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa62c0b3fe0 0x7fa62c149ed0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa628001eb0 tx=0x7fa62800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:31.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.680+0000 7fa6227fc700 1 -- 172.21.15.59:0/101188675 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa628005d70 con 0x7fa62c0b3fe0 2023-09-21T00:18:31.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.680+0000 7fa6227fc700 1 -- 172.21.15.59:0/101188675 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6280070d0 con 0x7fa62c0b3fe0 2023-09-21T00:18:31.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.680+0000 7fa633da8700 1 -- 172.21.15.59:0/101188675 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa62c0c64c0 con 0x7fa62c0b3fe0 2023-09-21T00:18:31.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.680+0000 7fa6227fc700 1 -- 172.21.15.59:0/101188675 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa628007460 con 0x7fa62c0b3fe0 2023-09-21T00:18:31.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.680+0000 7fa633da8700 1 -- 172.21.15.59:0/101188675 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa62c0c6a80 con 0x7fa62c0b3fe0 2023-09-21T00:18:31.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.681+0000 7fa633da8700 1 -- 172.21.15.59:0/101188675 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa62c067190 con 0x7fa62c0b3fe0 2023-09-21T00:18:31.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.682+0000 7fa6227fc700 1 -- 172.21.15.59:0/101188675 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fa6280075c0 con 0x7fa62c0b3fe0 2023-09-21T00:18:31.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.682+0000 7fa6227fc700 1 --2- 172.21.15.59:0/101188675 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa61006ae00 0x7fa61006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:31.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.682+0000 7fa6227fc700 1 -- 172.21.15.59:0/101188675 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa628088be0 con 0x7fa62c0b3fe0 2023-09-21T00:18:31.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.682+0000 7fa631343700 1 --2- 172.21.15.59:0/101188675 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa61006ae00 0x7fa61006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:31.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.683+0000 7fa631343700 1 --2- 172.21.15.59:0/101188675 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa61006ae00 0x7fa61006d2c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa62c0d0c90 tx=0x7fa61c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:31.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.686+0000 7fa6227fc700 1 -- 172.21.15.59:0/101188675 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fa628053bc0 con 0x7fa62c0b3fe0 2023-09-21T00:18:31.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.888+0000 7fa633da8700 1 -- 172.21.15.59:0/101188675 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa62c067e50 con 0x7fa62c0b3fe0 2023-09-21T00:18:31.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.889+0000 7fa6227fc700 1 -- 172.21.15.59:0/101188675 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16690 (secure 0 0 0) 0x7fa628017090 con 0x7fa62c0b3fe0 2023-09-21T00:18:31.890 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:18:31.891 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":38,"fsid":"dd69925c-6e25-42fe-880b-2f60fc6f384b","created":"2023-09-21T00:16:43.074489+0000","modified":"2023-09-21T00:18:28.924084+0000","last_up_change":"2023-09-21T00:16:54.740101+0000","last_in_change":"2023-09-21T00:16:45.987089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T00:16:54.796248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-09-21T00:18:25.534473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-09-21T00:18:26.494284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d4b18344-74c0-4f75-920b-7a9247e48914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6809","nonce":2418314235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6811","nonce":2418314235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6815","nonce":2418314235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6813","nonce":2418314235}]},"public_addr":"172.21.15.59:6809/2418314235","cluster_addr":"172.21.15.59:6811/2418314235","heartbeat_back_addr":"172.21.15.59:6815/2418314235","heartbeat_front_addr":"172.21.15.59:6813/2418314235","state":["exists","up"]},{"osd":1,"uuid":"80940d50-a248-4e64-a282-7ffcdad790ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6801","nonce":869668251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6803","nonce":869668251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6807","nonce":869668251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6805","nonce":869668251}]},"public_addr":"172.21.15.59:6801/869668251","cluster_addr":"172.21.15.59:6803/869668251","heartbeat_back_addr":"172.21.15.59:6807/869668251","heartbeat_front_addr":"172.21.15.59:6805/869668251","state":["exists","up"]},{"osd":2,"uuid":"55f2eceb-c54a-4879-a6ce-968c1c548b5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6817","nonce":372517778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6819","nonce":372517778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6823","nonce":372517778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6821","nonce":372517778}]},"public_addr":"172.21.15.59:6817/372517778","cluster_addr":"172.21.15.59:6819/372517778","heartbeat_back_addr":"172.21.15.59:6823/372517778","heartbeat_front_addr":"172.21.15.59:6821/372517778","state":["exists","up"]},{"osd":3,"uuid":"92b89cd0-869c-49b9-a9f9-97ac8423f304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6825","nonce":575188498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6827","nonce":575188498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6831","nonce":575188498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6829","nonce":575188498}]},"public_addr":"172.21.15.59:6825/575188498","cluster_addr":"172.21.15.59:6827/575188498","heartbeat_back_addr":"172.21.15.59:6831/575188498","heartbeat_front_addr":"172.21.15.59:6829/575188498","state":["exists","up"]},{"osd":4,"uuid":"25b80e94-e0e6-403d-b69f-61542f289637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6803","nonce":1741219098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6805","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6807","nonce":1741219098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6815","nonce":1741219098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6811","nonce":1741219098}]},"public_addr":"172.21.15.83:6803/1741219098","cluster_addr":"172.21.15.83:6807/1741219098","heartbeat_back_addr":"172.21.15.83:6815/1741219098","heartbeat_front_addr":"172.21.15.83:6811/1741219098","state":["exists","up"]},{"osd":5,"uuid":"5498d9ab-1086-4796-a199-9051e6dfea91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6817","nonce":156730565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6819","nonce":156730565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6823","nonce":156730565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6821","nonce":156730565}]},"public_addr":"172.21.15.83:6817/156730565","cluster_addr":"172.21.15.83:6819/156730565","heartbeat_back_addr":"172.21.15.83:6823/156730565","heartbeat_front_addr":"172.21.15.83:6821/156730565","state":["exists","up"]},{"osd":6,"uuid":"cfd810c0-5015-4d60-9a75-7efc93a32e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6801","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6800","nonce":1337723778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6806","nonce":1337723778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6814","nonce":1337723778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6810","nonce":1337723778}]},"public_addr":"172.21.15.83:6800/1337723778","cluster_addr":"172.21.15.83:6806/1337723778","heartbeat_back_addr":"172.21.15.83:6814/1337723778","heartbeat_front_addr":"172.21.15.83:6810/1337723778","state":["exists","up"]},{"osd":7,"uuid":"e992c8fa-0a3d-4b3c-85b5-2c511223dee4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6825","nonce":4204859272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6827","nonce":4204859272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6831","nonce":4204859272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6829","nonce":4204859272}]},"public_addr":"172.21.15.83:6825/4204859272","cluster_addr":"172.21.15.83:6827/4204859272","heartbeat_back_addr":"172.21.15.83:6831/4204859272","heartbeat_front_addr":"172.21.15.83:6829/4204859272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.156498+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.882707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.093978+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.158565+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.173933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.888606+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.135525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.149712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T00:18:31.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.891+0000 7fa633da8700 1 -- 172.21.15.59:0/101188675 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa61006ae00 msgr2=0x7fa61006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:31.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.891+0000 7fa633da8700 1 --2- 172.21.15.59:0/101188675 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa61006ae00 0x7fa61006d2c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa62c0d0c90 tx=0x7fa61c009040 comp rx=0 tx=0).stop 2023-09-21T00:18:31.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.891+0000 7fa633da8700 1 -- 172.21.15.59:0/101188675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa62c0b3fe0 msgr2=0x7fa62c149ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:31.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.891+0000 7fa633da8700 1 --2- 172.21.15.59:0/101188675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa62c0b3fe0 0x7fa62c149ed0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa628001eb0 tx=0x7fa62800c860 comp rx=0 tx=0).stop 2023-09-21T00:18:31.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.891+0000 7fa633da8700 1 -- 172.21.15.59:0/101188675 shutdown_connections 2023-09-21T00:18:31.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.891+0000 7fa633da8700 1 --2- 172.21.15.59:0/101188675 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa61006ae00 0x7fa61006d2c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:31.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.891+0000 7fa633da8700 1 --2- 172.21.15.59:0/101188675 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa62c15a470 0x7fa62c0d00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:31.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.891+0000 7fa633da8700 1 --2- 172.21.15.59:0/101188675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa62c0b3fe0 0x7fa62c149ed0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:31.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.891+0000 7fa633da8700 1 --2- 172.21.15.59:0/101188675 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa62c0b4d90 0x7fa62c1580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:31.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.891+0000 7fa633da8700 1 -- 172.21.15.59:0/101188675 >> 172.21.15.59:0/101188675 conn(0x7fa62c0b1d80 msgr2=0x7fa62c0afc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:31.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.891+0000 7fa633da8700 1 -- 172.21.15.59:0/101188675 shutdown_connections 2023-09-21T00:18:31.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:31.891+0000 7fa633da8700 1 -- 172.21.15.59:0/101188675 wait complete. 2023-09-21T00:18:31.905 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-21T00:18:31.905 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-21T00:18:31.958 INFO:tasks.ceph.mds.a.smithi059.stderr:2023-09-21T00:18:31.957+0000 7facd5613700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-21T00:18:32.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.030+0000 7f77ed6e3700 1 Processor -- start 2023-09-21T00:18:32.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.030+0000 7f77ed6e3700 1 -- start start 2023-09-21T00:18:32.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.030+0000 7f77ed6e3700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f77e8070d60 0x7f77e80cd630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:32.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.030+0000 7f77ed6e3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f77e806f100 0x7f77e815ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:32.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.030+0000 7f77ed6e3700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77e80708d0 con 0x7f77e815e950 2023-09-21T00:18:32.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.030+0000 7f77ed6e3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77e80d0ca0 con 0x7f77e806f100 2023-09-21T00:18:32.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.030+0000 7f77ed6e3700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77e815ed30 con 0x7f77e8070d60 2023-09-21T00:18:32.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.031+0000 7f77e77fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f77e806f100 0x7f77e815ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:32.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.031+0000 7f77e77fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f77e806f100 0x7f77e815ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53512/0 (socket says 172.21.15.59:53512) 2023-09-21T00:18:32.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.031+0000 7f77e77fe700 1 -- 172.21.15.59:0/3460348485 learned_addr learned my addr 172.21.15.59:0/3460348485 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:32.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.031+0000 7f77e67fc700 1 --2- 172.21.15.59:0/3460348485 >> v2:172.21.15.83:3300/0 conn(0x7f77e8070d60 0x7f77e80cd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:32.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.031+0000 7f77e77fe700 1 -- 172.21.15.59:0/3460348485 >> v2:172.21.15.83:3300/0 conn(0x7f77e8070d60 msgr2=0x7f77e80cd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:32.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.031+0000 7f77e77fe700 1 --2- 172.21.15.59:0/3460348485 >> v2:172.21.15.83:3300/0 conn(0x7f77e8070d60 0x7f77e80cd630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:32.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.031+0000 7f77e77fe700 1 -- 172.21.15.59:0/3460348485 >> v1:172.21.15.83:6789/0 conn(0x7f77e815e950 legacy=0x7f77e806e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:32.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.031+0000 7f77e77fe700 1 -- 172.21.15.59:0/3460348485 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e8070280 con 0x7f77e806f100 2023-09-21T00:18:32.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.031+0000 7f77e77fe700 1 --2- 172.21.15.59:0/3460348485 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77e806f100 0x7f77e815ef90 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f77e80c8230 tx=0x7f77e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84ad5c56905f4824 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:32.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.031+0000 7f77e5ffb700 1 -- 172.21.15.59:0/3460348485 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e000e070 con 0x7f77e806f100 2023-09-21T00:18:32.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.031+0000 7f77e5ffb700 1 -- 172.21.15.59:0/3460348485 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e000b910 con 0x7f77e806f100 2023-09-21T00:18:32.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.031+0000 7f77e5ffb700 1 -- 172.21.15.59:0/3460348485 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e000bcc0 con 0x7f77e806f100 2023-09-21T00:18:32.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.032+0000 7f77ed6e3700 1 -- 172.21.15.59:0/3460348485 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77e806f100 msgr2=0x7f77e815ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:32.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.032+0000 7f77ed6e3700 1 --2- 172.21.15.59:0/3460348485 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77e806f100 0x7f77e815ef90 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f77e80c8230 tx=0x7f77e000b330 comp rx=0 tx=0).stop 2023-09-21T00:18:32.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.032+0000 7f77ed6e3700 1 -- 172.21.15.59:0/3460348485 shutdown_connections 2023-09-21T00:18:32.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.032+0000 7f77ed6e3700 1 --2- 172.21.15.59:0/3460348485 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77e806f100 0x7f77e815ef90 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:32.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.032+0000 7f77ed6e3700 1 --2- 172.21.15.59:0/3460348485 >> v2:172.21.15.83:3300/0 conn(0x7f77e8070d60 0x7f77e80cd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:32.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.032+0000 7f77ed6e3700 1 -- 172.21.15.59:0/3460348485 >> 172.21.15.59:0/3460348485 conn(0x7f77e80d11e0 msgr2=0x7f77e80d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:32.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.032+0000 7f77ed6e3700 1 -- 172.21.15.59:0/3460348485 shutdown_connections 2023-09-21T00:18:32.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.032+0000 7f77ed6e3700 1 -- 172.21.15.59:0/3460348485 wait complete. 2023-09-21T00:18:32.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.033+0000 7f77ed6e3700 1 Processor -- start 2023-09-21T00:18:32.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.033+0000 7f77ed6e3700 1 -- start start 2023-09-21T00:18:32.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.034+0000 7f77ed6e3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77e806f100 0x7f77e80c5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:32.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.034+0000 7f77ed6e3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77e8070d60 0x7f77e8153380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:32.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.034+0000 7f77ed6e3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77e815e950 0x7f77e814fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:32.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.034+0000 7f77ed6e3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e806bda0 con 0x7f77e8070d60 2023-09-21T00:18:32.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.034+0000 7f77ed6e3700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e80c5ee0 con 0x7f77e815e950 2023-09-21T00:18:32.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.034+0000 7f77ed6e3700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e80c61c0 con 0x7f77e806f100 2023-09-21T00:18:32.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.034+0000 7f77e67fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77e8070d60 0x7f77e8153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:32.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.034+0000 7f77e67fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77e8070d60 0x7f77e8153380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53516/0 (socket says 172.21.15.59:53516) 2023-09-21T00:18:32.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.034+0000 7f77e67fc700 1 -- 172.21.15.59:0/3444266472 learned_addr learned my addr 172.21.15.59:0/3444266472 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:32.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.034+0000 7f77e67fc700 1 -- 172.21.15.59:0/3444266472 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77e806f100 msgr2=0x7f77e80c5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:32.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.034+0000 7f77e67fc700 1 --2- 172.21.15.59:0/3444266472 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77e806f100 0x7f77e80c5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:32.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.034+0000 7f77e67fc700 1 -- 172.21.15.59:0/3444266472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77e815e950 msgr2=0x7f77e814fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:32.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.034+0000 7f77e77fe700 1 --2- 172.21.15.59:0/3444266472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77e815e950 0x7f77e814fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:32.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.035+0000 7f77e67fc700 1 --2- 172.21.15.59:0/3444266472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77e815e950 0x7f77e814fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:32.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.035+0000 7f77e67fc700 1 -- 172.21.15.59:0/3444266472 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e0009b30 con 0x7f77e8070d60 2023-09-21T00:18:32.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.035+0000 7f77e67fc700 1 --2- 172.21.15.59:0/3444266472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77e8070d60 0x7f77e8153380 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f77dc00e870 tx=0x7f77dc00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:32.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.035+0000 7f77cf7fe700 1 -- 172.21.15.59:0/3444266472 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77dc009590 con 0x7f77e8070d60 2023-09-21T00:18:32.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.035+0000 7f77cf7fe700 1 -- 172.21.15.59:0/3444266472 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77dc00ee70 con 0x7f77e8070d60 2023-09-21T00:18:32.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.035+0000 7f77ed6e3700 1 -- 172.21.15.59:0/3444266472 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77e806b9c0 con 0x7f77e8070d60 2023-09-21T00:18:32.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.035+0000 7f77cf7fe700 1 -- 172.21.15.59:0/3444266472 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77dc00ca50 con 0x7f77e8070d60 2023-09-21T00:18:32.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.035+0000 7f77ed6e3700 1 -- 172.21.15.59:0/3444266472 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77e80c5bd0 con 0x7f77e8070d60 2023-09-21T00:18:32.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.036+0000 7f77ed6e3700 1 -- 172.21.15.59:0/3444266472 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77e806c010 con 0x7f77e8070d60 2023-09-21T00:18:32.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.036+0000 7f77cf7fe700 1 -- 172.21.15.59:0/3444266472 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f77dc00cbb0 con 0x7f77e8070d60 2023-09-21T00:18:32.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.037+0000 7f77cf7fe700 1 --2- 172.21.15.59:0/3444266472 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f77d406ae00 0x7f77d406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:32.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.037+0000 7f77cf7fe700 1 -- 172.21.15.59:0/3444266472 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f77dc0895d0 con 0x7f77e8070d60 2023-09-21T00:18:32.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.037+0000 7f77e6ffd700 1 --2- 172.21.15.59:0/3444266472 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f77d406ae00 0x7f77d406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:32.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.038+0000 7f77e6ffd700 1 --2- 172.21.15.59:0/3444266472 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f77d406ae00 0x7f77d406d2c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f77d8000f60 tx=0x7f77d8007a40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:32.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.041+0000 7f77cf7fe700 1 -- 172.21.15.59:0/3444266472 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f77dc0545a0 con 0x7f77e8070d60 2023-09-21T00:18:32.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.237+0000 7f77ed6e3700 1 -- 172.21.15.59:0/3444266472 --> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f77e80d0f10 con 0x7f77d406ae00 2023-09-21T00:18:32.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.246+0000 7f77cf7fe700 1 -- 172.21.15.59:0/3444266472 <== mgr.4103 v2:172.21.15.83:6832/1736808576 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289282 (secure 0 0 0) 0x7f77d8005080 con 0x7f77d406ae00 2023-09-21T00:18:32.250 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:18:32.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.249+0000 7f77ed6e3700 1 -- 172.21.15.59:0/3444266472 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f77d406ae00 msgr2=0x7f77d406d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:32.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.249+0000 7f77ed6e3700 1 --2- 172.21.15.59:0/3444266472 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f77d406ae00 0x7f77d406d2c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f77d8000f60 tx=0x7f77d8007a40 comp rx=0 tx=0).stop 2023-09-21T00:18:32.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.249+0000 7f77ed6e3700 1 -- 172.21.15.59:0/3444266472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77e8070d60 msgr2=0x7f77e8153380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:32.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.249+0000 7f77ed6e3700 1 --2- 172.21.15.59:0/3444266472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77e8070d60 0x7f77e8153380 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f77dc00e870 tx=0x7f77dc00ec30 comp rx=0 tx=0).stop 2023-09-21T00:18:32.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.249+0000 7f77ed6e3700 1 -- 172.21.15.59:0/3444266472 shutdown_connections 2023-09-21T00:18:32.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.249+0000 7f77ed6e3700 1 --2- 172.21.15.59:0/3444266472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77e815e950 0x7f77e814fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:32.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.249+0000 7f77ed6e3700 1 --2- 172.21.15.59:0/3444266472 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f77d406ae00 0x7f77d406d2c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:32.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.249+0000 7f77ed6e3700 1 --2- 172.21.15.59:0/3444266472 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f77e806f100 0x7f77e80c5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:32.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.249+0000 7f77ed6e3700 1 --2- 172.21.15.59:0/3444266472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77e8070d60 0x7f77e8153380 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:32.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.249+0000 7f77ed6e3700 1 -- 172.21.15.59:0/3444266472 >> 172.21.15.59:0/3444266472 conn(0x7f77e80d11e0 msgr2=0x7f77e8159360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:32.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.249+0000 7f77ed6e3700 1 -- 172.21.15.59:0/3444266472 shutdown_connections 2023-09-21T00:18:32.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.249+0000 7f77ed6e3700 1 -- 172.21.15.59:0/3444266472 wait complete. 2023-09-21T00:18:32.255 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2023-09-21T00:18:32.262 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2023-09-21T00:18:30.766243+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":157,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220840,"kb_used_data":4636,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753880,"statfs":{"total":773094113280,"available":772867973120,"internally_reserved":0,"allocated":4747264,"data_stored":2698320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.678064"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.928343+0000","last_change":"2023-09-21T00:18:27.940775+0000","last_active":"2023-09-21T00:18:28.928343+0000","last_peered":"2023-09-21T00:18:28.928343+0000","last_clean":"2023-09-21T00:18:28.928343+0000","last_became_active":"2023-09-21T00:18:27.940445+0000","last_became_peered":"2023-09-21T00:18:27.940445+0000","last_unstale":"2023-09-21T00:18:28.928343+0000","last_undegraded":"2023-09-21T00:18:28.928343+0000","last_fullsized":"2023-09-21T00:18:28.928343+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:59:15.508085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.927861+0000","last_change":"2023-09-21T00:18:27.934508+0000","last_active":"2023-09-21T00:18:28.927861+0000","last_peered":"2023-09-21T00:18:28.927861+0000","last_clean":"2023-09-21T00:18:28.927861+0000","last_became_active":"2023-09-21T00:18:27.934207+0000","last_became_peered":"2023-09-21T00:18:27.934207+0000","last_unstale":"2023-09-21T00:18:28.927861+0000","last_undegraded":"2023-09-21T00:18:28.927861+0000","last_fullsized":"2023-09-21T00:18:28.927861+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:39:08.392015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.024368+0000","last_change":"2023-09-21T00:18:27.942596+0000","last_active":"2023-09-21T00:18:29.024368+0000","last_peered":"2023-09-21T00:18:29.024368+0000","last_clean":"2023-09-21T00:18:29.024368+0000","last_became_active":"2023-09-21T00:18:27.942345+0000","last_became_peered":"2023-09-21T00:18:27.942345+0000","last_unstale":"2023-09-21T00:18:29.024368+0000","last_undegraded":"2023-09-21T00:18:29.024368+0000","last_fullsized":"2023-09-21T00:18:29.024368+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:01:12.461787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.024576+0000","last_change":"2023-09-21T00:18:27.946032+0000","last_active":"2023-09-21T00:18:29.024576+0000","last_peered":"2023-09-21T00:18:29.024576+0000","last_clean":"2023-09-21T00:18:29.024576+0000","last_became_active":"2023-09-21T00:18:27.945852+0000","last_became_peered":"2023-09-21T00:18:27.945852+0000","last_unstale":"2023-09-21T00:18:29.024576+0000","last_undegraded":"2023-09-21T00:18:29.024576+0000","last_fullsized":"2023-09-21T00:18:29.024576+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T11:58:29.371790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.024270+0000","last_change":"2023-09-21T00:18:27.946231+0000","last_active":"2023-09-21T00:18:29.024270+0000","last_peered":"2023-09-21T00:18:29.024270+0000","last_clean":"2023-09-21T00:18:29.024270+0000","last_became_active":"2023-09-21T00:18:27.945500+0000","last_became_peered":"2023-09-21T00:18:27.945500+0000","last_unstale":"2023-09-21T00:18:29.024270+0000","last_undegraded":"2023-09-21T00:18:29.024270+0000","last_fullsized":"2023-09-21T00:18:29.024270+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T10:51:20.961954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.023570+0000","last_change":"2023-09-21T00:18:27.936690+0000","last_active":"2023-09-21T00:18:29.023570+0000","last_peered":"2023-09-21T00:18:29.023570+0000","last_clean":"2023-09-21T00:18:29.023570+0000","last_became_active":"2023-09-21T00:18:27.936311+0000","last_became_peered":"2023-09-21T00:18:27.936311+0000","last_unstale":"2023-09-21T00:18:29.023570+0000","last_undegraded":"2023-09-21T00:18:29.023570+0000","last_fullsized":"2023-09-21T00:18:29.023570+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:01:12.461787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025105+0000","last_change":"2023-09-21T00:18:27.940009+0000","last_active":"2023-09-21T00:18:29.025105+0000","last_peered":"2023-09-21T00:18:29.025105+0000","last_clean":"2023-09-21T00:18:29.025105+0000","last_became_active":"2023-09-21T00:18:27.939709+0000","last_became_peered":"2023-09-21T00:18:27.939709+0000","last_unstale":"2023-09-21T00:18:29.025105+0000","last_undegraded":"2023-09-21T00:18:29.025105+0000","last_fullsized":"2023-09-21T00:18:29.025105+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:39:08.392015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.927585+0000","last_change":"2023-09-21T00:18:27.940026+0000","last_active":"2023-09-21T00:18:28.927585+0000","last_peered":"2023-09-21T00:18:28.927585+0000","last_clean":"2023-09-21T00:18:28.927585+0000","last_became_active":"2023-09-21T00:18:27.939666+0000","last_became_peered":"2023-09-21T00:18:27.939666+0000","last_unstale":"2023-09-21T00:18:28.927585+0000","last_undegraded":"2023-09-21T00:18:28.927585+0000","last_fullsized":"2023-09-21T00:18:28.927585+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T12:09:35.018753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.024461+0000","last_change":"2023-09-21T00:18:27.941842+0000","last_active":"2023-09-21T00:18:29.024461+0000","last_peered":"2023-09-21T00:18:29.024461+0000","last_clean":"2023-09-21T00:18:29.024461+0000","last_became_active":"2023-09-21T00:18:27.941124+0000","last_became_peered":"2023-09-21T00:18:27.941124+0000","last_unstale":"2023-09-21T00:18:29.024461+0000","last_undegraded":"2023-09-21T00:18:29.024461+0000","last_fullsized":"2023-09-21T00:18:29.024461+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T10:38:53.559631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025724+0000","last_change":"2023-09-21T00:18:27.945169+0000","last_active":"2023-09-21T00:18:29.025724+0000","last_peered":"2023-09-21T00:18:29.025724+0000","last_clean":"2023-09-21T00:18:29.025724+0000","last_became_active":"2023-09-21T00:18:27.944871+0000","last_became_peered":"2023-09-21T00:18:27.944871+0000","last_unstale":"2023-09-21T00:18:29.025724+0000","last_undegraded":"2023-09-21T00:18:29.025724+0000","last_fullsized":"2023-09-21T00:18:29.025724+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:49:45.951706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025914+0000","last_change":"2023-09-21T00:18:27.943781+0000","last_active":"2023-09-21T00:18:29.025914+0000","last_peered":"2023-09-21T00:18:29.025914+0000","last_clean":"2023-09-21T00:18:29.025914+0000","last_became_active":"2023-09-21T00:18:27.943517+0000","last_became_peered":"2023-09-21T00:18:27.943517+0000","last_unstale":"2023-09-21T00:18:29.025914+0000","last_undegraded":"2023-09-21T00:18:29.025914+0000","last_fullsized":"2023-09-21T00:18:29.025914+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:20:05.712777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.024218+0000","last_change":"2023-09-21T00:18:27.939014+0000","last_active":"2023-09-21T00:18:29.024218+0000","last_peered":"2023-09-21T00:18:29.024218+0000","last_clean":"2023-09-21T00:18:29.024218+0000","last_became_active":"2023-09-21T00:18:27.938733+0000","last_became_peered":"2023-09-21T00:18:27.938733+0000","last_unstale":"2023-09-21T00:18:29.024218+0000","last_undegraded":"2023-09-21T00:18:29.024218+0000","last_fullsized":"2023-09-21T00:18:29.024218+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T04:38:30.921844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.024979+0000","last_change":"2023-09-21T00:18:27.939727+0000","last_active":"2023-09-21T00:18:29.024979+0000","last_peered":"2023-09-21T00:18:29.024979+0000","last_clean":"2023-09-21T00:18:29.024979+0000","last_became_active":"2023-09-21T00:18:27.939415+0000","last_became_peered":"2023-09-21T00:18:27.939415+0000","last_unstale":"2023-09-21T00:18:29.024979+0000","last_undegraded":"2023-09-21T00:18:29.024979+0000","last_fullsized":"2023-09-21T00:18:29.024979+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:30:36.740692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.929323+0000","last_change":"2023-09-21T00:18:27.946867+0000","last_active":"2023-09-21T00:18:28.929323+0000","last_peered":"2023-09-21T00:18:28.929323+0000","last_clean":"2023-09-21T00:18:28.929323+0000","last_became_active":"2023-09-21T00:18:27.946609+0000","last_became_peered":"2023-09-21T00:18:27.946609+0000","last_unstale":"2023-09-21T00:18:28.929323+0000","last_undegraded":"2023-09-21T00:18:28.929323+0000","last_fullsized":"2023-09-21T00:18:28.929323+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:47:40.029238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.024848+0000","last_change":"2023-09-21T00:18:27.948384+0000","last_active":"2023-09-21T00:18:29.024848+0000","last_peered":"2023-09-21T00:18:29.024848+0000","last_clean":"2023-09-21T00:18:29.024848+0000","last_became_active":"2023-09-21T00:18:27.948018+0000","last_became_peered":"2023-09-21T00:18:27.948018+0000","last_unstale":"2023-09-21T00:18:29.024848+0000","last_undegraded":"2023-09-21T00:18:29.024848+0000","last_fullsized":"2023-09-21T00:18:29.024848+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T11:06:28.805733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.024840+0000","last_change":"2023-09-21T00:18:27.944041+0000","last_active":"2023-09-21T00:18:29.024840+0000","last_peered":"2023-09-21T00:18:29.024840+0000","last_clean":"2023-09-21T00:18:29.024840+0000","last_became_active":"2023-09-21T00:18:27.943588+0000","last_became_peered":"2023-09-21T00:18:27.943588+0000","last_unstale":"2023-09-21T00:18:29.024840+0000","last_undegraded":"2023-09-21T00:18:29.024840+0000","last_fullsized":"2023-09-21T00:18:29.024840+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:01:12.461787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025357+0000","last_change":"2023-09-21T00:18:27.944365+0000","last_active":"2023-09-21T00:18:29.025357+0000","last_peered":"2023-09-21T00:18:29.025357+0000","last_clean":"2023-09-21T00:18:29.025357+0000","last_became_active":"2023-09-21T00:18:27.943909+0000","last_became_peered":"2023-09-21T00:18:27.943909+0000","last_unstale":"2023-09-21T00:18:29.025357+0000","last_undegraded":"2023-09-21T00:18:29.025357+0000","last_fullsized":"2023-09-21T00:18:29.025357+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:50:22.514198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.929341+0000","last_change":"2023-09-21T00:18:27.943990+0000","last_active":"2023-09-21T00:18:28.929341+0000","last_peered":"2023-09-21T00:18:28.929341+0000","last_clean":"2023-09-21T00:18:28.929341+0000","last_became_active":"2023-09-21T00:18:27.943409+0000","last_became_peered":"2023-09-21T00:18:27.943409+0000","last_unstale":"2023-09-21T00:18:28.929341+0000","last_undegraded":"2023-09-21T00:18:28.929341+0000","last_fullsized":"2023-09-21T00:18:28.929341+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T04:17:55.878693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.024947+0000","last_change":"2023-09-21T00:18:27.937399+0000","last_active":"2023-09-21T00:18:29.024947+0000","last_peered":"2023-09-21T00:18:29.024947+0000","last_clean":"2023-09-21T00:18:29.024947+0000","last_became_active":"2023-09-21T00:18:27.937122+0000","last_became_peered":"2023-09-21T00:18:27.937122+0000","last_unstale":"2023-09-21T00:18:29.024947+0000","last_undegraded":"2023-09-21T00:18:29.024947+0000","last_fullsized":"2023-09-21T00:18:29.024947+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T10:22:57.470831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.929527+0000","last_change":"2023-09-21T00:18:27.943173+0000","last_active":"2023-09-21T00:18:28.929527+0000","last_peered":"2023-09-21T00:18:28.929527+0000","last_clean":"2023-09-21T00:18:28.929527+0000","last_became_active":"2023-09-21T00:18:27.942894+0000","last_became_peered":"2023-09-21T00:18:27.942894+0000","last_unstale":"2023-09-21T00:18:28.929527+0000","last_undegraded":"2023-09-21T00:18:28.929527+0000","last_fullsized":"2023-09-21T00:18:28.929527+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T02:17:26.292597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025063+0000","last_change":"2023-09-21T00:18:27.948156+0000","last_active":"2023-09-21T00:18:29.025063+0000","last_peered":"2023-09-21T00:18:29.025063+0000","last_clean":"2023-09-21T00:18:29.025063+0000","last_became_active":"2023-09-21T00:18:27.947864+0000","last_became_peered":"2023-09-21T00:18:27.947864+0000","last_unstale":"2023-09-21T00:18:29.025063+0000","last_undegraded":"2023-09-21T00:18:29.025063+0000","last_fullsized":"2023-09-21T00:18:29.025063+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T02:49:18.802099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.928907+0000","last_change":"2023-09-21T00:18:27.941305+0000","last_active":"2023-09-21T00:18:28.928907+0000","last_peered":"2023-09-21T00:18:28.928907+0000","last_clean":"2023-09-21T00:18:28.928907+0000","last_became_active":"2023-09-21T00:18:27.940792+0000","last_became_peered":"2023-09-21T00:18:27.940792+0000","last_unstale":"2023-09-21T00:18:28.928907+0000","last_undegraded":"2023-09-21T00:18:28.928907+0000","last_fullsized":"2023-09-21T00:18:28.928907+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T07:26:49.715996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025580+0000","last_change":"2023-09-21T00:18:27.948329+0000","last_active":"2023-09-21T00:18:29.025580+0000","last_peered":"2023-09-21T00:18:29.025580+0000","last_clean":"2023-09-21T00:18:29.025580+0000","last_became_active":"2023-09-21T00:18:27.948061+0000","last_became_peered":"2023-09-21T00:18:27.948061+0000","last_unstale":"2023-09-21T00:18:29.025580+0000","last_undegraded":"2023-09-21T00:18:29.025580+0000","last_fullsized":"2023-09-21T00:18:29.025580+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:30:36.740692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.023550+0000","last_change":"2023-09-21T00:18:27.939029+0000","last_active":"2023-09-21T00:18:29.023550+0000","last_peered":"2023-09-21T00:18:29.023550+0000","last_clean":"2023-09-21T00:18:29.023550+0000","last_became_active":"2023-09-21T00:18:27.938592+0000","last_became_peered":"2023-09-21T00:18:27.938592+0000","last_unstale":"2023-09-21T00:18:29.023550+0000","last_undegraded":"2023-09-21T00:18:29.023550+0000","last_fullsized":"2023-09-21T00:18:29.023550+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T07:47:14.988972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.929490+0000","last_change":"2023-09-21T00:18:27.941321+0000","last_active":"2023-09-21T00:18:28.929490+0000","last_peered":"2023-09-21T00:18:28.929490+0000","last_clean":"2023-09-21T00:18:28.929490+0000","last_became_active":"2023-09-21T00:18:27.940963+0000","last_became_peered":"2023-09-21T00:18:27.940963+0000","last_unstale":"2023-09-21T00:18:28.929490+0000","last_undegraded":"2023-09-21T00:18:28.929490+0000","last_fullsized":"2023-09-21T00:18:28.929490+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T07:26:49.715996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.023912+0000","last_change":"2023-09-21T00:18:27.943556+0000","last_active":"2023-09-21T00:18:29.023912+0000","last_peered":"2023-09-21T00:18:29.023912+0000","last_clean":"2023-09-21T00:18:29.023912+0000","last_became_active":"2023-09-21T00:18:27.943127+0000","last_became_peered":"2023-09-21T00:18:27.943127+0000","last_unstale":"2023-09-21T00:18:29.023912+0000","last_undegraded":"2023-09-21T00:18:29.023912+0000","last_fullsized":"2023-09-21T00:18:29.023912+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T12:00:59.854920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.929099+0000","last_change":"2023-09-21T00:18:27.941980+0000","last_active":"2023-09-21T00:18:28.929099+0000","last_peered":"2023-09-21T00:18:28.929099+0000","last_clean":"2023-09-21T00:18:28.929099+0000","last_became_active":"2023-09-21T00:18:27.941632+0000","last_became_peered":"2023-09-21T00:18:27.941632+0000","last_unstale":"2023-09-21T00:18:28.929099+0000","last_undegraded":"2023-09-21T00:18:28.929099+0000","last_fullsized":"2023-09-21T00:18:28.929099+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:32:49.442862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025596+0000","last_change":"2023-09-21T00:18:27.944378+0000","last_active":"2023-09-21T00:18:29.025596+0000","last_peered":"2023-09-21T00:18:29.025596+0000","last_clean":"2023-09-21T00:18:29.025596+0000","last_became_active":"2023-09-21T00:18:27.944068+0000","last_became_peered":"2023-09-21T00:18:27.944068+0000","last_unstale":"2023-09-21T00:18:29.025596+0000","last_undegraded":"2023-09-21T00:18:29.025596+0000","last_fullsized":"2023-09-21T00:18:29.025596+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T10:18:06.702966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.929200+0000","last_change":"2023-09-21T00:18:27.941118+0000","last_active":"2023-09-21T00:18:28.929200+0000","last_peered":"2023-09-21T00:18:28.929200+0000","last_clean":"2023-09-21T00:18:28.929200+0000","last_became_active":"2023-09-21T00:18:27.940832+0000","last_became_peered":"2023-09-21T00:18:27.940832+0000","last_unstale":"2023-09-21T00:18:28.929200+0000","last_undegraded":"2023-09-21T00:18:28.929200+0000","last_fullsized":"2023-09-21T00:18:28.929200+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T02:57:19.901703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.928777+0000","last_change":"2023-09-21T00:18:27.945956+0000","last_active":"2023-09-21T00:18:28.928777+0000","last_peered":"2023-09-21T00:18:28.928777+0000","last_clean":"2023-09-21T00:18:28.928777+0000","last_became_active":"2023-09-21T00:18:27.945658+0000","last_became_peered":"2023-09-21T00:18:27.945658+0000","last_unstale":"2023-09-21T00:18:28.928777+0000","last_undegraded":"2023-09-21T00:18:28.928777+0000","last_fullsized":"2023-09-21T00:18:28.928777+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:11:40.019659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025809+0000","last_change":"2023-09-21T00:18:27.947500+0000","last_active":"2023-09-21T00:18:29.025809+0000","last_peered":"2023-09-21T00:18:29.025809+0000","last_clean":"2023-09-21T00:18:29.025809+0000","last_became_active":"2023-09-21T00:18:27.947172+0000","last_became_peered":"2023-09-21T00:18:27.947172+0000","last_unstale":"2023-09-21T00:18:29.025809+0000","last_undegraded":"2023-09-21T00:18:29.025809+0000","last_fullsized":"2023-09-21T00:18:29.025809+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T02:49:18.802099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.023423+0000","last_change":"2023-09-21T00:18:27.938524+0000","last_active":"2023-09-21T00:18:29.023423+0000","last_peered":"2023-09-21T00:18:29.023423+0000","last_clean":"2023-09-21T00:18:29.023423+0000","last_became_active":"2023-09-21T00:18:27.938248+0000","last_became_peered":"2023-09-21T00:18:27.938248+0000","last_unstale":"2023-09-21T00:18:29.023423+0000","last_undegraded":"2023-09-21T00:18:29.023423+0000","last_fullsized":"2023-09-21T00:18:29.023423+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:10:38.100718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025318+0000","last_change":"2023-09-21T00:18:27.944464+0000","last_active":"2023-09-21T00:18:29.025318+0000","last_peered":"2023-09-21T00:18:29.025318+0000","last_clean":"2023-09-21T00:18:29.025318+0000","last_became_active":"2023-09-21T00:18:27.943570+0000","last_became_peered":"2023-09-21T00:18:27.943570+0000","last_unstale":"2023-09-21T00:18:29.025318+0000","last_undegraded":"2023-09-21T00:18:29.025318+0000","last_fullsized":"2023-09-21T00:18:29.025318+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T12:00:59.854920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.929573+0000","last_change":"2023-09-21T00:18:27.110652+0000","last_active":"2023-09-21T00:18:28.929573+0000","last_peered":"2023-09-21T00:18:28.929573+0000","last_clean":"2023-09-21T00:18:28.929573+0000","last_became_active":"2023-09-21T00:18:27.110419+0000","last_became_peered":"2023-09-21T00:18:27.110419+0000","last_unstale":"2023-09-21T00:18:28.929573+0000","last_undegraded":"2023-09-21T00:18:28.929573+0000","last_fullsized":"2023-09-21T00:18:28.929573+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T11:58:28.364652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.023931+0000","last_change":"2023-09-21T00:18:27.941448+0000","last_active":"2023-09-21T00:18:29.023931+0000","last_peered":"2023-09-21T00:18:29.023931+0000","last_clean":"2023-09-21T00:18:29.023931+0000","last_became_active":"2023-09-21T00:18:27.940963+0000","last_became_peered":"2023-09-21T00:18:27.940963+0000","last_unstale":"2023-09-21T00:18:29.023931+0000","last_undegraded":"2023-09-21T00:18:29.023931+0000","last_fullsized":"2023-09-21T00:18:29.023931+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:50:22.514198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.024358+0000","last_change":"2023-09-21T00:18:27.114867+0000","last_active":"2023-09-21T00:18:29.024358+0000","last_peered":"2023-09-21T00:18:29.024358+0000","last_clean":"2023-09-21T00:18:29.024358+0000","last_became_active":"2023-09-21T00:18:27.114561+0000","last_became_peered":"2023-09-21T00:18:27.114561+0000","last_unstale":"2023-09-21T00:18:29.024358+0000","last_undegraded":"2023-09-21T00:18:29.024358+0000","last_fullsized":"2023-09-21T00:18:29.024358+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T04:17:54.871555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.929143+0000","last_change":"2023-09-21T00:18:27.942420+0000","last_active":"2023-09-21T00:18:28.929143+0000","last_peered":"2023-09-21T00:18:28.929143+0000","last_clean":"2023-09-21T00:18:28.929143+0000","last_became_active":"2023-09-21T00:18:27.942188+0000","last_became_peered":"2023-09-21T00:18:27.942188+0000","last_unstale":"2023-09-21T00:18:28.929143+0000","last_undegraded":"2023-09-21T00:18:28.929143+0000","last_fullsized":"2023-09-21T00:18:28.929143+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T02:17:26.292597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.024011+0000","last_change":"2023-09-21T00:18:27.111791+0000","last_active":"2023-09-21T00:18:29.024011+0000","last_peered":"2023-09-21T00:18:29.024011+0000","last_clean":"2023-09-21T00:18:29.024011+0000","last_became_active":"2023-09-21T00:18:27.111467+0000","last_became_peered":"2023-09-21T00:18:27.111467+0000","last_unstale":"2023-09-21T00:18:29.024011+0000","last_undegraded":"2023-09-21T00:18:29.024011+0000","last_fullsized":"2023-09-21T00:18:29.024011+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T02:17:25.285459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.928410+0000","last_change":"2023-09-21T00:18:27.942329+0000","last_active":"2023-09-21T00:18:28.928410+0000","last_peered":"2023-09-21T00:18:28.928410+0000","last_clean":"2023-09-21T00:18:28.928410+0000","last_became_active":"2023-09-21T00:18:27.942003+0000","last_became_peered":"2023-09-21T00:18:27.942003+0000","last_unstale":"2023-09-21T00:18:28.928410+0000","last_undegraded":"2023-09-21T00:18:28.928410+0000","last_fullsized":"2023-09-21T00:18:28.928410+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:49:45.951706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.928968+0000","last_change":"2023-09-21T00:18:27.103750+0000","last_active":"2023-09-21T00:18:28.928968+0000","last_peered":"2023-09-21T00:18:28.928968+0000","last_clean":"2023-09-21T00:18:28.928968+0000","last_became_active":"2023-09-21T00:18:27.103490+0000","last_became_peered":"2023-09-21T00:18:27.103490+0000","last_unstale":"2023-09-21T00:18:28.928968+0000","last_undegraded":"2023-09-21T00:18:28.928968+0000","last_fullsized":"2023-09-21T00:18:28.928968+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T02:57:18.894565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.024011+0000","last_change":"2023-09-21T00:18:27.937840+0000","last_active":"2023-09-21T00:18:29.024011+0000","last_peered":"2023-09-21T00:18:29.024011+0000","last_clean":"2023-09-21T00:18:29.024011+0000","last_became_active":"2023-09-21T00:18:27.937538+0000","last_became_peered":"2023-09-21T00:18:27.937538+0000","last_unstale":"2023-09-21T00:18:29.024011+0000","last_undegraded":"2023-09-21T00:18:29.024011+0000","last_fullsized":"2023-09-21T00:18:29.024011+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:47:40.029238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025077+0000","last_change":"2023-09-21T00:18:27.118292+0000","last_active":"2023-09-21T00:18:29.025077+0000","last_peered":"2023-09-21T00:18:29.025077+0000","last_clean":"2023-09-21T00:18:29.025077+0000","last_became_active":"2023-09-21T00:18:27.118039+0000","last_became_peered":"2023-09-21T00:18:27.118039+0000","last_unstale":"2023-09-21T00:18:29.025077+0000","last_undegraded":"2023-09-21T00:18:29.025077+0000","last_fullsized":"2023-09-21T00:18:29.025077+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:10:37.093580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025187+0000","last_change":"2023-09-21T00:18:27.948240+0000","last_active":"2023-09-21T00:18:29.025187+0000","last_peered":"2023-09-21T00:18:29.025187+0000","last_clean":"2023-09-21T00:18:29.025187+0000","last_became_active":"2023-09-21T00:18:27.947658+0000","last_became_peered":"2023-09-21T00:18:27.947658+0000","last_unstale":"2023-09-21T00:18:29.025187+0000","last_undegraded":"2023-09-21T00:18:29.025187+0000","last_fullsized":"2023-09-21T00:18:29.025187+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T04:19:13.224421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025653+0000","last_change":"2023-09-21T00:18:27.117533+0000","last_active":"2023-09-21T00:18:29.025653+0000","last_peered":"2023-09-21T00:18:29.025653+0000","last_clean":"2023-09-21T00:18:29.025653+0000","last_became_active":"2023-09-21T00:18:27.117182+0000","last_became_peered":"2023-09-21T00:18:27.117182+0000","last_unstale":"2023-09-21T00:18:29.025653+0000","last_undegraded":"2023-09-21T00:18:29.025653+0000","last_fullsized":"2023-09-21T00:18:29.025653+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:11:39.012521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.929220+0000","last_change":"2023-09-21T00:18:27.941247+0000","last_active":"2023-09-21T00:18:28.929220+0000","last_peered":"2023-09-21T00:18:28.929220+0000","last_clean":"2023-09-21T00:18:28.929220+0000","last_became_active":"2023-09-21T00:18:27.940452+0000","last_became_peered":"2023-09-21T00:18:27.940452+0000","last_unstale":"2023-09-21T00:18:28.929220+0000","last_undegraded":"2023-09-21T00:18:28.929220+0000","last_fullsized":"2023-09-21T00:18:28.929220+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T04:37:38.137258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.023652+0000","last_change":"2023-09-21T00:18:27.117578+0000","last_active":"2023-09-21T00:18:29.023652+0000","last_peered":"2023-09-21T00:18:29.023652+0000","last_clean":"2023-09-21T00:18:29.023652+0000","last_became_active":"2023-09-21T00:18:27.117301+0000","last_became_peered":"2023-09-21T00:18:27.117301+0000","last_unstale":"2023-09-21T00:18:29.023652+0000","last_undegraded":"2023-09-21T00:18:29.023652+0000","last_fullsized":"2023-09-21T00:18:29.023652+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:47:39.022100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.928083+0000","last_change":"2023-09-21T00:18:27.939945+0000","last_active":"2023-09-21T00:18:28.928083+0000","last_peered":"2023-09-21T00:18:28.928083+0000","last_clean":"2023-09-21T00:18:28.928083+0000","last_became_active":"2023-09-21T00:18:27.939597+0000","last_became_peered":"2023-09-21T00:18:27.939597+0000","last_unstale":"2023-09-21T00:18:28.928083+0000","last_undegraded":"2023-09-21T00:18:28.928083+0000","last_fullsized":"2023-09-21T00:18:28.928083+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T11:12:02.265864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.928663+0000","last_change":"2023-09-21T00:18:27.113838+0000","last_active":"2023-09-21T00:18:28.928663+0000","last_peered":"2023-09-21T00:18:28.928663+0000","last_clean":"2023-09-21T00:18:28.928663+0000","last_became_active":"2023-09-21T00:18:27.113510+0000","last_became_peered":"2023-09-21T00:18:27.113510+0000","last_unstale":"2023-09-21T00:18:28.928663+0000","last_undegraded":"2023-09-21T00:18:28.928663+0000","last_fullsized":"2023-09-21T00:18:28.928663+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T11:58:28.364652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.024699+0000","last_change":"2023-09-21T00:18:27.945850+0000","last_active":"2023-09-21T00:18:29.024699+0000","last_peered":"2023-09-21T00:18:29.024699+0000","last_clean":"2023-09-21T00:18:29.024699+0000","last_became_active":"2023-09-21T00:18:27.945453+0000","last_became_peered":"2023-09-21T00:18:27.945453+0000","last_unstale":"2023-09-21T00:18:29.024699+0000","last_undegraded":"2023-09-21T00:18:29.024699+0000","last_fullsized":"2023-09-21T00:18:29.024699+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T07:50:06.336846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.928452+0000","last_change":"2023-09-21T00:18:27.106295+0000","last_active":"2023-09-21T00:18:28.928452+0000","last_peered":"2023-09-21T00:18:28.928452+0000","last_clean":"2023-09-21T00:18:28.928452+0000","last_became_active":"2023-09-21T00:18:27.105998+0000","last_became_peered":"2023-09-21T00:18:27.105998+0000","last_unstale":"2023-09-21T00:18:28.928452+0000","last_undegraded":"2023-09-21T00:18:28.928452+0000","last_fullsized":"2023-09-21T00:18:28.928452+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:50:21.507060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025318+0000","last_change":"2023-09-21T00:18:27.947185+0000","last_active":"2023-09-21T00:18:29.025318+0000","last_peered":"2023-09-21T00:18:29.025318+0000","last_clean":"2023-09-21T00:18:29.025318+0000","last_became_active":"2023-09-21T00:18:27.946817+0000","last_became_peered":"2023-09-21T00:18:27.946817+0000","last_unstale":"2023-09-21T00:18:29.025318+0000","last_undegraded":"2023-09-21T00:18:29.025318+0000","last_fullsized":"2023-09-21T00:18:29.025318+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T02:57:17.997529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025921+0000","last_change":"2023-09-21T00:18:27.115791+0000","last_active":"2023-09-21T00:18:29.025921+0000","last_peered":"2023-09-21T00:18:29.025921+0000","last_clean":"2023-09-21T00:18:29.025921+0000","last_became_active":"2023-09-21T00:18:27.115388+0000","last_became_peered":"2023-09-21T00:18:27.115388+0000","last_unstale":"2023-09-21T00:18:29.025921+0000","last_undegraded":"2023-09-21T00:18:29.025921+0000","last_fullsized":"2023-09-21T00:18:29.025921+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:50:21.507060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.024263+0000","last_change":"2023-09-21T00:18:27.938479+0000","last_active":"2023-09-21T00:18:29.024263+0000","last_peered":"2023-09-21T00:18:29.024263+0000","last_clean":"2023-09-21T00:18:29.024263+0000","last_became_active":"2023-09-21T00:18:27.938179+0000","last_became_peered":"2023-09-21T00:18:27.938179+0000","last_unstale":"2023-09-21T00:18:29.024263+0000","last_undegraded":"2023-09-21T00:18:29.024263+0000","last_fullsized":"2023-09-21T00:18:29.024263+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:10:38.100718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025848+0000","last_change":"2023-09-21T00:18:27.120149+0000","last_active":"2023-09-21T00:18:29.025848+0000","last_peered":"2023-09-21T00:18:29.025848+0000","last_clean":"2023-09-21T00:18:29.025848+0000","last_became_active":"2023-09-21T00:18:27.119849+0000","last_became_peered":"2023-09-21T00:18:27.119849+0000","last_unstale":"2023-09-21T00:18:29.025848+0000","last_undegraded":"2023-09-21T00:18:29.025848+0000","last_fullsized":"2023-09-21T00:18:29.025848+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T07:26:48.708858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.929641+0000","last_change":"2023-09-21T00:18:27.934345+0000","last_active":"2023-09-21T00:18:28.929641+0000","last_peered":"2023-09-21T00:18:28.929641+0000","last_clean":"2023-09-21T00:18:28.929641+0000","last_became_active":"2023-09-21T00:18:27.934068+0000","last_became_peered":"2023-09-21T00:18:27.934068+0000","last_unstale":"2023-09-21T00:18:28.929641+0000","last_undegraded":"2023-09-21T00:18:28.929641+0000","last_fullsized":"2023-09-21T00:18:28.929641+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T04:38:30.921844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.928009+0000","last_change":"2023-09-21T00:18:27.112623+0000","last_active":"2023-09-21T00:18:28.928009+0000","last_peered":"2023-09-21T00:18:28.928009+0000","last_clean":"2023-09-21T00:18:28.928009+0000","last_became_active":"2023-09-21T00:18:27.112244+0000","last_became_peered":"2023-09-21T00:18:27.112244+0000","last_unstale":"2023-09-21T00:18:28.928009+0000","last_undegraded":"2023-09-21T00:18:28.928009+0000","last_fullsized":"2023-09-21T00:18:28.928009+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T04:37:37.130120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.023807+0000","last_change":"2023-09-21T00:18:27.941502+0000","last_active":"2023-09-21T00:18:29.023807+0000","last_peered":"2023-09-21T00:18:29.023807+0000","last_clean":"2023-09-21T00:18:29.023807+0000","last_became_active":"2023-09-21T00:18:27.941162+0000","last_became_peered":"2023-09-21T00:18:27.941162+0000","last_unstale":"2023-09-21T00:18:29.023807+0000","last_undegraded":"2023-09-21T00:18:29.023807+0000","last_fullsized":"2023-09-21T00:18:29.023807+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:13:05.004005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.928176+0000","last_change":"2023-09-21T00:18:27.117885+0000","last_active":"2023-09-21T00:18:28.928176+0000","last_peered":"2023-09-21T00:18:28.928176+0000","last_clean":"2023-09-21T00:18:28.928176+0000","last_became_active":"2023-09-21T00:18:27.117588+0000","last_became_peered":"2023-09-21T00:18:27.117588+0000","last_unstale":"2023-09-21T00:18:28.928176+0000","last_undegraded":"2023-09-21T00:18:28.928176+0000","last_fullsized":"2023-09-21T00:18:28.928176+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T04:38:29.914706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.927602+0000","last_change":"2023-09-21T00:18:27.940537+0000","last_active":"2023-09-21T00:18:28.927602+0000","last_peered":"2023-09-21T00:18:28.927602+0000","last_clean":"2023-09-21T00:18:28.927602+0000","last_became_active":"2023-09-21T00:18:27.940244+0000","last_became_peered":"2023-09-21T00:18:27.940244+0000","last_unstale":"2023-09-21T00:18:28.927602+0000","last_undegraded":"2023-09-21T00:18:28.927602+0000","last_fullsized":"2023-09-21T00:18:28.927602+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T11:06:28.805733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.023624+0000","last_change":"2023-09-21T00:18:27.115452+0000","last_active":"2023-09-21T00:18:29.023624+0000","last_peered":"2023-09-21T00:18:29.023624+0000","last_clean":"2023-09-21T00:18:29.023624+0000","last_became_active":"2023-09-21T00:18:27.115087+0000","last_became_peered":"2023-09-21T00:18:27.115087+0000","last_unstale":"2023-09-21T00:18:29.023624+0000","last_undegraded":"2023-09-21T00:18:29.023624+0000","last_fullsized":"2023-09-21T00:18:29.023624+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T07:26:48.708858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025432+0000","last_change":"2023-09-21T00:18:27.947991+0000","last_active":"2023-09-21T00:18:29.025432+0000","last_peered":"2023-09-21T00:18:29.025432+0000","last_clean":"2023-09-21T00:18:29.025432+0000","last_became_active":"2023-09-21T00:18:27.947023+0000","last_became_peered":"2023-09-21T00:18:27.947023+0000","last_unstale":"2023-09-21T00:18:29.025432+0000","last_undegraded":"2023-09-21T00:18:29.025432+0000","last_fullsized":"2023-09-21T00:18:29.025432+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:17:22.057023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.928569+0000","last_change":"2023-09-21T00:18:27.109060+0000","last_active":"2023-09-21T00:18:28.928569+0000","last_peered":"2023-09-21T00:18:28.928569+0000","last_clean":"2023-09-21T00:18:28.928569+0000","last_became_active":"2023-09-21T00:18:27.108747+0000","last_became_peered":"2023-09-21T00:18:27.108747+0000","last_unstale":"2023-09-21T00:18:28.928569+0000","last_undegraded":"2023-09-21T00:18:28.928569+0000","last_fullsized":"2023-09-21T00:18:28.928569+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:51:05.667271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.927833+0000","last_change":"2023-09-21T00:18:27.940611+0000","last_active":"2023-09-21T00:18:28.927833+0000","last_peered":"2023-09-21T00:18:28.927833+0000","last_clean":"2023-09-21T00:18:28.927833+0000","last_became_active":"2023-09-21T00:18:27.940252+0000","last_became_peered":"2023-09-21T00:18:27.940252+0000","last_unstale":"2023-09-21T00:18:28.927833+0000","last_undegraded":"2023-09-21T00:18:28.927833+0000","last_fullsized":"2023-09-21T00:18:28.927833+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T02:49:18.802099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025014+0000","last_change":"2023-09-21T00:18:27.116043+0000","last_active":"2023-09-21T00:18:29.025014+0000","last_peered":"2023-09-21T00:18:29.025014+0000","last_clean":"2023-09-21T00:18:29.025014+0000","last_became_active":"2023-09-21T00:18:27.115743+0000","last_became_peered":"2023-09-21T00:18:27.115743+0000","last_unstale":"2023-09-21T00:18:29.025014+0000","last_undegraded":"2023-09-21T00:18:29.025014+0000","last_fullsized":"2023-09-21T00:18:29.025014+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:07:03.287374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.927757+0000","last_change":"2023-09-21T00:18:27.945942+0000","last_active":"2023-09-21T00:18:28.927757+0000","last_peered":"2023-09-21T00:18:28.927757+0000","last_clean":"2023-09-21T00:18:28.927757+0000","last_became_active":"2023-09-21T00:18:27.945714+0000","last_became_peered":"2023-09-21T00:18:27.945714+0000","last_unstale":"2023-09-21T00:18:28.927757+0000","last_undegraded":"2023-09-21T00:18:28.927757+0000","last_fullsized":"2023-09-21T00:18:28.927757+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:30:36.740692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025968+0000","last_change":"2023-09-21T00:18:27.112969+0000","last_active":"2023-09-21T00:18:29.025968+0000","last_peered":"2023-09-21T00:18:29.025968+0000","last_clean":"2023-09-21T00:18:29.025968+0000","last_became_active":"2023-09-21T00:18:27.112703+0000","last_became_peered":"2023-09-21T00:18:27.112703+0000","last_unstale":"2023-09-21T00:18:29.025968+0000","last_undegraded":"2023-09-21T00:18:29.025968+0000","last_fullsized":"2023-09-21T00:18:29.025968+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T02:57:16.990391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025694+0000","last_change":"2023-09-21T00:18:27.940299+0000","last_active":"2023-09-21T00:18:29.025694+0000","last_peered":"2023-09-21T00:18:29.025694+0000","last_clean":"2023-09-21T00:18:29.025694+0000","last_became_active":"2023-09-21T00:18:27.939615+0000","last_became_peered":"2023-09-21T00:18:27.939615+0000","last_unstale":"2023-09-21T00:18:29.025694+0000","last_undegraded":"2023-09-21T00:18:29.025694+0000","last_fullsized":"2023-09-21T00:18:29.025694+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T11:12:02.265864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.929151+0000","last_change":"2023-09-21T00:18:27.112815+0000","last_active":"2023-09-21T00:18:28.929151+0000","last_peered":"2023-09-21T00:18:28.929151+0000","last_clean":"2023-09-21T00:18:28.929151+0000","last_became_active":"2023-09-21T00:18:27.112558+0000","last_became_peered":"2023-09-21T00:18:27.112558+0000","last_unstale":"2023-09-21T00:18:28.929151+0000","last_undegraded":"2023-09-21T00:18:28.929151+0000","last_fullsized":"2023-09-21T00:18:28.929151+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:11:39.012521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.929250+0000","last_change":"2023-09-21T00:18:27.939759+0000","last_active":"2023-09-21T00:18:28.929250+0000","last_peered":"2023-09-21T00:18:28.929250+0000","last_clean":"2023-09-21T00:18:28.929250+0000","last_became_active":"2023-09-21T00:18:27.939481+0000","last_became_peered":"2023-09-21T00:18:27.939481+0000","last_unstale":"2023-09-21T00:18:28.929250+0000","last_undegraded":"2023-09-21T00:18:28.929250+0000","last_fullsized":"2023-09-21T00:18:28.929250+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:07:04.294512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025014+0000","last_change":"2023-09-21T00:18:27.113973+0000","last_active":"2023-09-21T00:18:29.025014+0000","last_peered":"2023-09-21T00:18:29.025014+0000","last_clean":"2023-09-21T00:18:29.025014+0000","last_became_active":"2023-09-21T00:18:27.113769+0000","last_became_peered":"2023-09-21T00:18:27.113769+0000","last_unstale":"2023-09-21T00:18:29.025014+0000","last_undegraded":"2023-09-21T00:18:29.025014+0000","last_fullsized":"2023-09-21T00:18:29.025014+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:51:05.667271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.024954+0000","last_change":"2023-09-21T00:18:27.934395+0000","last_active":"2023-09-21T00:18:29.024954+0000","last_peered":"2023-09-21T00:18:29.024954+0000","last_clean":"2023-09-21T00:18:29.024954+0000","last_became_active":"2023-09-21T00:18:27.934129+0000","last_became_peered":"2023-09-21T00:18:27.934129+0000","last_unstale":"2023-09-21T00:18:29.024954+0000","last_undegraded":"2023-09-21T00:18:29.024954+0000","last_fullsized":"2023-09-21T00:18:29.024954+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:39:17.292819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.023770+0000","last_change":"2023-09-21T00:18:27.113505+0000","last_active":"2023-09-21T00:18:29.023770+0000","last_peered":"2023-09-21T00:18:29.023770+0000","last_clean":"2023-09-21T00:18:29.023770+0000","last_became_active":"2023-09-21T00:18:27.113162+0000","last_became_peered":"2023-09-21T00:18:27.113162+0000","last_unstale":"2023-09-21T00:18:29.023770+0000","last_undegraded":"2023-09-21T00:18:29.023770+0000","last_fullsized":"2023-09-21T00:18:29.023770+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:07:03.287374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.024902+0000","last_change":"2023-09-21T00:18:27.948778+0000","last_active":"2023-09-21T00:18:29.024902+0000","last_peered":"2023-09-21T00:18:29.024902+0000","last_clean":"2023-09-21T00:18:29.024902+0000","last_became_active":"2023-09-21T00:18:27.948336+0000","last_became_peered":"2023-09-21T00:18:27.948336+0000","last_unstale":"2023-09-21T00:18:29.024902+0000","last_undegraded":"2023-09-21T00:18:29.024902+0000","last_fullsized":"2023-09-21T00:18:29.024902+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T10:38:53.559631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.024302+0000","last_change":"2023-09-21T00:18:27.118154+0000","last_active":"2023-09-21T00:18:29.024302+0000","last_peered":"2023-09-21T00:18:29.024302+0000","last_clean":"2023-09-21T00:18:29.024302+0000","last_became_active":"2023-09-21T00:18:27.117854+0000","last_became_peered":"2023-09-21T00:18:27.117854+0000","last_unstale":"2023-09-21T00:18:29.024302+0000","last_undegraded":"2023-09-21T00:18:29.024302+0000","last_fullsized":"2023-09-21T00:18:29.024302+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:38:30.140442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.023860+0000","last_change":"2023-09-21T00:18:27.941403+0000","last_active":"2023-09-21T00:18:29.023860+0000","last_peered":"2023-09-21T00:18:29.023860+0000","last_clean":"2023-09-21T00:18:29.023860+0000","last_became_active":"2023-09-21T00:18:27.941073+0000","last_became_peered":"2023-09-21T00:18:27.941073+0000","last_unstale":"2023-09-21T00:18:29.023860+0000","last_undegraded":"2023-09-21T00:18:29.023860+0000","last_fullsized":"2023-09-21T00:18:29.023860+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T04:37:38.137258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025169+0000","last_change":"2023-09-21T00:18:27.111877+0000","last_active":"2023-09-21T00:18:29.025169+0000","last_peered":"2023-09-21T00:18:29.025169+0000","last_clean":"2023-09-21T00:18:29.025169+0000","last_became_active":"2023-09-21T00:18:27.111562+0000","last_became_peered":"2023-09-21T00:18:27.111562+0000","last_unstale":"2023-09-21T00:18:29.025169+0000","last_undegraded":"2023-09-21T00:18:29.025169+0000","last_fullsized":"2023-09-21T00:18:29.025169+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:18:13.474101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025695+0000","last_change":"2023-09-21T00:18:27.944886+0000","last_active":"2023-09-21T00:18:29.025695+0000","last_peered":"2023-09-21T00:18:29.025695+0000","last_clean":"2023-09-21T00:18:29.025695+0000","last_became_active":"2023-09-21T00:18:27.944559+0000","last_became_peered":"2023-09-21T00:18:27.944559+0000","last_unstale":"2023-09-21T00:18:29.025695+0000","last_undegraded":"2023-09-21T00:18:29.025695+0000","last_fullsized":"2023-09-21T00:18:29.025695+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:59:15.508085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025674+0000","last_change":"2023-09-21T00:18:27.116131+0000","last_active":"2023-09-21T00:18:29.025674+0000","last_peered":"2023-09-21T00:18:29.025674+0000","last_clean":"2023-09-21T00:18:29.025674+0000","last_became_active":"2023-09-21T00:18:27.115414+0000","last_became_peered":"2023-09-21T00:18:27.115414+0000","last_unstale":"2023-09-21T00:18:29.025674+0000","last_undegraded":"2023-09-21T00:18:29.025674+0000","last_fullsized":"2023-09-21T00:18:29.025674+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:13:03.996867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.927957+0000","last_change":"2023-09-21T00:18:27.935860+0000","last_active":"2023-09-21T00:18:28.927957+0000","last_peered":"2023-09-21T00:18:28.927957+0000","last_clean":"2023-09-21T00:18:28.927957+0000","last_became_active":"2023-09-21T00:18:27.935574+0000","last_became_peered":"2023-09-21T00:18:27.935574+0000","last_unstale":"2023-09-21T00:18:28.927957+0000","last_undegraded":"2023-09-21T00:18:28.927957+0000","last_fullsized":"2023-09-21T00:18:28.927957+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T10:18:06.702966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.023409+0000","last_change":"2023-09-21T00:18:27.108540+0000","last_active":"2023-09-21T00:18:29.023409+0000","last_peered":"2023-09-21T00:18:29.023409+0000","last_clean":"2023-09-21T00:18:29.023409+0000","last_became_active":"2023-09-21T00:18:27.108228+0000","last_became_peered":"2023-09-21T00:18:27.108228+0000","last_unstale":"2023-09-21T00:18:29.023409+0000","last_undegraded":"2023-09-21T00:18:29.023409+0000","last_fullsized":"2023-09-21T00:18:29.023409+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:05:05.977799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.023775+0000","last_change":"2023-09-21T00:18:27.942893+0000","last_active":"2023-09-21T00:18:29.023775+0000","last_peered":"2023-09-21T00:18:29.023775+0000","last_clean":"2023-09-21T00:18:29.023775+0000","last_became_active":"2023-09-21T00:18:27.942623+0000","last_became_peered":"2023-09-21T00:18:27.942623+0000","last_unstale":"2023-09-21T00:18:29.023775+0000","last_undegraded":"2023-09-21T00:18:29.023775+0000","last_fullsized":"2023-09-21T00:18:29.023775+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T02:57:17.997529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.026002+0000","last_change":"2023-09-21T00:18:27.120147+0000","last_active":"2023-09-21T00:18:29.026002+0000","last_peered":"2023-09-21T00:18:29.026002+0000","last_clean":"2023-09-21T00:18:29.026002+0000","last_became_active":"2023-09-21T00:18:27.119861+0000","last_became_peered":"2023-09-21T00:18:27.119861+0000","last_unstale":"2023-09-21T00:18:29.026002+0000","last_undegraded":"2023-09-21T00:18:29.026002+0000","last_fullsized":"2023-09-21T00:18:29.026002+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T12:00:58.847782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025495+0000","last_change":"2023-09-21T00:18:27.947567+0000","last_active":"2023-09-21T00:18:29.025495+0000","last_peered":"2023-09-21T00:18:29.025495+0000","last_clean":"2023-09-21T00:18:29.025495+0000","last_became_active":"2023-09-21T00:18:27.947257+0000","last_became_peered":"2023-09-21T00:18:27.947257+0000","last_unstale":"2023-09-21T00:18:29.025495+0000","last_undegraded":"2023-09-21T00:18:29.025495+0000","last_fullsized":"2023-09-21T00:18:29.025495+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T12:09:35.018753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025110+0000","last_change":"2023-09-21T00:18:27.113393+0000","last_active":"2023-09-21T00:18:29.025110+0000","last_peered":"2023-09-21T00:18:29.025110+0000","last_clean":"2023-09-21T00:18:29.025110+0000","last_became_active":"2023-09-21T00:18:27.113134+0000","last_became_peered":"2023-09-21T00:18:27.113134+0000","last_unstale":"2023-09-21T00:18:29.025110+0000","last_undegraded":"2023-09-21T00:18:29.025110+0000","last_fullsized":"2023-09-21T00:18:29.025110+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:18:48.718755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.927870+0000","last_change":"2023-09-21T00:18:27.940795+0000","last_active":"2023-09-21T00:18:28.927870+0000","last_peered":"2023-09-21T00:18:28.927870+0000","last_clean":"2023-09-21T00:18:28.927870+0000","last_became_active":"2023-09-21T00:18:27.940503+0000","last_became_peered":"2023-09-21T00:18:27.940503+0000","last_unstale":"2023-09-21T00:18:28.927870+0000","last_undegraded":"2023-09-21T00:18:28.927870+0000","last_fullsized":"2023-09-21T00:18:28.927870+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T04:19:13.224421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.024426+0000","last_change":"2023-09-21T00:18:27.115932+0000","last_active":"2023-09-21T00:18:29.024426+0000","last_peered":"2023-09-21T00:18:29.024426+0000","last_clean":"2023-09-21T00:18:29.024426+0000","last_became_active":"2023-09-21T00:18:27.115681+0000","last_became_peered":"2023-09-21T00:18:27.115681+0000","last_unstale":"2023-09-21T00:18:29.024426+0000","last_undegraded":"2023-09-21T00:18:29.024426+0000","last_fullsized":"2023-09-21T00:18:29.024426+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T07:26:48.708858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.023864+0000","last_change":"2023-09-21T00:18:27.938896+0000","last_active":"2023-09-21T00:18:29.023864+0000","last_peered":"2023-09-21T00:18:29.023864+0000","last_clean":"2023-09-21T00:18:29.023864+0000","last_became_active":"2023-09-21T00:18:27.937817+0000","last_became_peered":"2023-09-21T00:18:27.937817+0000","last_unstale":"2023-09-21T00:18:29.023864+0000","last_undegraded":"2023-09-21T00:18:29.023864+0000","last_fullsized":"2023-09-21T00:18:29.023864+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:07:04.294512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.024336+0000","last_change":"2023-09-21T00:18:27.114956+0000","last_active":"2023-09-21T00:18:29.024336+0000","last_peered":"2023-09-21T00:18:29.024336+0000","last_clean":"2023-09-21T00:18:29.024336+0000","last_became_active":"2023-09-21T00:18:27.114651+0000","last_became_peered":"2023-09-21T00:18:27.114651+0000","last_unstale":"2023-09-21T00:18:29.024336+0000","last_undegraded":"2023-09-21T00:18:29.024336+0000","last_fullsized":"2023-09-21T00:18:29.024336+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:32:48.435724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.023568+0000","last_change":"2023-09-21T00:18:27.946252+0000","last_active":"2023-09-21T00:18:29.023568+0000","last_peered":"2023-09-21T00:18:29.023568+0000","last_clean":"2023-09-21T00:18:29.023568+0000","last_became_active":"2023-09-21T00:18:27.945938+0000","last_became_peered":"2023-09-21T00:18:27.945938+0000","last_unstale":"2023-09-21T00:18:29.023568+0000","last_undegraded":"2023-09-21T00:18:29.023568+0000","last_fullsized":"2023-09-21T00:18:29.023568+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T10:38:53.559631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.928876+0000","last_change":"2023-09-21T00:18:27.109581+0000","last_active":"2023-09-21T00:18:28.928876+0000","last_peered":"2023-09-21T00:18:28.928876+0000","last_clean":"2023-09-21T00:18:28.928876+0000","last_became_active":"2023-09-21T00:18:27.109321+0000","last_became_peered":"2023-09-21T00:18:27.109321+0000","last_unstale":"2023-09-21T00:18:28.928876+0000","last_undegraded":"2023-09-21T00:18:28.928876+0000","last_fullsized":"2023-09-21T00:18:28.928876+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T10:22:56.463693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.929162+0000","last_change":"2023-09-21T00:18:27.941084+0000","last_active":"2023-09-21T00:18:28.929162+0000","last_peered":"2023-09-21T00:18:28.929162+0000","last_clean":"2023-09-21T00:18:28.929162+0000","last_became_active":"2023-09-21T00:18:27.940418+0000","last_became_peered":"2023-09-21T00:18:27.940418+0000","last_unstale":"2023-09-21T00:18:28.929162+0000","last_undegraded":"2023-09-21T00:18:28.929162+0000","last_fullsized":"2023-09-21T00:18:28.929162+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:13:05.004005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.928767+0000","last_change":"2023-09-21T00:18:27.103739+0000","last_active":"2023-09-21T00:18:28.928767+0000","last_peered":"2023-09-21T00:18:28.928767+0000","last_clean":"2023-09-21T00:18:28.928767+0000","last_became_active":"2023-09-21T00:18:27.103478+0000","last_became_peered":"2023-09-21T00:18:27.103478+0000","last_unstale":"2023-09-21T00:18:28.928767+0000","last_undegraded":"2023-09-21T00:18:28.928767+0000","last_fullsized":"2023-09-21T00:18:28.928767+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T07:50:05.329708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025499+0000","last_change":"2023-09-21T00:18:27.946004+0000","last_active":"2023-09-21T00:18:29.025499+0000","last_peered":"2023-09-21T00:18:29.025499+0000","last_clean":"2023-09-21T00:18:29.025499+0000","last_became_active":"2023-09-21T00:18:27.945723+0000","last_became_peered":"2023-09-21T00:18:27.945723+0000","last_unstale":"2023-09-21T00:18:29.025499+0000","last_undegraded":"2023-09-21T00:18:29.025499+0000","last_fullsized":"2023-09-21T00:18:29.025499+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T11:06:28.805733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.927592+0000","last_change":"2023-09-21T00:18:27.107643+0000","last_active":"2023-09-21T00:18:28.927592+0000","last_peered":"2023-09-21T00:18:28.927592+0000","last_clean":"2023-09-21T00:18:28.927592+0000","last_became_active":"2023-09-21T00:18:27.107290+0000","last_became_peered":"2023-09-21T00:18:27.107290+0000","last_unstale":"2023-09-21T00:18:28.927592+0000","last_undegraded":"2023-09-21T00:18:28.927592+0000","last_fullsized":"2023-09-21T00:18:28.927592+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T04:17:54.871555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025900+0000","last_change":"2023-09-21T00:18:27.946921+0000","last_active":"2023-09-21T00:18:29.025900+0000","last_peered":"2023-09-21T00:18:29.025900+0000","last_clean":"2023-09-21T00:18:29.025900+0000","last_became_active":"2023-09-21T00:18:27.946653+0000","last_became_peered":"2023-09-21T00:18:27.946653+0000","last_unstale":"2023-09-21T00:18:29.025900+0000","last_undegraded":"2023-09-21T00:18:29.025900+0000","last_fullsized":"2023-09-21T00:18:29.025900+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:16:32.648569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025241+0000","last_change":"2023-09-21T00:18:27.117852+0000","last_active":"2023-09-21T00:18:29.025241+0000","last_peered":"2023-09-21T00:18:29.025241+0000","last_clean":"2023-09-21T00:18:29.025241+0000","last_became_active":"2023-09-21T00:18:27.117603+0000","last_became_peered":"2023-09-21T00:18:27.117603+0000","last_unstale":"2023-09-21T00:18:29.025241+0000","last_undegraded":"2023-09-21T00:18:29.025241+0000","last_fullsized":"2023-09-21T00:18:29.025241+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T07:26:48.708858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":180,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-21T00:18:27.933704+0000","last_change":"2023-09-21T00:16:57.071188+0000","last_active":"2023-09-21T00:18:27.933704+0000","last_peered":"2023-09-21T00:18:27.933704+0000","last_clean":"2023-09-21T00:18:27.933704+0000","last_became_active":"2023-09-21T00:16:57.070240+0000","last_became_peered":"2023-09-21T00:16:57.070240+0000","last_unstale":"2023-09-21T00:18:27.933704+0000","last_undegraded":"2023-09-21T00:18:27.933704+0000","last_fullsized":"2023-09-21T00:18:27.933704+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:16:55.741965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:16:55.741965+0000","last_clean_scrub_stamp":"2023-09-21T00:16:55.741965+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:21:26.215032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1048576,"data_stored":781973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 00:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.57799999999999996}]},{"osd":1,"last update":"Thu Sep 21 00:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.54800000000000004}]},{"osd":2,"last update":"Thu Sep 21 00:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Sep 21 00:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.63300000000000001}]},{"osd":4,"last update":"Thu Sep 21 00:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.40000000000000002}]},{"osd":5,"last update":"Thu Sep 21 00:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.374},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.51000000000000001}]},{"osd":6,"last update":"Thu Sep 21 00:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.433},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.46300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":442368,"data_stored":190505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 00:17:58 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.50700000000000001}]},{"osd":1,"last update":"Thu Sep 21 00:17:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.56599999999999995}]},{"osd":2,"last update":"Thu Sep 21 00:17:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.53100000000000003}]},{"osd":3,"last update":"Thu Sep 21 00:17:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Sep 21 00:17:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.38900000000000001}]},{"osd":5,"last update":"Thu Sep 21 00:17:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.436},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.41499999999999998}]},{"osd":7,"last update":"Thu Sep 21 00:17:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.371}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":183393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 00:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.28999999999999998}]},{"osd":2,"last update":"Thu Sep 21 00:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.308},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.36799999999999999}]},{"osd":3,"last update":"Thu Sep 21 00:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":3.8849999999999998,"5min":3.8849999999999998,"15min":3.8849999999999998},"last":0.38100000000000001}]},{"osd":4,"last update":"Thu Sep 21 00:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.71199999999999997}]},{"osd":5,"last update":"Thu Sep 21 00:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":3.7650000000000001,"5min":3.7650000000000001,"15min":3.7650000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Sep 21 00:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":3.851,"5min":3.851,"15min":3.851},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.748}]},{"osd":7,"last update":"Thu Sep 21 00:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":3.8159999999999998,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":0.623}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28040,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343800,"statfs":{"total":96636764160,"available":96608051200,"internally_reserved":0,"allocated":1036288,"data_stored":780325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Sep 21 00:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.439}]},{"osd":2,"last update":"Thu Sep 21 00:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.35299999999999998}]},{"osd":3,"last update":"Thu Sep 21 00:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.315},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.33800000000000002}]},{"osd":4,"last update":"Thu Sep 21 00:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.496},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.39000000000000001}]},{"osd":5,"last update":"Thu Sep 21 00:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.45600000000000002}]},{"osd":6,"last update":"Thu Sep 21 00:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.55800000000000005}]},{"osd":7,"last update":"Thu Sep 21 00:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.47699999999999998},{"interface":"front","average":{"1min":1.637,"5min":1.637,"15min":1.637},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":19.096,"5min":19.096,"15min":19.096},"last":0.53900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":442368,"data_stored":189993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 00:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.41699999999999998}]},{"osd":1,"last update":"Thu Sep 21 00:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.35599999999999998}]},{"osd":3,"last update":"Thu Sep 21 00:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.378}]},{"osd":4,"last update":"Thu Sep 21 00:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.56999999999999995}]},{"osd":5,"last update":"Thu Sep 21 00:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.51100000000000001}]},{"osd":6,"last update":"Thu Sep 21 00:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.495},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.60099999999999998}]},{"osd":7,"last update":"Thu Sep 21 00:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.58299999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":191569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 00:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.895,"5min":1.895,"15min":1.895},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":18.942,"5min":18.942,"15min":18.942},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.39900000000000002}]},{"osd":1,"last update":"Thu Sep 21 00:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":7.3979999999999997,"5min":7.3979999999999997,"15min":7.3979999999999997},"last":0.34100000000000003},{"interface":"front","average":{"1min":1.911,"5min":1.911,"15min":1.911},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":19.001000000000001,"5min":19.001000000000001,"15min":19.001000000000001},"last":0.42099999999999999}]},{"osd":2,"last update":"Thu Sep 21 00:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":12.173,"5min":12.173,"15min":12.173},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.443}]},{"osd":4,"last update":"Thu Sep 21 00:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":1.1779999999999999}]},{"osd":5,"last update":"Thu Sep 21 00:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.544,"5min":1.544,"15min":1.544},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":12.390000000000001,"5min":12.390000000000001,"15min":12.390000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.65100000000000002}]},{"osd":6,"last update":"Thu Sep 21 00:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":1.24},{"interface":"front","average":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":12.33,"5min":12.33,"15min":12.33},"last":0.70599999999999996}]},{"osd":7,"last update":"Thu Sep 21 00:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":1.2050000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":190527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 00:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.70899999999999996}]},{"osd":1,"last update":"Thu Sep 21 00:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.72299999999999998}]},{"osd":2,"last update":"Thu Sep 21 00:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.57699999999999996}]},{"osd":3,"last update":"Thu Sep 21 00:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.69399999999999995}]},{"osd":5,"last update":"Thu Sep 21 00:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.52100000000000002}]},{"osd":6,"last update":"Thu Sep 21 00:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.63100000000000001}]},{"osd":7,"last update":"Thu Sep 21 00:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.65100000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":190035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 00:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.47899999999999998}]},{"osd":1,"last update":"Thu Sep 21 00:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.54000000000000004}]},{"osd":2,"last update":"Thu Sep 21 00:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.57799999999999996}]},{"osd":3,"last update":"Thu Sep 21 00:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.69999999999999996}]},{"osd":4,"last update":"Thu Sep 21 00:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.46000000000000002}]},{"osd":6,"last update":"Thu Sep 21 00:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.623},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.52200000000000002}]},{"osd":7,"last update":"Thu Sep 21 00:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.498},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.55300000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-21T00:18:32.270 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-21T00:18:32.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.426+0000 7f771cced700 1 Processor -- start 2023-09-21T00:18:32.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.426+0000 7f771cced700 1 -- start start 2023-09-21T00:18:32.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.427+0000 7f771cced700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f771815a230 0x7f771815e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:32.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.427+0000 7f771cced700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f77180ca790 0x7f7718071680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:32.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.427+0000 7f771cced700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77180cb1c0 con 0x7f77180cac20 2023-09-21T00:18:32.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.427+0000 7f771cced700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77180cb780 con 0x7f77180ca790 2023-09-21T00:18:32.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.427+0000 7f771cced700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77180cb4a0 con 0x7f771815a230 2023-09-21T00:18:32.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.427+0000 7f7715d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f77180ca790 0x7f7718071680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:32.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.427+0000 7f7716d9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f77180cac20 0x7f771806eaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59092/0 (socket says 172.21.15.59:59092) 2023-09-21T00:18:32.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.427+0000 7f7716d9d700 1 -- 172.21.15.59:0/887500126 learned_addr learned my addr 172.21.15.59:0/887500126 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:32.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.428+0000 7f771659c700 1 --2- 172.21.15.59:0/887500126 >> v2:172.21.15.83:3300/0 conn(0x7f771815a230 0x7f771815e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:32.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.428+0000 7f7715d9b700 1 -- 172.21.15.59:0/887500126 >> v2:172.21.15.83:3300/0 conn(0x7f771815a230 msgr2=0x7f771815e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:32.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.428+0000 7f7715d9b700 1 --2- 172.21.15.59:0/887500126 >> v2:172.21.15.83:3300/0 conn(0x7f771815a230 0x7f771815e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:32.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.428+0000 7f7715d9b700 1 -- 172.21.15.59:0/887500126 >> v1:172.21.15.59:6789/0 conn(0x7f77180cac20 legacy=0x7f771806eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:32.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.428+0000 7f7715d9b700 1 -- 172.21.15.59:0/887500126 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f771815e0b0 con 0x7f77180ca790 2023-09-21T00:18:32.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.428+0000 7f771559a700 1 -- 172.21.15.59:0/887500126 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2922713679 0 0) 0x7f77180cb1c0 con 0x7f77180cac20 2023-09-21T00:18:32.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.428+0000 7f771659c700 1 --2- 172.21.15.59:0/887500126 >> v2:172.21.15.83:3300/0 conn(0x7f771815a230 0x7f771815e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:18:32.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.428+0000 7f7715d9b700 1 --2- 172.21.15.59:0/887500126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77180ca790 0x7f7718071680 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f77180cbb60 tx=0x7f7700009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d45c2d3a8df3a26 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:32.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.428+0000 7f771559a700 1 -- 172.21.15.59:0/887500126 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7700011830 con 0x7f77180ca790 2023-09-21T00:18:32.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.428+0000 7f771559a700 1 -- 172.21.15.59:0/887500126 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7700011990 con 0x7f77180ca790 2023-09-21T00:18:32.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.428+0000 7f771559a700 1 -- 172.21.15.59:0/887500126 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7700011d20 con 0x7f77180ca790 2023-09-21T00:18:32.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.429+0000 7f771cced700 1 -- 172.21.15.59:0/887500126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77180ca790 msgr2=0x7f7718071680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:32.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.429+0000 7f771cced700 1 --2- 172.21.15.59:0/887500126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77180ca790 0x7f7718071680 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f77180cbb60 tx=0x7f7700009b20 comp rx=0 tx=0).stop 2023-09-21T00:18:32.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.429+0000 7f771cced700 1 -- 172.21.15.59:0/887500126 shutdown_connections 2023-09-21T00:18:32.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.429+0000 7f771cced700 1 --2- 172.21.15.59:0/887500126 >> v2:172.21.15.83:3300/0 conn(0x7f771815a230 0x7f771815e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:32.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.429+0000 7f771cced700 1 --2- 172.21.15.59:0/887500126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77180ca790 0x7f7718071680 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:32.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.429+0000 7f771cced700 1 -- 172.21.15.59:0/887500126 >> 172.21.15.59:0/887500126 conn(0x7f77180d0140 msgr2=0x7f77180d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:32.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.429+0000 7f771cced700 1 -- 172.21.15.59:0/887500126 shutdown_connections 2023-09-21T00:18:32.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.429+0000 7f771cced700 1 -- 172.21.15.59:0/887500126 wait complete. 2023-09-21T00:18:32.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.430+0000 7f771cced700 1 Processor -- start 2023-09-21T00:18:32.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.430+0000 7f771cced700 1 -- start start 2023-09-21T00:18:32.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.431+0000 7f771cced700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77180ca790 0x7f77180c7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:32.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.431+0000 7f771cced700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77180cac20 0x7f77180aeb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:32.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.431+0000 7f771cced700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f771815a230 0x7f7718158380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:32.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.431+0000 7f771cced700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77180c60b0 con 0x7f77180ca790 2023-09-21T00:18:32.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.431+0000 7f771cced700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77180c5710 con 0x7f77180cac20 2023-09-21T00:18:32.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.431+0000 7f771cced700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77180c59f0 con 0x7f771815a230 2023-09-21T00:18:32.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.431+0000 7f771659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77180ca790 0x7f77180c7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:32.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.431+0000 7f771659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77180ca790 0x7f77180c7210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53528/0 (socket says 172.21.15.59:53528) 2023-09-21T00:18:32.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.431+0000 7f771659c700 1 -- 172.21.15.59:0/832250036 learned_addr learned my addr 172.21.15.59:0/832250036 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:32.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.431+0000 7f7715d9b700 1 --2- 172.21.15.59:0/832250036 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77180cac20 0x7f77180aeb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:32.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.431+0000 7f7716d9d700 1 --2- 172.21.15.59:0/832250036 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f771815a230 0x7f7718158380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:32.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.431+0000 7f771659c700 1 -- 172.21.15.59:0/832250036 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f771815a230 msgr2=0x7f7718158380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:32.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.431+0000 7f771659c700 1 --2- 172.21.15.59:0/832250036 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f771815a230 0x7f7718158380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:32.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.431+0000 7f771659c700 1 -- 172.21.15.59:0/832250036 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77180cac20 msgr2=0x7f77180aeb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:32.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.431+0000 7f771659c700 1 --2- 172.21.15.59:0/832250036 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77180cac20 0x7f77180aeb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:32.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.431+0000 7f771659c700 1 -- 172.21.15.59:0/832250036 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77000094a0 con 0x7f77180ca790 2023-09-21T00:18:32.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.431+0000 7f7715d9b700 1 --2- 172.21.15.59:0/832250036 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77180cac20 0x7f77180aeb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:18:32.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.431+0000 7f771659c700 1 --2- 172.21.15.59:0/832250036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77180ca790 0x7f77180c7210 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f770800c750 tx=0x7f770800cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:32.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.432+0000 7f770effd700 1 -- 172.21.15.59:0/832250036 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7708011800 con 0x7f77180ca790 2023-09-21T00:18:32.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.432+0000 7f770effd700 1 -- 172.21.15.59:0/832250036 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7708011960 con 0x7f77180ca790 2023-09-21T00:18:32.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.432+0000 7f771cced700 1 -- 172.21.15.59:0/832250036 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77180c5cd0 con 0x7f77180ca790 2023-09-21T00:18:32.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.432+0000 7f770effd700 1 -- 172.21.15.59:0/832250036 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7708011cd0 con 0x7f77180ca790 2023-09-21T00:18:32.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.432+0000 7f771cced700 1 -- 172.21.15.59:0/832250036 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77180c5350 con 0x7f77180ca790 2023-09-21T00:18:32.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.433+0000 7f771cced700 1 -- 172.21.15.59:0/832250036 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77180c61f0 con 0x7f77180ca790 2023-09-21T00:18:32.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.433+0000 7f770effd700 1 -- 172.21.15.59:0/832250036 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f7708021350 con 0x7f77180ca790 2023-09-21T00:18:32.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.434+0000 7f770effd700 1 --2- 172.21.15.59:0/832250036 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f76f806ae00 0x7f76f806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:32.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.434+0000 7f770effd700 1 -- 172.21.15.59:0/832250036 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7708089650 con 0x7f77180ca790 2023-09-21T00:18:32.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.434+0000 7f7715d9b700 1 --2- 172.21.15.59:0/832250036 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f76f806ae00 0x7f76f806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:32.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.434+0000 7f7715d9b700 1 --2- 172.21.15.59:0/832250036 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f76f806ae00 0x7f76f806d2c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f77000090b0 tx=0x7f770001c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:32.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.438+0000 7f770effd700 1 -- 172.21.15.59:0/832250036 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f77180c61f0 con 0x7f77180ca790 2023-09-21T00:18:32.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.633+0000 7f771cced700 1 -- 172.21.15.59:0/832250036 --> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f771815edf0 con 0x7f76f806ae00 2023-09-21T00:18:32.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.642+0000 7f770effd700 1 -- 172.21.15.59:0/832250036 <== mgr.4103 v2:172.21.15.83:6832/1736808576 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289282 (secure 0 0 0) 0x7f7700004040 con 0x7f76f806ae00 2023-09-21T00:18:32.646 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:18:32.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.645+0000 7f771cced700 1 -- 172.21.15.59:0/832250036 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f76f806ae00 msgr2=0x7f76f806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:32.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.645+0000 7f771cced700 1 --2- 172.21.15.59:0/832250036 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f76f806ae00 0x7f76f806d2c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f77000090b0 tx=0x7f770001c040 comp rx=0 tx=0).stop 2023-09-21T00:18:32.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.645+0000 7f771cced700 1 -- 172.21.15.59:0/832250036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77180ca790 msgr2=0x7f77180c7210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:32.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.645+0000 7f771cced700 1 --2- 172.21.15.59:0/832250036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77180ca790 0x7f77180c7210 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f770800c750 tx=0x7f770800cb10 comp rx=0 tx=0).stop 2023-09-21T00:18:32.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.645+0000 7f771cced700 1 -- 172.21.15.59:0/832250036 shutdown_connections 2023-09-21T00:18:32.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.645+0000 7f771cced700 1 --2- 172.21.15.59:0/832250036 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f76f806ae00 0x7f76f806d2c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:32.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.645+0000 7f771cced700 1 --2- 172.21.15.59:0/832250036 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f771815a230 0x7f7718158380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:32.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.645+0000 7f771cced700 1 --2- 172.21.15.59:0/832250036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77180ca790 0x7f77180c7210 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:32.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.645+0000 7f771cced700 1 --2- 172.21.15.59:0/832250036 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77180cac20 0x7f77180aeb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:32.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.645+0000 7f771cced700 1 -- 172.21.15.59:0/832250036 >> 172.21.15.59:0/832250036 conn(0x7f77180d0140 msgr2=0x7f77180b13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:32.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.645+0000 7f771cced700 1 -- 172.21.15.59:0/832250036 shutdown_connections 2023-09-21T00:18:32.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.645+0000 7f771cced700 1 -- 172.21.15.59:0/832250036 wait complete. 2023-09-21T00:18:32.651 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2023-09-21T00:18:32.659 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2023-09-21T00:18:30.766243+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":157,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220840,"kb_used_data":4636,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753880,"statfs":{"total":773094113280,"available":772867973120,"internally_reserved":0,"allocated":4747264,"data_stored":2698320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.678064"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.928343+0000","last_change":"2023-09-21T00:18:27.940775+0000","last_active":"2023-09-21T00:18:28.928343+0000","last_peered":"2023-09-21T00:18:28.928343+0000","last_clean":"2023-09-21T00:18:28.928343+0000","last_became_active":"2023-09-21T00:18:27.940445+0000","last_became_peered":"2023-09-21T00:18:27.940445+0000","last_unstale":"2023-09-21T00:18:28.928343+0000","last_undegraded":"2023-09-21T00:18:28.928343+0000","last_fullsized":"2023-09-21T00:18:28.928343+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:59:15.508085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.927861+0000","last_change":"2023-09-21T00:18:27.934508+0000","last_active":"2023-09-21T00:18:28.927861+0000","last_peered":"2023-09-21T00:18:28.927861+0000","last_clean":"2023-09-21T00:18:28.927861+0000","last_became_active":"2023-09-21T00:18:27.934207+0000","last_became_peered":"2023-09-21T00:18:27.934207+0000","last_unstale":"2023-09-21T00:18:28.927861+0000","last_undegraded":"2023-09-21T00:18:28.927861+0000","last_fullsized":"2023-09-21T00:18:28.927861+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:39:08.392015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.024368+0000","last_change":"2023-09-21T00:18:27.942596+0000","last_active":"2023-09-21T00:18:29.024368+0000","last_peered":"2023-09-21T00:18:29.024368+0000","last_clean":"2023-09-21T00:18:29.024368+0000","last_became_active":"2023-09-21T00:18:27.942345+0000","last_became_peered":"2023-09-21T00:18:27.942345+0000","last_unstale":"2023-09-21T00:18:29.024368+0000","last_undegraded":"2023-09-21T00:18:29.024368+0000","last_fullsized":"2023-09-21T00:18:29.024368+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:01:12.461787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.024576+0000","last_change":"2023-09-21T00:18:27.946032+0000","last_active":"2023-09-21T00:18:29.024576+0000","last_peered":"2023-09-21T00:18:29.024576+0000","last_clean":"2023-09-21T00:18:29.024576+0000","last_became_active":"2023-09-21T00:18:27.945852+0000","last_became_peered":"2023-09-21T00:18:27.945852+0000","last_unstale":"2023-09-21T00:18:29.024576+0000","last_undegraded":"2023-09-21T00:18:29.024576+0000","last_fullsized":"2023-09-21T00:18:29.024576+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T11:58:29.371790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.024270+0000","last_change":"2023-09-21T00:18:27.946231+0000","last_active":"2023-09-21T00:18:29.024270+0000","last_peered":"2023-09-21T00:18:29.024270+0000","last_clean":"2023-09-21T00:18:29.024270+0000","last_became_active":"2023-09-21T00:18:27.945500+0000","last_became_peered":"2023-09-21T00:18:27.945500+0000","last_unstale":"2023-09-21T00:18:29.024270+0000","last_undegraded":"2023-09-21T00:18:29.024270+0000","last_fullsized":"2023-09-21T00:18:29.024270+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T10:51:20.961954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.023570+0000","last_change":"2023-09-21T00:18:27.936690+0000","last_active":"2023-09-21T00:18:29.023570+0000","last_peered":"2023-09-21T00:18:29.023570+0000","last_clean":"2023-09-21T00:18:29.023570+0000","last_became_active":"2023-09-21T00:18:27.936311+0000","last_became_peered":"2023-09-21T00:18:27.936311+0000","last_unstale":"2023-09-21T00:18:29.023570+0000","last_undegraded":"2023-09-21T00:18:29.023570+0000","last_fullsized":"2023-09-21T00:18:29.023570+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:01:12.461787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025105+0000","last_change":"2023-09-21T00:18:27.940009+0000","last_active":"2023-09-21T00:18:29.025105+0000","last_peered":"2023-09-21T00:18:29.025105+0000","last_clean":"2023-09-21T00:18:29.025105+0000","last_became_active":"2023-09-21T00:18:27.939709+0000","last_became_peered":"2023-09-21T00:18:27.939709+0000","last_unstale":"2023-09-21T00:18:29.025105+0000","last_undegraded":"2023-09-21T00:18:29.025105+0000","last_fullsized":"2023-09-21T00:18:29.025105+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:39:08.392015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.927585+0000","last_change":"2023-09-21T00:18:27.940026+0000","last_active":"2023-09-21T00:18:28.927585+0000","last_peered":"2023-09-21T00:18:28.927585+0000","last_clean":"2023-09-21T00:18:28.927585+0000","last_became_active":"2023-09-21T00:18:27.939666+0000","last_became_peered":"2023-09-21T00:18:27.939666+0000","last_unstale":"2023-09-21T00:18:28.927585+0000","last_undegraded":"2023-09-21T00:18:28.927585+0000","last_fullsized":"2023-09-21T00:18:28.927585+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T12:09:35.018753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.024461+0000","last_change":"2023-09-21T00:18:27.941842+0000","last_active":"2023-09-21T00:18:29.024461+0000","last_peered":"2023-09-21T00:18:29.024461+0000","last_clean":"2023-09-21T00:18:29.024461+0000","last_became_active":"2023-09-21T00:18:27.941124+0000","last_became_peered":"2023-09-21T00:18:27.941124+0000","last_unstale":"2023-09-21T00:18:29.024461+0000","last_undegraded":"2023-09-21T00:18:29.024461+0000","last_fullsized":"2023-09-21T00:18:29.024461+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T10:38:53.559631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025724+0000","last_change":"2023-09-21T00:18:27.945169+0000","last_active":"2023-09-21T00:18:29.025724+0000","last_peered":"2023-09-21T00:18:29.025724+0000","last_clean":"2023-09-21T00:18:29.025724+0000","last_became_active":"2023-09-21T00:18:27.944871+0000","last_became_peered":"2023-09-21T00:18:27.944871+0000","last_unstale":"2023-09-21T00:18:29.025724+0000","last_undegraded":"2023-09-21T00:18:29.025724+0000","last_fullsized":"2023-09-21T00:18:29.025724+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:49:45.951706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025914+0000","last_change":"2023-09-21T00:18:27.943781+0000","last_active":"2023-09-21T00:18:29.025914+0000","last_peered":"2023-09-21T00:18:29.025914+0000","last_clean":"2023-09-21T00:18:29.025914+0000","last_became_active":"2023-09-21T00:18:27.943517+0000","last_became_peered":"2023-09-21T00:18:27.943517+0000","last_unstale":"2023-09-21T00:18:29.025914+0000","last_undegraded":"2023-09-21T00:18:29.025914+0000","last_fullsized":"2023-09-21T00:18:29.025914+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T00:20:05.712777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.024218+0000","last_change":"2023-09-21T00:18:27.939014+0000","last_active":"2023-09-21T00:18:29.024218+0000","last_peered":"2023-09-21T00:18:29.024218+0000","last_clean":"2023-09-21T00:18:29.024218+0000","last_became_active":"2023-09-21T00:18:27.938733+0000","last_became_peered":"2023-09-21T00:18:27.938733+0000","last_unstale":"2023-09-21T00:18:29.024218+0000","last_undegraded":"2023-09-21T00:18:29.024218+0000","last_fullsized":"2023-09-21T00:18:29.024218+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T04:38:30.921844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.024979+0000","last_change":"2023-09-21T00:18:27.939727+0000","last_active":"2023-09-21T00:18:29.024979+0000","last_peered":"2023-09-21T00:18:29.024979+0000","last_clean":"2023-09-21T00:18:29.024979+0000","last_became_active":"2023-09-21T00:18:27.939415+0000","last_became_peered":"2023-09-21T00:18:27.939415+0000","last_unstale":"2023-09-21T00:18:29.024979+0000","last_undegraded":"2023-09-21T00:18:29.024979+0000","last_fullsized":"2023-09-21T00:18:29.024979+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:30:36.740692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.929323+0000","last_change":"2023-09-21T00:18:27.946867+0000","last_active":"2023-09-21T00:18:28.929323+0000","last_peered":"2023-09-21T00:18:28.929323+0000","last_clean":"2023-09-21T00:18:28.929323+0000","last_became_active":"2023-09-21T00:18:27.946609+0000","last_became_peered":"2023-09-21T00:18:27.946609+0000","last_unstale":"2023-09-21T00:18:28.929323+0000","last_undegraded":"2023-09-21T00:18:28.929323+0000","last_fullsized":"2023-09-21T00:18:28.929323+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:47:40.029238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.024848+0000","last_change":"2023-09-21T00:18:27.948384+0000","last_active":"2023-09-21T00:18:29.024848+0000","last_peered":"2023-09-21T00:18:29.024848+0000","last_clean":"2023-09-21T00:18:29.024848+0000","last_became_active":"2023-09-21T00:18:27.948018+0000","last_became_peered":"2023-09-21T00:18:27.948018+0000","last_unstale":"2023-09-21T00:18:29.024848+0000","last_undegraded":"2023-09-21T00:18:29.024848+0000","last_fullsized":"2023-09-21T00:18:29.024848+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T11:06:28.805733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.024840+0000","last_change":"2023-09-21T00:18:27.944041+0000","last_active":"2023-09-21T00:18:29.024840+0000","last_peered":"2023-09-21T00:18:29.024840+0000","last_clean":"2023-09-21T00:18:29.024840+0000","last_became_active":"2023-09-21T00:18:27.943588+0000","last_became_peered":"2023-09-21T00:18:27.943588+0000","last_unstale":"2023-09-21T00:18:29.024840+0000","last_undegraded":"2023-09-21T00:18:29.024840+0000","last_fullsized":"2023-09-21T00:18:29.024840+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:01:12.461787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025357+0000","last_change":"2023-09-21T00:18:27.944365+0000","last_active":"2023-09-21T00:18:29.025357+0000","last_peered":"2023-09-21T00:18:29.025357+0000","last_clean":"2023-09-21T00:18:29.025357+0000","last_became_active":"2023-09-21T00:18:27.943909+0000","last_became_peered":"2023-09-21T00:18:27.943909+0000","last_unstale":"2023-09-21T00:18:29.025357+0000","last_undegraded":"2023-09-21T00:18:29.025357+0000","last_fullsized":"2023-09-21T00:18:29.025357+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:50:22.514198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.929341+0000","last_change":"2023-09-21T00:18:27.943990+0000","last_active":"2023-09-21T00:18:28.929341+0000","last_peered":"2023-09-21T00:18:28.929341+0000","last_clean":"2023-09-21T00:18:28.929341+0000","last_became_active":"2023-09-21T00:18:27.943409+0000","last_became_peered":"2023-09-21T00:18:27.943409+0000","last_unstale":"2023-09-21T00:18:28.929341+0000","last_undegraded":"2023-09-21T00:18:28.929341+0000","last_fullsized":"2023-09-21T00:18:28.929341+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T04:17:55.878693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.024947+0000","last_change":"2023-09-21T00:18:27.937399+0000","last_active":"2023-09-21T00:18:29.024947+0000","last_peered":"2023-09-21T00:18:29.024947+0000","last_clean":"2023-09-21T00:18:29.024947+0000","last_became_active":"2023-09-21T00:18:27.937122+0000","last_became_peered":"2023-09-21T00:18:27.937122+0000","last_unstale":"2023-09-21T00:18:29.024947+0000","last_undegraded":"2023-09-21T00:18:29.024947+0000","last_fullsized":"2023-09-21T00:18:29.024947+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T10:22:57.470831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.929527+0000","last_change":"2023-09-21T00:18:27.943173+0000","last_active":"2023-09-21T00:18:28.929527+0000","last_peered":"2023-09-21T00:18:28.929527+0000","last_clean":"2023-09-21T00:18:28.929527+0000","last_became_active":"2023-09-21T00:18:27.942894+0000","last_became_peered":"2023-09-21T00:18:27.942894+0000","last_unstale":"2023-09-21T00:18:28.929527+0000","last_undegraded":"2023-09-21T00:18:28.929527+0000","last_fullsized":"2023-09-21T00:18:28.929527+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T02:17:26.292597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025063+0000","last_change":"2023-09-21T00:18:27.948156+0000","last_active":"2023-09-21T00:18:29.025063+0000","last_peered":"2023-09-21T00:18:29.025063+0000","last_clean":"2023-09-21T00:18:29.025063+0000","last_became_active":"2023-09-21T00:18:27.947864+0000","last_became_peered":"2023-09-21T00:18:27.947864+0000","last_unstale":"2023-09-21T00:18:29.025063+0000","last_undegraded":"2023-09-21T00:18:29.025063+0000","last_fullsized":"2023-09-21T00:18:29.025063+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T02:49:18.802099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.928907+0000","last_change":"2023-09-21T00:18:27.941305+0000","last_active":"2023-09-21T00:18:28.928907+0000","last_peered":"2023-09-21T00:18:28.928907+0000","last_clean":"2023-09-21T00:18:28.928907+0000","last_became_active":"2023-09-21T00:18:27.940792+0000","last_became_peered":"2023-09-21T00:18:27.940792+0000","last_unstale":"2023-09-21T00:18:28.928907+0000","last_undegraded":"2023-09-21T00:18:28.928907+0000","last_fullsized":"2023-09-21T00:18:28.928907+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T07:26:49.715996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025580+0000","last_change":"2023-09-21T00:18:27.948329+0000","last_active":"2023-09-21T00:18:29.025580+0000","last_peered":"2023-09-21T00:18:29.025580+0000","last_clean":"2023-09-21T00:18:29.025580+0000","last_became_active":"2023-09-21T00:18:27.948061+0000","last_became_peered":"2023-09-21T00:18:27.948061+0000","last_unstale":"2023-09-21T00:18:29.025580+0000","last_undegraded":"2023-09-21T00:18:29.025580+0000","last_fullsized":"2023-09-21T00:18:29.025580+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:30:36.740692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.023550+0000","last_change":"2023-09-21T00:18:27.939029+0000","last_active":"2023-09-21T00:18:29.023550+0000","last_peered":"2023-09-21T00:18:29.023550+0000","last_clean":"2023-09-21T00:18:29.023550+0000","last_became_active":"2023-09-21T00:18:27.938592+0000","last_became_peered":"2023-09-21T00:18:27.938592+0000","last_unstale":"2023-09-21T00:18:29.023550+0000","last_undegraded":"2023-09-21T00:18:29.023550+0000","last_fullsized":"2023-09-21T00:18:29.023550+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T07:47:14.988972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.929490+0000","last_change":"2023-09-21T00:18:27.941321+0000","last_active":"2023-09-21T00:18:28.929490+0000","last_peered":"2023-09-21T00:18:28.929490+0000","last_clean":"2023-09-21T00:18:28.929490+0000","last_became_active":"2023-09-21T00:18:27.940963+0000","last_became_peered":"2023-09-21T00:18:27.940963+0000","last_unstale":"2023-09-21T00:18:28.929490+0000","last_undegraded":"2023-09-21T00:18:28.929490+0000","last_fullsized":"2023-09-21T00:18:28.929490+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T07:26:49.715996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.023912+0000","last_change":"2023-09-21T00:18:27.943556+0000","last_active":"2023-09-21T00:18:29.023912+0000","last_peered":"2023-09-21T00:18:29.023912+0000","last_clean":"2023-09-21T00:18:29.023912+0000","last_became_active":"2023-09-21T00:18:27.943127+0000","last_became_peered":"2023-09-21T00:18:27.943127+0000","last_unstale":"2023-09-21T00:18:29.023912+0000","last_undegraded":"2023-09-21T00:18:29.023912+0000","last_fullsized":"2023-09-21T00:18:29.023912+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T12:00:59.854920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.929099+0000","last_change":"2023-09-21T00:18:27.941980+0000","last_active":"2023-09-21T00:18:28.929099+0000","last_peered":"2023-09-21T00:18:28.929099+0000","last_clean":"2023-09-21T00:18:28.929099+0000","last_became_active":"2023-09-21T00:18:27.941632+0000","last_became_peered":"2023-09-21T00:18:27.941632+0000","last_unstale":"2023-09-21T00:18:28.929099+0000","last_undegraded":"2023-09-21T00:18:28.929099+0000","last_fullsized":"2023-09-21T00:18:28.929099+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:32:49.442862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025596+0000","last_change":"2023-09-21T00:18:27.944378+0000","last_active":"2023-09-21T00:18:29.025596+0000","last_peered":"2023-09-21T00:18:29.025596+0000","last_clean":"2023-09-21T00:18:29.025596+0000","last_became_active":"2023-09-21T00:18:27.944068+0000","last_became_peered":"2023-09-21T00:18:27.944068+0000","last_unstale":"2023-09-21T00:18:29.025596+0000","last_undegraded":"2023-09-21T00:18:29.025596+0000","last_fullsized":"2023-09-21T00:18:29.025596+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T10:18:06.702966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.929200+0000","last_change":"2023-09-21T00:18:27.941118+0000","last_active":"2023-09-21T00:18:28.929200+0000","last_peered":"2023-09-21T00:18:28.929200+0000","last_clean":"2023-09-21T00:18:28.929200+0000","last_became_active":"2023-09-21T00:18:27.940832+0000","last_became_peered":"2023-09-21T00:18:27.940832+0000","last_unstale":"2023-09-21T00:18:28.929200+0000","last_undegraded":"2023-09-21T00:18:28.929200+0000","last_fullsized":"2023-09-21T00:18:28.929200+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T02:57:19.901703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.928777+0000","last_change":"2023-09-21T00:18:27.945956+0000","last_active":"2023-09-21T00:18:28.928777+0000","last_peered":"2023-09-21T00:18:28.928777+0000","last_clean":"2023-09-21T00:18:28.928777+0000","last_became_active":"2023-09-21T00:18:27.945658+0000","last_became_peered":"2023-09-21T00:18:27.945658+0000","last_unstale":"2023-09-21T00:18:28.928777+0000","last_undegraded":"2023-09-21T00:18:28.928777+0000","last_fullsized":"2023-09-21T00:18:28.928777+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:11:40.019659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025809+0000","last_change":"2023-09-21T00:18:27.947500+0000","last_active":"2023-09-21T00:18:29.025809+0000","last_peered":"2023-09-21T00:18:29.025809+0000","last_clean":"2023-09-21T00:18:29.025809+0000","last_became_active":"2023-09-21T00:18:27.947172+0000","last_became_peered":"2023-09-21T00:18:27.947172+0000","last_unstale":"2023-09-21T00:18:29.025809+0000","last_undegraded":"2023-09-21T00:18:29.025809+0000","last_fullsized":"2023-09-21T00:18:29.025809+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T02:49:18.802099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.023423+0000","last_change":"2023-09-21T00:18:27.938524+0000","last_active":"2023-09-21T00:18:29.023423+0000","last_peered":"2023-09-21T00:18:29.023423+0000","last_clean":"2023-09-21T00:18:29.023423+0000","last_became_active":"2023-09-21T00:18:27.938248+0000","last_became_peered":"2023-09-21T00:18:27.938248+0000","last_unstale":"2023-09-21T00:18:29.023423+0000","last_undegraded":"2023-09-21T00:18:29.023423+0000","last_fullsized":"2023-09-21T00:18:29.023423+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:10:38.100718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025318+0000","last_change":"2023-09-21T00:18:27.944464+0000","last_active":"2023-09-21T00:18:29.025318+0000","last_peered":"2023-09-21T00:18:29.025318+0000","last_clean":"2023-09-21T00:18:29.025318+0000","last_became_active":"2023-09-21T00:18:27.943570+0000","last_became_peered":"2023-09-21T00:18:27.943570+0000","last_unstale":"2023-09-21T00:18:29.025318+0000","last_undegraded":"2023-09-21T00:18:29.025318+0000","last_fullsized":"2023-09-21T00:18:29.025318+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T12:00:59.854920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.929573+0000","last_change":"2023-09-21T00:18:27.110652+0000","last_active":"2023-09-21T00:18:28.929573+0000","last_peered":"2023-09-21T00:18:28.929573+0000","last_clean":"2023-09-21T00:18:28.929573+0000","last_became_active":"2023-09-21T00:18:27.110419+0000","last_became_peered":"2023-09-21T00:18:27.110419+0000","last_unstale":"2023-09-21T00:18:28.929573+0000","last_undegraded":"2023-09-21T00:18:28.929573+0000","last_fullsized":"2023-09-21T00:18:28.929573+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T11:58:28.364652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.023931+0000","last_change":"2023-09-21T00:18:27.941448+0000","last_active":"2023-09-21T00:18:29.023931+0000","last_peered":"2023-09-21T00:18:29.023931+0000","last_clean":"2023-09-21T00:18:29.023931+0000","last_became_active":"2023-09-21T00:18:27.940963+0000","last_became_peered":"2023-09-21T00:18:27.940963+0000","last_unstale":"2023-09-21T00:18:29.023931+0000","last_undegraded":"2023-09-21T00:18:29.023931+0000","last_fullsized":"2023-09-21T00:18:29.023931+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:50:22.514198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.024358+0000","last_change":"2023-09-21T00:18:27.114867+0000","last_active":"2023-09-21T00:18:29.024358+0000","last_peered":"2023-09-21T00:18:29.024358+0000","last_clean":"2023-09-21T00:18:29.024358+0000","last_became_active":"2023-09-21T00:18:27.114561+0000","last_became_peered":"2023-09-21T00:18:27.114561+0000","last_unstale":"2023-09-21T00:18:29.024358+0000","last_undegraded":"2023-09-21T00:18:29.024358+0000","last_fullsized":"2023-09-21T00:18:29.024358+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T04:17:54.871555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.929143+0000","last_change":"2023-09-21T00:18:27.942420+0000","last_active":"2023-09-21T00:18:28.929143+0000","last_peered":"2023-09-21T00:18:28.929143+0000","last_clean":"2023-09-21T00:18:28.929143+0000","last_became_active":"2023-09-21T00:18:27.942188+0000","last_became_peered":"2023-09-21T00:18:27.942188+0000","last_unstale":"2023-09-21T00:18:28.929143+0000","last_undegraded":"2023-09-21T00:18:28.929143+0000","last_fullsized":"2023-09-21T00:18:28.929143+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T02:17:26.292597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.024011+0000","last_change":"2023-09-21T00:18:27.111791+0000","last_active":"2023-09-21T00:18:29.024011+0000","last_peered":"2023-09-21T00:18:29.024011+0000","last_clean":"2023-09-21T00:18:29.024011+0000","last_became_active":"2023-09-21T00:18:27.111467+0000","last_became_peered":"2023-09-21T00:18:27.111467+0000","last_unstale":"2023-09-21T00:18:29.024011+0000","last_undegraded":"2023-09-21T00:18:29.024011+0000","last_fullsized":"2023-09-21T00:18:29.024011+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T02:17:25.285459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.928410+0000","last_change":"2023-09-21T00:18:27.942329+0000","last_active":"2023-09-21T00:18:28.928410+0000","last_peered":"2023-09-21T00:18:28.928410+0000","last_clean":"2023-09-21T00:18:28.928410+0000","last_became_active":"2023-09-21T00:18:27.942003+0000","last_became_peered":"2023-09-21T00:18:27.942003+0000","last_unstale":"2023-09-21T00:18:28.928410+0000","last_undegraded":"2023-09-21T00:18:28.928410+0000","last_fullsized":"2023-09-21T00:18:28.928410+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:49:45.951706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.928968+0000","last_change":"2023-09-21T00:18:27.103750+0000","last_active":"2023-09-21T00:18:28.928968+0000","last_peered":"2023-09-21T00:18:28.928968+0000","last_clean":"2023-09-21T00:18:28.928968+0000","last_became_active":"2023-09-21T00:18:27.103490+0000","last_became_peered":"2023-09-21T00:18:27.103490+0000","last_unstale":"2023-09-21T00:18:28.928968+0000","last_undegraded":"2023-09-21T00:18:28.928968+0000","last_fullsized":"2023-09-21T00:18:28.928968+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T02:57:18.894565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.024011+0000","last_change":"2023-09-21T00:18:27.937840+0000","last_active":"2023-09-21T00:18:29.024011+0000","last_peered":"2023-09-21T00:18:29.024011+0000","last_clean":"2023-09-21T00:18:29.024011+0000","last_became_active":"2023-09-21T00:18:27.937538+0000","last_became_peered":"2023-09-21T00:18:27.937538+0000","last_unstale":"2023-09-21T00:18:29.024011+0000","last_undegraded":"2023-09-21T00:18:29.024011+0000","last_fullsized":"2023-09-21T00:18:29.024011+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:47:40.029238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025077+0000","last_change":"2023-09-21T00:18:27.118292+0000","last_active":"2023-09-21T00:18:29.025077+0000","last_peered":"2023-09-21T00:18:29.025077+0000","last_clean":"2023-09-21T00:18:29.025077+0000","last_became_active":"2023-09-21T00:18:27.118039+0000","last_became_peered":"2023-09-21T00:18:27.118039+0000","last_unstale":"2023-09-21T00:18:29.025077+0000","last_undegraded":"2023-09-21T00:18:29.025077+0000","last_fullsized":"2023-09-21T00:18:29.025077+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:10:37.093580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025187+0000","last_change":"2023-09-21T00:18:27.948240+0000","last_active":"2023-09-21T00:18:29.025187+0000","last_peered":"2023-09-21T00:18:29.025187+0000","last_clean":"2023-09-21T00:18:29.025187+0000","last_became_active":"2023-09-21T00:18:27.947658+0000","last_became_peered":"2023-09-21T00:18:27.947658+0000","last_unstale":"2023-09-21T00:18:29.025187+0000","last_undegraded":"2023-09-21T00:18:29.025187+0000","last_fullsized":"2023-09-21T00:18:29.025187+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T04:19:13.224421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025653+0000","last_change":"2023-09-21T00:18:27.117533+0000","last_active":"2023-09-21T00:18:29.025653+0000","last_peered":"2023-09-21T00:18:29.025653+0000","last_clean":"2023-09-21T00:18:29.025653+0000","last_became_active":"2023-09-21T00:18:27.117182+0000","last_became_peered":"2023-09-21T00:18:27.117182+0000","last_unstale":"2023-09-21T00:18:29.025653+0000","last_undegraded":"2023-09-21T00:18:29.025653+0000","last_fullsized":"2023-09-21T00:18:29.025653+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:11:39.012521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.929220+0000","last_change":"2023-09-21T00:18:27.941247+0000","last_active":"2023-09-21T00:18:28.929220+0000","last_peered":"2023-09-21T00:18:28.929220+0000","last_clean":"2023-09-21T00:18:28.929220+0000","last_became_active":"2023-09-21T00:18:27.940452+0000","last_became_peered":"2023-09-21T00:18:27.940452+0000","last_unstale":"2023-09-21T00:18:28.929220+0000","last_undegraded":"2023-09-21T00:18:28.929220+0000","last_fullsized":"2023-09-21T00:18:28.929220+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T04:37:38.137258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.023652+0000","last_change":"2023-09-21T00:18:27.117578+0000","last_active":"2023-09-21T00:18:29.023652+0000","last_peered":"2023-09-21T00:18:29.023652+0000","last_clean":"2023-09-21T00:18:29.023652+0000","last_became_active":"2023-09-21T00:18:27.117301+0000","last_became_peered":"2023-09-21T00:18:27.117301+0000","last_unstale":"2023-09-21T00:18:29.023652+0000","last_undegraded":"2023-09-21T00:18:29.023652+0000","last_fullsized":"2023-09-21T00:18:29.023652+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:47:39.022100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.928083+0000","last_change":"2023-09-21T00:18:27.939945+0000","last_active":"2023-09-21T00:18:28.928083+0000","last_peered":"2023-09-21T00:18:28.928083+0000","last_clean":"2023-09-21T00:18:28.928083+0000","last_became_active":"2023-09-21T00:18:27.939597+0000","last_became_peered":"2023-09-21T00:18:27.939597+0000","last_unstale":"2023-09-21T00:18:28.928083+0000","last_undegraded":"2023-09-21T00:18:28.928083+0000","last_fullsized":"2023-09-21T00:18:28.928083+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T11:12:02.265864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.928663+0000","last_change":"2023-09-21T00:18:27.113838+0000","last_active":"2023-09-21T00:18:28.928663+0000","last_peered":"2023-09-21T00:18:28.928663+0000","last_clean":"2023-09-21T00:18:28.928663+0000","last_became_active":"2023-09-21T00:18:27.113510+0000","last_became_peered":"2023-09-21T00:18:27.113510+0000","last_unstale":"2023-09-21T00:18:28.928663+0000","last_undegraded":"2023-09-21T00:18:28.928663+0000","last_fullsized":"2023-09-21T00:18:28.928663+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T11:58:28.364652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.024699+0000","last_change":"2023-09-21T00:18:27.945850+0000","last_active":"2023-09-21T00:18:29.024699+0000","last_peered":"2023-09-21T00:18:29.024699+0000","last_clean":"2023-09-21T00:18:29.024699+0000","last_became_active":"2023-09-21T00:18:27.945453+0000","last_became_peered":"2023-09-21T00:18:27.945453+0000","last_unstale":"2023-09-21T00:18:29.024699+0000","last_undegraded":"2023-09-21T00:18:29.024699+0000","last_fullsized":"2023-09-21T00:18:29.024699+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T07:50:06.336846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.928452+0000","last_change":"2023-09-21T00:18:27.106295+0000","last_active":"2023-09-21T00:18:28.928452+0000","last_peered":"2023-09-21T00:18:28.928452+0000","last_clean":"2023-09-21T00:18:28.928452+0000","last_became_active":"2023-09-21T00:18:27.105998+0000","last_became_peered":"2023-09-21T00:18:27.105998+0000","last_unstale":"2023-09-21T00:18:28.928452+0000","last_undegraded":"2023-09-21T00:18:28.928452+0000","last_fullsized":"2023-09-21T00:18:28.928452+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:50:21.507060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025318+0000","last_change":"2023-09-21T00:18:27.947185+0000","last_active":"2023-09-21T00:18:29.025318+0000","last_peered":"2023-09-21T00:18:29.025318+0000","last_clean":"2023-09-21T00:18:29.025318+0000","last_became_active":"2023-09-21T00:18:27.946817+0000","last_became_peered":"2023-09-21T00:18:27.946817+0000","last_unstale":"2023-09-21T00:18:29.025318+0000","last_undegraded":"2023-09-21T00:18:29.025318+0000","last_fullsized":"2023-09-21T00:18:29.025318+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T02:57:17.997529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025921+0000","last_change":"2023-09-21T00:18:27.115791+0000","last_active":"2023-09-21T00:18:29.025921+0000","last_peered":"2023-09-21T00:18:29.025921+0000","last_clean":"2023-09-21T00:18:29.025921+0000","last_became_active":"2023-09-21T00:18:27.115388+0000","last_became_peered":"2023-09-21T00:18:27.115388+0000","last_unstale":"2023-09-21T00:18:29.025921+0000","last_undegraded":"2023-09-21T00:18:29.025921+0000","last_fullsized":"2023-09-21T00:18:29.025921+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:50:21.507060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.024263+0000","last_change":"2023-09-21T00:18:27.938479+0000","last_active":"2023-09-21T00:18:29.024263+0000","last_peered":"2023-09-21T00:18:29.024263+0000","last_clean":"2023-09-21T00:18:29.024263+0000","last_became_active":"2023-09-21T00:18:27.938179+0000","last_became_peered":"2023-09-21T00:18:27.938179+0000","last_unstale":"2023-09-21T00:18:29.024263+0000","last_undegraded":"2023-09-21T00:18:29.024263+0000","last_fullsized":"2023-09-21T00:18:29.024263+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:10:38.100718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025848+0000","last_change":"2023-09-21T00:18:27.120149+0000","last_active":"2023-09-21T00:18:29.025848+0000","last_peered":"2023-09-21T00:18:29.025848+0000","last_clean":"2023-09-21T00:18:29.025848+0000","last_became_active":"2023-09-21T00:18:27.119849+0000","last_became_peered":"2023-09-21T00:18:27.119849+0000","last_unstale":"2023-09-21T00:18:29.025848+0000","last_undegraded":"2023-09-21T00:18:29.025848+0000","last_fullsized":"2023-09-21T00:18:29.025848+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T07:26:48.708858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.929641+0000","last_change":"2023-09-21T00:18:27.934345+0000","last_active":"2023-09-21T00:18:28.929641+0000","last_peered":"2023-09-21T00:18:28.929641+0000","last_clean":"2023-09-21T00:18:28.929641+0000","last_became_active":"2023-09-21T00:18:27.934068+0000","last_became_peered":"2023-09-21T00:18:27.934068+0000","last_unstale":"2023-09-21T00:18:28.929641+0000","last_undegraded":"2023-09-21T00:18:28.929641+0000","last_fullsized":"2023-09-21T00:18:28.929641+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T04:38:30.921844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.928009+0000","last_change":"2023-09-21T00:18:27.112623+0000","last_active":"2023-09-21T00:18:28.928009+0000","last_peered":"2023-09-21T00:18:28.928009+0000","last_clean":"2023-09-21T00:18:28.928009+0000","last_became_active":"2023-09-21T00:18:27.112244+0000","last_became_peered":"2023-09-21T00:18:27.112244+0000","last_unstale":"2023-09-21T00:18:28.928009+0000","last_undegraded":"2023-09-21T00:18:28.928009+0000","last_fullsized":"2023-09-21T00:18:28.928009+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T04:37:37.130120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.023807+0000","last_change":"2023-09-21T00:18:27.941502+0000","last_active":"2023-09-21T00:18:29.023807+0000","last_peered":"2023-09-21T00:18:29.023807+0000","last_clean":"2023-09-21T00:18:29.023807+0000","last_became_active":"2023-09-21T00:18:27.941162+0000","last_became_peered":"2023-09-21T00:18:27.941162+0000","last_unstale":"2023-09-21T00:18:29.023807+0000","last_undegraded":"2023-09-21T00:18:29.023807+0000","last_fullsized":"2023-09-21T00:18:29.023807+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:13:05.004005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.928176+0000","last_change":"2023-09-21T00:18:27.117885+0000","last_active":"2023-09-21T00:18:28.928176+0000","last_peered":"2023-09-21T00:18:28.928176+0000","last_clean":"2023-09-21T00:18:28.928176+0000","last_became_active":"2023-09-21T00:18:27.117588+0000","last_became_peered":"2023-09-21T00:18:27.117588+0000","last_unstale":"2023-09-21T00:18:28.928176+0000","last_undegraded":"2023-09-21T00:18:28.928176+0000","last_fullsized":"2023-09-21T00:18:28.928176+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T04:38:29.914706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.927602+0000","last_change":"2023-09-21T00:18:27.940537+0000","last_active":"2023-09-21T00:18:28.927602+0000","last_peered":"2023-09-21T00:18:28.927602+0000","last_clean":"2023-09-21T00:18:28.927602+0000","last_became_active":"2023-09-21T00:18:27.940244+0000","last_became_peered":"2023-09-21T00:18:27.940244+0000","last_unstale":"2023-09-21T00:18:28.927602+0000","last_undegraded":"2023-09-21T00:18:28.927602+0000","last_fullsized":"2023-09-21T00:18:28.927602+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T11:06:28.805733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.023624+0000","last_change":"2023-09-21T00:18:27.115452+0000","last_active":"2023-09-21T00:18:29.023624+0000","last_peered":"2023-09-21T00:18:29.023624+0000","last_clean":"2023-09-21T00:18:29.023624+0000","last_became_active":"2023-09-21T00:18:27.115087+0000","last_became_peered":"2023-09-21T00:18:27.115087+0000","last_unstale":"2023-09-21T00:18:29.023624+0000","last_undegraded":"2023-09-21T00:18:29.023624+0000","last_fullsized":"2023-09-21T00:18:29.023624+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T07:26:48.708858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025432+0000","last_change":"2023-09-21T00:18:27.947991+0000","last_active":"2023-09-21T00:18:29.025432+0000","last_peered":"2023-09-21T00:18:29.025432+0000","last_clean":"2023-09-21T00:18:29.025432+0000","last_became_active":"2023-09-21T00:18:27.947023+0000","last_became_peered":"2023-09-21T00:18:27.947023+0000","last_unstale":"2023-09-21T00:18:29.025432+0000","last_undegraded":"2023-09-21T00:18:29.025432+0000","last_fullsized":"2023-09-21T00:18:29.025432+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:17:22.057023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.928569+0000","last_change":"2023-09-21T00:18:27.109060+0000","last_active":"2023-09-21T00:18:28.928569+0000","last_peered":"2023-09-21T00:18:28.928569+0000","last_clean":"2023-09-21T00:18:28.928569+0000","last_became_active":"2023-09-21T00:18:27.108747+0000","last_became_peered":"2023-09-21T00:18:27.108747+0000","last_unstale":"2023-09-21T00:18:28.928569+0000","last_undegraded":"2023-09-21T00:18:28.928569+0000","last_fullsized":"2023-09-21T00:18:28.928569+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:51:05.667271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.927833+0000","last_change":"2023-09-21T00:18:27.940611+0000","last_active":"2023-09-21T00:18:28.927833+0000","last_peered":"2023-09-21T00:18:28.927833+0000","last_clean":"2023-09-21T00:18:28.927833+0000","last_became_active":"2023-09-21T00:18:27.940252+0000","last_became_peered":"2023-09-21T00:18:27.940252+0000","last_unstale":"2023-09-21T00:18:28.927833+0000","last_undegraded":"2023-09-21T00:18:28.927833+0000","last_fullsized":"2023-09-21T00:18:28.927833+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T02:49:18.802099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025014+0000","last_change":"2023-09-21T00:18:27.116043+0000","last_active":"2023-09-21T00:18:29.025014+0000","last_peered":"2023-09-21T00:18:29.025014+0000","last_clean":"2023-09-21T00:18:29.025014+0000","last_became_active":"2023-09-21T00:18:27.115743+0000","last_became_peered":"2023-09-21T00:18:27.115743+0000","last_unstale":"2023-09-21T00:18:29.025014+0000","last_undegraded":"2023-09-21T00:18:29.025014+0000","last_fullsized":"2023-09-21T00:18:29.025014+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:07:03.287374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.927757+0000","last_change":"2023-09-21T00:18:27.945942+0000","last_active":"2023-09-21T00:18:28.927757+0000","last_peered":"2023-09-21T00:18:28.927757+0000","last_clean":"2023-09-21T00:18:28.927757+0000","last_became_active":"2023-09-21T00:18:27.945714+0000","last_became_peered":"2023-09-21T00:18:27.945714+0000","last_unstale":"2023-09-21T00:18:28.927757+0000","last_undegraded":"2023-09-21T00:18:28.927757+0000","last_fullsized":"2023-09-21T00:18:28.927757+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:30:36.740692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025968+0000","last_change":"2023-09-21T00:18:27.112969+0000","last_active":"2023-09-21T00:18:29.025968+0000","last_peered":"2023-09-21T00:18:29.025968+0000","last_clean":"2023-09-21T00:18:29.025968+0000","last_became_active":"2023-09-21T00:18:27.112703+0000","last_became_peered":"2023-09-21T00:18:27.112703+0000","last_unstale":"2023-09-21T00:18:29.025968+0000","last_undegraded":"2023-09-21T00:18:29.025968+0000","last_fullsized":"2023-09-21T00:18:29.025968+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T02:57:16.990391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025694+0000","last_change":"2023-09-21T00:18:27.940299+0000","last_active":"2023-09-21T00:18:29.025694+0000","last_peered":"2023-09-21T00:18:29.025694+0000","last_clean":"2023-09-21T00:18:29.025694+0000","last_became_active":"2023-09-21T00:18:27.939615+0000","last_became_peered":"2023-09-21T00:18:27.939615+0000","last_unstale":"2023-09-21T00:18:29.025694+0000","last_undegraded":"2023-09-21T00:18:29.025694+0000","last_fullsized":"2023-09-21T00:18:29.025694+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T11:12:02.265864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.929151+0000","last_change":"2023-09-21T00:18:27.112815+0000","last_active":"2023-09-21T00:18:28.929151+0000","last_peered":"2023-09-21T00:18:28.929151+0000","last_clean":"2023-09-21T00:18:28.929151+0000","last_became_active":"2023-09-21T00:18:27.112558+0000","last_became_peered":"2023-09-21T00:18:27.112558+0000","last_unstale":"2023-09-21T00:18:28.929151+0000","last_undegraded":"2023-09-21T00:18:28.929151+0000","last_fullsized":"2023-09-21T00:18:28.929151+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:11:39.012521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.929250+0000","last_change":"2023-09-21T00:18:27.939759+0000","last_active":"2023-09-21T00:18:28.929250+0000","last_peered":"2023-09-21T00:18:28.929250+0000","last_clean":"2023-09-21T00:18:28.929250+0000","last_became_active":"2023-09-21T00:18:27.939481+0000","last_became_peered":"2023-09-21T00:18:27.939481+0000","last_unstale":"2023-09-21T00:18:28.929250+0000","last_undegraded":"2023-09-21T00:18:28.929250+0000","last_fullsized":"2023-09-21T00:18:28.929250+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:07:04.294512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025014+0000","last_change":"2023-09-21T00:18:27.113973+0000","last_active":"2023-09-21T00:18:29.025014+0000","last_peered":"2023-09-21T00:18:29.025014+0000","last_clean":"2023-09-21T00:18:29.025014+0000","last_became_active":"2023-09-21T00:18:27.113769+0000","last_became_peered":"2023-09-21T00:18:27.113769+0000","last_unstale":"2023-09-21T00:18:29.025014+0000","last_undegraded":"2023-09-21T00:18:29.025014+0000","last_fullsized":"2023-09-21T00:18:29.025014+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:51:05.667271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.024954+0000","last_change":"2023-09-21T00:18:27.934395+0000","last_active":"2023-09-21T00:18:29.024954+0000","last_peered":"2023-09-21T00:18:29.024954+0000","last_clean":"2023-09-21T00:18:29.024954+0000","last_became_active":"2023-09-21T00:18:27.934129+0000","last_became_peered":"2023-09-21T00:18:27.934129+0000","last_unstale":"2023-09-21T00:18:29.024954+0000","last_undegraded":"2023-09-21T00:18:29.024954+0000","last_fullsized":"2023-09-21T00:18:29.024954+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:39:17.292819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.023770+0000","last_change":"2023-09-21T00:18:27.113505+0000","last_active":"2023-09-21T00:18:29.023770+0000","last_peered":"2023-09-21T00:18:29.023770+0000","last_clean":"2023-09-21T00:18:29.023770+0000","last_became_active":"2023-09-21T00:18:27.113162+0000","last_became_peered":"2023-09-21T00:18:27.113162+0000","last_unstale":"2023-09-21T00:18:29.023770+0000","last_undegraded":"2023-09-21T00:18:29.023770+0000","last_fullsized":"2023-09-21T00:18:29.023770+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:07:03.287374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.024902+0000","last_change":"2023-09-21T00:18:27.948778+0000","last_active":"2023-09-21T00:18:29.024902+0000","last_peered":"2023-09-21T00:18:29.024902+0000","last_clean":"2023-09-21T00:18:29.024902+0000","last_became_active":"2023-09-21T00:18:27.948336+0000","last_became_peered":"2023-09-21T00:18:27.948336+0000","last_unstale":"2023-09-21T00:18:29.024902+0000","last_undegraded":"2023-09-21T00:18:29.024902+0000","last_fullsized":"2023-09-21T00:18:29.024902+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T10:38:53.559631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.024302+0000","last_change":"2023-09-21T00:18:27.118154+0000","last_active":"2023-09-21T00:18:29.024302+0000","last_peered":"2023-09-21T00:18:29.024302+0000","last_clean":"2023-09-21T00:18:29.024302+0000","last_became_active":"2023-09-21T00:18:27.117854+0000","last_became_peered":"2023-09-21T00:18:27.117854+0000","last_unstale":"2023-09-21T00:18:29.024302+0000","last_undegraded":"2023-09-21T00:18:29.024302+0000","last_fullsized":"2023-09-21T00:18:29.024302+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:38:30.140442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.023860+0000","last_change":"2023-09-21T00:18:27.941403+0000","last_active":"2023-09-21T00:18:29.023860+0000","last_peered":"2023-09-21T00:18:29.023860+0000","last_clean":"2023-09-21T00:18:29.023860+0000","last_became_active":"2023-09-21T00:18:27.941073+0000","last_became_peered":"2023-09-21T00:18:27.941073+0000","last_unstale":"2023-09-21T00:18:29.023860+0000","last_undegraded":"2023-09-21T00:18:29.023860+0000","last_fullsized":"2023-09-21T00:18:29.023860+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T04:37:38.137258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025169+0000","last_change":"2023-09-21T00:18:27.111877+0000","last_active":"2023-09-21T00:18:29.025169+0000","last_peered":"2023-09-21T00:18:29.025169+0000","last_clean":"2023-09-21T00:18:29.025169+0000","last_became_active":"2023-09-21T00:18:27.111562+0000","last_became_peered":"2023-09-21T00:18:27.111562+0000","last_unstale":"2023-09-21T00:18:29.025169+0000","last_undegraded":"2023-09-21T00:18:29.025169+0000","last_fullsized":"2023-09-21T00:18:29.025169+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:18:13.474101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025695+0000","last_change":"2023-09-21T00:18:27.944886+0000","last_active":"2023-09-21T00:18:29.025695+0000","last_peered":"2023-09-21T00:18:29.025695+0000","last_clean":"2023-09-21T00:18:29.025695+0000","last_became_active":"2023-09-21T00:18:27.944559+0000","last_became_peered":"2023-09-21T00:18:27.944559+0000","last_unstale":"2023-09-21T00:18:29.025695+0000","last_undegraded":"2023-09-21T00:18:29.025695+0000","last_fullsized":"2023-09-21T00:18:29.025695+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T03:59:15.508085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025674+0000","last_change":"2023-09-21T00:18:27.116131+0000","last_active":"2023-09-21T00:18:29.025674+0000","last_peered":"2023-09-21T00:18:29.025674+0000","last_clean":"2023-09-21T00:18:29.025674+0000","last_became_active":"2023-09-21T00:18:27.115414+0000","last_became_peered":"2023-09-21T00:18:27.115414+0000","last_unstale":"2023-09-21T00:18:29.025674+0000","last_undegraded":"2023-09-21T00:18:29.025674+0000","last_fullsized":"2023-09-21T00:18:29.025674+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:13:03.996867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.927957+0000","last_change":"2023-09-21T00:18:27.935860+0000","last_active":"2023-09-21T00:18:28.927957+0000","last_peered":"2023-09-21T00:18:28.927957+0000","last_clean":"2023-09-21T00:18:28.927957+0000","last_became_active":"2023-09-21T00:18:27.935574+0000","last_became_peered":"2023-09-21T00:18:27.935574+0000","last_unstale":"2023-09-21T00:18:28.927957+0000","last_undegraded":"2023-09-21T00:18:28.927957+0000","last_fullsized":"2023-09-21T00:18:28.927957+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T10:18:06.702966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.023409+0000","last_change":"2023-09-21T00:18:27.108540+0000","last_active":"2023-09-21T00:18:29.023409+0000","last_peered":"2023-09-21T00:18:29.023409+0000","last_clean":"2023-09-21T00:18:29.023409+0000","last_became_active":"2023-09-21T00:18:27.108228+0000","last_became_peered":"2023-09-21T00:18:27.108228+0000","last_unstale":"2023-09-21T00:18:29.023409+0000","last_undegraded":"2023-09-21T00:18:29.023409+0000","last_fullsized":"2023-09-21T00:18:29.023409+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:05:05.977799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.023775+0000","last_change":"2023-09-21T00:18:27.942893+0000","last_active":"2023-09-21T00:18:29.023775+0000","last_peered":"2023-09-21T00:18:29.023775+0000","last_clean":"2023-09-21T00:18:29.023775+0000","last_became_active":"2023-09-21T00:18:27.942623+0000","last_became_peered":"2023-09-21T00:18:27.942623+0000","last_unstale":"2023-09-21T00:18:29.023775+0000","last_undegraded":"2023-09-21T00:18:29.023775+0000","last_fullsized":"2023-09-21T00:18:29.023775+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T02:57:17.997529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.026002+0000","last_change":"2023-09-21T00:18:27.120147+0000","last_active":"2023-09-21T00:18:29.026002+0000","last_peered":"2023-09-21T00:18:29.026002+0000","last_clean":"2023-09-21T00:18:29.026002+0000","last_became_active":"2023-09-21T00:18:27.119861+0000","last_became_peered":"2023-09-21T00:18:27.119861+0000","last_unstale":"2023-09-21T00:18:29.026002+0000","last_undegraded":"2023-09-21T00:18:29.026002+0000","last_fullsized":"2023-09-21T00:18:29.026002+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T12:00:58.847782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025495+0000","last_change":"2023-09-21T00:18:27.947567+0000","last_active":"2023-09-21T00:18:29.025495+0000","last_peered":"2023-09-21T00:18:29.025495+0000","last_clean":"2023-09-21T00:18:29.025495+0000","last_became_active":"2023-09-21T00:18:27.947257+0000","last_became_peered":"2023-09-21T00:18:27.947257+0000","last_unstale":"2023-09-21T00:18:29.025495+0000","last_undegraded":"2023-09-21T00:18:29.025495+0000","last_fullsized":"2023-09-21T00:18:29.025495+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T12:09:35.018753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025110+0000","last_change":"2023-09-21T00:18:27.113393+0000","last_active":"2023-09-21T00:18:29.025110+0000","last_peered":"2023-09-21T00:18:29.025110+0000","last_clean":"2023-09-21T00:18:29.025110+0000","last_became_active":"2023-09-21T00:18:27.113134+0000","last_became_peered":"2023-09-21T00:18:27.113134+0000","last_unstale":"2023-09-21T00:18:29.025110+0000","last_undegraded":"2023-09-21T00:18:29.025110+0000","last_fullsized":"2023-09-21T00:18:29.025110+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:18:48.718755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.927870+0000","last_change":"2023-09-21T00:18:27.940795+0000","last_active":"2023-09-21T00:18:28.927870+0000","last_peered":"2023-09-21T00:18:28.927870+0000","last_clean":"2023-09-21T00:18:28.927870+0000","last_became_active":"2023-09-21T00:18:27.940503+0000","last_became_peered":"2023-09-21T00:18:27.940503+0000","last_unstale":"2023-09-21T00:18:28.927870+0000","last_undegraded":"2023-09-21T00:18:28.927870+0000","last_fullsized":"2023-09-21T00:18:28.927870+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T04:19:13.224421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.024426+0000","last_change":"2023-09-21T00:18:27.115932+0000","last_active":"2023-09-21T00:18:29.024426+0000","last_peered":"2023-09-21T00:18:29.024426+0000","last_clean":"2023-09-21T00:18:29.024426+0000","last_became_active":"2023-09-21T00:18:27.115681+0000","last_became_peered":"2023-09-21T00:18:27.115681+0000","last_unstale":"2023-09-21T00:18:29.024426+0000","last_undegraded":"2023-09-21T00:18:29.024426+0000","last_fullsized":"2023-09-21T00:18:29.024426+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T07:26:48.708858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.023864+0000","last_change":"2023-09-21T00:18:27.938896+0000","last_active":"2023-09-21T00:18:29.023864+0000","last_peered":"2023-09-21T00:18:29.023864+0000","last_clean":"2023-09-21T00:18:29.023864+0000","last_became_active":"2023-09-21T00:18:27.937817+0000","last_became_peered":"2023-09-21T00:18:27.937817+0000","last_unstale":"2023-09-21T00:18:29.023864+0000","last_undegraded":"2023-09-21T00:18:29.023864+0000","last_fullsized":"2023-09-21T00:18:29.023864+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T08:07:04.294512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.024336+0000","last_change":"2023-09-21T00:18:27.114956+0000","last_active":"2023-09-21T00:18:29.024336+0000","last_peered":"2023-09-21T00:18:29.024336+0000","last_clean":"2023-09-21T00:18:29.024336+0000","last_became_active":"2023-09-21T00:18:27.114651+0000","last_became_peered":"2023-09-21T00:18:27.114651+0000","last_unstale":"2023-09-21T00:18:29.024336+0000","last_undegraded":"2023-09-21T00:18:29.024336+0000","last_fullsized":"2023-09-21T00:18:29.024336+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T01:32:48.435724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.023568+0000","last_change":"2023-09-21T00:18:27.946252+0000","last_active":"2023-09-21T00:18:29.023568+0000","last_peered":"2023-09-21T00:18:29.023568+0000","last_clean":"2023-09-21T00:18:29.023568+0000","last_became_active":"2023-09-21T00:18:27.945938+0000","last_became_peered":"2023-09-21T00:18:27.945938+0000","last_unstale":"2023-09-21T00:18:29.023568+0000","last_undegraded":"2023-09-21T00:18:29.023568+0000","last_fullsized":"2023-09-21T00:18:29.023568+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T10:38:53.559631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.928876+0000","last_change":"2023-09-21T00:18:27.109581+0000","last_active":"2023-09-21T00:18:28.928876+0000","last_peered":"2023-09-21T00:18:28.928876+0000","last_clean":"2023-09-21T00:18:28.928876+0000","last_became_active":"2023-09-21T00:18:27.109321+0000","last_became_peered":"2023-09-21T00:18:27.109321+0000","last_unstale":"2023-09-21T00:18:28.928876+0000","last_undegraded":"2023-09-21T00:18:28.928876+0000","last_fullsized":"2023-09-21T00:18:28.928876+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T10:22:56.463693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.929162+0000","last_change":"2023-09-21T00:18:27.941084+0000","last_active":"2023-09-21T00:18:28.929162+0000","last_peered":"2023-09-21T00:18:28.929162+0000","last_clean":"2023-09-21T00:18:28.929162+0000","last_became_active":"2023-09-21T00:18:27.940418+0000","last_became_peered":"2023-09-21T00:18:27.940418+0000","last_unstale":"2023-09-21T00:18:28.929162+0000","last_undegraded":"2023-09-21T00:18:28.929162+0000","last_fullsized":"2023-09-21T00:18:28.929162+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T06:13:05.004005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.928767+0000","last_change":"2023-09-21T00:18:27.103739+0000","last_active":"2023-09-21T00:18:28.928767+0000","last_peered":"2023-09-21T00:18:28.928767+0000","last_clean":"2023-09-21T00:18:28.928767+0000","last_became_active":"2023-09-21T00:18:27.103478+0000","last_became_peered":"2023-09-21T00:18:27.103478+0000","last_unstale":"2023-09-21T00:18:28.928767+0000","last_undegraded":"2023-09-21T00:18:28.928767+0000","last_fullsized":"2023-09-21T00:18:28.928767+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T07:50:05.329708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025499+0000","last_change":"2023-09-21T00:18:27.946004+0000","last_active":"2023-09-21T00:18:29.025499+0000","last_peered":"2023-09-21T00:18:29.025499+0000","last_clean":"2023-09-21T00:18:29.025499+0000","last_became_active":"2023-09-21T00:18:27.945723+0000","last_became_peered":"2023-09-21T00:18:27.945723+0000","last_unstale":"2023-09-21T00:18:29.025499+0000","last_undegraded":"2023-09-21T00:18:29.025499+0000","last_fullsized":"2023-09-21T00:18:29.025499+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T11:06:28.805733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:28.927592+0000","last_change":"2023-09-21T00:18:27.107643+0000","last_active":"2023-09-21T00:18:28.927592+0000","last_peered":"2023-09-21T00:18:28.927592+0000","last_clean":"2023-09-21T00:18:28.927592+0000","last_became_active":"2023-09-21T00:18:27.107290+0000","last_became_peered":"2023-09-21T00:18:27.107290+0000","last_unstale":"2023-09-21T00:18:28.927592+0000","last_undegraded":"2023-09-21T00:18:28.927592+0000","last_fullsized":"2023-09-21T00:18:28.927592+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T04:17:54.871555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025900+0000","last_change":"2023-09-21T00:18:27.946921+0000","last_active":"2023-09-21T00:18:29.025900+0000","last_peered":"2023-09-21T00:18:29.025900+0000","last_clean":"2023-09-21T00:18:29.025900+0000","last_became_active":"2023-09-21T00:18:27.946653+0000","last_became_peered":"2023-09-21T00:18:27.946653+0000","last_unstale":"2023-09-21T00:18:29.025900+0000","last_undegraded":"2023-09-21T00:18:29.025900+0000","last_fullsized":"2023-09-21T00:18:29.025900+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:27.088106+0000","last_clean_scrub_stamp":"2023-09-21T00:18:27.088106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T09:16:32.648569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-21T00:18:29.025241+0000","last_change":"2023-09-21T00:18:27.117852+0000","last_active":"2023-09-21T00:18:29.025241+0000","last_peered":"2023-09-21T00:18:29.025241+0000","last_clean":"2023-09-21T00:18:29.025241+0000","last_became_active":"2023-09-21T00:18:27.117603+0000","last_became_peered":"2023-09-21T00:18:27.117603+0000","last_unstale":"2023-09-21T00:18:29.025241+0000","last_undegraded":"2023-09-21T00:18:29.025241+0000","last_fullsized":"2023-09-21T00:18:29.025241+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:18:26.080968+0000","last_clean_scrub_stamp":"2023-09-21T00:18:26.080968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T07:26:48.708858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":180,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-09-21T00:18:27.933704+0000","last_change":"2023-09-21T00:16:57.071188+0000","last_active":"2023-09-21T00:18:27.933704+0000","last_peered":"2023-09-21T00:18:27.933704+0000","last_clean":"2023-09-21T00:18:27.933704+0000","last_became_active":"2023-09-21T00:16:57.070240+0000","last_became_peered":"2023-09-21T00:16:57.070240+0000","last_unstale":"2023-09-21T00:18:27.933704+0000","last_undegraded":"2023-09-21T00:18:27.933704+0000","last_fullsized":"2023-09-21T00:18:27.933704+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T00:16:55.741965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T00:16:55.741965+0000","last_clean_scrub_stamp":"2023-09-21T00:16:55.741965+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T05:21:26.215032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1048576,"data_stored":781973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 00:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.57799999999999996}]},{"osd":1,"last update":"Thu Sep 21 00:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.54800000000000004}]},{"osd":2,"last update":"Thu Sep 21 00:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Sep 21 00:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.63300000000000001}]},{"osd":4,"last update":"Thu Sep 21 00:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.40000000000000002}]},{"osd":5,"last update":"Thu Sep 21 00:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.374},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.51000000000000001}]},{"osd":6,"last update":"Thu Sep 21 00:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.433},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.46300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":442368,"data_stored":190505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 00:17:58 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.50700000000000001}]},{"osd":1,"last update":"Thu Sep 21 00:17:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.56599999999999995}]},{"osd":2,"last update":"Thu Sep 21 00:17:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.53100000000000003}]},{"osd":3,"last update":"Thu Sep 21 00:17:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Sep 21 00:17:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.38900000000000001}]},{"osd":5,"last update":"Thu Sep 21 00:17:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.436},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.41499999999999998}]},{"osd":7,"last update":"Thu Sep 21 00:17:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.371}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":183393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 00:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.28999999999999998}]},{"osd":2,"last update":"Thu Sep 21 00:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.308},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.36799999999999999}]},{"osd":3,"last update":"Thu Sep 21 00:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":3.8849999999999998,"5min":3.8849999999999998,"15min":3.8849999999999998},"last":0.38100000000000001}]},{"osd":4,"last update":"Thu Sep 21 00:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.71199999999999997}]},{"osd":5,"last update":"Thu Sep 21 00:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":3.7650000000000001,"5min":3.7650000000000001,"15min":3.7650000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Sep 21 00:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":3.851,"5min":3.851,"15min":3.851},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.748}]},{"osd":7,"last update":"Thu Sep 21 00:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":3.8159999999999998,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":0.623}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28040,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343800,"statfs":{"total":96636764160,"available":96608051200,"internally_reserved":0,"allocated":1036288,"data_stored":780325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Sep 21 00:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.439}]},{"osd":2,"last update":"Thu Sep 21 00:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.35299999999999998}]},{"osd":3,"last update":"Thu Sep 21 00:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.315},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.33800000000000002}]},{"osd":4,"last update":"Thu Sep 21 00:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.496},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.39000000000000001}]},{"osd":5,"last update":"Thu Sep 21 00:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.45600000000000002}]},{"osd":6,"last update":"Thu Sep 21 00:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.55800000000000005}]},{"osd":7,"last update":"Thu Sep 21 00:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.47699999999999998},{"interface":"front","average":{"1min":1.637,"5min":1.637,"15min":1.637},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":19.096,"5min":19.096,"15min":19.096},"last":0.53900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":442368,"data_stored":189993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 00:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.41699999999999998}]},{"osd":1,"last update":"Thu Sep 21 00:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.35599999999999998}]},{"osd":3,"last update":"Thu Sep 21 00:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.378}]},{"osd":4,"last update":"Thu Sep 21 00:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.56999999999999995}]},{"osd":5,"last update":"Thu Sep 21 00:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.51100000000000001}]},{"osd":6,"last update":"Thu Sep 21 00:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.495},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.60099999999999998}]},{"osd":7,"last update":"Thu Sep 21 00:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.58299999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":191569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 00:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.895,"5min":1.895,"15min":1.895},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":18.942,"5min":18.942,"15min":18.942},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.39900000000000002}]},{"osd":1,"last update":"Thu Sep 21 00:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":7.3979999999999997,"5min":7.3979999999999997,"15min":7.3979999999999997},"last":0.34100000000000003},{"interface":"front","average":{"1min":1.911,"5min":1.911,"15min":1.911},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":19.001000000000001,"5min":19.001000000000001,"15min":19.001000000000001},"last":0.42099999999999999}]},{"osd":2,"last update":"Thu Sep 21 00:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":12.173,"5min":12.173,"15min":12.173},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.443}]},{"osd":4,"last update":"Thu Sep 21 00:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":1.1779999999999999}]},{"osd":5,"last update":"Thu Sep 21 00:17:57 2023","interfaces":[{"interface":"back","average":{"1min":1.544,"5min":1.544,"15min":1.544},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":12.390000000000001,"5min":12.390000000000001,"15min":12.390000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.65100000000000002}]},{"osd":6,"last update":"Thu Sep 21 00:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":1.24},{"interface":"front","average":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":12.33,"5min":12.33,"15min":12.33},"last":0.70599999999999996}]},{"osd":7,"last update":"Thu Sep 21 00:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":1.2050000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":190527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 00:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.70899999999999996}]},{"osd":1,"last update":"Thu Sep 21 00:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.72299999999999998}]},{"osd":2,"last update":"Thu Sep 21 00:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.57699999999999996}]},{"osd":3,"last update":"Thu Sep 21 00:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.69399999999999995}]},{"osd":5,"last update":"Thu Sep 21 00:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.52100000000000002}]},{"osd":6,"last update":"Thu Sep 21 00:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.63100000000000001}]},{"osd":7,"last update":"Thu Sep 21 00:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.65100000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":190035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 00:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.47899999999999998}]},{"osd":1,"last update":"Thu Sep 21 00:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.54000000000000004}]},{"osd":2,"last update":"Thu Sep 21 00:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.57799999999999996}]},{"osd":3,"last update":"Thu Sep 21 00:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.69999999999999996}]},{"osd":4,"last update":"Thu Sep 21 00:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.46000000000000002}]},{"osd":6,"last update":"Thu Sep 21 00:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.623},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.52200000000000002}]},{"osd":7,"last update":"Thu Sep 21 00:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.498},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.55300000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-21T00:18:32.669 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-21T00:18:32.671 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-09-21T00:18:32.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.830+0000 7f28272e8700 1 Processor -- start 2023-09-21T00:18:32.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.830+0000 7f28272e8700 1 -- start start 2023-09-21T00:18:32.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.831+0000 7f28272e8700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f28200b54a0 0x7f28200cc250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:32.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.831+0000 7f28272e8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f282015ecf0 con 0x7f28200cc790 2023-09-21T00:18:32.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.831+0000 7f28272e8700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f282006d290 con 0x7f282015e910 2023-09-21T00:18:32.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.831+0000 7f28272e8700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f282006d080 con 0x7f28200b54a0 2023-09-21T00:18:32.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.831+0000 7f2825885700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f28200cc790 0x7f28200b2810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59108/0 (socket says 172.21.15.59:59108) 2023-09-21T00:18:32.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.831+0000 7f2825885700 1 -- 172.21.15.59:0/3154534525 learned_addr learned my addr 172.21.15.59:0/3154534525 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:32.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.831+0000 7f2824883700 1 --2- 172.21.15.59:0/3154534525 >> v2:172.21.15.83:3300/0 conn(0x7f28200b54a0 0x7f28200cc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:32.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.832+0000 7f2817fff700 1 -- 172.21.15.59:0/3154534525 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3333576748 0 0) 0x7f282015ecf0 con 0x7f28200cc790 2023-09-21T00:18:32.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.832+0000 7f2817fff700 1 -- 172.21.15.59:0/3154534525 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f280c0035b0 con 0x7f28200cc790 2023-09-21T00:18:32.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.832+0000 7f2824883700 1 -- 172.21.15.59:0/3154534525 >> v1:172.21.15.83:6789/0 conn(0x7f282015e910 legacy=0x7f282015f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:32.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.832+0000 7f2824883700 1 -- 172.21.15.59:0/3154534525 >> v1:172.21.15.59:6789/0 conn(0x7f28200cc790 legacy=0x7f28200b2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:32.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.832+0000 7f2824883700 1 -- 172.21.15.59:0/3154534525 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f282006d570 con 0x7f28200b54a0 2023-09-21T00:18:32.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.832+0000 7f2824883700 1 --2- 172.21.15.59:0/3154534525 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f28200b54a0 0x7f28200cc250 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f281c009840 tx=0x7f281c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7d9e483a4ef6a87 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:32.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.832+0000 7f2817fff700 1 -- 172.21.15.59:0/3154534525 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c011830 con 0x7f28200b54a0 2023-09-21T00:18:32.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.832+0000 7f2817fff700 1 -- 172.21.15.59:0/3154534525 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281c011990 con 0x7f28200b54a0 2023-09-21T00:18:32.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.832+0000 7f2817fff700 1 -- 172.21.15.59:0/3154534525 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c011d20 con 0x7f28200b54a0 2023-09-21T00:18:32.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.833+0000 7f28272e8700 1 -- 172.21.15.59:0/3154534525 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f28200b54a0 msgr2=0x7f28200cc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:32.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.833+0000 7f28272e8700 1 --2- 172.21.15.59:0/3154534525 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f28200b54a0 0x7f28200cc250 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f281c009840 tx=0x7f281c009b50 comp rx=0 tx=0).stop 2023-09-21T00:18:32.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.833+0000 7f28272e8700 1 -- 172.21.15.59:0/3154534525 shutdown_connections 2023-09-21T00:18:32.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.833+0000 7f28272e8700 1 --2- 172.21.15.59:0/3154534525 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f28200b54a0 0x7f28200cc250 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:32.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.833+0000 7f28272e8700 1 -- 172.21.15.59:0/3154534525 >> 172.21.15.59:0/3154534525 conn(0x7f282006a780 msgr2=0x7f282006ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:32.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.833+0000 7f28272e8700 1 -- 172.21.15.59:0/3154534525 shutdown_connections 2023-09-21T00:18:32.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.833+0000 7f28272e8700 1 -- 172.21.15.59:0/3154534525 wait complete. 2023-09-21T00:18:32.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.834+0000 7f28272e8700 1 Processor -- start 2023-09-21T00:18:32.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.834+0000 7f28272e8700 1 -- start start 2023-09-21T00:18:32.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.835+0000 7f28272e8700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f28200b54a0 0x7f28200af340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:32.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.835+0000 7f28272e8700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f28200cc790 0x7f28200b1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:32.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.835+0000 7f28272e8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f282015e910 0x7f2820154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:32.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.835+0000 7f28272e8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2820152c60 con 0x7f282015e910 2023-09-21T00:18:32.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.835+0000 7f28272e8700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28200b2430 con 0x7f28200b54a0 2023-09-21T00:18:32.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.835+0000 7f28272e8700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28200b2710 con 0x7f28200cc790 2023-09-21T00:18:32.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.835+0000 7f2825885700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f282015e910 0x7f2820154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:32.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.835+0000 7f2825885700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f282015e910 0x7f2820154880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53546/0 (socket says 172.21.15.59:53546) 2023-09-21T00:18:32.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.835+0000 7f2825885700 1 -- 172.21.15.59:0/1297829952 learned_addr learned my addr 172.21.15.59:0/1297829952 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:32.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.835+0000 7f2825084700 1 --2- 172.21.15.59:0/1297829952 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f28200b54a0 0x7f28200af340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:32.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.835+0000 7f2824883700 1 --2- 172.21.15.59:0/1297829952 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f28200cc790 0x7f28200b1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:32.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.835+0000 7f2825885700 1 -- 172.21.15.59:0/1297829952 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f28200cc790 msgr2=0x7f28200b1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:32.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.835+0000 7f2825885700 1 --2- 172.21.15.59:0/1297829952 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f28200cc790 0x7f28200b1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:32.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.835+0000 7f2825885700 1 -- 172.21.15.59:0/1297829952 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f28200b54a0 msgr2=0x7f28200af340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:32.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.835+0000 7f2825885700 1 --2- 172.21.15.59:0/1297829952 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f28200b54a0 0x7f28200af340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:32.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.835+0000 7f2825885700 1 -- 172.21.15.59:0/1297829952 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f281c0094a0 con 0x7f282015e910 2023-09-21T00:18:32.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.835+0000 7f2825885700 1 --2- 172.21.15.59:0/1297829952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f282015e910 0x7f2820154880 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f28180014b0 tx=0x7f281800ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:32.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.836+0000 7f2815ffb700 1 -- 172.21.15.59:0/1297829952 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281800a9e0 con 0x7f282015e910 2023-09-21T00:18:32.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.836+0000 7f2815ffb700 1 -- 172.21.15.59:0/1297829952 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281800ab40 con 0x7f282015e910 2023-09-21T00:18:32.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.836+0000 7f28272e8700 1 -- 172.21.15.59:0/1297829952 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28200b29f0 con 0x7f282015e910 2023-09-21T00:18:32.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.836+0000 7f2815ffb700 1 -- 172.21.15.59:0/1297829952 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2818012400 con 0x7f282015e910 2023-09-21T00:18:32.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.836+0000 7f28272e8700 1 -- 172.21.15.59:0/1297829952 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28200af880 con 0x7f282015e910 2023-09-21T00:18:32.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.837+0000 7f28272e8700 1 -- 172.21.15.59:0/1297829952 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28200afa70 con 0x7f282015e910 2023-09-21T00:18:32.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.837+0000 7f2815ffb700 1 -- 172.21.15.59:0/1297829952 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f2818007d50 con 0x7f282015e910 2023-09-21T00:18:32.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.838+0000 7f2815ffb700 1 --2- 172.21.15.59:0/1297829952 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f280406ae30 0x7f280406d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:32.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.838+0000 7f2815ffb700 1 -- 172.21.15.59:0/1297829952 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2818089020 con 0x7f282015e910 2023-09-21T00:18:32.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.838+0000 7f2825084700 1 --2- 172.21.15.59:0/1297829952 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f280406ae30 0x7f280406d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:32.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.838+0000 7f2825084700 1 --2- 172.21.15.59:0/1297829952 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f280406ae30 0x7f280406d2f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2810007fd0 tx=0x7f2810009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:32.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:32.842+0000 7f2815ffb700 1 -- 172.21.15.59:0/1297829952 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f2818053f70 con 0x7f282015e910 2023-09-21T00:18:33.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.125+0000 7f28272e8700 1 -- 172.21.15.59:0/1297829952 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f282006b780 con 0x7f282015e910 2023-09-21T00:18:33.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.128+0000 7f2815ffb700 1 -- 172.21.15.59:0/1297829952 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) v1 ==== 190+0+147 (secure 0 0 0) 0x7f2818017020 con 0x7f282015e910 2023-09-21T00:18:33.129 INFO:teuthology.orchestra.run.smithi059.stdout:[client.0] 2023-09-21T00:18:33.129 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQBJiwtlXkIrIxAAhtDnCTE6nihKV14aqR/afg== 2023-09-21T00:18:33.129 INFO:teuthology.orchestra.run.smithi059.stdout: caps mds = "allow" 2023-09-21T00:18:33.129 INFO:teuthology.orchestra.run.smithi059.stdout: caps mon = "allow r" 2023-09-21T00:18:33.130 INFO:teuthology.orchestra.run.smithi059.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-09-21T00:18:33.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.130+0000 7f28272e8700 1 -- 172.21.15.59:0/1297829952 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f280406ae30 msgr2=0x7f280406d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:33.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.130+0000 7f28272e8700 1 --2- 172.21.15.59:0/1297829952 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f280406ae30 0x7f280406d2f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2810007fd0 tx=0x7f2810009040 comp rx=0 tx=0).stop 2023-09-21T00:18:33.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.130+0000 7f28272e8700 1 -- 172.21.15.59:0/1297829952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f282015e910 msgr2=0x7f2820154880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:33.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.130+0000 7f28272e8700 1 --2- 172.21.15.59:0/1297829952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f282015e910 0x7f2820154880 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f28180014b0 tx=0x7f281800ce90 comp rx=0 tx=0).stop 2023-09-21T00:18:33.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.130+0000 7f28272e8700 1 -- 172.21.15.59:0/1297829952 shutdown_connections 2023-09-21T00:18:33.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.130+0000 7f28272e8700 1 --2- 172.21.15.59:0/1297829952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f282015e910 0x7f2820154880 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:33.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.130+0000 7f28272e8700 1 --2- 172.21.15.59:0/1297829952 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f28200b54a0 0x7f28200af340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:33.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.130+0000 7f28272e8700 1 --2- 172.21.15.59:0/1297829952 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f280406ae30 0x7f280406d2f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:33.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.130+0000 7f28272e8700 1 --2- 172.21.15.59:0/1297829952 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f28200cc790 0x7f28200b1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:33.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.130+0000 7f28272e8700 1 -- 172.21.15.59:0/1297829952 >> 172.21.15.59:0/1297829952 conn(0x7f282006a780 msgr2=0x7f2820159f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:33.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.130+0000 7f28272e8700 1 -- 172.21.15.59:0/1297829952 shutdown_connections 2023-09-21T00:18:33.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.130+0000 7f28272e8700 1 -- 172.21.15.59:0/1297829952 wait complete. 2023-09-21T00:18:33.134 INFO:teuthology.orchestra.run.smithi059.stderr:updated caps for client.0 2023-09-21T00:18:33.143 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T00:18:33.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.267+0000 7f121524d700 1 Processor -- start 2023-09-21T00:18:33.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.267+0000 7f121524d700 1 -- start start 2023-09-21T00:18:33.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.268+0000 7f121524d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f121015b4f0 0x7f12100cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:33.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.268+0000 7f121524d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f12100cac80 0x7f121006a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:33.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.268+0000 7f121524d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12100b3030 con 0x7f121006acc0 2023-09-21T00:18:33.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.268+0000 7f121524d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f121006b170 con 0x7f121015b4f0 2023-09-21T00:18:33.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.268+0000 7f121524d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12100cb180 con 0x7f12100cac80 2023-09-21T00:18:33.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.268+0000 7f120ed9d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f121015b4f0 0x7f12100cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:33.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.268+0000 7f120e59c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f12100cac80 0x7f121006a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:33.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.268+0000 7f120f59e700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f121006acc0 0x7f1210071680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.59:49622/0 (socket says 172.21.15.59:49622) 2023-09-21T00:18:33.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.268+0000 7f120ed9d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f121015b4f0 0x7f12100cc410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.59:39666/0 (socket says 172.21.15.59:39666) 2023-09-21T00:18:33.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.268+0000 7f120f59e700 1 -- 172.21.15.59:0/3866077114 learned_addr learned my addr 172.21.15.59:0/3866077114 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:33.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.268+0000 7f120ed9d700 1 -- 172.21.15.59:0/3866077114 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f12100cac80 msgr2=0x7f121006a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:33.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.269+0000 7f120ed9d700 1 --2- 172.21.15.59:0/3866077114 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f12100cac80 0x7f121006a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:33.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.269+0000 7f120ed9d700 1 -- 172.21.15.59:0/3866077114 >> v1:172.21.15.83:6789/0 conn(0x7f121006acc0 legacy=0x7f1210071680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:33.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.269+0000 7f120ed9d700 1 -- 172.21.15.59:0/3866077114 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12100cb460 con 0x7f121015b4f0 2023-09-21T00:18:33.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.269+0000 7f120dd9b700 1 -- 172.21.15.59:0/3866077114 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3082339038 0 0) 0x7f12100b3030 con 0x7f121006acc0 2023-09-21T00:18:33.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.269+0000 7f120ed9d700 1 --2- 172.21.15.59:0/3866077114 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f121015b4f0 0x7f12100cc410 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1204009840 tx=0x7f1204009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6701336963e402c server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:33.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.269+0000 7f120dd9b700 1 -- 172.21.15.59:0/3866077114 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1204011830 con 0x7f121015b4f0 2023-09-21T00:18:33.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.269+0000 7f120dd9b700 1 -- 172.21.15.59:0/3866077114 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1204011990 con 0x7f121015b4f0 2023-09-21T00:18:33.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.269+0000 7f120dd9b700 1 -- 172.21.15.59:0/3866077114 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1204011d20 con 0x7f121015b4f0 2023-09-21T00:18:33.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.269+0000 7f121524d700 1 -- 172.21.15.59:0/3866077114 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f121015b4f0 msgr2=0x7f12100cc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:33.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.269+0000 7f121524d700 1 --2- 172.21.15.59:0/3866077114 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f121015b4f0 0x7f12100cc410 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1204009840 tx=0x7f1204009b50 comp rx=0 tx=0).stop 2023-09-21T00:18:33.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.269+0000 7f121524d700 1 -- 172.21.15.59:0/3866077114 shutdown_connections 2023-09-21T00:18:33.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.269+0000 7f121524d700 1 --2- 172.21.15.59:0/3866077114 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f121015b4f0 0x7f12100cc410 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:33.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.269+0000 7f121524d700 1 --2- 172.21.15.59:0/3866077114 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f12100cac80 0x7f121006a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:33.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.269+0000 7f121524d700 1 -- 172.21.15.59:0/3866077114 >> 172.21.15.59:0/3866077114 conn(0x7f12100d0140 msgr2=0x7f12100d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:33.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.270+0000 7f121524d700 1 -- 172.21.15.59:0/3866077114 shutdown_connections 2023-09-21T00:18:33.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.270+0000 7f121524d700 1 -- 172.21.15.59:0/3866077114 wait complete. 2023-09-21T00:18:33.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.271+0000 7f121524d700 1 Processor -- start 2023-09-21T00:18:33.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.271+0000 7f121524d700 1 -- start start 2023-09-21T00:18:33.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.272+0000 7f121524d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f121006acc0 0x7f12100b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:33.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.272+0000 7f121524d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12100cac80 0x7f121014d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:33.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.272+0000 7f121524d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f121015b4f0 0x7f121014b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:33.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.272+0000 7f121524d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f121014d7c0 con 0x7f12100cac80 2023-09-21T00:18:33.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.272+0000 7f121524d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12100c8350 con 0x7f121006acc0 2023-09-21T00:18:33.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.272+0000 7f121524d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f121014ae30 con 0x7f121015b4f0 2023-09-21T00:18:33.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.272+0000 7f120e59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12100cac80 0x7f121014d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:33.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.272+0000 7f120e59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12100cac80 0x7f121014d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53558/0 (socket says 172.21.15.59:53558) 2023-09-21T00:18:33.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.272+0000 7f120e59c700 1 -- 172.21.15.59:0/2716843952 learned_addr learned my addr 172.21.15.59:0/2716843952 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:33.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.272+0000 7f120f59e700 1 --2- 172.21.15.59:0/2716843952 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f121015b4f0 0x7f121014b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:33.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.272+0000 7f120ed9d700 1 --2- 172.21.15.59:0/2716843952 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f121006acc0 0x7f12100b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:33.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.272+0000 7f120e59c700 1 -- 172.21.15.59:0/2716843952 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f121015b4f0 msgr2=0x7f121014b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:33.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.272+0000 7f120e59c700 1 --2- 172.21.15.59:0/2716843952 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f121015b4f0 0x7f121014b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:33.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.272+0000 7f120e59c700 1 -- 172.21.15.59:0/2716843952 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f121006acc0 msgr2=0x7f12100b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:33.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.272+0000 7f120e59c700 1 --2- 172.21.15.59:0/2716843952 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f121006acc0 0x7f12100b5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:33.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.272+0000 7f120e59c700 1 -- 172.21.15.59:0/2716843952 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12040094a0 con 0x7f12100cac80 2023-09-21T00:18:33.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.272+0000 7f120e59c700 1 --2- 172.21.15.59:0/2716843952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12100cac80 0x7f121014d280 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f120000e870 tx=0x7f120000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:33.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.273+0000 7f11f77fe700 1 -- 172.21.15.59:0/2716843952 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1200009590 con 0x7f12100cac80 2023-09-21T00:18:33.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.273+0000 7f11f77fe700 1 -- 172.21.15.59:0/2716843952 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1200013680 con 0x7f12100cac80 2023-09-21T00:18:33.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.273+0000 7f121524d700 1 -- 172.21.15.59:0/2716843952 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12100c7780 con 0x7f12100cac80 2023-09-21T00:18:33.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.273+0000 7f11f77fe700 1 -- 172.21.15.59:0/2716843952 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12000139f0 con 0x7f12100cac80 2023-09-21T00:18:33.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.273+0000 7f121524d700 1 -- 172.21.15.59:0/2716843952 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12100c7d00 con 0x7f12100cac80 2023-09-21T00:18:33.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.274+0000 7f121524d700 1 -- 172.21.15.59:0/2716843952 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1210067e50 con 0x7f12100cac80 2023-09-21T00:18:33.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.274+0000 7f11f77fe700 1 -- 172.21.15.59:0/2716843952 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f1200013b50 con 0x7f12100cac80 2023-09-21T00:18:33.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.275+0000 7f11f77fe700 1 --2- 172.21.15.59:0/2716843952 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f11fc06ae00 0x7f11fc06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:33.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.275+0000 7f11f77fe700 1 -- 172.21.15.59:0/2716843952 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f12000894a0 con 0x7f12100cac80 2023-09-21T00:18:33.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.275+0000 7f120ed9d700 1 --2- 172.21.15.59:0/2716843952 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f11fc06ae00 0x7f11fc06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:33.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.275+0000 7f120ed9d700 1 --2- 172.21.15.59:0/2716843952 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f11fc06ae00 0x7f11fc06d2c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1204000c00 tx=0x7f1204008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:33.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.279+0000 7f11f77fe700 1 -- 172.21.15.59:0/2716843952 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f1200054480 con 0x7f12100cac80 2023-09-21T00:18:33.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.524+0000 7f121524d700 1 -- 172.21.15.59:0/2716843952 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f121014b860 con 0x7f12100cac80 2023-09-21T00:18:33.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.524+0000 7f11f77fe700 1 -- 172.21.15.59:0/2716843952 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f1200057aa0 con 0x7f12100cac80 2023-09-21T00:18:33.526 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:18:33.526 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4898,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6836/1114790703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1114790703},{"type":"v1","addr":"172.21.15.83:6836","nonce":1114790703}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4901,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/1202041805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6835","nonce":1202041805},{"type":"v1","addr":"172.21.15.83:6837","nonce":1202041805}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4907,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1175160979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1175160979},{"type":"v1","addr":"172.21.15.59:6834","nonce":1175160979}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-21T00:18:27.516592+0000","modified":"2023-09-21T00:18:30.527932+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5182},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5182":{"gid":5182,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.59:6835/1133941828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1133941828},{"type":"v1","addr":"172.21.15.59:6835","nonce":1133941828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-09-21T00:18:33.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.526+0000 7f121524d700 1 -- 172.21.15.59:0/2716843952 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f11fc06ae00 msgr2=0x7f11fc06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:33.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.526+0000 7f121524d700 1 --2- 172.21.15.59:0/2716843952 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f11fc06ae00 0x7f11fc06d2c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1204000c00 tx=0x7f1204008030 comp rx=0 tx=0).stop 2023-09-21T00:18:33.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.526+0000 7f121524d700 1 -- 172.21.15.59:0/2716843952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12100cac80 msgr2=0x7f121014d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:33.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.526+0000 7f121524d700 1 --2- 172.21.15.59:0/2716843952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12100cac80 0x7f121014d280 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f120000e870 tx=0x7f120000eb80 comp rx=0 tx=0).stop 2023-09-21T00:18:33.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.527+0000 7f121524d700 1 -- 172.21.15.59:0/2716843952 shutdown_connections 2023-09-21T00:18:33.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.527+0000 7f121524d700 1 --2- 172.21.15.59:0/2716843952 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f11fc06ae00 0x7f11fc06d2c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:33.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.527+0000 7f121524d700 1 --2- 172.21.15.59:0/2716843952 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f121015b4f0 0x7f121014b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:33.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.527+0000 7f121524d700 1 --2- 172.21.15.59:0/2716843952 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f121006acc0 0x7f12100b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:33.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.527+0000 7f121524d700 1 --2- 172.21.15.59:0/2716843952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12100cac80 0x7f121014d280 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:33.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.527+0000 7f121524d700 1 -- 172.21.15.59:0/2716843952 >> 172.21.15.59:0/2716843952 conn(0x7f12100d0140 msgr2=0x7f12100b4bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:33.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.527+0000 7f121524d700 1 -- 172.21.15.59:0/2716843952 shutdown_connections 2023-09-21T00:18:33.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:33.527+0000 7f121524d700 1 -- 172.21.15.59:0/2716843952 wait complete. 2023-09-21T00:18:33.531 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 17 2023-09-21T00:18:33.943 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-21T00:18:27.516592+0000', 'modified': '2023-09-21T00:18:30.527932+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5182}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5182': {'gid': 5182, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.59:6835/1133941828', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6833', 'nonce': 1133941828}, {'type': 'v1', 'addr': '172.21.15.59:6835', 'nonce': 1133941828}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-09-21T00:18:33.944 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-21T00:18:33.944 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-09-21T00:18:34.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.075+0000 7f5e639ef700 1 Processor -- start 2023-09-21T00:18:34.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.075+0000 7f5e639ef700 1 -- start start 2023-09-21T00:18:34.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.076+0000 7f5e639ef700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5e5c160d60 0x7f5e5c06a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:34.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.076+0000 7f5e639ef700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e5c06b080 con 0x7f5e5c0cf2c0 2023-09-21T00:18:34.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.076+0000 7f5e639ef700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e5c0ce7e0 con 0x7f5e5c0cafd0 2023-09-21T00:18:34.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.076+0000 7f5e639ef700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e5c06b360 con 0x7f5e5c160d60 2023-09-21T00:18:34.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.076+0000 7f5e60f8a700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5e5c0cf2c0 0x7f5e5c0ca8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59132/0 (socket says 172.21.15.59:59132) 2023-09-21T00:18:34.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.076+0000 7f5e60f8a700 1 -- 172.21.15.59:0/3566140091 learned_addr learned my addr 172.21.15.59:0/3566140091 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:34.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.076+0000 7f5e53fff700 1 -- 172.21.15.59:0/3566140091 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3196925490 0 0) 0x7f5e5c06b080 con 0x7f5e5c0cf2c0 2023-09-21T00:18:34.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.076+0000 7f5e53fff700 1 -- 172.21.15.59:0/3566140091 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e480035b0 con 0x7f5e5c0cf2c0 2023-09-21T00:18:34.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.076+0000 7f5e6178b700 1 --2- 172.21.15.59:0/3566140091 >> v2:172.21.15.83:3300/0 conn(0x7f5e5c160d60 0x7f5e5c06a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:34.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.077+0000 7f5e53fff700 1 -- 172.21.15.59:0/3566140091 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 204160380 0 0) 0x7f5e480035b0 con 0x7f5e5c0cf2c0 2023-09-21T00:18:34.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.077+0000 7f5e53fff700 1 -- 172.21.15.59:0/3566140091 >> v2:172.21.15.83:3300/0 conn(0x7f5e5c160d60 msgr2=0x7f5e5c06a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:34.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.077+0000 7f5e53fff700 1 --2- 172.21.15.59:0/3566140091 >> v2:172.21.15.83:3300/0 conn(0x7f5e5c160d60 0x7f5e5c06a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:34.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.077+0000 7f5e53fff700 1 -- 172.21.15.59:0/3566140091 >> v1:172.21.15.83:6789/0 conn(0x7f5e5c0cafd0 legacy=0x7f5e5c06d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:34.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.077+0000 7f5e53fff700 1 -- 172.21.15.59:0/3566140091 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e5c0ceac0 con 0x7f5e5c0cf2c0 2023-09-21T00:18:34.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.077+0000 7f5e53fff700 1 -- 172.21.15.59:0/3566140091 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 710825841 0 0) 0x7f5e58001670 con 0x7f5e5c0cf2c0 2023-09-21T00:18:34.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.077+0000 7f5e53fff700 1 -- 172.21.15.59:0/3566140091 >> v1:172.21.15.59:6789/0 conn(0x7f5e5c0cf2c0 legacy=0x7f5e5c0ca8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:34.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.077+0000 7f5e53fff700 1 --2- 172.21.15.59:0/3566140091 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5e48003a00 0x7f5e48003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:34.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.077+0000 7f5e53fff700 1 --2- 172.21.15.59:0/3566140091 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e48004850 0x7f5e48004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:34.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.077+0000 7f5e53fff700 1 --2- 172.21.15.59:0/3566140091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e48005210 0x7f5e4800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:34.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.077+0000 7f5e53fff700 1 -- 172.21.15.59:0/3566140091 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c06b360 con 0x7f5e48005210 2023-09-21T00:18:34.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.077+0000 7f5e53fff700 1 -- 172.21.15.59:0/3566140091 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4800c0b0 con 0x7f5e48004850 2023-09-21T00:18:34.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.077+0000 7f5e53fff700 1 -- 172.21.15.59:0/3566140091 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4800c270 con 0x7f5e48003a00 2023-09-21T00:18:34.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.077+0000 7f5e61f8c700 1 --2- 172.21.15.59:0/3566140091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e48005210 0x7f5e4800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:34.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.077+0000 7f5e6178b700 1 --2- 172.21.15.59:0/3566140091 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5e48003a00 0x7f5e48003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:34.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.077+0000 7f5e60f8a700 1 --2- 172.21.15.59:0/3566140091 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e48004850 0x7f5e48004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:34.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.077+0000 7f5e61f8c700 1 -- 172.21.15.59:0/3566140091 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5e48003a00 msgr2=0x7f5e48003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:34.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.077+0000 7f5e61f8c700 1 --2- 172.21.15.59:0/3566140091 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5e48003a00 0x7f5e48003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:34.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.077+0000 7f5e61f8c700 1 -- 172.21.15.59:0/3566140091 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e48004850 msgr2=0x7f5e48004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:34.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.077+0000 7f5e61f8c700 1 --2- 172.21.15.59:0/3566140091 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e48004850 0x7f5e48004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:34.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.077+0000 7f5e61f8c700 1 -- 172.21.15.59:0/3566140091 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e480035b0 con 0x7f5e48005210 2023-09-21T00:18:34.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.077+0000 7f5e61f8c700 1 -- 172.21.15.59:0/3566140091 reap_dead start 2023-09-21T00:18:34.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.077+0000 7f5e61f8c700 1 --2- 172.21.15.59:0/3566140091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e48005210 0x7f5e4800ba10 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5e5400c240 tx=0x7f5e48005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db6c7b3ff070d210 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:34.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.078+0000 7f5e53fff700 1 -- 172.21.15.59:0/3566140091 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e54001df0 con 0x7f5e48005210 2023-09-21T00:18:34.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.078+0000 7f5e53fff700 1 -- 172.21.15.59:0/3566140091 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e5400cdc0 con 0x7f5e48005210 2023-09-21T00:18:34.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.078+0000 7f5e53fff700 1 -- 172.21.15.59:0/3566140091 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e54003c40 con 0x7f5e48005210 2023-09-21T00:18:34.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.078+0000 7f5e639ef700 1 -- 172.21.15.59:0/3566140091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e48005210 msgr2=0x7f5e4800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:34.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.078+0000 7f5e639ef700 1 --2- 172.21.15.59:0/3566140091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e48005210 0x7f5e4800ba10 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5e5400c240 tx=0x7f5e48005880 comp rx=0 tx=0).stop 2023-09-21T00:18:34.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.078+0000 7f5e639ef700 1 -- 172.21.15.59:0/3566140091 shutdown_connections 2023-09-21T00:18:34.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.078+0000 7f5e639ef700 1 --2- 172.21.15.59:0/3566140091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e48005210 0x7f5e4800ba10 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:34.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.078+0000 7f5e639ef700 1 -- 172.21.15.59:0/3566140091 >> 172.21.15.59:0/3566140091 conn(0x7f5e5c0ccae0 msgr2=0x7f5e5c0ccef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:34.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.078+0000 7f5e639ef700 1 -- 172.21.15.59:0/3566140091 shutdown_connections 2023-09-21T00:18:34.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.078+0000 7f5e639ef700 1 -- 172.21.15.59:0/3566140091 wait complete. 2023-09-21T00:18:34.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.079+0000 7f5e639ef700 1 Processor -- start 2023-09-21T00:18:34.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.079+0000 7f5e639ef700 1 -- start start 2023-09-21T00:18:34.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.080+0000 7f5e639ef700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5e48005210 0x7f5e5c157d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:34.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.080+0000 7f5e639ef700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e5c15fce0 0x7f5e5c0c6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:34.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.080+0000 7f5e639ef700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e5c160160 0x7f5e5c0c6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:34.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.080+0000 7f5e639ef700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c0c6aa0 con 0x7f5e5c15fce0 2023-09-21T00:18:34.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.080+0000 7f5e639ef700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c0c4780 con 0x7f5e5c160160 2023-09-21T00:18:34.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.080+0000 7f5e639ef700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c0b38b0 con 0x7f5e48005210 2023-09-21T00:18:34.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.080+0000 7f5e60f8a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e5c15fce0 0x7f5e5c0c6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:34.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.080+0000 7f5e60f8a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e5c15fce0 0x7f5e5c0c6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53580/0 (socket says 172.21.15.59:53580) 2023-09-21T00:18:34.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.080+0000 7f5e60f8a700 1 -- 172.21.15.59:0/254692174 learned_addr learned my addr 172.21.15.59:0/254692174 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:34.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.081+0000 7f5e6178b700 1 --2- 172.21.15.59:0/254692174 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5e48005210 0x7f5e5c157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:34.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.081+0000 7f5e60f8a700 1 -- 172.21.15.59:0/254692174 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5e48005210 msgr2=0x7f5e5c157d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:34.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.081+0000 7f5e60f8a700 1 --2- 172.21.15.59:0/254692174 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5e48005210 0x7f5e5c157d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:34.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.081+0000 7f5e61f8c700 1 --2- 172.21.15.59:0/254692174 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e5c160160 0x7f5e5c0c6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:34.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.081+0000 7f5e60f8a700 1 -- 172.21.15.59:0/254692174 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e5c160160 msgr2=0x7f5e5c0c6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:34.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.081+0000 7f5e60f8a700 1 --2- 172.21.15.59:0/254692174 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e5c160160 0x7f5e5c0c6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:34.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.081+0000 7f5e60f8a700 1 -- 172.21.15.59:0/254692174 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e5c0b3b90 con 0x7f5e5c15fce0 2023-09-21T00:18:34.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.081+0000 7f5e60f8a700 1 --2- 172.21.15.59:0/254692174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e5c15fce0 0x7f5e5c0c6020 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5e58007290 tx=0x7f5e580075a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:34.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.081+0000 7f5e51ffb700 1 -- 172.21.15.59:0/254692174 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5800f5e0 con 0x7f5e5c15fce0 2023-09-21T00:18:34.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.081+0000 7f5e51ffb700 1 -- 172.21.15.59:0/254692174 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e5800f740 con 0x7f5e5c15fce0 2023-09-21T00:18:34.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.081+0000 7f5e639ef700 1 -- 172.21.15.59:0/254692174 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e5c0b3e70 con 0x7f5e5c15fce0 2023-09-21T00:18:34.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.081+0000 7f5e51ffb700 1 -- 172.21.15.59:0/254692174 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5800fad0 con 0x7f5e5c15fce0 2023-09-21T00:18:34.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.081+0000 7f5e639ef700 1 -- 172.21.15.59:0/254692174 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e5c0c43a0 con 0x7f5e5c15fce0 2023-09-21T00:18:34.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.083+0000 7f5e51ffb700 1 -- 172.21.15.59:0/254692174 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f5e5800fc30 con 0x7f5e5c15fce0 2023-09-21T00:18:34.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.083+0000 7f5e51ffb700 1 --2- 172.21.15.59:0/254692174 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f5e4006ae00 0x7f5e4006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:34.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.083+0000 7f5e51ffb700 1 -- 172.21.15.59:0/254692174 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5e58089640 con 0x7f5e5c15fce0 2023-09-21T00:18:34.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.083+0000 7f5e6178b700 1 --2- 172.21.15.59:0/254692174 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f5e4006ae00 0x7f5e4006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:34.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.084+0000 7f5e6178b700 1 --2- 172.21.15.59:0/254692174 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f5e4006ae00 0x7f5e4006d2c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c009a20 tx=0x7f5e4c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:34.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.085+0000 7f5e6fbb3b80 1 Processor -- start 2023-09-21T00:18:34.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.085+0000 7f5e6fbb3b80 1 -- start start 2023-09-21T00:18:34.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.086+0000 7f5e6fbb3b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e55da9f620 0x55e55da71e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:34.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.086+0000 7f5e6fbb3b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e55dab1040 0x55e55da9fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:34.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.086+0000 7f5e6fbb3b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55e55da9b7f0 0x55e55da74fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:34.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.086+0000 7f5e6fbb3b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e55d9e9c50 con 0x55e55da9f620 2023-09-21T00:18:34.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.086+0000 7f5e6fbb3b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e55d9cdc20 con 0x55e55dab1040 2023-09-21T00:18:34.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.086+0000 7f5e6fbb3b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e55d9cb540 con 0x55e55da9b7f0 2023-09-21T00:18:34.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.086+0000 7f5e6178b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e55da9f620 0x55e55da71e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:34.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.086+0000 7f5e6178b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e55da9f620 0x55e55da71e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53584/0 (socket says 172.21.15.59:53584) 2023-09-21T00:18:34.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.086+0000 7f5e6178b700 1 -- 172.21.15.59:0/2062692540 learned_addr learned my addr 172.21.15.59:0/2062692540 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:34.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.086+0000 7f5e61f8c700 1 --2- 172.21.15.59:0/2062692540 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55e55da9b7f0 0x55e55da74fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:34.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.086+0000 7f5e60f8a700 1 --2- 172.21.15.59:0/2062692540 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e55dab1040 0x55e55da9fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:34.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.086+0000 7f5e6178b700 1 -- 172.21.15.59:0/2062692540 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55e55da9b7f0 msgr2=0x55e55da74fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:34.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.086+0000 7f5e6178b700 1 --2- 172.21.15.59:0/2062692540 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55e55da9b7f0 0x55e55da74fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:34.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.086+0000 7f5e6178b700 1 -- 172.21.15.59:0/2062692540 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e55dab1040 msgr2=0x55e55da9fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:34.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.086+0000 7f5e6178b700 1 --2- 172.21.15.59:0/2062692540 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e55dab1040 0x55e55da9fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:34.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.086+0000 7f5e6178b700 1 -- 172.21.15.59:0/2062692540 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e55d8455e0 con 0x55e55da9f620 2023-09-21T00:18:34.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.086+0000 7f5e6178b700 1 --2- 172.21.15.59:0/2062692540 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e55da9f620 0x55e55da71e40 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c013bd0 tx=0x7f5e4c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f21e31c3f0357925 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:34.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.087+0000 7f5e46ffd700 1 -- 172.21.15.59:0/2062692540 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c013ee0 con 0x55e55da9f620 2023-09-21T00:18:34.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.087+0000 7f5e46ffd700 1 -- 172.21.15.59:0/2062692540 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4c0168f0 con 0x55e55da9f620 2023-09-21T00:18:34.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.087+0000 7f5e46ffd700 1 -- 172.21.15.59:0/2062692540 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c016c60 con 0x55e55da9f620 2023-09-21T00:18:34.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.087+0000 7f5e6fbb3b80 1 -- 172.21.15.59:0/2062692540 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e55da9f620 msgr2=0x55e55da71e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:34.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.087+0000 7f5e6fbb3b80 1 --2- 172.21.15.59:0/2062692540 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e55da9f620 0x55e55da71e40 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c013bd0 tx=0x7f5e4c016000 comp rx=0 tx=0).stop 2023-09-21T00:18:34.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.087+0000 7f5e6fbb3b80 1 -- 172.21.15.59:0/2062692540 shutdown_connections 2023-09-21T00:18:34.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.087+0000 7f5e6fbb3b80 1 --2- 172.21.15.59:0/2062692540 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55e55da9b7f0 0x55e55da74fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:34.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.087+0000 7f5e6fbb3b80 1 --2- 172.21.15.59:0/2062692540 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e55da9f620 0x55e55da71e40 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:34.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.087+0000 7f5e6fbb3b80 1 --2- 172.21.15.59:0/2062692540 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e55dab1040 0x55e55da9fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:34.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.087+0000 7f5e6fbb3b80 1 -- 172.21.15.59:0/2062692540 >> 172.21.15.59:0/2062692540 conn(0x55e55d9a1fb0 msgr2=0x55e55daba430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:34.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.087+0000 7f5e6fbb3b80 1 -- 172.21.15.59:0/2062692540 shutdown_connections 2023-09-21T00:18:34.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.087+0000 7f5e6fbb3b80 1 -- 172.21.15.59:0/2062692540 wait complete. 2023-09-21T00:18:34.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.088+0000 7f5e6fbb3b80 1 -- start start 2023-09-21T00:18:34.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.088+0000 7f5e6fbb3b80 1 Processor -- start 2023-09-21T00:18:34.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.089+0000 7f5e6fbb3b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55e55da9b7f0 0x55e55da95f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:34.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.089+0000 7f5e6fbb3b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e55da9f620 0x55e55dabb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:34.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.089+0000 7f5e6fbb3b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e55dab1040 0x55e55da97900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:34.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.089+0000 7f5e6fbb3b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e55d9c6e30 con 0x55e55da9f620 2023-09-21T00:18:34.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.089+0000 7f5e6fbb3b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e55d9636f0 con 0x55e55dab1040 2023-09-21T00:18:34.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.089+0000 7f5e6fbb3b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e55d963390 con 0x55e55da9b7f0 2023-09-21T00:18:34.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.089+0000 7f5e6fbb3b80 10 client.0 _ll_register_callbacks cb 0x55e55d8ada30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T00:18:34.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.089+0000 7f5e60f8a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e55da9f620 0x55e55dabb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:34.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.089+0000 7f5e60f8a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e55da9f620 0x55e55dabb8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53592/0 (socket says 172.21.15.59:53592) 2023-09-21T00:18:34.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.089+0000 7f5e60f8a700 1 -- 172.21.15.59:0/1594204953 learned_addr learned my addr 172.21.15.59:0/1594204953 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:34.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.089+0000 7f5e6178b700 1 --2- 172.21.15.59:0/1594204953 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55e55da9b7f0 0x55e55da95f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:34.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.089+0000 7f5e61f8c700 1 --2- 172.21.15.59:0/1594204953 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e55dab1040 0x55e55da97900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:34.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.089+0000 7f5e60f8a700 1 -- 172.21.15.59:0/1594204953 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55e55da9b7f0 msgr2=0x55e55da95f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:34.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.089+0000 7f5e60f8a700 1 --2- 172.21.15.59:0/1594204953 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55e55da9b7f0 0x55e55da95f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:34.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.089+0000 7f5e60f8a700 1 -- 172.21.15.59:0/1594204953 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e55dab1040 msgr2=0x55e55da97900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:34.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.089+0000 7f5e60f8a700 1 --2- 172.21.15.59:0/1594204953 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e55dab1040 0x55e55da97900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:34.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.089+0000 7f5e60f8a700 1 -- 172.21.15.59:0/1594204953 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e4c0138b0 con 0x55e55da9f620 2023-09-21T00:18:34.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.089+0000 7f5e6178b700 1 --2- 172.21.15.59:0/1594204953 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55e55da9b7f0 0x55e55da95f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T00:18:34.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.089+0000 7f5e60f8a700 1 --2- 172.21.15.59:0/1594204953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e55da9f620 0x55e55dabb8b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5e58087ac0 tx=0x7f5e58001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9066eb7d6843aa71 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:34.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.089+0000 7f5e3bfff700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-09-21T00:18:34.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.090+0000 7f5e3bfff700 1 -- 172.21.15.59:0/1594204953 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5805e270 con 0x55e55da9f620 2023-09-21T00:18:34.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.090+0000 7f5e3bfff700 1 -- 172.21.15.59:0/1594204953 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5e580602d0 con 0x55e55da9f620 2023-09-21T00:18:34.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.090+0000 7f5e6fbb3b80 1 -- 172.21.15.59:0/1594204953 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e55d986b40 con 0x55e55da9f620 2023-09-21T00:18:34.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.090+0000 7f5e3bfff700 1 -- 172.21.15.59:0/1594204953 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e58058550 con 0x55e55da9f620 2023-09-21T00:18:34.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.090+0000 7f5e6fbb3b80 10 client.5499 fetch_fsmap learned FSMap version 17 2023-09-21T00:18:34.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.090+0000 7f5e6fbb3b80 1 -- 172.21.15.59:0/1594204953 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55e55d7f1d90 con 0x55e55da9f620 2023-09-21T00:18:34.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.090+0000 7f5e3bfff700 1 -- 172.21.15.59:0/1594204953 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e55d986b40 con 0x55e55da9f620 2023-09-21T00:18:34.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.090+0000 7f5e3bfff700 1 -- 172.21.15.59:0/1594204953 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5e580577e0 con 0x55e55da9f620 2023-09-21T00:18:34.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.090+0000 7f5e6fbb3b80 10 client.5499 fetch_fsmap finished waiting for FSMap version 17 2023-09-21T00:18:34.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.090+0000 7f5e6fbb3b80 10 client.5499 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-21T00:18:34.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.090+0000 7f5e6fbb3b80 20 client.5499 populate_metadata read hostname 'smithi059' 2023-09-21T00:18:34.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.090+0000 7f5e6fbb3b80 1 --2- 172.21.15.59:0/1594204953 >> [v2:172.21.15.59:6833/1133941828,v1:172.21.15.59:6835/1133941828] conn(0x55e55da9a290 0x55e55daa07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:34.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.090+0000 7f5e6fbb3b80 4 client.5499 mds_command: new command op to 5182 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T00:18:34.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.090+0000 7f5e6fbb3b80 1 -- 172.21.15.59:0/1594204953 --> [v2:172.21.15.59:6833/1133941828,v1:172.21.15.59:6835/1133941828] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e55da44060 con 0x55e55da9a290 2023-09-21T00:18:34.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.090+0000 7f5e6178b700 1 --2- 172.21.15.59:0/1594204953 >> [v2:172.21.15.59:6833/1133941828,v1:172.21.15.59:6835/1133941828] conn(0x55e55da9a290 0x55e55daa07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:34.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.090+0000 7f5e3bfff700 10 client.5499 ms_handle_connect on v2:172.21.15.59:6833/1133941828 2023-09-21T00:18:34.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.090+0000 7f5e6178b700 1 --2- 172.21.15.59:0/1594204953 >> [v2:172.21.15.59:6833/1133941828,v1:172.21.15.59:6835/1133941828] conn(0x55e55da9a290 0x55e55daa07e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a308293f4d79dda1 server_cookie=aa7d2d67d66e1422 in_seq=0 out_seq=0 2023-09-21T00:18:34.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.091+0000 7f5e3bfff700 1 -- 172.21.15.59:0/1594204953 <== mds.0 v2:172.21.15.59:6833/1133941828 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e55da44060 con 0x55e55da9a290 2023-09-21T00:18:34.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.091+0000 7f5e3bfff700 10 client.5499 handle_command_reply: tid=0 2023-09-21T00:18:34.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.091+0000 7f5e6fbb3b80 1 client.5499 shutdown 2023-09-21T00:18:34.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.091+0000 7f5e6fbb3b80 1 -- 172.21.15.59:0/1594204953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e55da9f620 msgr2=0x55e55dabb8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:34.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.091+0000 7f5e6fbb3b80 1 --2- 172.21.15.59:0/1594204953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e55da9f620 0x55e55dabb8b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5e58087ac0 tx=0x7f5e58001a00 comp rx=0 tx=0).stop 2023-09-21T00:18:34.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.091+0000 7f5e6fbb3b80 1 -- 172.21.15.59:0/1594204953 shutdown_connections 2023-09-21T00:18:34.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.091+0000 7f5e6fbb3b80 1 --2- 172.21.15.59:0/1594204953 >> [v2:172.21.15.59:6833/1133941828,v1:172.21.15.59:6835/1133941828] conn(0x55e55da9a290 0x55e55daa07e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:34.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.091+0000 7f5e6fbb3b80 1 --2- 172.21.15.59:0/1594204953 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e55dab1040 0x55e55da97900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:34.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.091+0000 7f5e3bfff700 0 client.5499 ms_handle_reset on v2:172.21.15.59:6833/1133941828 2023-09-21T00:18:34.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.091+0000 7f5e6fbb3b80 1 --2- 172.21.15.59:0/1594204953 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55e55da9b7f0 0x55e55da95f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:34.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.091+0000 7f5e6fbb3b80 1 --2- 172.21.15.59:0/1594204953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e55da9f620 0x55e55dabb8b0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:34.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.091+0000 7f5e6fbb3b80 1 -- 172.21.15.59:0/1594204953 >> 172.21.15.59:0/1594204953 conn(0x55e55d9a1fb0 msgr2=0x55e55da742a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:34.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.091+0000 7f5e6fbb3b80 1 -- 172.21.15.59:0/1594204953 shutdown_connections 2023-09-21T00:18:34.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.091+0000 7f5e6fbb3b80 1 -- 172.21.15.59:0/1594204953 wait complete. 2023-09-21T00:18:34.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.092+0000 7f5e6fbb3b80 20 client.5499 trim_cache size 0 max 16384 2023-09-21T00:18:34.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.109+0000 7f5e6fbb3b80 1 Processor -- start 2023-09-21T00:18:34.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.109+0000 7f5e6fbb3b80 1 -- start start 2023-09-21T00:18:34.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.110+0000 7f5e6fbb3b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e55da9b7f0 0x55e55da72690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:34.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.110+0000 7f5e6fbb3b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55e55da9f620 0x55e55da71e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:34.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.110+0000 7f5e6fbb3b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e55dab1040 0x55e55da6e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:34.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.110+0000 7f5e6fbb3b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e55d8478d0 con 0x55e55dab1040 2023-09-21T00:18:34.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.110+0000 7f5e6fbb3b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e55da76a30 con 0x55e55da9b7f0 2023-09-21T00:18:34.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.110+0000 7f5e6fbb3b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e55dab9a90 con 0x55e55da9f620 2023-09-21T00:18:34.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.110+0000 7f5e61f8c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e55dab1040 0x55e55da6e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:34.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.110+0000 7f5e61f8c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e55dab1040 0x55e55da6e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53602/0 (socket says 172.21.15.59:53602) 2023-09-21T00:18:34.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.110+0000 7f5e61f8c700 1 -- 172.21.15.59:0/1910544983 learned_addr learned my addr 172.21.15.59:0/1910544983 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:34.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.110+0000 7f5e61f8c700 1 -- 172.21.15.59:0/1910544983 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55e55da9f620 msgr2=0x55e55da71e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:34.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.110+0000 7f5e61f8c700 1 --2- 172.21.15.59:0/1910544983 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55e55da9f620 0x55e55da71e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:34.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.110+0000 7f5e6178b700 1 --2- 172.21.15.59:0/1910544983 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e55da9b7f0 0x55e55da72690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:34.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.110+0000 7f5e61f8c700 1 -- 172.21.15.59:0/1910544983 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e55da9b7f0 msgr2=0x55e55da72690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:34.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.110+0000 7f5e61f8c700 1 --2- 172.21.15.59:0/1910544983 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e55da9b7f0 0x55e55da72690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:34.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.110+0000 7f5e61f8c700 1 -- 172.21.15.59:0/1910544983 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e55d7dac10 con 0x55e55dab1040 2023-09-21T00:18:34.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.110+0000 7f5e6178b700 1 --2- 172.21.15.59:0/1910544983 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e55da9b7f0 0x55e55da72690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:18:34.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.111+0000 7f5e61f8c700 1 --2- 172.21.15.59:0/1910544983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e55dab1040 0x55e55da6e680 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f5e54002230 tx=0x7f5e54011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=794e01f9fb9144f0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:34.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.111+0000 7f5e477fe700 1 -- 172.21.15.59:0/1910544983 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e54001250 con 0x55e55dab1040 2023-09-21T00:18:34.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.111+0000 7f5e477fe700 1 -- 172.21.15.59:0/1910544983 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e54023070 con 0x55e55dab1040 2023-09-21T00:18:34.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.111+0000 7f5e477fe700 1 -- 172.21.15.59:0/1910544983 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e54003a00 con 0x55e55dab1040 2023-09-21T00:18:34.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.111+0000 7f5e6fbb3b80 1 -- 172.21.15.59:0/1910544983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e55dab1040 msgr2=0x55e55da6e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:34.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.111+0000 7f5e6fbb3b80 1 --2- 172.21.15.59:0/1910544983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e55dab1040 0x55e55da6e680 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f5e54002230 tx=0x7f5e54011000 comp rx=0 tx=0).stop 2023-09-21T00:18:34.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.111+0000 7f5e6fbb3b80 1 -- 172.21.15.59:0/1910544983 shutdown_connections 2023-09-21T00:18:34.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.111+0000 7f5e6fbb3b80 1 --2- 172.21.15.59:0/1910544983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e55dab1040 0x55e55da6e680 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:34.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.111+0000 7f5e6fbb3b80 1 --2- 172.21.15.59:0/1910544983 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e55da9b7f0 0x55e55da72690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:34.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.111+0000 7f5e6fbb3b80 1 --2- 172.21.15.59:0/1910544983 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55e55da9f620 0x55e55da71e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:34.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.111+0000 7f5e6fbb3b80 1 -- 172.21.15.59:0/1910544983 >> 172.21.15.59:0/1910544983 conn(0x55e55d9a1fb0 msgr2=0x55e55dab9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:34.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.111+0000 7f5e6fbb3b80 1 -- 172.21.15.59:0/1910544983 shutdown_connections 2023-09-21T00:18:34.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.111+0000 7f5e6fbb3b80 1 -- 172.21.15.59:0/1910544983 wait complete. 2023-09-21T00:18:34.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.112+0000 7f5e6fbb3b80 1 -- start start 2023-09-21T00:18:34.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.112+0000 7f5e6fbb3b80 1 Processor -- start 2023-09-21T00:18:34.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.113+0000 7f5e6fbb3b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e55da9b7f0 0x55e55db06a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:34.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.113+0000 7f5e6fbb3b80 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55e55da9f620 0x55e55da955a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:34.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.113+0000 7f5e6fbb3b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e55dab1040 0x55e55daa0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:34.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.113+0000 7f5e6fbb3b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e55da939e0 con 0x55e55da9b7f0 2023-09-21T00:18:34.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.113+0000 7f5e6fbb3b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e55db20eb0 con 0x55e55dab1040 2023-09-21T00:18:34.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.113+0000 7f5e6fbb3b80 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e55db21190 con 0x55e55da9f620 2023-09-21T00:18:34.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.113+0000 7f5e6fbb3b80 10 client.0 _ll_register_callbacks cb 0x55e55d8ada30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T00:18:34.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.113+0000 7f5e6178b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e55da9b7f0 0x55e55db06a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:34.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.113+0000 7f5e6178b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e55da9b7f0 0x55e55db06a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53604/0 (socket says 172.21.15.59:53604) 2023-09-21T00:18:34.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.113+0000 7f5e6178b700 1 -- 172.21.15.59:0/1486518165 learned_addr learned my addr 172.21.15.59:0/1486518165 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:34.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.113+0000 7f5e61f8c700 1 --2- 172.21.15.59:0/1486518165 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e55dab1040 0x55e55daa0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:34.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.113+0000 7f5e60f8a700 1 --2- 172.21.15.59:0/1486518165 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55e55da9f620 0x55e55da955a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:34.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.113+0000 7f5e6178b700 1 -- 172.21.15.59:0/1486518165 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55e55da9f620 msgr2=0x55e55da955a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:34.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.113+0000 7f5e6178b700 1 --2- 172.21.15.59:0/1486518165 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55e55da9f620 0x55e55da955a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:34.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.113+0000 7f5e6178b700 1 -- 172.21.15.59:0/1486518165 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e55dab1040 msgr2=0x55e55daa0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:34.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.113+0000 7f5e6178b700 1 --2- 172.21.15.59:0/1486518165 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e55dab1040 0x55e55daa0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:34.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.113+0000 7f5e6178b700 1 -- 172.21.15.59:0/1486518165 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e480035b0 con 0x55e55da9b7f0 2023-09-21T00:18:34.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.113+0000 7f5e6178b700 1 --2- 172.21.15.59:0/1486518165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e55da9b7f0 0x55e55db06a70 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c025040 tx=0x7f5e4c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0c7ce637861a7d9 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:34.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.113+0000 7f5e3bfff700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-09-21T00:18:34.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.114+0000 7f5e3bfff700 1 -- 172.21.15.59:0/1486518165 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c031040 con 0x55e55da9b7f0 2023-09-21T00:18:34.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.114+0000 7f5e3bfff700 1 -- 172.21.15.59:0/1486518165 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5e4c016c60 con 0x55e55da9b7f0 2023-09-21T00:18:34.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.114+0000 7f5e6fbb3b80 1 -- 172.21.15.59:0/1486518165 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e55da9acd0 con 0x55e55da9b7f0 2023-09-21T00:18:34.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.114+0000 7f5e3bfff700 1 -- 172.21.15.59:0/1486518165 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e4c013ee0 con 0x55e55da9b7f0 2023-09-21T00:18:34.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.114+0000 7f5e6fbb3b80 10 client.5505 fetch_fsmap learned FSMap version 17 2023-09-21T00:18:34.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.114+0000 7f5e6fbb3b80 1 -- 172.21.15.59:0/1486518165 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55e55d818200 con 0x55e55da9b7f0 2023-09-21T00:18:34.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.114+0000 7f5e3bfff700 1 -- 172.21.15.59:0/1486518165 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e55da9acd0 con 0x55e55da9b7f0 2023-09-21T00:18:34.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.114+0000 7f5e3bfff700 1 -- 172.21.15.59:0/1486518165 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5e4c038910 con 0x55e55da9b7f0 2023-09-21T00:18:34.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.114+0000 7f5e6fbb3b80 10 client.5505 fetch_fsmap finished waiting for FSMap version 17 2023-09-21T00:18:34.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.114+0000 7f5e6fbb3b80 10 client.5505 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-21T00:18:34.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.114+0000 7f5e6fbb3b80 20 client.5505 populate_metadata read hostname 'smithi059' 2023-09-21T00:18:34.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.114+0000 7f5e6fbb3b80 1 --2- 172.21.15.59:0/1486518165 >> [v2:172.21.15.59:6833/1133941828,v1:172.21.15.59:6835/1133941828] conn(0x55e55db24710 0x55e55db24af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:34.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.114+0000 7f5e6fbb3b80 4 client.5505 mds_command: new command op to 5182 tid=0[{"prefix": "status"}] 2023-09-21T00:18:34.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.114+0000 7f5e6fbb3b80 1 -- 172.21.15.59:0/1486518165 --> [v2:172.21.15.59:6833/1133941828,v1:172.21.15.59:6835/1133941828] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f5e4c0168f0 con 0x55e55db24710 2023-09-21T00:18:34.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.114+0000 7f5e60f8a700 1 --2- 172.21.15.59:0/1486518165 >> [v2:172.21.15.59:6833/1133941828,v1:172.21.15.59:6835/1133941828] conn(0x55e55db24710 0x55e55db24af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:34.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.114+0000 7f5e3bfff700 10 client.5505 ms_handle_connect on v2:172.21.15.59:6833/1133941828 2023-09-21T00:18:34.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.114+0000 7f5e60f8a700 1 --2- 172.21.15.59:0/1486518165 >> [v2:172.21.15.59:6833/1133941828,v1:172.21.15.59:6835/1133941828] conn(0x55e55db24710 0x55e55db24af0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=359815eed1305e5c server_cookie=d7a697c795d663dc in_seq=0 out_seq=0 2023-09-21T00:18:34.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.115+0000 7f5e3bfff700 1 -- 172.21.15.59:0/1486518165 <== mds.0 v2:172.21.15.59:6833/1133941828 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x7f5e4c0168f0 con 0x55e55db24710 2023-09-21T00:18:34.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.115+0000 7f5e3bfff700 10 client.5505 handle_command_reply: tid=0 2023-09-21T00:18:34.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.115+0000 7f5e6fbb3b80 1 client.5505 shutdown 2023-09-21T00:18:34.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.115+0000 7f5e6fbb3b80 1 -- 172.21.15.59:0/1486518165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e55da9b7f0 msgr2=0x55e55db06a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:34.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.115+0000 7f5e6fbb3b80 1 --2- 172.21.15.59:0/1486518165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e55da9b7f0 0x55e55db06a70 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c025040 tx=0x7f5e4c004750 comp rx=0 tx=0).stop 2023-09-21T00:18:34.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.115+0000 7f5e6fbb3b80 1 -- 172.21.15.59:0/1486518165 shutdown_connections 2023-09-21T00:18:34.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.115+0000 7f5e6fbb3b80 1 --2- 172.21.15.59:0/1486518165 >> [v2:172.21.15.59:6833/1133941828,v1:172.21.15.59:6835/1133941828] conn(0x55e55db24710 0x55e55db24af0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:34.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.115+0000 7f5e6fbb3b80 1 --2- 172.21.15.59:0/1486518165 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e55dab1040 0x55e55daa0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:34.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.115+0000 7f5e6fbb3b80 1 --2- 172.21.15.59:0/1486518165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e55da9b7f0 0x55e55db06a70 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:34.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.115+0000 7f5e3bfff700 0 client.5505 ms_handle_reset on v2:172.21.15.59:6833/1133941828 2023-09-21T00:18:34.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.115+0000 7f5e6fbb3b80 1 --2- 172.21.15.59:0/1486518165 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55e55da9f620 0x55e55da955a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:34.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.115+0000 7f5e6fbb3b80 1 -- 172.21.15.59:0/1486518165 >> 172.21.15.59:0/1486518165 conn(0x55e55d9a1fb0 msgr2=0x55e55da74d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:34.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.115+0000 7f5e6fbb3b80 1 -- 172.21.15.59:0/1486518165 shutdown_connections 2023-09-21T00:18:34.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.115+0000 7f5e6fbb3b80 1 -- 172.21.15.59:0/1486518165 wait complete. 2023-09-21T00:18:34.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.115+0000 7f5e6fbb3b80 20 client.5505 trim_cache size 0 max 16384 2023-09-21T00:18:34.138 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-09-21T00:18:34.139 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "dd69925c-6e25-42fe-880b-2f60fc6f384b", 2023-09-21T00:18:34.139 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 0, 2023-09-21T00:18:34.139 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 5182, 2023-09-21T00:18:34.139 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2023-09-21T00:18:34.139 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2023-09-21T00:18:34.140 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2023-09-21T00:18:34.140 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 6.0204295190000003, 2023-09-21T00:18:34.140 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 17, 2023-09-21T00:18:34.140 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 38, 2023-09-21T00:18:34.140 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 38, 2023-09-21T00:18:34.140 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 14.015848672000001 2023-09-21T00:18:34.141 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-09-21T00:18:34.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.116+0000 7f5e639ef700 1 -- 172.21.15.59:0/254692174 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f5e4006ae00 msgr2=0x7f5e4006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:34.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.116+0000 7f5e639ef700 1 --2- 172.21.15.59:0/254692174 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f5e4006ae00 0x7f5e4006d2c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c009a20 tx=0x7f5e4c008040 comp rx=0 tx=0).stop 2023-09-21T00:18:34.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.116+0000 7f5e639ef700 1 -- 172.21.15.59:0/254692174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e5c15fce0 msgr2=0x7f5e5c0c6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:34.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.116+0000 7f5e639ef700 1 --2- 172.21.15.59:0/254692174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e5c15fce0 0x7f5e5c0c6020 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5e58007290 tx=0x7f5e580075a0 comp rx=0 tx=0).stop 2023-09-21T00:18:34.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.116+0000 7f5e639ef700 1 -- 172.21.15.59:0/254692174 shutdown_connections 2023-09-21T00:18:34.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.116+0000 7f5e639ef700 1 --2- 172.21.15.59:0/254692174 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5e5c160160 0x7f5e5c0c6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:34.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.116+0000 7f5e639ef700 1 --2- 172.21.15.59:0/254692174 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f5e4006ae00 0x7f5e4006d2c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:34.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.116+0000 7f5e639ef700 1 --2- 172.21.15.59:0/254692174 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5e48005210 0x7f5e5c157d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:34.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.116+0000 7f5e639ef700 1 --2- 172.21.15.59:0/254692174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e5c15fce0 0x7f5e5c0c6020 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:34.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.116+0000 7f5e639ef700 1 -- 172.21.15.59:0/254692174 >> 172.21.15.59:0/254692174 conn(0x7f5e5c0ccae0 msgr2=0x7f5e5c0ae8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:34.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.116+0000 7f5e639ef700 1 -- 172.21.15.59:0/254692174 shutdown_connections 2023-09-21T00:18:34.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.116+0000 7f5e639ef700 1 -- 172.21.15.59:0/254692174 wait complete. 2023-09-21T00:18:34.145 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-21T00:18:34.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.269+0000 7fd9e15b3700 1 Processor -- start 2023-09-21T00:18:34.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.269+0000 7fd9e15b3700 1 -- start start 2023-09-21T00:18:34.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.270+0000 7fd9e15b3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9dc15d7e0 0x7fd9dc0cf120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:34.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.270+0000 7fd9e15b3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd9dc0d11b0 0x7fd9dc0b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:34.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.270+0000 7fd9e15b3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9dc0d1720 con 0x7fd9dc0cf660 2023-09-21T00:18:34.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.270+0000 7fd9e15b3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9dc0ced00 con 0x7fd9dc0d11b0 2023-09-21T00:18:34.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.270+0000 7fd9e15b3700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc0ce360 con 0x7fd9dc15d7e0 2023-09-21T00:18:34.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.270+0000 7fd9da7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd9dc0d11b0 0x7fd9dc0b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:34.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.270+0000 7fd9db7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd9dc0cf660 0x7fd9dc0d1990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59184/0 (socket says 172.21.15.59:59184) 2023-09-21T00:18:34.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.270+0000 7fd9db7fe700 1 -- 172.21.15.59:0/505761925 learned_addr learned my addr 172.21.15.59:0/505761925 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:34.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.270+0000 7fd9daffd700 1 --2- 172.21.15.59:0/505761925 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9dc15d7e0 0x7fd9dc0cf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:34.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.270+0000 7fd9da7fc700 1 -- 172.21.15.59:0/505761925 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9dc15d7e0 msgr2=0x7fd9dc0cf120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:34.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.270+0000 7fd9da7fc700 1 --2- 172.21.15.59:0/505761925 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9dc15d7e0 0x7fd9dc0cf120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:34.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.270+0000 7fd9da7fc700 1 -- 172.21.15.59:0/505761925 >> v1:172.21.15.59:6789/0 conn(0x7fd9dc0cf660 legacy=0x7fd9dc0d1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:34.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.270+0000 7fd9da7fc700 1 -- 172.21.15.59:0/505761925 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9dc0ce640 con 0x7fd9dc0d11b0 2023-09-21T00:18:34.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.270+0000 7fd9d9ffb700 1 -- 172.21.15.59:0/505761925 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4265714999 0 0) 0x7fd9dc0d1720 con 0x7fd9dc0cf660 2023-09-21T00:18:34.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.271+0000 7fd9da7fc700 1 --2- 172.21.15.59:0/505761925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9dc0d11b0 0x7fd9dc0b2d30 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd9d0009840 tx=0x7fd9d0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ac5f2e068837049 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:34.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.271+0000 7fd9d9ffb700 1 -- 172.21.15.59:0/505761925 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d0011830 con 0x7fd9dc0d11b0 2023-09-21T00:18:34.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.271+0000 7fd9d9ffb700 1 -- 172.21.15.59:0/505761925 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d0011990 con 0x7fd9dc0d11b0 2023-09-21T00:18:34.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.271+0000 7fd9d9ffb700 1 -- 172.21.15.59:0/505761925 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d0011d20 con 0x7fd9dc0d11b0 2023-09-21T00:18:34.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.271+0000 7fd9e15b3700 1 -- 172.21.15.59:0/505761925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9dc0d11b0 msgr2=0x7fd9dc0b2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:34.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.271+0000 7fd9e15b3700 1 --2- 172.21.15.59:0/505761925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9dc0d11b0 0x7fd9dc0b2d30 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd9d0009840 tx=0x7fd9d0009b50 comp rx=0 tx=0).stop 2023-09-21T00:18:34.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.271+0000 7fd9e15b3700 1 -- 172.21.15.59:0/505761925 shutdown_connections 2023-09-21T00:18:34.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.271+0000 7fd9e15b3700 1 --2- 172.21.15.59:0/505761925 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9dc15d7e0 0x7fd9dc0cf120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:34.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.271+0000 7fd9e15b3700 1 --2- 172.21.15.59:0/505761925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9dc0d11b0 0x7fd9dc0b2d30 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:34.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.271+0000 7fd9e15b3700 1 -- 172.21.15.59:0/505761925 >> 172.21.15.59:0/505761925 conn(0x7fd9dc09c740 msgr2=0x7fd9dc0d33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:34.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.271+0000 7fd9e15b3700 1 -- 172.21.15.59:0/505761925 shutdown_connections 2023-09-21T00:18:34.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.271+0000 7fd9e15b3700 1 -- 172.21.15.59:0/505761925 wait complete. 2023-09-21T00:18:34.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.273+0000 7fd9e15b3700 1 Processor -- start 2023-09-21T00:18:34.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.273+0000 7fd9e15b3700 1 -- start start 2023-09-21T00:18:34.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.273+0000 7fd9e15b3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9dc0cf660 0x7fd9dc0b3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:34.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.273+0000 7fd9e15b3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9dc0d11b0 0x7fd9dc14e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:34.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.273+0000 7fd9e15b3700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9dc15d7e0 0x7fd9dc0cc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:34.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.273+0000 7fd9e15b3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc14ed40 con 0x7fd9dc0d11b0 2023-09-21T00:18:34.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.273+0000 7fd9e15b3700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc0b2dd0 con 0x7fd9dc0cf660 2023-09-21T00:18:34.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.273+0000 7fd9e15b3700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc0b30b0 con 0x7fd9dc15d7e0 2023-09-21T00:18:34.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.274+0000 7fd9da7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9dc0d11b0 0x7fd9dc14e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:34.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.274+0000 7fd9da7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9dc0d11b0 0x7fd9dc14e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53620/0 (socket says 172.21.15.59:53620) 2023-09-21T00:18:34.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.274+0000 7fd9da7fc700 1 -- 172.21.15.59:0/3231911894 learned_addr learned my addr 172.21.15.59:0/3231911894 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:34.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.274+0000 7fd9db7fe700 1 --2- 172.21.15.59:0/3231911894 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9dc15d7e0 0x7fd9dc0cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:34.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.274+0000 7fd9daffd700 1 --2- 172.21.15.59:0/3231911894 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9dc0cf660 0x7fd9dc0b3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:34.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.274+0000 7fd9da7fc700 1 -- 172.21.15.59:0/3231911894 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9dc15d7e0 msgr2=0x7fd9dc0cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:34.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.274+0000 7fd9da7fc700 1 --2- 172.21.15.59:0/3231911894 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9dc15d7e0 0x7fd9dc0cc260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:34.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.274+0000 7fd9da7fc700 1 -- 172.21.15.59:0/3231911894 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9dc0cf660 msgr2=0x7fd9dc0b3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:34.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.274+0000 7fd9da7fc700 1 --2- 172.21.15.59:0/3231911894 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9dc0cf660 0x7fd9dc0b3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:34.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.274+0000 7fd9da7fc700 1 -- 172.21.15.59:0/3231911894 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d00094a0 con 0x7fd9dc0d11b0 2023-09-21T00:18:34.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.274+0000 7fd9daffd700 1 --2- 172.21.15.59:0/3231911894 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9dc0cf660 0x7fd9dc0b3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:18:34.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.274+0000 7fd9da7fc700 1 --2- 172.21.15.59:0/3231911894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9dc0d11b0 0x7fd9dc14e800 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd9d0014040 tx=0x7fd9d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:34.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.274+0000 7fd9c37fe700 1 -- 172.21.15.59:0/3231911894 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d00038a0 con 0x7fd9dc0d11b0 2023-09-21T00:18:34.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.274+0000 7fd9c37fe700 1 -- 172.21.15.59:0/3231911894 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d001e070 con 0x7fd9dc0d11b0 2023-09-21T00:18:34.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.274+0000 7fd9e15b3700 1 -- 172.21.15.59:0/3231911894 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9dc0b3390 con 0x7fd9dc0d11b0 2023-09-21T00:18:34.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.274+0000 7fd9c37fe700 1 -- 172.21.15.59:0/3231911894 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d0003c20 con 0x7fd9dc0d11b0 2023-09-21T00:18:34.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.274+0000 7fd9e15b3700 1 -- 172.21.15.59:0/3231911894 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9dc0b3950 con 0x7fd9dc0d11b0 2023-09-21T00:18:34.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.275+0000 7fd9e15b3700 1 -- 172.21.15.59:0/3231911894 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9dc0b2ba0 con 0x7fd9dc0d11b0 2023-09-21T00:18:34.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.276+0000 7fd9c37fe700 1 -- 172.21.15.59:0/3231911894 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fd9d002d450 con 0x7fd9dc0d11b0 2023-09-21T00:18:34.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.276+0000 7fd9c37fe700 1 --2- 172.21.15.59:0/3231911894 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd9c806ae00 0x7fd9c806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:34.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.276+0000 7fd9c37fe700 1 -- 172.21.15.59:0/3231911894 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd9d008a770 con 0x7fd9dc0d11b0 2023-09-21T00:18:34.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.276+0000 7fd9daffd700 1 --2- 172.21.15.59:0/3231911894 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd9c806ae00 0x7fd9c806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:34.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.277+0000 7fd9daffd700 1 --2- 172.21.15.59:0/3231911894 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd9c806ae00 0x7fd9c806d2c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc009a00 tx=0x7fd9cc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:34.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.280+0000 7fd9c37fe700 1 -- 172.21.15.59:0/3231911894 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fd9d0055760 con 0x7fd9dc0d11b0 2023-09-21T00:18:34.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.529+0000 7fd9e15b3700 1 -- 172.21.15.59:0/3231911894 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd9dc067e50 con 0x7fd9dc0d11b0 2023-09-21T00:18:34.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.530+0000 7fd9c37fe700 1 -- 172.21.15.59:0/3231911894 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd9d0058d80 con 0x7fd9dc0d11b0 2023-09-21T00:18:34.531 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-21T00:18:34.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.532+0000 7fd9e15b3700 1 -- 172.21.15.59:0/3231911894 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd9c806ae00 msgr2=0x7fd9c806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:34.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.532+0000 7fd9e15b3700 1 --2- 172.21.15.59:0/3231911894 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd9c806ae00 0x7fd9c806d2c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc009a00 tx=0x7fd9cc008040 comp rx=0 tx=0).stop 2023-09-21T00:18:34.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.532+0000 7fd9e15b3700 1 -- 172.21.15.59:0/3231911894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9dc0d11b0 msgr2=0x7fd9dc14e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:34.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.532+0000 7fd9e15b3700 1 --2- 172.21.15.59:0/3231911894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9dc0d11b0 0x7fd9dc14e800 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd9d0014040 tx=0x7fd9d0004750 comp rx=0 tx=0).stop 2023-09-21T00:18:34.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.532+0000 7fd9e15b3700 1 -- 172.21.15.59:0/3231911894 shutdown_connections 2023-09-21T00:18:34.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.532+0000 7fd9e15b3700 1 --2- 172.21.15.59:0/3231911894 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd9c806ae00 0x7fd9c806d2c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:34.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.532+0000 7fd9e15b3700 1 --2- 172.21.15.59:0/3231911894 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd9dc15d7e0 0x7fd9dc0cc260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:34.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.532+0000 7fd9e15b3700 1 --2- 172.21.15.59:0/3231911894 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9dc0cf660 0x7fd9dc0b3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:34.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.532+0000 7fd9e15b3700 1 --2- 172.21.15.59:0/3231911894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9dc0d11b0 0x7fd9dc14e800 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:34.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.532+0000 7fd9e15b3700 1 -- 172.21.15.59:0/3231911894 >> 172.21.15.59:0/3231911894 conn(0x7fd9dc09c740 msgr2=0x7fd9dc0b22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:34.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.532+0000 7fd9e15b3700 1 -- 172.21.15.59:0/3231911894 shutdown_connections 2023-09-21T00:18:34.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:34.532+0000 7fd9e15b3700 1 -- 172.21.15.59:0/3231911894 wait complete. 2023-09-21T00:18:34.545 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-21T00:18:34.546 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-21T00:18:34.546 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2023-09-21T00:18:34.546 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-21T00:18:34.547 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-21T00:18:34.547 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-21T00:18:34.547 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-09-21T00:18:34.548 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-21T00:18:34.548 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-21T00:18:34.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:18:34.549 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2023-09-21T00:18:34.567 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-21T00:18:34.567 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-21T00:18:34.567 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2023-09-21T00:18:34.568 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-09-21T00:18:34.568 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2023-09-21T00:18:34.568 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-09-21T00:18:34.568 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-21T00:18:34.568 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2023-09-21T00:18:34.569 INFO:teuthology.orchestra.run.smithi059.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-21T00:18:34.569 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2023-09-21T00:18:34.569 INFO:teuthology.orchestra.run.smithi059.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-21T00:18:34.569 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2023-09-21T00:18:34.569 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-09-21T00:18:34.570 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 42325sec preferred_lft 42325sec 2023-09-21T00:18:34.570 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2023-09-21T00:18:34.570 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-09-21T00:18:34.570 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-21T00:18:34.570 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2023-09-21T00:18:34.570 INFO:teuthology.orchestra.run.smithi059.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-21T00:18:34.571 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 6e:19:5a:56:af:73 brd ff:ff:ff:ff:ff:ff 2023-09-21T00:18:34.571 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-21T00:18:34.571 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-09-21T00:18:34.571 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::d8c6:8cff:fe74:f12b/64 scope link 2023-09-21T00:18:34.571 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-09-21T00:18:34.572 INFO:teuthology.orchestra.run.smithi059.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-21T00:18:34.572 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 86:97:cb:1d:6b:91 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-21T00:18:34.572 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::8497:cbff:fe1d:6b91/64 scope link 2023-09-21T00:18:34.572 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-09-21T00:18:34.572 INFO:teuthology.orchestra.run.smithi059.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-21T00:18:34.573 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 6e:19:5a:56:af:73 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-21T00:18:34.573 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::6c19:5aff:fe56:af73/64 scope link 2023-09-21T00:18:34.573 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-09-21T00:18:34.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:18:34.574 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-21T00:18:34.634 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-09-21T00:18:34.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:18:34.636 DEBUG:teuthology.orchestra.run.smithi059:> route 2023-09-21T00:18:34.695 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2023-09-21T00:18:34.695 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-21T00:18:34.695 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-09-21T00:18:34.695 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-09-21T00:18:34.696 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-21T00:18:34.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:18:34.697 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-09-21T00:18:34.697 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-09-21T00:18:34.697 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-09-21T00:18:34.698 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-09-21T00:18:34.698 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-09-21T00:18:34.698 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-09-21T00:18:34.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:18:34.803 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2023-09-21T00:18:34.820 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-09-21T00:18:34.820 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-21T00:18:34.821 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-21T00:18:34.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:18:34.822 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2023-09-21T00:18:34.889 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-21T00:18:34.889 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-09-21T00:18:34.946 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-09-21T00:18:34.946 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-21T00:18:34.947 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-09-21T00:18:35.003 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-09-21T00:18:35.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:18:35.003 DEBUG:teuthology.orchestra.run.smithi059:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-21T00:18:35.090 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-21T00:18:35.090 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-21T00:18:35.090 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-09-21T00:18:35.099 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-21T00:18:35.099 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-21T00:18:35.099 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-09-21T00:18:35.099 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-09-21T00:18:35.100 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-21T00:18:35.131 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-09-21T00:18:35.131 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-09-21T00:18:35.131 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-09-21T00:18:35.132 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.83:3300,172.21.15.83:3301" 2023-09-21T00:18:35.132 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2023-09-21T00:18:35.132 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:6789,172.21.15.83:6789,172.21.15.83:6790" 2023-09-21T00:18:35.132 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.59:6789,172.21.15.83:6789,172.21.15.83:6790:/ 2023-09-21T00:18:35.132 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=dd69925c-6e25-42fe-880b-2f60fc6f384b" will pass to kernel 2023-09-21T00:18:35.142 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-21T00:18:35.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:18:35.143 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-09-21T00:18:35.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:18:35.181 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-21T00:18:35.269 INFO:teuthology.orchestra.run.smithi059.stdout:client5517 2023-09-21T00:18:35.270 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-21T00:18:35.270 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-21T00:18:35.289 DEBUG:teuthology.orchestra.run.smithi059:> mktemp -d --suffix=xfstests-dev 2023-09-21T00:18:35.346 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.evOnb5iVkLxfstests-dev 2023-09-21T00:18:35.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:18:35.347 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.evOnb5iVkLxfstests-dev) 2023-09-21T00:18:35.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:18:35.415 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.evOnb5iVkLxfstests-dev) 2023-09-21T00:18:35.474 INFO:teuthology.orchestra.run.smithi059.stderr:Cloning into '/tmp/tmp.evOnb5iVkLxfstests-dev'... 2023-09-21T00:18:36.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:18:36.140 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-09-21T00:18:36.202 DEBUG:teuthology.orchestra.run.smithi059:> mktemp -d --suffix=test 2023-09-21T00:18:36.259 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.3HPsqub1xdtest 2023-09-21T00:18:36.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:18:36.260 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-09-21T00:18:36.319 DEBUG:teuthology.orchestra.run.smithi059:> mktemp -d --suffix=scratch 2023-09-21T00:18:36.376 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.ent7E9UExKscratch 2023-09-21T00:18:36.376 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "rhel" and "8.6". 2023-09-21T00:18:36.377 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python3 sqlite xfsprogs-qa-devel 2023-09-21T00:18:36.793 INFO:teuthology.orchestra.run.smithi059.stdout:Updating Subscription Management repositories. 2023-09-21T00:18:36.826 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:18:36.829 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:18:38.377 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:04:34 ago on Thu 21 Sep 2023 12:14:04 AM UTC. 2023-09-21T00:18:39.731 INFO:teuthology.orchestra.run.smithi059.stdout:Package acl-2.2.53-1.el8.x86_64 is already installed. 2023-09-21T00:18:39.732 INFO:teuthology.orchestra.run.smithi059.stdout:Package attr-2.4.48-3.el8.x86_64 is already installed. 2023-09-21T00:18:39.734 INFO:teuthology.orchestra.run.smithi059.stdout:Package automake-1.16.1-7.el8.noarch is already installed. 2023-09-21T00:18:39.735 INFO:teuthology.orchestra.run.smithi059.stdout:Package bc-1.07.1-5.el8.x86_64 is already installed. 2023-09-21T00:18:39.736 INFO:teuthology.orchestra.run.smithi059.stdout:Package dbench-4.0-20.el8.x86_64 is already installed. 2023-09-21T00:18:39.738 INFO:teuthology.orchestra.run.smithi059.stdout:Package e2fsprogs-1.45.6-4.el8.x86_64 is already installed. 2023-09-21T00:18:39.740 INFO:teuthology.orchestra.run.smithi059.stdout:Package gawk-4.2.1-4.el8.x86_64 is already installed. 2023-09-21T00:18:39.741 INFO:teuthology.orchestra.run.smithi059.stdout:Package gcc-8.5.0-10.1.el8_6.x86_64 is already installed. 2023-09-21T00:18:39.744 INFO:teuthology.orchestra.run.smithi059.stdout:Package libtool-2.4.6-25.el8.x86_64 is already installed. 2023-09-21T00:18:39.745 INFO:teuthology.orchestra.run.smithi059.stdout:Package lvm2-8:2.03.14-3.el8_6.2.x86_64 is already installed. 2023-09-21T00:18:39.746 INFO:teuthology.orchestra.run.smithi059.stdout:Package make-1:4.2.1-11.el8.x86_64 is already installed. 2023-09-21T00:18:39.747 INFO:teuthology.orchestra.run.smithi059.stdout:Package psmisc-23.1-5.el8.x86_64 is already installed. 2023-09-21T00:18:39.748 INFO:teuthology.orchestra.run.smithi059.stdout:Package quota-1:4.04-14.el8.x86_64 is already installed. 2023-09-21T00:18:39.749 INFO:teuthology.orchestra.run.smithi059.stdout:Package sed-4.5-5.el8.x86_64 is already installed. 2023-09-21T00:18:39.751 INFO:teuthology.orchestra.run.smithi059.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-09-21T00:18:39.752 INFO:teuthology.orchestra.run.smithi059.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-09-21T00:18:39.753 INFO:teuthology.orchestra.run.smithi059.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-09-21T00:18:39.754 INFO:teuthology.orchestra.run.smithi059.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-09-21T00:18:39.755 INFO:teuthology.orchestra.run.smithi059.stdout:Package libaio-devel-0.3.112-1.el8.x86_64 is already installed. 2023-09-21T00:18:39.757 INFO:teuthology.orchestra.run.smithi059.stdout:Package libuuid-devel-2.32.1-35.el8.x86_64 is already installed. 2023-09-21T00:18:39.758 INFO:teuthology.orchestra.run.smithi059.stdout:Package xfsprogs-devel-5.0.0-10.el8.x86_64 is already installed. 2023-09-21T00:18:39.762 INFO:teuthology.orchestra.run.smithi059.stdout:Package python36-3.6.8-38.module+el8.5.0+12207+5c5719bc.x86_64 is already installed. 2023-09-21T00:18:39.763 INFO:teuthology.orchestra.run.smithi059.stdout:Package sqlite-3.26.0-15.el8.x86_64 is already installed. 2023-09-21T00:18:39.768 INFO:teuthology.orchestra.run.smithi059.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-09-21T00:18:39.889 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2023-09-21T00:18:39.891 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2023-09-21T00:18:39.891 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2023-09-21T00:18:39.891 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2023-09-21T00:18:39.891 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2023-09-21T00:18:39.892 INFO:teuthology.orchestra.run.smithi059.stdout: dump x86_64 1:0.4-0.36.b46.el8 rhel-8-for-x86_64-baseos-rpms 164 k 2023-09-21T00:18:39.892 INFO:teuthology.orchestra.run.smithi059.stdout: fio x86_64 3.19-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-09-21T00:18:39.892 INFO:teuthology.orchestra.run.smithi059.stdout: indent x86_64 2.2.13-4.el8 epel 187 k 2023-09-21T00:18:39.892 INFO:teuthology.orchestra.run.smithi059.stdout:Upgrading: 2023-09-21T00:18:39.893 INFO:teuthology.orchestra.run.smithi059.stdout: sqlite x86_64 3.26.0-16.el8_6 rhel-8-for-x86_64-baseos-rpms 668 k 2023-09-21T00:18:39.893 INFO:teuthology.orchestra.run.smithi059.stdout: sqlite-libs x86_64 3.26.0-16.el8_6 rhel-8-for-x86_64-baseos-rpms 581 k 2023-09-21T00:18:39.893 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2023-09-21T00:18:39.894 INFO:teuthology.orchestra.run.smithi059.stdout: daxctl-libs x86_64 71.1-3.el8 rhel-8-for-x86_64-baseos-rpms 42 k 2023-09-21T00:18:39.894 INFO:teuthology.orchestra.run.smithi059.stdout: libpmemblk x86_64 1.6.1-1.el8 rhel-8-for-x86_64-appstream-rpms 92 k 2023-09-21T00:18:39.894 INFO:teuthology.orchestra.run.smithi059.stdout: ndctl-libs x86_64 71.1-3.el8 rhel-8-for-x86_64-baseos-rpms 79 k 2023-09-21T00:18:39.894 INFO:teuthology.orchestra.run.smithi059.stdout: rmt x86_64 2:1.5.3-13.el8 rhel-8-for-x86_64-baseos-rpms 51 k 2023-09-21T00:18:39.895 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:18:39.895 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2023-09-21T00:18:39.895 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2023-09-21T00:18:39.895 INFO:teuthology.orchestra.run.smithi059.stdout:Install 7 Packages 2023-09-21T00:18:39.895 INFO:teuthology.orchestra.run.smithi059.stdout:Upgrade 2 Packages 2023-09-21T00:18:39.896 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:18:39.896 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 2.3 M 2023-09-21T00:18:39.896 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2023-09-21T00:18:40.146 INFO:teuthology.orchestra.run.smithi059.stdout:(1/9): libpmemblk-1.6.1-1.el8.x86_64.rpm 828 kB/s | 92 kB 00:00 2023-09-21T00:18:40.191 INFO:teuthology.orchestra.run.smithi059.stdout:(2/9): fio-3.19-3.el8.x86_64.rpm 3.4 MB/s | 538 kB 00:00 2023-09-21T00:18:40.221 INFO:teuthology.orchestra.run.smithi059.stdout:(3/9): dump-0.4-0.36.b46.el8.x86_64.rpm 2.1 MB/s | 164 kB 00:00 2023-09-21T00:18:40.247 INFO:teuthology.orchestra.run.smithi059.stdout:(4/9): rmt-1.5.3-13.el8.x86_64.rpm 932 kB/s | 51 kB 00:00 2023-09-21T00:18:40.288 INFO:teuthology.orchestra.run.smithi059.stdout:(5/9): daxctl-libs-71.1-3.el8.x86_64.rpm 624 kB/s | 42 kB 00:00 2023-09-21T00:18:40.305 INFO:teuthology.orchestra.run.smithi059.stdout:(6/9): ndctl-libs-71.1-3.el8.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2023-09-21T00:18:40.372 INFO:teuthology.orchestra.run.smithi059.stdout:(7/9): sqlite-3.26.0-16.el8_6.x86_64.rpm 7.8 MB/s | 668 kB 00:00 2023-09-21T00:18:40.406 INFO:teuthology.orchestra.run.smithi059.stdout:(8/9): sqlite-libs-3.26.0-16.el8_6.x86_64.rpm 5.7 MB/s | 581 kB 00:00 2023-09-21T00:18:40.498 INFO:teuthology.orchestra.run.smithi059.stdout:(9/9): indent-2.2.13-4.el8.x86_64.rpm 403 kB/s | 187 kB 00:00 2023-09-21T00:18:40.499 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2023-09-21T00:18:40.499 INFO:teuthology.orchestra.run.smithi059.stdout:Total 3.9 MB/s | 2.3 MB 00:00 2023-09-21T00:18:40.586 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2023-09-21T00:18:40.621 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2023-09-21T00:18:40.621 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2023-09-21T00:18:40.716 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2023-09-21T00:18:40.720 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2023-09-21T00:18:41.127 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2023-09-21T00:18:41.303 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : daxctl-libs-71.1-3.el8.x86_64 1/11 2023-09-21T00:18:41.378 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: daxctl-libs-71.1-3.el8.x86_64 1/11 2023-09-21T00:18:41.577 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ndctl-libs-71.1-3.el8.x86_64 2/11 2023-09-21T00:18:41.646 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ndctl-libs-71.1-3.el8.x86_64 2/11 2023-09-21T00:18:41.836 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libpmemblk-1.6.1-1.el8.x86_64 3/11 2023-09-21T00:18:41.942 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libpmemblk-1.6.1-1.el8.x86_64 3/11 2023-09-21T00:18:42.112 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : sqlite-libs-3.26.0-16.el8_6.x86_64 4/11 2023-09-21T00:18:42.289 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rmt-2:1.5.3-13.el8.x86_64 5/11 2023-09-21T00:18:42.529 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : dump-1:0.4-0.36.b46.el8.x86_64 6/11 2023-09-21T00:18:42.847 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : sqlite-3.26.0-16.el8_6.x86_64 7/11 2023-09-21T00:18:43.112 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : fio-3.19-3.el8.x86_64 8/11 2023-09-21T00:18:43.353 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : indent-2.2.13-4.el8.x86_64 9/11 2023-09-21T00:18:43.478 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : sqlite-3.26.0-15.el8.x86_64 10/11 2023-09-21T00:18:43.626 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : sqlite-libs-3.26.0-15.el8.x86_64 11/11 2023-09-21T00:18:43.961 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: sqlite-libs-3.26.0-15.el8.x86_64 11/11 2023-09-21T00:18:43.962 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : indent-2.2.13-4.el8.x86_64 1/11 2023-09-21T00:18:43.962 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : fio-3.19-3.el8.x86_64 2/11 2023-09-21T00:18:43.962 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libpmemblk-1.6.1-1.el8.x86_64 3/11 2023-09-21T00:18:43.962 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : dump-1:0.4-0.36.b46.el8.x86_64 4/11 2023-09-21T00:18:43.963 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rmt-2:1.5.3-13.el8.x86_64 5/11 2023-09-21T00:18:43.963 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : daxctl-libs-71.1-3.el8.x86_64 6/11 2023-09-21T00:18:43.963 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ndctl-libs-71.1-3.el8.x86_64 7/11 2023-09-21T00:18:43.963 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : sqlite-3.26.0-16.el8_6.x86_64 8/11 2023-09-21T00:18:43.963 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : sqlite-3.26.0-15.el8.x86_64 9/11 2023-09-21T00:18:43.964 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : sqlite-libs-3.26.0-16.el8_6.x86_64 10/11 2023-09-21T00:18:45.210 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : sqlite-libs-3.26.0-15.el8.x86_64 11/11 2023-09-21T00:18:45.210 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:04:41 ago on Thu 21 Sep 2023 12:14:04 AM UTC. 2023-09-21T00:18:47.765 INFO:teuthology.orchestra.run.smithi059.stdout:Installed products updated. 2023-09-21T00:18:47.971 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:18:47.971 INFO:teuthology.orchestra.run.smithi059.stdout:Upgraded: 2023-09-21T00:18:47.971 INFO:teuthology.orchestra.run.smithi059.stdout: sqlite-3.26.0-16.el8_6.x86_64 sqlite-libs-3.26.0-16.el8_6.x86_64 2023-09-21T00:18:47.972 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2023-09-21T00:18:47.972 INFO:teuthology.orchestra.run.smithi059.stdout: daxctl-libs-71.1-3.el8.x86_64 dump-1:0.4-0.36.b46.el8.x86_64 2023-09-21T00:18:47.972 INFO:teuthology.orchestra.run.smithi059.stdout: fio-3.19-3.el8.x86_64 indent-2.2.13-4.el8.x86_64 2023-09-21T00:18:47.972 INFO:teuthology.orchestra.run.smithi059.stdout: libpmemblk-1.6.1-1.el8.x86_64 ndctl-libs-71.1-3.el8.x86_64 2023-09-21T00:18:47.972 INFO:teuthology.orchestra.run.smithi059.stdout: rmt-2:1.5.3-13.el8.x86_64 2023-09-21T00:18:47.973 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:18:47.973 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2023-09-21T00:18:48.137 DEBUG:teuthology.orchestra.run.smithi059:> sudo useradd -m fsgqa 2023-09-21T00:18:48.166 INFO:teuthology.orchestra.run.smithi059.stderr:useradd: user 'fsgqa' already exists 2023-09-21T00:18:48.167 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-09-21T00:18:48.168 DEBUG:teuthology.orchestra.run.smithi059:> sudo groupadd fsgqa 2023-09-21T00:18:48.236 INFO:teuthology.orchestra.run.smithi059.stderr:groupadd: group 'fsgqa' already exists 2023-09-21T00:18:48.237 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-09-21T00:18:48.238 DEBUG:teuthology.orchestra.run.smithi059:> sudo useradd fsgqa2 2023-09-21T00:18:49.319 DEBUG:teuthology.orchestra.run.smithi059:> sudo useradd 123456-fsgqa 2023-09-21T00:18:52.020 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-09-21T00:18:52.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.159+0000 7fe0f3033700 1 Processor -- start 2023-09-21T00:18:52.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.159+0000 7fe0f3033700 1 -- start start 2023-09-21T00:18:52.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.160+0000 7fe0f3033700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe0ec159a80 0x7fe0ec071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:52.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.160+0000 7fe0f3033700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0ec0c9870 0x7fe0ec06c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:52.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.160+0000 7fe0f3033700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0ec15e2f0 con 0x7fe0ec0cc530 2023-09-21T00:18:52.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.160+0000 7fe0f3033700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0ec0cb060 con 0x7fe0ec159a80 2023-09-21T00:18:52.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.160+0000 7fe0f3033700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec070fe0 con 0x7fe0ec0c9870 2023-09-21T00:18:52.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.160+0000 7fe0f0dcf700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe0ec159a80 0x7fe0ec071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:52.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.160+0000 7fe0ebfff700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0ec0c9870 0x7fe0ec06c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:52.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.160+0000 7fe0f15d0700 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fe0ec0cc530 0x7fe0ec0ccdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.59:49716/0 (socket says 172.21.15.59:49716) 2023-09-21T00:18:52.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.161+0000 7fe0f15d0700 1 -- 172.21.15.59:0/3587551229 learned_addr learned my addr 172.21.15.59:0/3587551229 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:52.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.161+0000 7fe0eb7fe700 1 -- 172.21.15.59:0/3587551229 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4266970647 0 0) 0x7fe0ec15e2f0 con 0x7fe0ec0cc530 2023-09-21T00:18:52.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.161+0000 7fe0eb7fe700 1 -- 172.21.15.59:0/3587551229 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0dc0035b0 con 0x7fe0ec0cc530 2023-09-21T00:18:52.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.161+0000 7fe0ebfff700 1 -- 172.21.15.59:0/3587551229 >> v2:172.21.15.83:3300/0 conn(0x7fe0ec159a80 msgr2=0x7fe0ec071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:52.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.161+0000 7fe0ebfff700 1 --2- 172.21.15.59:0/3587551229 >> v2:172.21.15.83:3300/0 conn(0x7fe0ec159a80 0x7fe0ec071ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:52.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.161+0000 7fe0ebfff700 1 -- 172.21.15.59:0/3587551229 >> v1:172.21.15.83:6789/0 conn(0x7fe0ec0cc530 legacy=0x7fe0ec0ccdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:52.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.161+0000 7fe0ebfff700 1 -- 172.21.15.59:0/3587551229 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0ec0712c0 con 0x7fe0ec0c9870 2023-09-21T00:18:52.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.161+0000 7fe0f0dcf700 1 --2- 172.21.15.59:0/3587551229 >> v2:172.21.15.83:3300/0 conn(0x7fe0ec159a80 0x7fe0ec071ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T00:18:52.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.161+0000 7fe0ebfff700 1 --2- 172.21.15.59:0/3587551229 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0ec0c9870 0x7fe0ec06c650 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8009840 tx=0x7fe0d8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1120631086433b2 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:52.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.161+0000 7fe0eb7fe700 1 -- 172.21.15.59:0/3587551229 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d8011830 con 0x7fe0ec0c9870 2023-09-21T00:18:52.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.161+0000 7fe0eb7fe700 1 -- 172.21.15.59:0/3587551229 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d8011990 con 0x7fe0ec0c9870 2023-09-21T00:18:52.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.161+0000 7fe0eb7fe700 1 -- 172.21.15.59:0/3587551229 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d8011d20 con 0x7fe0ec0c9870 2023-09-21T00:18:52.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.162+0000 7fe0f3033700 1 -- 172.21.15.59:0/3587551229 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0ec0c9870 msgr2=0x7fe0ec06c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:52.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.162+0000 7fe0f3033700 1 --2- 172.21.15.59:0/3587551229 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0ec0c9870 0x7fe0ec06c650 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8009840 tx=0x7fe0d8009b50 comp rx=0 tx=0).stop 2023-09-21T00:18:52.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.162+0000 7fe0f3033700 1 -- 172.21.15.59:0/3587551229 shutdown_connections 2023-09-21T00:18:52.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.162+0000 7fe0f3033700 1 --2- 172.21.15.59:0/3587551229 >> v2:172.21.15.83:3300/0 conn(0x7fe0ec159a80 0x7fe0ec071ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:52.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.162+0000 7fe0f3033700 1 --2- 172.21.15.59:0/3587551229 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0ec0c9870 0x7fe0ec06c650 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:52.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.162+0000 7fe0f3033700 1 -- 172.21.15.59:0/3587551229 >> 172.21.15.59:0/3587551229 conn(0x7fe0ec0b0d70 msgr2=0x7fe0ec0b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:52.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.162+0000 7fe0f3033700 1 -- 172.21.15.59:0/3587551229 shutdown_connections 2023-09-21T00:18:52.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.162+0000 7fe0f3033700 1 -- 172.21.15.59:0/3587551229 wait complete. 2023-09-21T00:18:52.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.163+0000 7fe0f3033700 1 Processor -- start 2023-09-21T00:18:52.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.163+0000 7fe0f3033700 1 -- start start 2023-09-21T00:18:52.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.164+0000 7fe0f3033700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0ec0c9870 0x7fe0ec152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:52.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.164+0000 7fe0f3033700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0ec0cc530 0x7fe0ec1f5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:52.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.164+0000 7fe0f3033700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0ec159a80 0x7fe0ec1f6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:52.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.164+0000 7fe0f3033700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec0c35c0 con 0x7fe0ec159a80 2023-09-21T00:18:52.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.164+0000 7fe0f3033700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec1534a0 con 0x7fe0ec0c9870 2023-09-21T00:18:52.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.164+0000 7fe0f3033700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec0adb30 con 0x7fe0ec0cc530 2023-09-21T00:18:52.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.164+0000 7fe0f15d0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0ec159a80 0x7fe0ec1f6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:52.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.164+0000 7fe0f15d0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0ec159a80 0x7fe0ec1f6230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53658/0 (socket says 172.21.15.59:53658) 2023-09-21T00:18:52.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.165+0000 7fe0f15d0700 1 -- 172.21.15.59:0/4226406501 learned_addr learned my addr 172.21.15.59:0/4226406501 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:52.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.165+0000 7fe0f0dcf700 1 --2- 172.21.15.59:0/4226406501 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0ec0c9870 0x7fe0ec152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:52.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.165+0000 7fe0ebfff700 1 --2- 172.21.15.59:0/4226406501 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0ec0cc530 0x7fe0ec1f5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:52.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.165+0000 7fe0f15d0700 1 -- 172.21.15.59:0/4226406501 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0ec0cc530 msgr2=0x7fe0ec1f5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:52.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.165+0000 7fe0f15d0700 1 --2- 172.21.15.59:0/4226406501 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0ec0cc530 0x7fe0ec1f5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:52.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.165+0000 7fe0f15d0700 1 -- 172.21.15.59:0/4226406501 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0ec0c9870 msgr2=0x7fe0ec152f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:52.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.165+0000 7fe0f15d0700 1 --2- 172.21.15.59:0/4226406501 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0ec0c9870 0x7fe0ec152f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:52.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.165+0000 7fe0f15d0700 1 -- 172.21.15.59:0/4226406501 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e00094a0 con 0x7fe0ec159a80 2023-09-21T00:18:52.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.165+0000 7fe0f0dcf700 1 --2- 172.21.15.59:0/4226406501 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0ec0c9870 0x7fe0ec152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T00:18:52.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.165+0000 7fe0f15d0700 1 --2- 172.21.15.59:0/4226406501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0ec159a80 0x7fe0ec1f6230 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe0e400cb40 tx=0x7fe0e400cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:52.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.165+0000 7fe0e97fa700 1 -- 172.21.15.59:0/4226406501 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e400ab50 con 0x7fe0ec159a80 2023-09-21T00:18:52.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.165+0000 7fe0e97fa700 1 -- 172.21.15.59:0/4226406501 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e400acb0 con 0x7fe0ec159a80 2023-09-21T00:18:52.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.165+0000 7fe0e97fa700 1 -- 172.21.15.59:0/4226406501 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e4012620 con 0x7fe0ec159a80 2023-09-21T00:18:52.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.165+0000 7fe0f3033700 1 -- 172.21.15.59:0/4226406501 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0d80094a0 con 0x7fe0ec159a80 2023-09-21T00:18:52.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.165+0000 7fe0f3033700 1 -- 172.21.15.59:0/4226406501 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0ec0c3810 con 0x7fe0ec159a80 2023-09-21T00:18:52.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.166+0000 7fe0f3033700 1 -- 172.21.15.59:0/4226406501 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0ec067e50 con 0x7fe0ec159a80 2023-09-21T00:18:52.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.167+0000 7fe0e97fa700 1 -- 172.21.15.59:0/4226406501 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fe0e401b3b0 con 0x7fe0ec159a80 2023-09-21T00:18:52.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.167+0000 7fe0e97fa700 1 --2- 172.21.15.59:0/4226406501 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fe0d006ae00 0x7fe0d006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:52.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.167+0000 7fe0e97fa700 1 -- 172.21.15.59:0/4226406501 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe0e4089400 con 0x7fe0ec159a80 2023-09-21T00:18:52.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.167+0000 7fe0f0dcf700 1 --2- 172.21.15.59:0/4226406501 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fe0d006ae00 0x7fe0d006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:52.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.168+0000 7fe0f0dcf700 1 --2- 172.21.15.59:0/4226406501 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fe0d006ae00 0x7fe0d006d2c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0009cf0 tx=0x7fe0e0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:52.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.172+0000 7fe0e97fa700 1 -- 172.21.15.59:0/4226406501 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fe0e4054450 con 0x7fe0ec159a80 2023-09-21T00:18:52.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.455+0000 7fe0f3033700 1 -- 172.21.15.59:0/4226406501 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe0ec06d5d0 con 0x7fe0ec159a80 2023-09-21T00:18:52.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.455+0000 7fe0e97fa700 1 -- 172.21.15.59:0/4226406501 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1268 (secure 0 0 0) 0x7fe0e4057a70 con 0x7fe0ec159a80 2023-09-21T00:18:52.457 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:18:52.457 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":1,"fsid":"dd69925c-6e25-42fe-880b-2f60fc6f384b","modified":"2023-09-21T00:16:08.456976Z","created":"2023-09-21T00:16:08.456976Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:3300","nonce":0},{"type":"v1","addr":"172.21.15.59:6789","nonce":0}]},"addr":"172.21.15.59:6789/0","public_addr":"172.21.15.59:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:3300","nonce":0},{"type":"v1","addr":"172.21.15.83:6789","nonce":0}]},"addr":"172.21.15.83:6789/0","public_addr":"172.21.15.83:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:3301","nonce":0},{"type":"v1","addr":"172.21.15.83:6790","nonce":0}]},"addr":"172.21.15.83:6790/0","public_addr":"172.21.15.83:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-09-21T00:18:52.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.458+0000 7fe0f3033700 1 -- 172.21.15.59:0/4226406501 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fe0d006ae00 msgr2=0x7fe0d006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:52.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.458+0000 7fe0f3033700 1 --2- 172.21.15.59:0/4226406501 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fe0d006ae00 0x7fe0d006d2c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0009cf0 tx=0x7fe0e0008040 comp rx=0 tx=0).stop 2023-09-21T00:18:52.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.458+0000 7fe0f3033700 1 -- 172.21.15.59:0/4226406501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0ec159a80 msgr2=0x7fe0ec1f6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:52.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.458+0000 7fe0f3033700 1 --2- 172.21.15.59:0/4226406501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0ec159a80 0x7fe0ec1f6230 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe0e400cb40 tx=0x7fe0e400cf00 comp rx=0 tx=0).stop 2023-09-21T00:18:52.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.458+0000 7fe0f3033700 1 -- 172.21.15.59:0/4226406501 shutdown_connections 2023-09-21T00:18:52.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.458+0000 7fe0f3033700 1 --2- 172.21.15.59:0/4226406501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0ec159a80 0x7fe0ec1f6230 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:52.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.458+0000 7fe0f3033700 1 --2- 172.21.15.59:0/4226406501 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0ec0c9870 0x7fe0ec152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:52.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.458+0000 7fe0f3033700 1 --2- 172.21.15.59:0/4226406501 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fe0d006ae00 0x7fe0d006d2c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:52.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.458+0000 7fe0f3033700 1 --2- 172.21.15.59:0/4226406501 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe0ec0cc530 0x7fe0ec1f5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:52.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.458+0000 7fe0f3033700 1 -- 172.21.15.59:0/4226406501 >> 172.21.15.59:0/4226406501 conn(0x7fe0ec0b0d70 msgr2=0x7fe0ec0c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:52.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.458+0000 7fe0f3033700 1 -- 172.21.15.59:0/4226406501 shutdown_connections 2023-09-21T00:18:52.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.458+0000 7fe0f3033700 1 -- 172.21.15.59:0/4226406501 wait complete. 2023-09-21T00:18:52.461 INFO:teuthology.orchestra.run.smithi059.stderr:dumped monmap epoch 1 2023-09-21T00:18:52.471 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-09-21T00:18:52.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.596+0000 7fd73d31d700 1 Processor -- start 2023-09-21T00:18:52.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.596+0000 7fd73d31d700 1 -- start start 2023-09-21T00:18:52.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.597+0000 7fd73d31d700 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd73815d930 0x7fd7380d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:52.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.597+0000 7fd73d31d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7380cf500 con 0x7fd7380d3f90 2023-09-21T00:18:52.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.597+0000 7fd73d31d700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7380cf7e0 con 0x7fd73815d550 2023-09-21T00:18:52.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.597+0000 7fd73d31d700 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7380cfac0 con 0x7fd73815d930 2023-09-21T00:18:52.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.597+0000 7fd7377fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd7380d3f90 0x7fd738161320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59234/0 (socket says 172.21.15.59:59234) 2023-09-21T00:18:52.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.597+0000 7fd7377fe700 1 -- 172.21.15.59:0/920229874 learned_addr learned my addr 172.21.15.59:0/920229874 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T00:18:52.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.598+0000 7fd7367fc700 1 --2- 172.21.15.59:0/920229874 >> v2:172.21.15.83:3300/0 conn(0x7fd73815d930 0x7fd7380d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:52.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.598+0000 7fd735ffb700 1 -- 172.21.15.59:0/920229874 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3907374927 0 0) 0x7fd7380cf500 con 0x7fd7380d3f90 2023-09-21T00:18:52.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.598+0000 7fd735ffb700 1 -- 172.21.15.59:0/920229874 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7200035b0 con 0x7fd7380d3f90 2023-09-21T00:18:52.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.598+0000 7fd735ffb700 1 -- 172.21.15.59:0/920229874 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 316020502 0 0) 0x7fd7380cf7e0 con 0x7fd73815d550 2023-09-21T00:18:52.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.598+0000 7fd735ffb700 1 -- 172.21.15.59:0/920229874 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7380cf500 con 0x7fd73815d550 2023-09-21T00:18:52.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.598+0000 7fd735ffb700 1 -- 172.21.15.59:0/920229874 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2919916355 0 0) 0x7fd7200035b0 con 0x7fd7380d3f90 2023-09-21T00:18:52.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.598+0000 7fd735ffb700 1 -- 172.21.15.59:0/920229874 >> v2:172.21.15.83:3300/0 conn(0x7fd73815d930 msgr2=0x7fd7380d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:52.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.598+0000 7fd735ffb700 1 --2- 172.21.15.59:0/920229874 >> v2:172.21.15.83:3300/0 conn(0x7fd73815d930 0x7fd7380d05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:52.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.598+0000 7fd735ffb700 1 -- 172.21.15.59:0/920229874 >> v1:172.21.15.83:6789/0 conn(0x7fd73815d550 legacy=0x7fd7380cecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:52.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.598+0000 7fd735ffb700 1 -- 172.21.15.59:0/920229874 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7380cfda0 con 0x7fd7380d3f90 2023-09-21T00:18:52.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.598+0000 7fd735ffb700 1 -- 172.21.15.59:0/920229874 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 710825841 0 0) 0x7fd7300019f0 con 0x7fd7380d3f90 2023-09-21T00:18:52.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.598+0000 7fd735ffb700 1 -- 172.21.15.59:0/920229874 >> v1:172.21.15.59:6789/0 conn(0x7fd7380d3f90 legacy=0x7fd738161320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:52.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.598+0000 7fd735ffb700 1 --2- 172.21.15.59:0/920229874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd720003be0 0x7fd720003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:52.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.598+0000 7fd735ffb700 1 --2- 172.21.15.59:0/920229874 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd720004850 0x7fd720004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:52.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.598+0000 7fd735ffb700 1 --2- 172.21.15.59:0/920229874 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd720005210 0x7fd72000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:52.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.598+0000 7fd735ffb700 1 -- 172.21.15.59:0/920229874 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7380cfac0 con 0x7fd720003be0 2023-09-21T00:18:52.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.598+0000 7fd735ffb700 1 -- 172.21.15.59:0/920229874 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd72000c0e0 con 0x7fd720005210 2023-09-21T00:18:52.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.598+0000 7fd735ffb700 1 -- 172.21.15.59:0/920229874 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd72000c2a0 con 0x7fd720004850 2023-09-21T00:18:52.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.598+0000 7fd736ffd700 1 --2- 172.21.15.59:0/920229874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd720003be0 0x7fd720003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:52.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.598+0000 7fd7377fe700 1 --2- 172.21.15.59:0/920229874 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd720005210 0x7fd72000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:52.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.598+0000 7fd7367fc700 1 --2- 172.21.15.59:0/920229874 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd720004850 0x7fd720004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:52.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.599+0000 7fd736ffd700 1 -- 172.21.15.59:0/920229874 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd720004850 msgr2=0x7fd720004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:52.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.599+0000 7fd736ffd700 1 --2- 172.21.15.59:0/920229874 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd720004850 0x7fd720004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:52.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.599+0000 7fd736ffd700 1 -- 172.21.15.59:0/920229874 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd720005210 msgr2=0x7fd72000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T00:18:52.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.599+0000 7fd736ffd700 1 --2- 172.21.15.59:0/920229874 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd720005210 0x7fd72000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:52.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.599+0000 7fd7377fe700 1 -- 172.21.15.59:0/920229874 reap_dead start 2023-09-21T00:18:52.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.599+0000 7fd736ffd700 1 -- 172.21.15.59:0/920229874 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7200035b0 con 0x7fd720003be0 2023-09-21T00:18:52.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.599+0000 7fd736ffd700 1 --2- 172.21.15.59:0/920229874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd720003be0 0x7fd720003fe0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd72c0019a0 tx=0x7fd720005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25823e497d864785 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:52.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.599+0000 7fd735ffb700 1 -- 172.21.15.59:0/920229874 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72c001dd0 con 0x7fd720003be0 2023-09-21T00:18:52.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.599+0000 7fd735ffb700 1 -- 172.21.15.59:0/920229874 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd72c0052f0 con 0x7fd720003be0 2023-09-21T00:18:52.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.599+0000 7fd735ffb700 1 -- 172.21.15.59:0/920229874 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72c001460 con 0x7fd720003be0 2023-09-21T00:18:52.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.599+0000 7fd73d31d700 1 -- 172.21.15.59:0/920229874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd720003be0 msgr2=0x7fd720003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:52.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.599+0000 7fd73d31d700 1 --2- 172.21.15.59:0/920229874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd720003be0 0x7fd720003fe0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd72c0019a0 tx=0x7fd720005880 comp rx=0 tx=0).stop 2023-09-21T00:18:52.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.599+0000 7fd73d31d700 1 -- 172.21.15.59:0/920229874 shutdown_connections 2023-09-21T00:18:52.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.599+0000 7fd73d31d700 1 --2- 172.21.15.59:0/920229874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd720003be0 0x7fd720003fe0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:52.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.599+0000 7fd73d31d700 1 -- 172.21.15.59:0/920229874 >> 172.21.15.59:0/920229874 conn(0x7fd73809c740 msgr2=0x7fd7380d33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:52.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.599+0000 7fd73d31d700 1 -- 172.21.15.59:0/920229874 shutdown_connections 2023-09-21T00:18:52.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.600+0000 7fd73d31d700 1 -- 172.21.15.59:0/920229874 wait complete. 2023-09-21T00:18:52.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.601+0000 7fd73d31d700 1 Processor -- start 2023-09-21T00:18:52.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.601+0000 7fd73d31d700 1 -- start start 2023-09-21T00:18:52.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.602+0000 7fd73d31d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd720003be0 0x7fd738156e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:52.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.602+0000 7fd73d31d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd738159180 0x7fd7381435b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:52.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.602+0000 7fd73d31d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd738155ca0 0x7fd7381f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:52.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.602+0000 7fd73d31d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7381599f0 con 0x7fd738155ca0 2023-09-21T00:18:52.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.602+0000 7fd73d31d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7380b69c0 con 0x7fd738159180 2023-09-21T00:18:52.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.602+0000 7fd73d31d700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7380b6ca0 con 0x7fd720003be0 2023-09-21T00:18:52.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.602+0000 7fd7377fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd738155ca0 0x7fd7381f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:52.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.602+0000 7fd7377fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd738155ca0 0x7fd7381f64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53678/0 (socket says 172.21.15.59:53678) 2023-09-21T00:18:52.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.602+0000 7fd7377fe700 1 -- 172.21.15.59:0/1940536876 learned_addr learned my addr 172.21.15.59:0/1940536876 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T00:18:52.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.602+0000 7fd7367fc700 1 --2- 172.21.15.59:0/1940536876 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd738159180 0x7fd7381435b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:52.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.602+0000 7fd736ffd700 1 --2- 172.21.15.59:0/1940536876 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd720003be0 0x7fd738156e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:52.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.602+0000 7fd7377fe700 1 -- 172.21.15.59:0/1940536876 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd720003be0 msgr2=0x7fd738156e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:52.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.602+0000 7fd7377fe700 1 --2- 172.21.15.59:0/1940536876 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd720003be0 0x7fd738156e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:52.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.602+0000 7fd7377fe700 1 -- 172.21.15.59:0/1940536876 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd738159180 msgr2=0x7fd7381435b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:52.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.602+0000 7fd7377fe700 1 --2- 172.21.15.59:0/1940536876 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd738159180 0x7fd7381435b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:52.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.602+0000 7fd7377fe700 1 -- 172.21.15.59:0/1940536876 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7380b6f80 con 0x7fd738155ca0 2023-09-21T00:18:52.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.602+0000 7fd7377fe700 1 --2- 172.21.15.59:0/1940536876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd738155ca0 0x7fd7381f64b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fd7380cd9d0 tx=0x7fd73000a510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:52.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.602+0000 7fd71f7fe700 1 -- 172.21.15.59:0/1940536876 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73000aba0 con 0x7fd738155ca0 2023-09-21T00:18:52.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.602+0000 7fd71f7fe700 1 -- 172.21.15.59:0/1940536876 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd73000ad40 con 0x7fd738155ca0 2023-09-21T00:18:52.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.602+0000 7fd73d31d700 1 -- 172.21.15.59:0/1940536876 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7380b7260 con 0x7fd738155ca0 2023-09-21T00:18:52.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.602+0000 7fd71f7fe700 1 -- 172.21.15.59:0/1940536876 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd730013630 con 0x7fd738155ca0 2023-09-21T00:18:52.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.602+0000 7fd73d31d700 1 -- 172.21.15.59:0/1940536876 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7381595e0 con 0x7fd738155ca0 2023-09-21T00:18:52.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.603+0000 7fd73d31d700 1 -- 172.21.15.59:0/1940536876 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7380b92e0 con 0x7fd738155ca0 2023-09-21T00:18:52.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.604+0000 7fd71f7fe700 1 -- 172.21.15.59:0/1940536876 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fd730013790 con 0x7fd738155ca0 2023-09-21T00:18:52.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.604+0000 7fd71f7fe700 1 --2- 172.21.15.59:0/1940536876 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd72406ae30 0x7fd72406d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T00:18:52.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.604+0000 7fd71f7fe700 1 -- 172.21.15.59:0/1940536876 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd730089c50 con 0x7fd738155ca0 2023-09-21T00:18:52.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.604+0000 7fd736ffd700 1 --2- 172.21.15.59:0/1940536876 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd72406ae30 0x7fd72406d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T00:18:52.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.605+0000 7fd736ffd700 1 --2- 172.21.15.59:0/1940536876 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd72406ae30 0x7fd72406d2f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd72c015040 tx=0x7fd72c00a000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T00:18:52.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.609+0000 7fd71f7fe700 1 -- 172.21.15.59:0/1940536876 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fd730054ca0 con 0x7fd738155ca0 2023-09-21T00:18:52.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.893+0000 7fd73d31d700 1 -- 172.21.15.59:0/1940536876 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7fd738067e50 con 0x7fd738155ca0 2023-09-21T00:18:52.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.893+0000 7fd71f7fe700 1 -- 172.21.15.59:0/1940536876 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v9) v1 ==== 92+0+63 (secure 0 0 0) 0x7fd7300582c0 con 0x7fd738155ca0 2023-09-21T00:18:52.895 INFO:teuthology.orchestra.run.smithi059.stdout:[client.admin] 2023-09-21T00:18:52.895 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== 2023-09-21T00:18:52.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.895+0000 7fd73d31d700 1 -- 172.21.15.59:0/1940536876 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd72406ae30 msgr2=0x7fd72406d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:52.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.895+0000 7fd73d31d700 1 --2- 172.21.15.59:0/1940536876 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd72406ae30 0x7fd72406d2f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd72c015040 tx=0x7fd72c00a000 comp rx=0 tx=0).stop 2023-09-21T00:18:52.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.895+0000 7fd73d31d700 1 -- 172.21.15.59:0/1940536876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd738155ca0 msgr2=0x7fd7381f64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T00:18:52.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.895+0000 7fd73d31d700 1 --2- 172.21.15.59:0/1940536876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd738155ca0 0x7fd7381f64b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fd7380cd9d0 tx=0x7fd73000a510 comp rx=0 tx=0).stop 2023-09-21T00:18:52.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.895+0000 7fd73d31d700 1 -- 172.21.15.59:0/1940536876 shutdown_connections 2023-09-21T00:18:52.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.895+0000 7fd73d31d700 1 --2- 172.21.15.59:0/1940536876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd738155ca0 0x7fd7381f64b0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:52.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.895+0000 7fd73d31d700 1 --2- 172.21.15.59:0/1940536876 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fd72406ae30 0x7fd72406d2f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:52.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.895+0000 7fd73d31d700 1 --2- 172.21.15.59:0/1940536876 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd720003be0 0x7fd738156e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:52.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.895+0000 7fd73d31d700 1 --2- 172.21.15.59:0/1940536876 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd738159180 0x7fd7381435b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T00:18:52.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.895+0000 7fd73d31d700 1 -- 172.21.15.59:0/1940536876 >> 172.21.15.59:0/1940536876 conn(0x7fd73809c740 msgr2=0x7fd73815c940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T00:18:52.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.895+0000 7fd73d31d700 1 -- 172.21.15.59:0/1940536876 shutdown_connections 2023-09-21T00:18:52.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T00:18:52.895+0000 7fd73d31d700 1 -- 172.21.15.59:0/1940536876 wait complete. 2023-09-21T00:18:52.909 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-21T00:18:52.909 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/tmp/tmp.evOnb5iVkLxfstests-dev/local.config 2023-09-21T00:18:52.938 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.59:6789:/test export TEST_DIR=/tmp/tmp.3HPsqub1xdtest export SCRATCH_DEV=172.21.15.59:6789:/scratch export SCRATCH_MNT=/tmp/tmp.ent7E9UExKscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g==" 2023-09-21T00:18:52.939 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-21T00:18:52.939 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/tmp/tmp.evOnb5iVkLxfstests-dev/ceph.exclude 2023-09-21T00:18:53.006 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo make) 2023-09-21T00:18:53.094 INFO:teuthology.orchestra.run.smithi059.stdout:libtoolize -cfi 2023-09-21T00:18:53.495 INFO:teuthology.orchestra.run.smithi059.stdout:libtoolize: putting auxiliary files in '.'. 2023-09-21T00:18:53.495 INFO:teuthology.orchestra.run.smithi059.stdout:libtoolize: copying file './config.guess' 2023-09-21T00:18:53.499 INFO:teuthology.orchestra.run.smithi059.stdout:libtoolize: copying file './config.sub' 2023-09-21T00:18:53.502 INFO:teuthology.orchestra.run.smithi059.stdout:libtoolize: copying file './install-sh' 2023-09-21T00:18:53.506 INFO:teuthology.orchestra.run.smithi059.stdout:libtoolize: copying file './ltmain.sh' 2023-09-21T00:18:53.528 INFO:teuthology.orchestra.run.smithi059.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-09-21T00:18:53.528 INFO:teuthology.orchestra.run.smithi059.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-09-21T00:18:53.532 INFO:teuthology.orchestra.run.smithi059.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-09-21T00:18:53.537 INFO:teuthology.orchestra.run.smithi059.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-09-21T00:18:53.541 INFO:teuthology.orchestra.run.smithi059.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-09-21T00:18:53.546 INFO:teuthology.orchestra.run.smithi059.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-09-21T00:18:53.552 INFO:teuthology.orchestra.run.smithi059.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-09-21T00:18:53.553 INFO:teuthology.orchestra.run.smithi059.stdout:cp include/install-sh . 2023-09-21T00:18:53.554 INFO:teuthology.orchestra.run.smithi059.stdout:aclocal -I m4 2023-09-21T00:18:54.763 INFO:teuthology.orchestra.run.smithi059.stdout:autoheader 2023-09-21T00:18:55.091 INFO:teuthology.orchestra.run.smithi059.stdout:autoconf 2023-09-21T00:18:55.257 INFO:teuthology.orchestra.run.smithi059.stdout:./configure \ 2023-09-21T00:18:55.257 INFO:teuthology.orchestra.run.smithi059.stdout: --libexecdir=/usr/lib \ 2023-09-21T00:18:55.258 INFO:teuthology.orchestra.run.smithi059.stdout: --exec_prefix=/var/lib 2023-09-21T00:18:55.716 INFO:teuthology.orchestra.run.smithi059.stdout:checking build system type... x86_64-pc-linux-gnu 2023-09-21T00:18:55.716 INFO:teuthology.orchestra.run.smithi059.stdout:checking host system type... x86_64-pc-linux-gnu 2023-09-21T00:18:55.717 INFO:teuthology.orchestra.run.smithi059.stdout:checking how to print strings... printf 2023-09-21T00:18:55.718 INFO:teuthology.orchestra.run.smithi059.stdout:checking for gcc... gcc 2023-09-21T00:18:55.838 INFO:teuthology.orchestra.run.smithi059.stdout:checking whether the C compiler works... yes 2023-09-21T00:18:55.839 INFO:teuthology.orchestra.run.smithi059.stdout:checking for C compiler default output file name... a.out 2023-09-21T00:18:55.866 INFO:teuthology.orchestra.run.smithi059.stdout:checking for suffix of executables... 2023-09-21T00:18:55.907 INFO:teuthology.orchestra.run.smithi059.stdout:checking whether we are cross compiling... no 2023-09-21T00:18:55.925 INFO:teuthology.orchestra.run.smithi059.stdout:checking for suffix of object files... o 2023-09-21T00:18:55.941 INFO:teuthology.orchestra.run.smithi059.stdout:checking whether we are using the GNU C compiler... yes 2023-09-21T00:18:55.958 INFO:teuthology.orchestra.run.smithi059.stdout:checking whether gcc accepts -g... yes 2023-09-21T00:18:55.985 INFO:teuthology.orchestra.run.smithi059.stdout:checking for gcc option to accept ISO C89... none needed 2023-09-21T00:18:55.987 INFO:teuthology.orchestra.run.smithi059.stdout:checking for a sed that does not truncate output... /bin/sed 2023-09-21T00:18:55.989 INFO:teuthology.orchestra.run.smithi059.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-09-21T00:18:55.991 INFO:teuthology.orchestra.run.smithi059.stdout:checking for egrep... /bin/grep -E 2023-09-21T00:18:55.992 INFO:teuthology.orchestra.run.smithi059.stdout:checking for fgrep... /bin/grep -F 2023-09-21T00:18:55.995 INFO:teuthology.orchestra.run.smithi059.stdout:checking for ld used by gcc... /bin/ld 2023-09-21T00:18:55.997 INFO:teuthology.orchestra.run.smithi059.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-09-21T00:18:56.034 INFO:teuthology.orchestra.run.smithi059.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-09-21T00:18:56.050 INFO:teuthology.orchestra.run.smithi059.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-09-21T00:18:56.051 INFO:teuthology.orchestra.run.smithi059.stdout:checking whether ln -s works... yes 2023-09-21T00:18:56.056 INFO:teuthology.orchestra.run.smithi059.stdout:checking the maximum length of command line arguments... 1572864 2023-09-21T00:18:56.058 INFO:teuthology.orchestra.run.smithi059.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-09-21T00:18:56.058 INFO:teuthology.orchestra.run.smithi059.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-09-21T00:18:56.059 INFO:teuthology.orchestra.run.smithi059.stdout:checking for /bin/ld option to reload object files... -r 2023-09-21T00:18:56.060 INFO:teuthology.orchestra.run.smithi059.stdout:checking for objdump... objdump 2023-09-21T00:18:56.060 INFO:teuthology.orchestra.run.smithi059.stdout:checking how to recognize dependent libraries... pass_all 2023-09-21T00:18:56.060 INFO:teuthology.orchestra.run.smithi059.stdout:checking for dlltool... no 2023-09-21T00:18:56.060 INFO:teuthology.orchestra.run.smithi059.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-09-21T00:18:56.061 INFO:teuthology.orchestra.run.smithi059.stdout:checking for ar... ar 2023-09-21T00:18:56.086 INFO:teuthology.orchestra.run.smithi059.stdout:checking for archiver @FILE support... @ 2023-09-21T00:18:56.086 INFO:teuthology.orchestra.run.smithi059.stdout:checking for strip... strip 2023-09-21T00:18:56.087 INFO:teuthology.orchestra.run.smithi059.stdout:checking for ranlib... ranlib 2023-09-21T00:18:56.087 INFO:teuthology.orchestra.run.smithi059.stdout:checking for gawk... gawk 2023-09-21T00:18:56.139 INFO:teuthology.orchestra.run.smithi059.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-09-21T00:18:56.140 INFO:teuthology.orchestra.run.smithi059.stdout:checking for sysroot... no 2023-09-21T00:18:56.143 INFO:teuthology.orchestra.run.smithi059.stdout:checking for a working dd... /bin/dd 2023-09-21T00:18:56.146 INFO:teuthology.orchestra.run.smithi059.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-09-21T00:18:56.159 INFO:teuthology.orchestra.run.smithi059.stdout:checking for mt... no 2023-09-21T00:18:56.161 INFO:teuthology.orchestra.run.smithi059.stdout:checking if : is a manifest tool... no 2023-09-21T00:18:56.188 INFO:teuthology.orchestra.run.smithi059.stdout:checking how to run the C preprocessor... gcc -E 2023-09-21T00:18:56.337 INFO:teuthology.orchestra.run.smithi059.stdout:checking for ANSI C header files... yes 2023-09-21T00:18:56.357 INFO:teuthology.orchestra.run.smithi059.stdout:checking for sys/types.h... yes 2023-09-21T00:18:56.381 INFO:teuthology.orchestra.run.smithi059.stdout:checking for sys/stat.h... yes 2023-09-21T00:18:56.405 INFO:teuthology.orchestra.run.smithi059.stdout:checking for stdlib.h... yes 2023-09-21T00:18:56.430 INFO:teuthology.orchestra.run.smithi059.stdout:checking for string.h... yes 2023-09-21T00:18:56.455 INFO:teuthology.orchestra.run.smithi059.stdout:checking for memory.h... yes 2023-09-21T00:18:56.480 INFO:teuthology.orchestra.run.smithi059.stdout:checking for strings.h... yes 2023-09-21T00:18:56.508 INFO:teuthology.orchestra.run.smithi059.stdout:checking for inttypes.h... yes 2023-09-21T00:18:56.533 INFO:teuthology.orchestra.run.smithi059.stdout:checking for stdint.h... yes 2023-09-21T00:18:56.562 INFO:teuthology.orchestra.run.smithi059.stdout:checking for unistd.h... yes 2023-09-21T00:18:56.597 INFO:teuthology.orchestra.run.smithi059.stdout:checking for dlfcn.h... yes 2023-09-21T00:18:56.600 INFO:teuthology.orchestra.run.smithi059.stdout:checking for objdir... .libs 2023-09-21T00:18:56.668 INFO:teuthology.orchestra.run.smithi059.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-09-21T00:18:56.668 INFO:teuthology.orchestra.run.smithi059.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-09-21T00:18:56.683 INFO:teuthology.orchestra.run.smithi059.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-09-21T00:18:56.703 INFO:teuthology.orchestra.run.smithi059.stdout:checking if gcc static flag -static works... no 2023-09-21T00:18:56.723 INFO:teuthology.orchestra.run.smithi059.stdout:checking if gcc supports -c -o file.o... yes 2023-09-21T00:18:56.724 INFO:teuthology.orchestra.run.smithi059.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-09-21T00:18:56.730 INFO:teuthology.orchestra.run.smithi059.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-09-21T00:18:56.754 INFO:teuthology.orchestra.run.smithi059.stdout:checking whether -lc should be explicitly linked in... no 2023-09-21T00:18:56.798 INFO:teuthology.orchestra.run.smithi059.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-09-21T00:18:56.799 INFO:teuthology.orchestra.run.smithi059.stdout:checking how to hardcode library paths into programs... immediate 2023-09-21T00:18:56.800 INFO:teuthology.orchestra.run.smithi059.stdout:checking whether stripping libraries is possible... yes 2023-09-21T00:18:56.801 INFO:teuthology.orchestra.run.smithi059.stdout:checking if libtool supports shared libraries... yes 2023-09-21T00:18:56.801 INFO:teuthology.orchestra.run.smithi059.stdout:checking whether to build shared libraries... yes 2023-09-21T00:18:56.801 INFO:teuthology.orchestra.run.smithi059.stdout:checking whether to build static libraries... yes 2023-09-21T00:18:56.805 INFO:teuthology.orchestra.run.smithi059.stdout:checking for gcc... (cached) gcc 2023-09-21T00:18:56.821 INFO:teuthology.orchestra.run.smithi059.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-09-21T00:18:56.821 INFO:teuthology.orchestra.run.smithi059.stdout:checking whether gcc accepts -g... (cached) yes 2023-09-21T00:18:56.822 INFO:teuthology.orchestra.run.smithi059.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-09-21T00:18:56.822 INFO:teuthology.orchestra.run.smithi059.stdout:checking for gmake... /usr/bin/gmake 2023-09-21T00:18:56.823 INFO:teuthology.orchestra.run.smithi059.stderr:./configure: line 12070: test: $(SHELL): binary operator expected 2023-09-21T00:18:56.824 INFO:teuthology.orchestra.run.smithi059.stdout:checking for tar... /bin/tar 2023-09-21T00:18:56.824 INFO:teuthology.orchestra.run.smithi059.stdout:checking for gzip... /bin/gzip 2023-09-21T00:18:56.829 INFO:teuthology.orchestra.run.smithi059.stdout:checking whether gcc -MM is supported... yes 2023-09-21T00:18:56.830 INFO:teuthology.orchestra.run.smithi059.stdout:checking for sort... /bin/sort 2023-09-21T00:18:56.830 INFO:teuthology.orchestra.run.smithi059.stdout:checking whether ln -s works... yes 2023-09-21T00:18:56.830 INFO:teuthology.orchestra.run.smithi059.stdout:checking for rpm... /bin/rpm 2023-09-21T00:18:56.834 INFO:teuthology.orchestra.run.smithi059.stdout:checking for rpmbuild... no 2023-09-21T00:18:56.863 INFO:teuthology.orchestra.run.smithi059.stdout:checking assert.h usability... yes 2023-09-21T00:18:56.869 INFO:teuthology.orchestra.run.smithi059.stdout:checking assert.h presence... yes 2023-09-21T00:18:56.870 INFO:teuthology.orchestra.run.smithi059.stdout:checking for assert.h... yes 2023-09-21T00:18:56.896 INFO:teuthology.orchestra.run.smithi059.stdout:checking bstring.h usability... no 2023-09-21T00:18:56.906 INFO:teuthology.orchestra.run.smithi059.stdout:checking bstring.h presence... no 2023-09-21T00:18:56.906 INFO:teuthology.orchestra.run.smithi059.stdout:checking for bstring.h... no 2023-09-21T00:18:56.931 INFO:teuthology.orchestra.run.smithi059.stdout:checking libgen.h usability... yes 2023-09-21T00:18:56.938 INFO:teuthology.orchestra.run.smithi059.stdout:checking libgen.h presence... yes 2023-09-21T00:18:56.938 INFO:teuthology.orchestra.run.smithi059.stdout:checking for libgen.h... yes 2023-09-21T00:18:56.966 INFO:teuthology.orchestra.run.smithi059.stdout:checking dirent.h usability... yes 2023-09-21T00:18:56.974 INFO:teuthology.orchestra.run.smithi059.stdout:checking dirent.h presence... yes 2023-09-21T00:18:56.975 INFO:teuthology.orchestra.run.smithi059.stdout:checking for dirent.h... yes 2023-09-21T00:18:57.034 INFO:teuthology.orchestra.run.smithi059.stdout:checking errno.h usability... yes 2023-09-21T00:18:57.039 INFO:teuthology.orchestra.run.smithi059.stdout:checking errno.h presence... yes 2023-09-21T00:18:57.039 INFO:teuthology.orchestra.run.smithi059.stdout:checking for errno.h... yes 2023-09-21T00:18:57.067 INFO:teuthology.orchestra.run.smithi059.stdout:checking malloc.h usability... yes 2023-09-21T00:18:57.075 INFO:teuthology.orchestra.run.smithi059.stdout:checking malloc.h presence... yes 2023-09-21T00:18:57.075 INFO:teuthology.orchestra.run.smithi059.stdout:checking for malloc.h... yes 2023-09-21T00:18:57.102 INFO:teuthology.orchestra.run.smithi059.stdout:checking uuid.h usability... no 2023-09-21T00:18:57.111 INFO:teuthology.orchestra.run.smithi059.stdout:checking uuid.h presence... no 2023-09-21T00:18:57.111 INFO:teuthology.orchestra.run.smithi059.stdout:checking for uuid.h... no 2023-09-21T00:18:57.139 INFO:teuthology.orchestra.run.smithi059.stdout:checking uuid/uuid.h usability... yes 2023-09-21T00:18:57.147 INFO:teuthology.orchestra.run.smithi059.stdout:checking uuid/uuid.h presence... yes 2023-09-21T00:18:57.148 INFO:teuthology.orchestra.run.smithi059.stdout:checking for uuid/uuid.h... yes 2023-09-21T00:18:57.174 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/uuid.h usability... no 2023-09-21T00:18:57.184 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/uuid.h presence... no 2023-09-21T00:18:57.184 INFO:teuthology.orchestra.run.smithi059.stdout:checking for sys/uuid.h... no 2023-09-21T00:18:57.210 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/file.h usability... yes 2023-09-21T00:18:57.217 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/file.h presence... yes 2023-09-21T00:18:57.217 INFO:teuthology.orchestra.run.smithi059.stdout:checking for sys/file.h... yes 2023-09-21T00:18:57.245 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/fcntl.h usability... yes 2023-09-21T00:18:57.252 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/fcntl.h presence... yes 2023-09-21T00:18:57.253 INFO:teuthology.orchestra.run.smithi059.stdout:checking for sys/fcntl.h... yes 2023-09-21T00:18:57.279 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/syssgi.h usability... no 2023-09-21T00:18:57.288 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/syssgi.h presence... no 2023-09-21T00:18:57.289 INFO:teuthology.orchestra.run.smithi059.stdout:checking for sys/syssgi.h... no 2023-09-21T00:18:57.332 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/param.h usability... yes 2023-09-21T00:18:57.342 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/param.h presence... yes 2023-09-21T00:18:57.342 INFO:teuthology.orchestra.run.smithi059.stdout:checking for sys/param.h... yes 2023-09-21T00:18:57.347 INFO:teuthology.orchestra.run.smithi059.stdout:checking for sys/stat.h... (cached) yes 2023-09-21T00:18:57.375 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/statvfs.h usability... yes 2023-09-21T00:18:57.382 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/statvfs.h presence... yes 2023-09-21T00:18:57.382 INFO:teuthology.orchestra.run.smithi059.stdout:checking for sys/statvfs.h... yes 2023-09-21T00:18:57.410 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/time.h usability... yes 2023-09-21T00:18:57.417 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/time.h presence... yes 2023-09-21T00:18:57.417 INFO:teuthology.orchestra.run.smithi059.stdout:checking for sys/time.h... yes 2023-09-21T00:18:57.447 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/ioctl.h usability... yes 2023-09-21T00:18:57.454 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/ioctl.h presence... yes 2023-09-21T00:18:57.455 INFO:teuthology.orchestra.run.smithi059.stdout:checking for sys/ioctl.h... yes 2023-09-21T00:18:57.485 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/wait.h usability... yes 2023-09-21T00:18:57.494 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/wait.h presence... yes 2023-09-21T00:18:57.494 INFO:teuthology.orchestra.run.smithi059.stdout:checking for sys/wait.h... yes 2023-09-21T00:18:57.499 INFO:teuthology.orchestra.run.smithi059.stdout:checking for sys/types.h... (cached) yes 2023-09-21T00:18:57.504 INFO:teuthology.orchestra.run.smithi059.stdout:checking for strings.h... (cached) yes 2023-09-21T00:18:57.531 INFO:teuthology.orchestra.run.smithi059.stdout:checking err.h usability... yes 2023-09-21T00:18:57.538 INFO:teuthology.orchestra.run.smithi059.stdout:checking err.h presence... yes 2023-09-21T00:18:57.538 INFO:teuthology.orchestra.run.smithi059.stdout:checking for err.h... yes 2023-09-21T00:18:57.565 INFO:teuthology.orchestra.run.smithi059.stdout:checking linux/falloc.h usability... yes 2023-09-21T00:18:57.572 INFO:teuthology.orchestra.run.smithi059.stdout:checking linux/falloc.h presence... yes 2023-09-21T00:18:57.572 INFO:teuthology.orchestra.run.smithi059.stdout:checking for linux/falloc.h... yes 2023-09-21T00:18:57.598 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-09-21T00:18:57.608 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-09-21T00:18:57.608 INFO:teuthology.orchestra.run.smithi059.stdout:checking for sys/fs/xfs_fsops.h... no 2023-09-21T00:18:57.631 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/fs/xfs_itable.h usability... no 2023-09-21T00:18:57.641 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/fs/xfs_itable.h presence... no 2023-09-21T00:18:57.641 INFO:teuthology.orchestra.run.smithi059.stdout:checking for sys/fs/xfs_itable.h... no 2023-09-21T00:18:57.665 INFO:teuthology.orchestra.run.smithi059.stdout:checking xfs/platform_defs.h usability... no 2023-09-21T00:18:57.674 INFO:teuthology.orchestra.run.smithi059.stdout:checking xfs/platform_defs.h presence... no 2023-09-21T00:18:57.674 INFO:teuthology.orchestra.run.smithi059.stdout:checking for xfs/platform_defs.h... no 2023-09-21T00:18:57.698 INFO:teuthology.orchestra.run.smithi059.stdout:checking btrfs/ioctl.h usability... no 2023-09-21T00:18:57.707 INFO:teuthology.orchestra.run.smithi059.stdout:checking btrfs/ioctl.h presence... no 2023-09-21T00:18:57.707 INFO:teuthology.orchestra.run.smithi059.stdout:checking for btrfs/ioctl.h... no 2023-09-21T00:18:57.731 INFO:teuthology.orchestra.run.smithi059.stdout:checking cifs/ioctl.h usability... no 2023-09-21T00:18:57.740 INFO:teuthology.orchestra.run.smithi059.stdout:checking cifs/ioctl.h presence... no 2023-09-21T00:18:57.740 INFO:teuthology.orchestra.run.smithi059.stdout:checking for cifs/ioctl.h... no 2023-09-21T00:18:57.766 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/mman.h usability... yes 2023-09-21T00:18:57.773 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/mman.h presence... yes 2023-09-21T00:18:57.774 INFO:teuthology.orchestra.run.smithi059.stdout:checking for sys/mman.h... yes 2023-09-21T00:18:57.788 INFO:teuthology.orchestra.run.smithi059.stdout:checking for xfs/xfs_log_format.h... no 2023-09-21T00:18:57.823 INFO:teuthology.orchestra.run.smithi059.stdout:checking for uuid_compare... no 2023-09-21T00:18:57.853 INFO:teuthology.orchestra.run.smithi059.stdout:checking for uuid_compare in -luuid... yes 2023-09-21T00:18:57.903 INFO:teuthology.orchestra.run.smithi059.stdout:checking for xfs/xfs.h... yes 2023-09-21T00:18:57.917 INFO:teuthology.orchestra.run.smithi059.stdout:checking for xfs/libxfs.h... no 2023-09-21T00:18:57.932 INFO:teuthology.orchestra.run.smithi059.stdout:checking whether xlog_assign_lsn is declared... no 2023-09-21T00:18:57.966 INFO:teuthology.orchestra.run.smithi059.stdout:checking for xfs/xqm.h... yes 2023-09-21T00:18:58.012 INFO:teuthology.orchestra.run.smithi059.stdout:checking xfsctl from xfs/xfs.h... ok 2023-09-21T00:18:58.036 INFO:teuthology.orchestra.run.smithi059.stdout:checking xfs/handle.h usability... yes 2023-09-21T00:18:58.042 INFO:teuthology.orchestra.run.smithi059.stdout:checking xfs/handle.h presence... yes 2023-09-21T00:18:58.042 INFO:teuthology.orchestra.run.smithi059.stdout:checking for xfs/handle.h... yes 2023-09-21T00:18:58.079 INFO:teuthology.orchestra.run.smithi059.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-09-21T00:18:58.105 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/acl.h usability... yes 2023-09-21T00:18:58.113 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/acl.h presence... yes 2023-09-21T00:18:58.113 INFO:teuthology.orchestra.run.smithi059.stdout:checking for sys/acl.h... yes 2023-09-21T00:18:58.142 INFO:teuthology.orchestra.run.smithi059.stdout:checking acl/libacl.h usability... yes 2023-09-21T00:18:58.150 INFO:teuthology.orchestra.run.smithi059.stdout:checking acl/libacl.h presence... yes 2023-09-21T00:18:58.150 INFO:teuthology.orchestra.run.smithi059.stdout:checking for acl/libacl.h... yes 2023-09-21T00:18:58.182 INFO:teuthology.orchestra.run.smithi059.stdout:checking for acl_init in -lacl... yes 2023-09-21T00:18:58.205 INFO:teuthology.orchestra.run.smithi059.stdout:checking gdbm-ndbm.h usability... no 2023-09-21T00:18:58.215 INFO:teuthology.orchestra.run.smithi059.stdout:checking gdbm-ndbm.h presence... no 2023-09-21T00:18:58.215 INFO:teuthology.orchestra.run.smithi059.stdout:checking for gdbm-ndbm.h... no 2023-09-21T00:18:58.236 INFO:teuthology.orchestra.run.smithi059.stdout:checking gdbm/ndbm.h usability... no 2023-09-21T00:18:58.246 INFO:teuthology.orchestra.run.smithi059.stdout:checking gdbm/ndbm.h presence... no 2023-09-21T00:18:58.246 INFO:teuthology.orchestra.run.smithi059.stdout:checking for gdbm/ndbm.h... no 2023-09-21T00:18:58.267 INFO:teuthology.orchestra.run.smithi059.stdout:checking ndbm.h usability... no 2023-09-21T00:18:58.277 INFO:teuthology.orchestra.run.smithi059.stdout:checking ndbm.h presence... no 2023-09-21T00:18:58.277 INFO:teuthology.orchestra.run.smithi059.stdout:checking for ndbm.h... no 2023-09-21T00:18:58.302 INFO:teuthology.orchestra.run.smithi059.stdout:checking libaio.h usability... yes 2023-09-21T00:18:58.312 INFO:teuthology.orchestra.run.smithi059.stdout:checking libaio.h presence... yes 2023-09-21T00:18:58.312 INFO:teuthology.orchestra.run.smithi059.stdout:checking for libaio.h... yes 2023-09-21T00:18:58.335 INFO:teuthology.orchestra.run.smithi059.stdout:checking liburing.h usability... no 2023-09-21T00:18:58.344 INFO:teuthology.orchestra.run.smithi059.stdout:checking liburing.h presence... no 2023-09-21T00:18:58.344 INFO:teuthology.orchestra.run.smithi059.stdout:checking for liburing.h... no 2023-09-21T00:18:58.366 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/capability.h usability... no 2023-09-21T00:18:58.375 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/capability.h presence... no 2023-09-21T00:18:58.376 INFO:teuthology.orchestra.run.smithi059.stdout:checking for sys/capability.h... no 2023-09-21T00:18:58.399 INFO:teuthology.orchestra.run.smithi059.stdout:checking linux/fiemap.h usability... yes 2023-09-21T00:18:58.405 INFO:teuthology.orchestra.run.smithi059.stdout:checking linux/fiemap.h presence... yes 2023-09-21T00:18:58.405 INFO:teuthology.orchestra.run.smithi059.stdout:checking for linux/fiemap.h... yes 2023-09-21T00:18:58.438 INFO:teuthology.orchestra.run.smithi059.stdout:checking for fallocate... yes 2023-09-21T00:18:58.471 INFO:teuthology.orchestra.run.smithi059.stdout:checking for open_by_handle_at... yes 2023-09-21T00:18:58.496 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/prctl.h usability... yes 2023-09-21T00:18:58.504 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/prctl.h presence... yes 2023-09-21T00:18:58.504 INFO:teuthology.orchestra.run.smithi059.stdout:checking for sys/prctl.h... yes 2023-09-21T00:18:58.528 INFO:teuthology.orchestra.run.smithi059.stdout:checking linux/fs.h usability... yes 2023-09-21T00:18:58.536 INFO:teuthology.orchestra.run.smithi059.stdout:checking linux/fs.h presence... yes 2023-09-21T00:18:58.536 INFO:teuthology.orchestra.run.smithi059.stdout:checking for linux/fs.h... yes 2023-09-21T00:18:58.557 INFO:teuthology.orchestra.run.smithi059.stdout:checking btrfsutil.h usability... no 2023-09-21T00:18:58.567 INFO:teuthology.orchestra.run.smithi059.stdout:checking btrfsutil.h presence... no 2023-09-21T00:18:58.567 INFO:teuthology.orchestra.run.smithi059.stdout:checking for btrfsutil.h... no 2023-09-21T00:18:58.604 INFO:teuthology.orchestra.run.smithi059.stdout:checking for copy_file_range... yes 2023-09-21T00:18:58.639 INFO:teuthology.orchestra.run.smithi059.stdout:checking for SEEK_DATA... yes 2023-09-21T00:18:58.685 INFO:teuthology.orchestra.run.smithi059.stdout:checking for BMV_OF_SHARED... yes 2023-09-21T00:18:58.720 INFO:teuthology.orchestra.run.smithi059.stdout:checking for nftw... yes 2023-09-21T00:18:58.761 INFO:teuthology.orchestra.run.smithi059.stdout:checking for RLIMIT_NOFILE... yes 2023-09-21T00:18:58.778 INFO:teuthology.orchestra.run.smithi059.stdout:checking for FIEXCHANGE_RANGE... no 2023-09-21T00:18:58.811 INFO:teuthology.orchestra.run.smithi059.stdout:checking for renameat2... yes 2023-09-21T00:18:58.844 INFO:teuthology.orchestra.run.smithi059.stdout:checking for reallocarray... yes 2023-09-21T00:18:58.857 INFO:teuthology.orchestra.run.smithi059.stdout:checking for struct mount_attr... no 2023-09-21T00:18:58.902 INFO:teuthology.orchestra.run.smithi059.stdout:checking for struct btrfs_qgroup_limit... yes 2023-09-21T00:18:58.936 INFO:teuthology.orchestra.run.smithi059.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-09-21T00:18:58.978 INFO:teuthology.orchestra.run.smithi059.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-09-21T00:18:59.013 INFO:teuthology.orchestra.run.smithi059.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-09-21T00:18:59.047 INFO:teuthology.orchestra.run.smithi059.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-09-21T00:18:59.081 INFO:teuthology.orchestra.run.smithi059.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-09-21T00:18:59.116 INFO:teuthology.orchestra.run.smithi059.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-09-21T00:18:59.143 INFO:teuthology.orchestra.run.smithi059.stdout:checking linux/btrfs.h usability... yes 2023-09-21T00:18:59.150 INFO:teuthology.orchestra.run.smithi059.stdout:checking linux/btrfs.h presence... yes 2023-09-21T00:18:59.151 INFO:teuthology.orchestra.run.smithi059.stdout:checking for linux/btrfs.h... yes 2023-09-21T00:18:59.180 INFO:teuthology.orchestra.run.smithi059.stdout:checking linux/btrfs_tree.h usability... yes 2023-09-21T00:18:59.187 INFO:teuthology.orchestra.run.smithi059.stdout:checking linux/btrfs_tree.h presence... yes 2023-09-21T00:18:59.188 INFO:teuthology.orchestra.run.smithi059.stdout:checking for linux/btrfs_tree.h... yes 2023-09-21T00:18:59.218 INFO:teuthology.orchestra.run.smithi059.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2023-09-21T00:18:59.235 INFO:teuthology.orchestra.run.smithi059.stdout:configure: creating ./config.status 2023-09-21T00:18:59.542 INFO:teuthology.orchestra.run.smithi059.stdout:config.status: creating include/builddefs 2023-09-21T00:18:59.553 INFO:teuthology.orchestra.run.smithi059.stdout:config.status: creating include/config.h 2023-09-21T00:18:59.561 INFO:teuthology.orchestra.run.smithi059.stdout:config.status: executing libtool commands 2023-09-21T00:18:59.600 INFO:teuthology.orchestra.run.smithi059.stdout:Building include 2023-09-21T00:18:59.603 INFO:teuthology.orchestra.run.smithi059.stdout:Building lib 2023-09-21T00:18:59.606 INFO:teuthology.orchestra.run.smithi059.stdout: [LTDEP] 2023-09-21T00:18:59.716 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] dataascii.lo 2023-09-21T00:18:59.831 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] databin.lo 2023-09-21T00:18:59.974 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] datapid.lo 2023-09-21T00:19:00.073 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] file_lock.lo 2023-09-21T00:19:00.214 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] forker.lo 2023-09-21T00:19:00.342 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] pattern.lo 2023-09-21T00:19:00.459 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] open_flags.lo 2023-09-21T00:19:00.596 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] random_range.lo 2023-09-21T00:19:00.811 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] string_to_tokens.lo 2023-09-21T00:19:00.913 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] str_to_bytes.lo 2023-09-21T00:19:01.038 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] tlibio.lo 2023-09-21T00:19:01.258 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] write_log.lo 2023-09-21T00:19:01.485 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] random.lo 2023-09-21T00:19:01.598 INFO:teuthology.orchestra.run.smithi059.stdout: [LD] 2023-09-21T00:19:01.669 INFO:teuthology.orchestra.run.smithi059.stdout:Building ltp 2023-09-21T00:19:01.672 INFO:teuthology.orchestra.run.smithi059.stdout: [DEP] 2023-09-21T00:19:01.797 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] doio 2023-09-21T00:19:02.413 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] fsstress 2023-09-21T00:19:03.659 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] fsx 2023-09-21T00:19:04.476 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] growfiles 2023-09-21T00:19:04.955 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] iogen 2023-09-21T00:19:05.288 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] aio-stress 2023-09-21T00:19:05.681 INFO:teuthology.orchestra.run.smithi059.stdout:Building src 2023-09-21T00:19:05.686 INFO:teuthology.orchestra.run.smithi059.stdout: [DEP] 2023-09-21T00:19:06.889 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:19:06.892 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:19:07.061 INFO:teuthology.orchestra.run.smithi059.stdout: [DEP] 2023-09-21T00:19:07.087 INFO:teuthology.orchestra.run.smithi059.stdout: [DEP] 2023-09-21T00:19:07.094 INFO:teuthology.orchestra.run.smithi059.stdout: [DEP] 2023-09-21T00:19:07.284 INFO:teuthology.orchestra.run.smithi059.stdout: [DEP] 2023-09-21T00:19:07.305 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] dirstress 2023-09-21T00:19:07.526 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] fill 2023-09-21T00:19:07.671 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] fill2 2023-09-21T00:19:07.883 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] getpagesize 2023-09-21T00:19:08.017 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] holes 2023-09-21T00:19:08.198 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] lstat64 2023-09-21T00:19:08.370 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] nametest 2023-09-21T00:19:08.594 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] permname 2023-09-21T00:19:08.781 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] randholes 2023-09-21T00:19:09.012 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] runas 2023-09-21T00:19:09.177 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] truncfile 2023-09-21T00:19:09.356 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] usemem 2023-09-21T00:19:09.499 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] mmapcat 2023-09-21T00:19:09.641 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] append_reader 2023-09-21T00:19:09.783 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] append_writer 2023-09-21T00:19:09.930 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] dirperf 2023-09-21T00:19:10.136 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] metaperf 2023-09-21T00:19:10.373 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] devzero 2023-09-21T00:19:10.536 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] feature 2023-09-21T00:19:10.736 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] alloc 2023-09-21T00:19:10.933 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] fault 2023-09-21T00:19:11.087 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] fstest 2023-09-21T00:19:11.309 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_access_root 2023-09-21T00:19:11.454 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] godown 2023-09-21T00:19:11.613 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] resvtest 2023-09-21T00:19:11.786 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] writemod 2023-09-21T00:19:11.922 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] writev_on_pagefault 2023-09-21T00:19:12.072 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] makeextents 2023-09-21T00:19:12.238 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] itrash 2023-09-21T00:19:12.386 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] rename 2023-09-21T00:19:12.517 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] multi_open_unlink 2023-09-21T00:19:12.672 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] unwritten_sync 2023-09-21T00:19:12.841 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] genhashnames 2023-09-21T00:19:13.018 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_holes 2023-09-21T00:19:13.158 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_mmap_writev 2023-09-21T00:19:13.297 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_truncate_cmtime 2023-09-21T00:19:13.446 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] dirhash_collide 2023-09-21T00:19:13.616 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_rename_overwrite 2023-09-21T00:19:13.750 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] holetest 2023-09-21T00:19:13.954 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_truncate_self 2023-09-21T00:19:14.087 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] af_unix 2023-09-21T00:19:14.231 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_mmap_stale_pmd 2023-09-21T00:19:14.378 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_mmap_cow_race 2023-09-21T00:19:14.533 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_mmap_fallocate 2023-09-21T00:19:14.674 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] fsync-err 2023-09-21T00:19:14.847 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_mmap_write_ro 2023-09-21T00:19:14.990 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_ext4_dax_journal_corruption 2023-09-21T00:19:15.142 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_ext4_dax_inline_corruption 2023-09-21T00:19:15.287 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_ofd_locks 2023-09-21T00:19:15.471 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_mmap_collision 2023-09-21T00:19:15.655 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] mmap-write-concurrent 2023-09-21T00:19:15.816 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_get_file_time 2023-09-21T00:19:15.956 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_create_short_dirs 2023-09-21T00:19:16.113 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_create_long_dirs 2023-09-21T00:19:16.267 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_enospc 2023-09-21T00:19:16.442 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_mmap_writev_overlap 2023-09-21T00:19:16.602 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] checkpoint_journal 2023-09-21T00:19:16.749 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] mmap-rw-fault 2023-09-21T00:19:16.924 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] allocstale 2023-09-21T00:19:17.084 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_mmap_cow_memory_failure 2023-09-21T00:19:17.244 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] fake-dump-rootino 2023-09-21T00:19:17.386 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] dio-buf-fault 2023-09-21T00:19:17.532 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] xfsctl 2023-09-21T00:19:17.709 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] bstat 2023-09-21T00:19:17.899 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_mtab 2023-09-21T00:19:18.073 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] getdevicesize 2023-09-21T00:19:18.206 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] preallo_rw_pattern_reader 2023-09-21T00:19:18.355 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] preallo_rw_pattern_writer 2023-09-21T00:19:18.504 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] ftrunc 2023-09-21T00:19:18.644 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] trunc 2023-09-21T00:19:18.795 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] fs_perms 2023-09-21T00:19:18.951 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] testx 2023-09-21T00:19:19.077 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] looptest 2023-09-21T00:19:19.258 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] locktest 2023-09-21T00:19:19.552 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] unwritten_mmap 2023-09-21T00:19:19.705 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] bulkstat_unlink_test 2023-09-21T00:19:19.892 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] deduperace 2023-09-21T00:19:20.074 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] bulkstat_unlink_test_modified 2023-09-21T00:19:20.259 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_dir_offset 2023-09-21T00:19:20.399 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_futimens 2023-09-21T00:19:20.535 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_immutable 2023-09-21T00:19:21.104 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] stale_handle 2023-09-21T00:19:21.264 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] pwrite_mmap_blocked 2023-09-21T00:19:21.408 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_dir_offset2 2023-09-21T00:19:21.589 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] seek_sanity_test 2023-09-21T00:19:21.996 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] seek_copy_test 2023-09-21T00:19:22.163 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_readdir_1 2023-09-21T00:19:22.303 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_readdir_2 2023-09-21T00:19:22.446 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] fsync-tester 2023-09-21T00:19:22.678 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] nsexec 2023-09-21T00:19:22.843 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] cloner 2023-09-21T00:19:23.011 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] renameat2 2023-09-21T00:19:23.168 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_getcwd 2023-09-21T00:19:23.317 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] e4compact 2023-09-21T00:19:23.505 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] test-nextquota 2023-09-21T00:19:23.665 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] punch-alternating 2023-09-21T00:19:23.825 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] attr-list-by-handle-cursor-test 2023-09-21T00:19:23.984 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] listxattr 2023-09-21T00:19:24.125 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] dio-interleaved 2023-09-21T00:19:24.276 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_dir_type 2023-09-21T00:19:24.423 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] dio-invalidate-cache 2023-09-21T00:19:24.641 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] stat_test 2023-09-21T00:19:24.920 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_encrypted_d_revalidate 2023-09-21T00:19:25.076 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] attr_replace_test 2023-09-21T00:19:25.230 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] swapon 2023-09-21T00:19:25.386 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] mkswap 2023-09-21T00:19:25.530 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_attr_corruption 2023-09-21T00:19:25.672 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_open_tmpfiles 2023-09-21T00:19:25.842 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] fscrypt-crypt-util 2023-09-21T00:19:26.440 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] bulkstat_null_ocount 2023-09-21T00:19:26.590 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] splice-test 2023-09-21T00:19:26.761 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] chprojid_fail 2023-09-21T00:19:26.913 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] detached_mounts_propagation 2023-09-21T00:19:27.086 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] ext4_resize 2023-09-21T00:19:27.228 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_readdir_3 2023-09-21T00:19:27.411 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] splice2pipe 2023-09-21T00:19:27.566 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] uuid_ioctl 2023-09-21T00:19:27.712 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] fiemap-tester 2023-09-21T00:19:27.963 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_stripealign 2023-09-21T00:19:28.111 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] open_by_handle 2023-09-21T00:19:28.349 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_mmap_dio 2023-09-21T00:19:28.502 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] xfsfind 2023-09-21T00:19:28.683 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] fssum 2023-09-21T00:19:29.089 INFO:teuthology.orchestra.run.smithi059.stdout:Building log-writes 2023-09-21T00:19:29.094 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] replay-log 2023-09-21T00:19:29.385 INFO:teuthology.orchestra.run.smithi059.stdout:Building perf 2023-09-21T00:19:29.388 INFO:teuthology.orchestra.run.smithi059.stdout:Building aio-dio-regress 2023-09-21T00:19:29.394 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] aio-dio-append-write-fallocate-race 2023-09-21T00:19:29.558 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] aio-dio-fcntl-race 2023-09-21T00:19:29.716 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] aio-dio-subblock-eof-read 2023-09-21T00:19:29.858 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] aio-dio-append-write-read-race 2023-09-21T00:19:30.026 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] aio-dio-invalidate-readahead 2023-09-21T00:19:30.185 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] aio-dio-write-verify 2023-09-21T00:19:30.369 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-09-21T00:19:30.501 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] aio-last-ref-held-by-io 2023-09-21T00:19:30.668 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] aio-dio-cycle-write 2023-09-21T00:19:30.845 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] aio-dio-extend-stat 2023-09-21T00:19:31.004 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-09-21T00:19:31.135 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] aio-dio-hole-filling-race 2023-09-21T00:19:31.279 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] aio-dio-invalidate-failure 2023-09-21T00:19:31.433 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] aiodio_sparse2 2023-09-21T00:19:31.638 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] aiocp 2023-09-21T00:19:31.852 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] aio-dio-cow-race 2023-09-21T00:19:32.002 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] aio-dio-eof-race 2023-09-21T00:19:32.178 INFO:teuthology.orchestra.run.smithi059.stdout:Building vfs 2023-09-21T00:19:32.183 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] vfstest 2023-09-21T00:19:33.939 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] mount-idmapped 2023-09-21T00:19:34.290 INFO:teuthology.orchestra.run.smithi059.stdout:Building m4 2023-09-21T00:19:34.293 INFO:teuthology.orchestra.run.smithi059.stdout:Building common 2023-09-21T00:19:34.296 INFO:teuthology.orchestra.run.smithi059.stdout:Building tests 2023-09-21T00:19:34.302 INFO:teuthology.orchestra.run.smithi059.stdout:Building perf 2023-09-21T00:19:34.307 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.evOnb5iVkLxfstests-dev/tests/perf/group.list 2023-09-21T00:19:34.317 INFO:teuthology.orchestra.run.smithi059.stdout:Building ext4 2023-09-21T00:19:34.322 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.evOnb5iVkLxfstests-dev/tests/ext4/group.list 2023-09-21T00:19:34.357 INFO:teuthology.orchestra.run.smithi059.stdout:Building ocfs2 2023-09-21T00:19:34.362 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.evOnb5iVkLxfstests-dev/tests/ocfs2/group.list 2023-09-21T00:19:34.374 INFO:teuthology.orchestra.run.smithi059.stdout:Building overlay 2023-09-21T00:19:34.379 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.evOnb5iVkLxfstests-dev/tests/overlay/group.list 2023-09-21T00:19:34.416 INFO:teuthology.orchestra.run.smithi059.stdout:Building cifs 2023-09-21T00:19:34.420 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.evOnb5iVkLxfstests-dev/tests/cifs/group.list 2023-09-21T00:19:34.432 INFO:teuthology.orchestra.run.smithi059.stdout:Building generic 2023-09-21T00:19:34.438 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.evOnb5iVkLxfstests-dev/tests/generic/group.list 2023-09-21T00:19:34.532 INFO:teuthology.orchestra.run.smithi059.stdout:Building shared 2023-09-21T00:19:34.538 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.evOnb5iVkLxfstests-dev/tests/shared/group.list 2023-09-21T00:19:34.553 INFO:teuthology.orchestra.run.smithi059.stdout:Building nfs 2023-09-21T00:19:34.558 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.evOnb5iVkLxfstests-dev/tests/nfs/group.list 2023-09-21T00:19:34.571 INFO:teuthology.orchestra.run.smithi059.stdout:Building f2fs 2023-09-21T00:19:34.576 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.evOnb5iVkLxfstests-dev/tests/f2fs/group.list 2023-09-21T00:19:34.591 INFO:teuthology.orchestra.run.smithi059.stdout:Building udf 2023-09-21T00:19:34.596 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.evOnb5iVkLxfstests-dev/tests/udf/group.list 2023-09-21T00:19:34.607 INFO:teuthology.orchestra.run.smithi059.stdout:Building ceph 2023-09-21T00:19:34.612 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.evOnb5iVkLxfstests-dev/tests/ceph/group.list 2023-09-21T00:19:34.625 INFO:teuthology.orchestra.run.smithi059.stdout:Building xfs 2023-09-21T00:19:34.631 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.evOnb5iVkLxfstests-dev/tests/xfs/group.list 2023-09-21T00:19:34.726 INFO:teuthology.orchestra.run.smithi059.stdout:Building btrfs 2023-09-21T00:19:34.731 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.evOnb5iVkLxfstests-dev/tests/btrfs/group.list 2023-09-21T00:19:34.787 INFO:teuthology.orchestra.run.smithi059.stdout:Building tmpfs 2023-09-21T00:19:34.792 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.evOnb5iVkLxfstests-dev/tests/tmpfs/group.list 2023-09-21T00:19:34.804 INFO:teuthology.orchestra.run.smithi059.stdout:Building selftest 2023-09-21T00:19:34.809 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.evOnb5iVkLxfstests-dev/tests/selftest/group.list 2023-09-21T00:19:34.823 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo make install) 2023-09-21T00:19:34.861 INFO:teuthology.orchestra.run.smithi059.stdout:Building include 2023-09-21T00:19:34.864 INFO:teuthology.orchestra.run.smithi059.stdout:Building lib 2023-09-21T00:19:34.868 INFO:teuthology.orchestra.run.smithi059.stdout:Building ltp 2023-09-21T00:19:34.872 INFO:teuthology.orchestra.run.smithi059.stdout:Building src 2023-09-21T00:19:34.905 INFO:teuthology.orchestra.run.smithi059.stdout:Building log-writes 2023-09-21T00:19:34.908 INFO:teuthology.orchestra.run.smithi059.stdout:Building perf 2023-09-21T00:19:34.912 INFO:teuthology.orchestra.run.smithi059.stdout:Building aio-dio-regress 2023-09-21T00:19:34.916 INFO:teuthology.orchestra.run.smithi059.stdout:Building vfs 2023-09-21T00:19:34.920 INFO:teuthology.orchestra.run.smithi059.stdout:Building m4 2023-09-21T00:19:34.923 INFO:teuthology.orchestra.run.smithi059.stdout:Building common 2023-09-21T00:19:34.926 INFO:teuthology.orchestra.run.smithi059.stdout:Building tests 2023-09-21T00:19:34.931 INFO:teuthology.orchestra.run.smithi059.stdout:Building perf 2023-09-21T00:19:34.936 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.evOnb5iVkLxfstests-dev/tests/perf/group.list 2023-09-21T00:19:34.947 INFO:teuthology.orchestra.run.smithi059.stdout:Building ext4 2023-09-21T00:19:34.952 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.evOnb5iVkLxfstests-dev/tests/ext4/group.list 2023-09-21T00:19:34.987 INFO:teuthology.orchestra.run.smithi059.stdout:Building ocfs2 2023-09-21T00:19:34.992 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.evOnb5iVkLxfstests-dev/tests/ocfs2/group.list 2023-09-21T00:19:35.004 INFO:teuthology.orchestra.run.smithi059.stdout:Building overlay 2023-09-21T00:19:35.009 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.evOnb5iVkLxfstests-dev/tests/overlay/group.list 2023-09-21T00:19:35.046 INFO:teuthology.orchestra.run.smithi059.stdout:Building cifs 2023-09-21T00:19:35.051 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.evOnb5iVkLxfstests-dev/tests/cifs/group.list 2023-09-21T00:19:35.062 INFO:teuthology.orchestra.run.smithi059.stdout:Building generic 2023-09-21T00:19:35.069 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.evOnb5iVkLxfstests-dev/tests/generic/group.list 2023-09-21T00:19:35.161 INFO:teuthology.orchestra.run.smithi059.stdout:Building shared 2023-09-21T00:19:35.166 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.evOnb5iVkLxfstests-dev/tests/shared/group.list 2023-09-21T00:19:35.182 INFO:teuthology.orchestra.run.smithi059.stdout:Building nfs 2023-09-21T00:19:35.186 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.evOnb5iVkLxfstests-dev/tests/nfs/group.list 2023-09-21T00:19:35.200 INFO:teuthology.orchestra.run.smithi059.stdout:Building f2fs 2023-09-21T00:19:35.205 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.evOnb5iVkLxfstests-dev/tests/f2fs/group.list 2023-09-21T00:19:35.220 INFO:teuthology.orchestra.run.smithi059.stdout:Building udf 2023-09-21T00:19:35.225 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.evOnb5iVkLxfstests-dev/tests/udf/group.list 2023-09-21T00:19:35.236 INFO:teuthology.orchestra.run.smithi059.stdout:Building ceph 2023-09-21T00:19:35.241 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.evOnb5iVkLxfstests-dev/tests/ceph/group.list 2023-09-21T00:19:35.254 INFO:teuthology.orchestra.run.smithi059.stdout:Building xfs 2023-09-21T00:19:35.260 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.evOnb5iVkLxfstests-dev/tests/xfs/group.list 2023-09-21T00:19:35.353 INFO:teuthology.orchestra.run.smithi059.stdout:Building btrfs 2023-09-21T00:19:35.359 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.evOnb5iVkLxfstests-dev/tests/btrfs/group.list 2023-09-21T00:19:35.414 INFO:teuthology.orchestra.run.smithi059.stdout:Building tmpfs 2023-09-21T00:19:35.419 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.evOnb5iVkLxfstests-dev/tests/tmpfs/group.list 2023-09-21T00:19:35.431 INFO:teuthology.orchestra.run.smithi059.stdout:Building selftest 2023-09-21T00:19:35.436 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.evOnb5iVkLxfstests-dev/tests/selftest/group.list 2023-09-21T00:19:35.447 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-09-21T00:19:35.449 INFO:teuthology.orchestra.run.smithi059.stdout:gmake[1]: Nothing to be done for 'install'. 2023-09-21T00:19:35.449 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-09-21T00:19:35.451 INFO:teuthology.orchestra.run.smithi059.stdout:gmake[1]: Nothing to be done for 'install'. 2023-09-21T00:19:35.451 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-09-21T00:19:35.453 INFO:teuthology.orchestra.run.smithi059.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-09-21T00:19:35.462 INFO:teuthology.orchestra.run.smithi059.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-09-21T00:19:35.541 INFO:teuthology.orchestra.run.smithi059.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-09-21T00:19:35.550 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-09-21T00:19:35.566 INFO:teuthology.orchestra.run.smithi059.stdout:Building log-writes 2023-09-21T00:19:35.569 INFO:teuthology.orchestra.run.smithi059.stdout:Building perf 2023-09-21T00:19:35.573 INFO:teuthology.orchestra.run.smithi059.stdout:Building aio-dio-regress 2023-09-21T00:19:35.577 INFO:teuthology.orchestra.run.smithi059.stdout:Building vfs 2023-09-21T00:19:35.580 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake -C log-writes install 2023-09-21T00:19:35.581 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-09-21T00:19:35.590 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-09-21T00:19:35.599 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake -C perf install 2023-09-21T00:19:35.601 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-09-21T00:19:35.610 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2023-09-21T00:19:35.633 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-09-21T00:19:35.635 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-09-21T00:19:35.644 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 aio-dio-append-write-fallocate-race aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-last-ref-held-by-io aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aio-dio-hole-filling-race aio-dio-invalidate-failure aiodio_sparse2 aiocp aio-dio-cow-race aio-dio-eof-race /var/lib/xfstests/src/aio-dio-regress 2023-09-21T00:19:35.698 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake -C vfs install 2023-09-21T00:19:35.699 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-09-21T00:19:35.708 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-09-21T00:19:35.721 INFO:teuthology.orchestra.run.smithi059.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-09-21T00:19:35.729 INFO:teuthology.orchestra.run.smithi059.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-09-21T00:19:36.955 INFO:teuthology.orchestra.run.smithi059.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2023-09-21T00:19:36.992 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:19:36.995 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:19:37.062 INFO:teuthology.orchestra.run.smithi059.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-09-21T00:19:37.093 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-09-21T00:19:37.095 INFO:teuthology.orchestra.run.smithi059.stdout:gmake[1]: Nothing to be done for 'install'. 2023-09-21T00:19:37.095 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-09-21T00:19:37.096 INFO:teuthology.orchestra.run.smithi059.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-09-21T00:19:37.105 INFO:teuthology.orchestra.run.smithi059.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-09-21T00:19:37.245 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-09-21T00:19:37.247 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.evOnb5iVkLxfstests-dev/tests/btrfs/ install 2023-09-21T00:19:37.249 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-09-21T00:19:37.258 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 299 300 /var/lib/xfstests/tests/btrfs 2023-09-21T00:19:38.105 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-09-21T00:19:38.114 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 175.out 186.out 240.out 092.out 077.out 140.out 265.out 236.out 108.out 204.out 233.out 194.out 234.out 295.out 109.out 033.out 082.out 252.out 270.out 040.out 176.out 202.out 137.out 034.out 125.out 014.out 165.out 181.out 152.out 024.out 192.out 148.out 282.out 267.out 052.out 256.out 228.out 183.out 273.out 251.out 110.out 043.out 069.out 151.out 206.out 195.out 274.out 215.out 115.out 015.out 275.out 250.out 191.out 281.out 046.out 051.out 131.out 244.out 219.out 119.out 019.out 128.out 177.out 232.out 189.out 220.out 120.out 020.out 102.out 263.out 171.out 261.out 045.out 217.out 117.out 017.out 072.out 068.out 048.out 062.out 038.out 084.out 129.out 066.out 029.out 229.out 103.out 111.out 011.out 243.out 134.out 170.out 260.out 157.out 143.out 133.out 286.out 161.out 246.out 216.out 116.out 016.out 155.out 296.out 118.out 287.out 067.out 010.out 238.out 141.out 114.out 138.out 095.out 297.out 160.out 091.out 081.out 071.out 061.out 085.out 037.out 300.out 200.out 100.out 025.out 258.out 185.out 269.out 208.out 039.out 173.out 222.out 035.out 169.out 098.out 290.out 080.out 070.out 060.out 207.out 106.out 009.out 167.out 211.out 158.out 182.out 146.out 188.out 293.out 104.out 089.out 086.out 254.out 279.out 225.out 174.out 156.out 268.out 135.out 257.out 124.out 172.out 063.out 058.out 113.out 262.out 036.out 042.out 047.out 193.out 097.out 271.out 283.out 083.out 199.out 099.out 278.out 007.out 209.out 053.out 164.out 154.out 239.out 241.out 002.out 178.out 190.out 214.out 074.out 056.out 041.out 057.out 005.out 223.out 150.out 123.out 179.out 144.out 032.out 277.out 205.out 136.out 096.out 198.out 008.out 280.out 050.out 105.out 027.out 187.out 153.out 088.out 285.out 044.out 201.out 101.out 001.out 266.out 237.out 065.out 231.out 227.out 075.out 028.out 213.out 142.out 013.out 031.out 272.out 078.out 184.out 259.out 210.out 132.out 093.out 235.out 127.out 230.out 166.out 292.out 130.out 023.out 073.out 030.out 203.out 003.out 055.out 291.out 245.out 145.out 159.out 249.out 122.out 076.out 022.out 289.out 006.out 284.out 299.out 224.out 276.out 149.out 064.out 264.out 218.out 018.out 168.out 021.out 079.out 054.out 059.out 049.out 226.out 163.out 126.out 121.out 026.out 180.out 253.out 255.out 139.out 090.out 221.out 087.out 294.out 212.out 112.out 094.out 012.out 247.out 107.out 248.out 162.out 147.out 288.out 197.out 196.out 242.out 004.out /var/lib/xfstests/tests/btrfs 2023-09-21T00:19:38.969 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.evOnb5iVkLxfstests-dev/tests/ceph/ install 2023-09-21T00:19:38.971 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-09-21T00:19:38.979 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-09-21T00:19:39.000 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-09-21T00:19:39.008 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/ceph 2023-09-21T00:19:39.029 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.evOnb5iVkLxfstests-dev/tests/cifs/ install 2023-09-21T00:19:39.030 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-09-21T00:19:39.039 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-09-21T00:19:39.048 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-09-21T00:19:39.057 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-09-21T00:19:39.066 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.evOnb5iVkLxfstests-dev/tests/ext4/ install 2023-09-21T00:19:39.068 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-09-21T00:19:39.077 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-09-21T00:19:39.273 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-09-21T00:19:39.282 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 032.out 039.out 305.out 005.out 008.out 035.out 036.out 308.out 050.out 040.out 306.out 007.out 021.out 046.out 012.out 009.out 033.out 045.out 034.out 056.out 047.out 018.out 023.out 302.out 020.out 002.out 014.out 024.out 013.out 031.out 015.out 304.out 004.out 048.out 038.out 052.out 303.out 029.out 011.out 027.out 042.out 044.out 055.out 030.out 058.out 003.out 017.out 043.out 053.out 016.out 059.out 037.out 301.out 010.out 022.out 006.out 057.out 025.out 026.out 271.out 051.out 041.out 307.out 019.out 028.out 054.out 049.out /var/lib/xfstests/tests/ext4 2023-09-21T00:19:39.490 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.evOnb5iVkLxfstests-dev/tests/f2fs/ install 2023-09-21T00:19:39.492 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-09-21T00:19:39.500 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-09-21T00:19:39.512 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-09-21T00:19:39.521 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-09-21T00:19:39.533 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.evOnb5iVkLxfstests-dev/tests/generic/ install 2023-09-21T00:19:39.537 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-09-21T00:19:39.546 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 /var/lib/xfstests/tests/generic 2023-09-21T00:19:41.626 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-09-21T00:19:41.635 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 050.out.xfsquota 035.out.nfs 035.out.default 050.out.nojournal 050.out.default 050.cfg 035.cfg 208.out 433.out 670.out 040.out 104.out 377.out 537.out 683.out 497.out 337.out 702.out 602.out 149.out 088.out 366.out 202.out 137.out 034.out 110.out 389.out 403.out 593.out 571.out 243.out 592.out 282.out 472.out 468.out 628.out 284.out 528.out 607.out 428.out 659.out 407.out 228.out 128.out 171.out 028.out 620.out 273.out 474.out 492.out 609.out 707.out 595.out 506.out 268.out 460.out 632.out 532.out 591.out 281.out 719.out 619.out 519.out 419.out 319.out 177.out 523.out 119.out 019.out 727.out 372.out 673.out 190.out 686.out 312.out 718.out 143.out 716.out 161.out 516.out 518.out 538.out 655.out 216.out 116.out 016.out 155.out 118.out 338.out 238.out 500.out 138.out 189.out 263.out 277.out 181.out 160.out 483.out 274.out 722.out 061.out 239.out 457.out 333.out 258.out 362.out 379.out 691.out 039.out 173.out 498.out 665.out 098.out 426.out 290.out 480.out 706.out 060.out 406.out 306.out 106.out 642.out 217.out 693.out 191.out 411.out 357.out 481.out 211.out 158.out 014.out 182.out 370.out 188.out 030.out 099.out 585.out 724.out 721.out 624.out 524.out 174.out 156.out 324.out 224.out 313.out 355.out 124.out 382.out 672.out 278.out 063.out 058.out 384.out 296.out 042.out 641.out 271.out 465.out 473.out 335.out 247.out 509.out 568.out 441.out 440.out 475.out 548.out 356.out 341.out 094.out 241.out 600.out 089.out 614.out 514.out 414.out 314.out 416.out 214.out 381.out 056.out 041.out 634.out 340.out 358.out 572.out 586.out 521.out 240.out 549.out 633.out 434.out 140.out 708.out 533.out 508.out 408.out 308.out 476.out 087.out 199.out 458.out 233.out 639.out 443.out 540.out 397.out 053.out 279.out 276.out 711.out 164.out 376.out 589.out 587.out 339.out 294.out 352.out 484.out 456.out 489.out 139.out 317.out 399.out 220.out 552.out 695.out 017.out 677.out 097.out 175.out 315.out 295.out 580.out 193.out 186.out 452.out 679.out 292.out 252.out 077.out 167.out 688.out 206.out 348.out 394.out 651.out 184.out 466.out 697.out 495.out 725.out 109.out 482.out 625.out 283.out 525.out 488.out 496.out 325.out 551.out 225.out 322.out 636.out 125.out 715.out 192.out 544.out 515.out 650.out 152.out 658.out 563.out 578.out 451.out 015.out 392.out 682.out 684.out 550.out 052.out 652.out 534.out 351.out 583.out 450.out 463.out 251.out 267.out 176.out 069.out 644.out 065.out 487.out 615.out 395.out 676.out 415.out 344.out 215.out 115.out 444.out 027.out 250.out 391.out 674.out 464.out 705.out 536.out 577.out 439.out 244.out 336.out 144.out 505.out 405.out 057.out 205.out 136.out 598.out 363.out 036.out 198.out 723.out 008.out 390.out 680.out 605.out 305.out 105.out 005.out 367.out 291.out 709.out 323.out 685.out 562.out 570.out 388.out 527.out 237.out 151.out 227.out 163.out 332.out 661.out 582.out 232.out 478.out 584.out 462.out 597.out 412.out 132.out 179.out 037.out 293.out 499.out 638.out 448.out 353.out 020.out 660.out 561.out 141.out 076.out 668.out 044.out 648.out 387.out 594.out 438.out 265.out 289.out 574.out 006.out 690.out 477.out 567.out 299.out 461.out 307.out 647.out 493.out 107.out 007.out 380.out 526.out 479.out 547.out 150.out 326.out 082.out 226.out 413.out 126.out 025.out 121.out 026.out 021.out 013.out 485.out 694.out 347.out 275.out 090.out 361.out 564.out 066.out 302.out 432.out 002.out 558.out 162.out 147.out 288.out 197.out 033.out 396.out 051.out 350.out 145.out 047.out 024.out 360.out 543.out 261.out 447.out 692.out 255.out 726.out 729.out 378.out 346.out 048.out 062.out 626.out 529.out 231.out 343.out 662.out 425.out 329.out 165.out 334.out 103.out 003.out 129.out 423.out 371.out 234.out 183.out 671.out 645.out 486.out 223.out 123.out 262.out 669.out 023.out 459.out 616.out 032.out 266.out 146.out 398.out 728.out 696.out 427.out 590.out 280.out 470.out 455.out 187.out 091.out 046.out 153.out 731.out 374.out 631.out 256.out 328.out 260.out 654.out 359.out 531.out 649.out 301.out 101.out 635.out 623.out 385.out 331.out 556.out 713.out 613.out 513.out 622.out 131.out 213.out 730.out 095.out 031.out 565.out 630.out 675.out 272.out 530.out 510.out 627.out 573.out 576.out 430.out 310.out 569.out 454.out 259.out 210.out 449.out 327.out 330.out 067.out 093.out 604.out 287.out 127.out 699.out 071.out 166.out 130.out 219.out 073.out 603.out 503.out 303.out 203.out 354.out 157.out 386.out 349.out 055.out 245.out 522.out 422.out 222.out 159.out 539.out 249.out 122.out 689.out 022.out 681.out 424.out 321.out 045.out 490.out 435.out 375.out 134.out 154.out 566.out 618.out 501.out 418.out 318.out 542.out 218.out 575.out 172.out 168.out 079.out 469.out 054.out 059.out 049.out 442.out 657.out 621.out 180.out 270.out 253.out 421.out 712.out 612.out 667.out 512.out 494.out 221.out 212.out 112.out 342.out 012.out 029.out 195.out 554.out 148.out 185.out 596.out 720.out 248.out 196.out 520.out 242.out 420.out 285.out 320.out 629.out 230.out 120.out 502.out 402.out 102.out 717.out 617.out 517.out 429.out 417.out 365.out 092.out 117.out 664.out 072.out 068.out 229.out 038.out 084.out 369.out 611.out 511.out 311.out 368.out 637.out 111.out 011.out 257.out 194.out 170.out 606.out 133.out 286.out 043.out 437.out 545.out 714.out 559.out 710.out 610.out 687.out 410.out 701.out 601.out 401.out 201.out 010.out 001.out 096.out 114.out 113.out 074.out 581.out 491.out 081.out 083.out 653.out 700.out 064.out 400.out 300.out 200.out 100.out 646.out 541.out 445.out 269.out 546.out 656.out 698.out 553.out 178.out 298.out 446.out 080.out 070.out 608.out 507.out 409.out 309.out 209.out 108.out 009.out 643.out 004.out 557.out 453.out 666.out 236.out 078.out 364.out 555.out 075.out 383.out 085.out 704.out 588.out 504.out 404.out 304.out 204.out 535.out 345.out 246.out 467.out 086.out 254.out 207.out 142.out 235.out 436.out 703.out 135.out 264.out 431.out 678.out 373.out 316.out 169.out 640.out 579.out 018.out 297.out 393.out 560.out 663.out 599.out /var/lib/xfstests/tests/generic 2023-09-21T00:19:43.741 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.evOnb5iVkLxfstests-dev/tests/nfs/ install 2023-09-21T00:19:43.742 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-09-21T00:19:43.751 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-09-21T00:19:43.760 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-09-21T00:19:43.769 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-09-21T00:19:43.780 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.evOnb5iVkLxfstests-dev/tests/ocfs2/ install 2023-09-21T00:19:43.780 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-09-21T00:19:43.789 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-09-21T00:19:43.798 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-09-21T00:19:43.807 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-09-21T00:19:43.816 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.evOnb5iVkLxfstests-dev/tests/overlay/ install 2023-09-21T00:19:43.818 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-09-21T00:19:43.827 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-09-21T00:19:44.106 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-09-21T00:19:44.115 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 035.out 019.out 034.out 018.out 024.out 077.out 069.out 020.out 102.out 014.out 013.out 031.out 015.out 117.out 017.out 072.out 068.out 063.out 048.out 062.out 038.out 026.out 042.out 052.out 110.out 067.out 029.out 111.out 055.out 112.out 073.out 078.out 030.out 058.out 003.out 045.out 023.out 043.out 053.out 109.out 036.out 116.out 016.out 010.out 001.out 022.out 106.out 007.out 006.out 115.out 057.out 113.out 114.out 074.out 046.out 071.out 061.out 025.out 051.out 011.out 041.out 047.out 100.out 064.out 107.out 104.out 028.out 076.out 079.out 054.out 059.out 008.out 049.out 032.out 039.out 021.out 005.out 002.out 065.out 108.out 080.out 070.out 060.out 050.out 027.out 105.out 009.out 004.out 037.out 044.out 012.out 101.out 075.out 103.out 033.out 066.out 040.out 056.out /var/lib/xfstests/tests/overlay 2023-09-21T00:19:44.398 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.evOnb5iVkLxfstests-dev/tests/perf/ install 2023-09-21T00:19:44.400 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-09-21T00:19:44.409 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-09-21T00:19:44.417 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-09-21T00:19:44.426 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-09-21T00:19:44.435 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.evOnb5iVkLxfstests-dev/tests/selftest/ install 2023-09-21T00:19:44.437 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-09-21T00:19:44.446 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-09-21T00:19:44.469 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-09-21T00:19:44.478 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 006.out 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2023-09-21T00:19:44.501 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.evOnb5iVkLxfstests-dev/tests/shared/ install 2023-09-21T00:19:44.502 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-09-21T00:19:44.511 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-09-21T00:19:44.526 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-09-21T00:19:44.535 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2023-09-21T00:19:44.550 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.evOnb5iVkLxfstests-dev/tests/tmpfs/ install 2023-09-21T00:19:44.551 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-09-21T00:19:44.560 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-09-21T00:19:44.569 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-09-21T00:19:44.578 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-09-21T00:19:44.588 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.evOnb5iVkLxfstests-dev/tests/udf/ install 2023-09-21T00:19:44.589 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-09-21T00:19:44.598 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-09-21T00:19:44.607 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-09-21T00:19:44.615 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-09-21T00:19:44.625 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.evOnb5iVkLxfstests-dev/tests/xfs/ install 2023-09-21T00:19:44.629 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-09-21T00:19:44.637 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-09-21T00:19:46.612 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-09-21T00:19:46.621 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 096.out.internal 033.out.crc 096.out.external 033.out.default 071.out.64 216.out.classic 216.out.64mblog 071.out.32 216.cfg 033.cfg 537.out 295.out 497.out 337.out 385.out 082.out 270.out 460.out 149.out 759.out 502.out 088.out 366.out 202.out 137.out 034.out 110.out 389.out 018.out 593.out 571.out 243.out 592.out 282.out 267.out 728.out 468.out 799.out 284.out 528.out 769.out 428.out 507.out 407.out 228.out 128.out 171.out 183.out 273.out 017.out 492.out 109.out 559.out 506.out 195.out 732.out 268.out 275.out 113.out 532.out 591.out 281.out 471.out 723.out 255.out 013.out 371.out 319.out 467.out 523.out 119.out 775.out 727.out 372.out 329.out 165.out 229.out 103.out 003.out 129.out 131.out 383.out 738.out 260.out 718.out 143.out 716.out 161.out 516.out 518.out 416.out 026.out 116.out 043.out 155.out 338.out 238.out 500.out 138.out 189.out 263.out 184.out 181.out 160.out 483.out 274.out 722.out 061.out 239.out 047.out 772.out 258.out 379.out 322.out 039.out 430.out 173.out 222.out 742.out 098.out 426.out 290.out 480.out 060.out 406.out 306.out 141.out 106.out 006.out 167.out 191.out 542.out 211.out 442.out 188.out 099.out 177.out 721.out 174.out 156.out 771.out 324.out 224.out 313.out 124.out 278.out 058.out 741.out 384.out 042.out 193.out 392.out 768.out 399.out 473.out 770.out 709.out 247.out 568.out 364.out 209.out 441.out 440.out 009.out 740.out 356.out 197.out 341.out 094.out 241.out 501.out 089.out 540.out 514.out 414.out 314.out 214.out 381.out 147.out 041.out 340.out 793.out 358.out 572.out 586.out 240.out 549.out 092.out 439.out 434.out 140.out 708.out 766.out 508.out 408.out 308.out 208.out 737.out 040.out 304.out 349.out 254.out 544.out 059.out 086.out 249.out 335.out 142.out 235.out 436.out 575.out 253.out 715.out 533.out 264.out 431.out 784.out 433.out 036.out 316.out 169.out 035.out 579.out 457.out 297.out 393.out 333.out 599.out 476.out 087.out 199.out 739.out 233.out 752.out 736.out 443.out 773.out 053.out 749.out 279.out 133.out 711.out 458.out 164.out 589.out 587.out 339.out 577.out 294.out 352.out 484.out 498.out 489.out 139.out 774.out 790.out 552.out 781.out 357.out 065.out 097.out 175.out 186.out 452.out 069.out 252.out 751.out 376.out 724.out 206.out 778.out 190.out 794.out 348.out 466.out 248.out 725.out 785.out 750.out 525.out 496.out 325.out 257.out 225.out 125.out 789.out 192.out 296.out 152.out 563.out 246.out 551.out 015.out 792.out 075.out 472.out 578.out 463.out 550.out 052.out 534.out 351.out 276.out 451.out 425.out 450.out 744.out 251.out 444.out 487.out 762.out 395.out 515.out 415.out 315.out 215.out 115.out 597.out 027.out 250.out 344.out 051.out 536.out 030.out 244.out 336.out 028.out 150.out 144.out 505.out 342.out 136.out 598.out 005.out 176.out 198.out 008.out 390.out 178.out 405.out 305.out 205.out 105.out 367.out 291.out 437.out 044.out 719.out 323.out 519.out 363.out 562.out 382.out 570.out 388.out 527.out 158.out 019.out 237.out 151.out 760.out 227.out 163.out 332.out 796.out 582.out 232.out 584.out 462.out 220.out 412.out 132.out 179.out 037.out 293.out 499.out 112.out 748.out 020.out 786.out 063.out 561.out 076.out 465.out 014.out 758.out 387.out 594.out 438.out 265.out 289.out 574.out 755.out 548.out 299.out 419.out 521.out 581.out 595.out 461.out 477.out 307.out 726.out 107.out 007.out 448.out 262.out 380.out 093.out 479.out 547.out 326.out 226.out 747.out 126.out 025.out 121.out 447.out 761.out 580.out 021.out 485.out 347.out 077.out 090.out 361.out 564.out 788.out 066.out 455.out 432.out 002.out 585.out 162.out 288.out 050.out 396.out 446.out 350.out 354.out 429.out 187.out 360.out 543.out 261.out 734.out 045.out 292.out 482.out 729.out 104.out 048.out 062.out 529.out 231.out 343.out 503.out 526.out 486.out 223.out 123.out 023.out 459.out 032.out 798.out 277.out 373.out 146.out 398.out 168.out 427.out 590.out 280.out 470.out 491.out 767.out 016.out 046.out 488.out 731.out 782.out 374.out 583.out 285.out 127.out 328.out 359.out 531.out 301.out 101.out 266.out 331.out 791.out 743.out 556.out 713.out 081.out 024.out 513.out 213.out 730.out 095.out 031.out 565.out 182.out 272.out 530.out 754.out 573.out 576.out 569.out 454.out 259.out 449.out 327.out 330.out 067.out 493.out 010.out 287.out 230.out 166.out 130.out 219.out 073.out 370.out 135.out 303.out 203.out 345.out 355.out 386.out 560.out 055.out 334.out 245.out 522.out 787.out 745.out 422.out 394.out 539.out 524.out 122.out 234.out 022.out 424.out 779.out 490.out 435.out 353.out 423.out 134.out 154.out 271.out 064.out 418.out 318.out 218.out 118.out 757.out 377.out 172.out 079.out 469.out 054.out 049.out 765.out 776.out 456.out 180.out 378.out 421.out 712.out 403.out 321.out 057.out 512.out 494.out 221.out 312.out 212.out 538.out 256.out 012.out 764.out 283.out 554.out 397.out 185.out 596.out 720.out 481.out 196.out 520.out 242.out 420.out 478.out 320.out 555.out 120.out 153.out 402.out 302.out 102.out 717.out 517.out 417.out 317.out 365.out 217.out 117.out 475.out 072.out 068.out 474.out 038.out 084.out 056.out 369.out 511.out 148.out 411.out 029.out 311.out 368.out 111.out 011.out 783.out 194.out 170.out 286.out 756.out 545.out 714.out 157.out 710.out 510.out 413.out 410.out 310.out 210.out 401.out 201.out 001.out 495.out 362.out 114.out 753.out 074.out 145.out 797.out 464.out 091.out 746.out 083.out 800.out 777.out 400.out 300.out 200.out 100.out 375.out 541.out 445.out 269.out 546.out 780.out 553.out 763.out 298.out 567.out 080.out 070.out 509.out 409.out 309.out 207.out 108.out 346.out 391.out 004.out 557.out 453.out 236.out 078.out 159.out 566.out 735.out 085.out 588.out 504.out 404.out 558.out 204.out 535.out 795.out 733.out /var/lib/xfstests/tests/xfs 2023-09-21T00:19:48.620 INFO:teuthology.orchestra.run.smithi059.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-09-21T00:19:48.629 INFO:teuthology.orchestra.run.smithi059.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-09-21T00:19:48.638 INFO:teuthology.orchestra.run.smithi059.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-09-21T00:19:48.647 INFO:teuthology.orchestra.run.smithi059.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-09-21T00:19:48.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T00:19:48.659 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec ls tests/generic) 2023-09-21T00:19:48.717 INFO:teuthology.orchestra.run.smithi059.stdout:001 2023-09-21T00:19:48.718 INFO:teuthology.orchestra.run.smithi059.stdout:001.out 2023-09-21T00:19:48.718 INFO:teuthology.orchestra.run.smithi059.stdout:002 2023-09-21T00:19:48.718 INFO:teuthology.orchestra.run.smithi059.stdout:002.out 2023-09-21T00:19:48.718 INFO:teuthology.orchestra.run.smithi059.stdout:003 2023-09-21T00:19:48.718 INFO:teuthology.orchestra.run.smithi059.stdout:003.out 2023-09-21T00:19:48.719 INFO:teuthology.orchestra.run.smithi059.stdout:004 2023-09-21T00:19:48.719 INFO:teuthology.orchestra.run.smithi059.stdout:004.out 2023-09-21T00:19:48.719 INFO:teuthology.orchestra.run.smithi059.stdout:005 2023-09-21T00:19:48.719 INFO:teuthology.orchestra.run.smithi059.stdout:005.out 2023-09-21T00:19:48.719 INFO:teuthology.orchestra.run.smithi059.stdout:006 2023-09-21T00:19:48.720 INFO:teuthology.orchestra.run.smithi059.stdout:006.out 2023-09-21T00:19:48.720 INFO:teuthology.orchestra.run.smithi059.stdout:007 2023-09-21T00:19:48.720 INFO:teuthology.orchestra.run.smithi059.stdout:007.out 2023-09-21T00:19:48.720 INFO:teuthology.orchestra.run.smithi059.stdout:008 2023-09-21T00:19:48.720 INFO:teuthology.orchestra.run.smithi059.stdout:008.out 2023-09-21T00:19:48.721 INFO:teuthology.orchestra.run.smithi059.stdout:009 2023-09-21T00:19:48.721 INFO:teuthology.orchestra.run.smithi059.stdout:009.out 2023-09-21T00:19:48.721 INFO:teuthology.orchestra.run.smithi059.stdout:010 2023-09-21T00:19:48.721 INFO:teuthology.orchestra.run.smithi059.stdout:010.out 2023-09-21T00:19:48.721 INFO:teuthology.orchestra.run.smithi059.stdout:011 2023-09-21T00:19:48.721 INFO:teuthology.orchestra.run.smithi059.stdout:011.out 2023-09-21T00:19:48.722 INFO:teuthology.orchestra.run.smithi059.stdout:012 2023-09-21T00:19:48.722 INFO:teuthology.orchestra.run.smithi059.stdout:012.out 2023-09-21T00:19:48.722 INFO:teuthology.orchestra.run.smithi059.stdout:013 2023-09-21T00:19:48.722 INFO:teuthology.orchestra.run.smithi059.stdout:013.out 2023-09-21T00:19:48.722 INFO:teuthology.orchestra.run.smithi059.stdout:014 2023-09-21T00:19:48.723 INFO:teuthology.orchestra.run.smithi059.stdout:014.out 2023-09-21T00:19:48.723 INFO:teuthology.orchestra.run.smithi059.stdout:015 2023-09-21T00:19:48.723 INFO:teuthology.orchestra.run.smithi059.stdout:015.out 2023-09-21T00:19:48.723 INFO:teuthology.orchestra.run.smithi059.stdout:016 2023-09-21T00:19:48.723 INFO:teuthology.orchestra.run.smithi059.stdout:016.out 2023-09-21T00:19:48.724 INFO:teuthology.orchestra.run.smithi059.stdout:017 2023-09-21T00:19:48.724 INFO:teuthology.orchestra.run.smithi059.stdout:017.out 2023-09-21T00:19:48.724 INFO:teuthology.orchestra.run.smithi059.stdout:018 2023-09-21T00:19:48.724 INFO:teuthology.orchestra.run.smithi059.stdout:018.out 2023-09-21T00:19:48.724 INFO:teuthology.orchestra.run.smithi059.stdout:019 2023-09-21T00:19:48.725 INFO:teuthology.orchestra.run.smithi059.stdout:019.out 2023-09-21T00:19:48.725 INFO:teuthology.orchestra.run.smithi059.stdout:020 2023-09-21T00:19:48.725 INFO:teuthology.orchestra.run.smithi059.stdout:020.out 2023-09-21T00:19:48.725 INFO:teuthology.orchestra.run.smithi059.stdout:021 2023-09-21T00:19:48.725 INFO:teuthology.orchestra.run.smithi059.stdout:021.out 2023-09-21T00:19:48.725 INFO:teuthology.orchestra.run.smithi059.stdout:022 2023-09-21T00:19:48.726 INFO:teuthology.orchestra.run.smithi059.stdout:022.out 2023-09-21T00:19:48.726 INFO:teuthology.orchestra.run.smithi059.stdout:023 2023-09-21T00:19:48.726 INFO:teuthology.orchestra.run.smithi059.stdout:023.out 2023-09-21T00:19:48.726 INFO:teuthology.orchestra.run.smithi059.stdout:024 2023-09-21T00:19:48.726 INFO:teuthology.orchestra.run.smithi059.stdout:024.out 2023-09-21T00:19:48.727 INFO:teuthology.orchestra.run.smithi059.stdout:025 2023-09-21T00:19:48.727 INFO:teuthology.orchestra.run.smithi059.stdout:025.out 2023-09-21T00:19:48.727 INFO:teuthology.orchestra.run.smithi059.stdout:026 2023-09-21T00:19:48.727 INFO:teuthology.orchestra.run.smithi059.stdout:026.out 2023-09-21T00:19:48.728 INFO:teuthology.orchestra.run.smithi059.stdout:027 2023-09-21T00:19:48.728 INFO:teuthology.orchestra.run.smithi059.stdout:027.out 2023-09-21T00:19:48.728 INFO:teuthology.orchestra.run.smithi059.stdout:028 2023-09-21T00:19:48.728 INFO:teuthology.orchestra.run.smithi059.stdout:028.out 2023-09-21T00:19:48.728 INFO:teuthology.orchestra.run.smithi059.stdout:029 2023-09-21T00:19:48.729 INFO:teuthology.orchestra.run.smithi059.stdout:029.out 2023-09-21T00:19:48.729 INFO:teuthology.orchestra.run.smithi059.stdout:030 2023-09-21T00:19:48.730 INFO:teuthology.orchestra.run.smithi059.stdout:030.out 2023-09-21T00:19:48.730 INFO:teuthology.orchestra.run.smithi059.stdout:031 2023-09-21T00:19:48.730 INFO:teuthology.orchestra.run.smithi059.stdout:031.out 2023-09-21T00:19:48.731 INFO:teuthology.orchestra.run.smithi059.stdout:032 2023-09-21T00:19:48.731 INFO:teuthology.orchestra.run.smithi059.stdout:032.out 2023-09-21T00:19:48.731 INFO:teuthology.orchestra.run.smithi059.stdout:033 2023-09-21T00:19:48.731 INFO:teuthology.orchestra.run.smithi059.stdout:033.out 2023-09-21T00:19:48.732 INFO:teuthology.orchestra.run.smithi059.stdout:034 2023-09-21T00:19:48.732 INFO:teuthology.orchestra.run.smithi059.stdout:034.out 2023-09-21T00:19:48.732 INFO:teuthology.orchestra.run.smithi059.stdout:035 2023-09-21T00:19:48.732 INFO:teuthology.orchestra.run.smithi059.stdout:035.cfg 2023-09-21T00:19:48.733 INFO:teuthology.orchestra.run.smithi059.stdout:035.out.default 2023-09-21T00:19:48.733 INFO:teuthology.orchestra.run.smithi059.stdout:035.out.nfs 2023-09-21T00:19:48.733 INFO:teuthology.orchestra.run.smithi059.stdout:036 2023-09-21T00:19:48.733 INFO:teuthology.orchestra.run.smithi059.stdout:036.out 2023-09-21T00:19:48.733 INFO:teuthology.orchestra.run.smithi059.stdout:037 2023-09-21T00:19:48.734 INFO:teuthology.orchestra.run.smithi059.stdout:037.out 2023-09-21T00:19:48.734 INFO:teuthology.orchestra.run.smithi059.stdout:038 2023-09-21T00:19:48.734 INFO:teuthology.orchestra.run.smithi059.stdout:038.out 2023-09-21T00:19:48.734 INFO:teuthology.orchestra.run.smithi059.stdout:039 2023-09-21T00:19:48.734 INFO:teuthology.orchestra.run.smithi059.stdout:039.out 2023-09-21T00:19:48.735 INFO:teuthology.orchestra.run.smithi059.stdout:040 2023-09-21T00:19:48.735 INFO:teuthology.orchestra.run.smithi059.stdout:040.out 2023-09-21T00:19:48.735 INFO:teuthology.orchestra.run.smithi059.stdout:041 2023-09-21T00:19:48.735 INFO:teuthology.orchestra.run.smithi059.stdout:041.out 2023-09-21T00:19:48.735 INFO:teuthology.orchestra.run.smithi059.stdout:042 2023-09-21T00:19:48.735 INFO:teuthology.orchestra.run.smithi059.stdout:042.out 2023-09-21T00:19:48.736 INFO:teuthology.orchestra.run.smithi059.stdout:043 2023-09-21T00:19:48.736 INFO:teuthology.orchestra.run.smithi059.stdout:043.out 2023-09-21T00:19:48.736 INFO:teuthology.orchestra.run.smithi059.stdout:044 2023-09-21T00:19:48.736 INFO:teuthology.orchestra.run.smithi059.stdout:044.out 2023-09-21T00:19:48.736 INFO:teuthology.orchestra.run.smithi059.stdout:045 2023-09-21T00:19:48.737 INFO:teuthology.orchestra.run.smithi059.stdout:045.out 2023-09-21T00:19:48.737 INFO:teuthology.orchestra.run.smithi059.stdout:046 2023-09-21T00:19:48.737 INFO:teuthology.orchestra.run.smithi059.stdout:046.out 2023-09-21T00:19:48.737 INFO:teuthology.orchestra.run.smithi059.stdout:047 2023-09-21T00:19:48.737 INFO:teuthology.orchestra.run.smithi059.stdout:047.out 2023-09-21T00:19:48.738 INFO:teuthology.orchestra.run.smithi059.stdout:048 2023-09-21T00:19:48.738 INFO:teuthology.orchestra.run.smithi059.stdout:048.out 2023-09-21T00:19:48.738 INFO:teuthology.orchestra.run.smithi059.stdout:049 2023-09-21T00:19:48.738 INFO:teuthology.orchestra.run.smithi059.stdout:049.out 2023-09-21T00:19:48.738 INFO:teuthology.orchestra.run.smithi059.stdout:050 2023-09-21T00:19:48.739 INFO:teuthology.orchestra.run.smithi059.stdout:050.cfg 2023-09-21T00:19:48.739 INFO:teuthology.orchestra.run.smithi059.stdout:050.out.default 2023-09-21T00:19:48.739 INFO:teuthology.orchestra.run.smithi059.stdout:050.out.nojournal 2023-09-21T00:19:48.739 INFO:teuthology.orchestra.run.smithi059.stdout:050.out.xfsquota 2023-09-21T00:19:48.739 INFO:teuthology.orchestra.run.smithi059.stdout:051 2023-09-21T00:19:48.740 INFO:teuthology.orchestra.run.smithi059.stdout:051.out 2023-09-21T00:19:48.740 INFO:teuthology.orchestra.run.smithi059.stdout:052 2023-09-21T00:19:48.740 INFO:teuthology.orchestra.run.smithi059.stdout:052.out 2023-09-21T00:19:48.740 INFO:teuthology.orchestra.run.smithi059.stdout:053 2023-09-21T00:19:48.740 INFO:teuthology.orchestra.run.smithi059.stdout:053.out 2023-09-21T00:19:48.740 INFO:teuthology.orchestra.run.smithi059.stdout:054 2023-09-21T00:19:48.741 INFO:teuthology.orchestra.run.smithi059.stdout:054.out 2023-09-21T00:19:48.741 INFO:teuthology.orchestra.run.smithi059.stdout:055 2023-09-21T00:19:48.741 INFO:teuthology.orchestra.run.smithi059.stdout:055.out 2023-09-21T00:19:48.741 INFO:teuthology.orchestra.run.smithi059.stdout:056 2023-09-21T00:19:48.741 INFO:teuthology.orchestra.run.smithi059.stdout:056.out 2023-09-21T00:19:48.742 INFO:teuthology.orchestra.run.smithi059.stdout:057 2023-09-21T00:19:48.742 INFO:teuthology.orchestra.run.smithi059.stdout:057.out 2023-09-21T00:19:48.742 INFO:teuthology.orchestra.run.smithi059.stdout:058 2023-09-21T00:19:48.742 INFO:teuthology.orchestra.run.smithi059.stdout:058.out 2023-09-21T00:19:48.743 INFO:teuthology.orchestra.run.smithi059.stdout:059 2023-09-21T00:19:48.743 INFO:teuthology.orchestra.run.smithi059.stdout:059.out 2023-09-21T00:19:48.743 INFO:teuthology.orchestra.run.smithi059.stdout:060 2023-09-21T00:19:48.743 INFO:teuthology.orchestra.run.smithi059.stdout:060.out 2023-09-21T00:19:48.743 INFO:teuthology.orchestra.run.smithi059.stdout:061 2023-09-21T00:19:48.744 INFO:teuthology.orchestra.run.smithi059.stdout:061.out 2023-09-21T00:19:48.744 INFO:teuthology.orchestra.run.smithi059.stdout:062 2023-09-21T00:19:48.744 INFO:teuthology.orchestra.run.smithi059.stdout:062.out 2023-09-21T00:19:48.744 INFO:teuthology.orchestra.run.smithi059.stdout:063 2023-09-21T00:19:48.744 INFO:teuthology.orchestra.run.smithi059.stdout:063.out 2023-09-21T00:19:48.745 INFO:teuthology.orchestra.run.smithi059.stdout:064 2023-09-21T00:19:48.745 INFO:teuthology.orchestra.run.smithi059.stdout:064.out 2023-09-21T00:19:48.745 INFO:teuthology.orchestra.run.smithi059.stdout:065 2023-09-21T00:19:48.745 INFO:teuthology.orchestra.run.smithi059.stdout:065.out 2023-09-21T00:19:48.745 INFO:teuthology.orchestra.run.smithi059.stdout:066 2023-09-21T00:19:48.745 INFO:teuthology.orchestra.run.smithi059.stdout:066.out 2023-09-21T00:19:48.746 INFO:teuthology.orchestra.run.smithi059.stdout:067 2023-09-21T00:19:48.746 INFO:teuthology.orchestra.run.smithi059.stdout:067.out 2023-09-21T00:19:48.746 INFO:teuthology.orchestra.run.smithi059.stdout:068 2023-09-21T00:19:48.746 INFO:teuthology.orchestra.run.smithi059.stdout:068.out 2023-09-21T00:19:48.747 INFO:teuthology.orchestra.run.smithi059.stdout:069 2023-09-21T00:19:48.747 INFO:teuthology.orchestra.run.smithi059.stdout:069.out 2023-09-21T00:19:48.747 INFO:teuthology.orchestra.run.smithi059.stdout:070 2023-09-21T00:19:48.747 INFO:teuthology.orchestra.run.smithi059.stdout:070.out 2023-09-21T00:19:48.747 INFO:teuthology.orchestra.run.smithi059.stdout:071 2023-09-21T00:19:48.748 INFO:teuthology.orchestra.run.smithi059.stdout:071.out 2023-09-21T00:19:48.748 INFO:teuthology.orchestra.run.smithi059.stdout:072 2023-09-21T00:19:48.748 INFO:teuthology.orchestra.run.smithi059.stdout:072.out 2023-09-21T00:19:48.748 INFO:teuthology.orchestra.run.smithi059.stdout:073 2023-09-21T00:19:48.749 INFO:teuthology.orchestra.run.smithi059.stdout:073.out 2023-09-21T00:19:48.749 INFO:teuthology.orchestra.run.smithi059.stdout:074 2023-09-21T00:19:48.750 INFO:teuthology.orchestra.run.smithi059.stdout:074.out 2023-09-21T00:19:48.750 INFO:teuthology.orchestra.run.smithi059.stdout:075 2023-09-21T00:19:48.750 INFO:teuthology.orchestra.run.smithi059.stdout:075.out 2023-09-21T00:19:48.751 INFO:teuthology.orchestra.run.smithi059.stdout:076 2023-09-21T00:19:48.751 INFO:teuthology.orchestra.run.smithi059.stdout:076.out 2023-09-21T00:19:48.751 INFO:teuthology.orchestra.run.smithi059.stdout:077 2023-09-21T00:19:48.752 INFO:teuthology.orchestra.run.smithi059.stdout:077.out 2023-09-21T00:19:48.752 INFO:teuthology.orchestra.run.smithi059.stdout:078 2023-09-21T00:19:48.753 INFO:teuthology.orchestra.run.smithi059.stdout:078.out 2023-09-21T00:19:48.753 INFO:teuthology.orchestra.run.smithi059.stdout:079 2023-09-21T00:19:48.753 INFO:teuthology.orchestra.run.smithi059.stdout:079.out 2023-09-21T00:19:48.754 INFO:teuthology.orchestra.run.smithi059.stdout:080 2023-09-21T00:19:48.754 INFO:teuthology.orchestra.run.smithi059.stdout:080.out 2023-09-21T00:19:48.754 INFO:teuthology.orchestra.run.smithi059.stdout:081 2023-09-21T00:19:48.755 INFO:teuthology.orchestra.run.smithi059.stdout:081.out 2023-09-21T00:19:48.755 INFO:teuthology.orchestra.run.smithi059.stdout:082 2023-09-21T00:19:48.755 INFO:teuthology.orchestra.run.smithi059.stdout:082.out 2023-09-21T00:19:48.755 INFO:teuthology.orchestra.run.smithi059.stdout:083 2023-09-21T00:19:48.756 INFO:teuthology.orchestra.run.smithi059.stdout:083.out 2023-09-21T00:19:48.756 INFO:teuthology.orchestra.run.smithi059.stdout:084 2023-09-21T00:19:48.756 INFO:teuthology.orchestra.run.smithi059.stdout:084.out 2023-09-21T00:19:48.756 INFO:teuthology.orchestra.run.smithi059.stdout:085 2023-09-21T00:19:48.757 INFO:teuthology.orchestra.run.smithi059.stdout:085.out 2023-09-21T00:19:48.757 INFO:teuthology.orchestra.run.smithi059.stdout:086 2023-09-21T00:19:48.757 INFO:teuthology.orchestra.run.smithi059.stdout:086.out 2023-09-21T00:19:48.758 INFO:teuthology.orchestra.run.smithi059.stdout:087 2023-09-21T00:19:48.758 INFO:teuthology.orchestra.run.smithi059.stdout:087.out 2023-09-21T00:19:48.758 INFO:teuthology.orchestra.run.smithi059.stdout:088 2023-09-21T00:19:48.758 INFO:teuthology.orchestra.run.smithi059.stdout:088.out 2023-09-21T00:19:48.759 INFO:teuthology.orchestra.run.smithi059.stdout:089 2023-09-21T00:19:48.759 INFO:teuthology.orchestra.run.smithi059.stdout:089.out 2023-09-21T00:19:48.759 INFO:teuthology.orchestra.run.smithi059.stdout:090 2023-09-21T00:19:48.759 INFO:teuthology.orchestra.run.smithi059.stdout:090.out 2023-09-21T00:19:48.759 INFO:teuthology.orchestra.run.smithi059.stdout:091 2023-09-21T00:19:48.760 INFO:teuthology.orchestra.run.smithi059.stdout:091.out 2023-09-21T00:19:48.760 INFO:teuthology.orchestra.run.smithi059.stdout:092 2023-09-21T00:19:48.760 INFO:teuthology.orchestra.run.smithi059.stdout:092.out 2023-09-21T00:19:48.760 INFO:teuthology.orchestra.run.smithi059.stdout:093 2023-09-21T00:19:48.760 INFO:teuthology.orchestra.run.smithi059.stdout:093.out 2023-09-21T00:19:48.761 INFO:teuthology.orchestra.run.smithi059.stdout:094 2023-09-21T00:19:48.761 INFO:teuthology.orchestra.run.smithi059.stdout:094.out 2023-09-21T00:19:48.761 INFO:teuthology.orchestra.run.smithi059.stdout:095 2023-09-21T00:19:48.761 INFO:teuthology.orchestra.run.smithi059.stdout:095.out 2023-09-21T00:19:48.761 INFO:teuthology.orchestra.run.smithi059.stdout:096 2023-09-21T00:19:48.761 INFO:teuthology.orchestra.run.smithi059.stdout:096.out 2023-09-21T00:19:48.762 INFO:teuthology.orchestra.run.smithi059.stdout:097 2023-09-21T00:19:48.762 INFO:teuthology.orchestra.run.smithi059.stdout:097.out 2023-09-21T00:19:48.762 INFO:teuthology.orchestra.run.smithi059.stdout:098 2023-09-21T00:19:48.763 INFO:teuthology.orchestra.run.smithi059.stdout:098.out 2023-09-21T00:19:48.763 INFO:teuthology.orchestra.run.smithi059.stdout:099 2023-09-21T00:19:48.763 INFO:teuthology.orchestra.run.smithi059.stdout:099.out 2023-09-21T00:19:48.764 INFO:teuthology.orchestra.run.smithi059.stdout:100 2023-09-21T00:19:48.764 INFO:teuthology.orchestra.run.smithi059.stdout:100.out 2023-09-21T00:19:48.765 INFO:teuthology.orchestra.run.smithi059.stdout:101 2023-09-21T00:19:48.765 INFO:teuthology.orchestra.run.smithi059.stdout:101.out 2023-09-21T00:19:48.765 INFO:teuthology.orchestra.run.smithi059.stdout:102 2023-09-21T00:19:48.766 INFO:teuthology.orchestra.run.smithi059.stdout:102.out 2023-09-21T00:19:48.766 INFO:teuthology.orchestra.run.smithi059.stdout:103 2023-09-21T00:19:48.766 INFO:teuthology.orchestra.run.smithi059.stdout:103.out 2023-09-21T00:19:48.769 INFO:teuthology.orchestra.run.smithi059.stdout:104 2023-09-21T00:19:48.769 INFO:teuthology.orchestra.run.smithi059.stdout:104.out 2023-09-21T00:19:48.770 INFO:teuthology.orchestra.run.smithi059.stdout:105 2023-09-21T00:19:48.770 INFO:teuthology.orchestra.run.smithi059.stdout:105.out 2023-09-21T00:19:48.770 INFO:teuthology.orchestra.run.smithi059.stdout:106 2023-09-21T00:19:48.771 INFO:teuthology.orchestra.run.smithi059.stdout:106.out 2023-09-21T00:19:48.771 INFO:teuthology.orchestra.run.smithi059.stdout:107 2023-09-21T00:19:48.771 INFO:teuthology.orchestra.run.smithi059.stdout:107.out 2023-09-21T00:19:48.771 INFO:teuthology.orchestra.run.smithi059.stdout:108 2023-09-21T00:19:48.772 INFO:teuthology.orchestra.run.smithi059.stdout:108.out 2023-09-21T00:19:48.772 INFO:teuthology.orchestra.run.smithi059.stdout:109 2023-09-21T00:19:48.772 INFO:teuthology.orchestra.run.smithi059.stdout:109.out 2023-09-21T00:19:48.773 INFO:teuthology.orchestra.run.smithi059.stdout:110 2023-09-21T00:19:48.773 INFO:teuthology.orchestra.run.smithi059.stdout:110.out 2023-09-21T00:19:48.773 INFO:teuthology.orchestra.run.smithi059.stdout:111 2023-09-21T00:19:48.774 INFO:teuthology.orchestra.run.smithi059.stdout:111.out 2023-09-21T00:19:48.774 INFO:teuthology.orchestra.run.smithi059.stdout:112 2023-09-21T00:19:48.774 INFO:teuthology.orchestra.run.smithi059.stdout:112.out 2023-09-21T00:19:48.775 INFO:teuthology.orchestra.run.smithi059.stdout:113 2023-09-21T00:19:48.775 INFO:teuthology.orchestra.run.smithi059.stdout:113.out 2023-09-21T00:19:48.775 INFO:teuthology.orchestra.run.smithi059.stdout:114 2023-09-21T00:19:48.776 INFO:teuthology.orchestra.run.smithi059.stdout:114.out 2023-09-21T00:19:48.776 INFO:teuthology.orchestra.run.smithi059.stdout:115 2023-09-21T00:19:48.776 INFO:teuthology.orchestra.run.smithi059.stdout:115.out 2023-09-21T00:19:48.776 INFO:teuthology.orchestra.run.smithi059.stdout:116 2023-09-21T00:19:48.777 INFO:teuthology.orchestra.run.smithi059.stdout:116.out 2023-09-21T00:19:48.777 INFO:teuthology.orchestra.run.smithi059.stdout:117 2023-09-21T00:19:48.777 INFO:teuthology.orchestra.run.smithi059.stdout:117.out 2023-09-21T00:19:48.777 INFO:teuthology.orchestra.run.smithi059.stdout:118 2023-09-21T00:19:48.778 INFO:teuthology.orchestra.run.smithi059.stdout:118.out 2023-09-21T00:19:48.778 INFO:teuthology.orchestra.run.smithi059.stdout:119 2023-09-21T00:19:48.778 INFO:teuthology.orchestra.run.smithi059.stdout:119.out 2023-09-21T00:19:48.779 INFO:teuthology.orchestra.run.smithi059.stdout:120 2023-09-21T00:19:48.779 INFO:teuthology.orchestra.run.smithi059.stdout:120.out 2023-09-21T00:19:48.779 INFO:teuthology.orchestra.run.smithi059.stdout:121 2023-09-21T00:19:48.781 INFO:teuthology.orchestra.run.smithi059.stdout:121.out 2023-09-21T00:19:48.781 INFO:teuthology.orchestra.run.smithi059.stdout:122 2023-09-21T00:19:48.781 INFO:teuthology.orchestra.run.smithi059.stdout:122.out 2023-09-21T00:19:48.782 INFO:teuthology.orchestra.run.smithi059.stdout:123 2023-09-21T00:19:48.782 INFO:teuthology.orchestra.run.smithi059.stdout:123.out 2023-09-21T00:19:48.782 INFO:teuthology.orchestra.run.smithi059.stdout:124 2023-09-21T00:19:48.782 INFO:teuthology.orchestra.run.smithi059.stdout:124.out 2023-09-21T00:19:48.782 INFO:teuthology.orchestra.run.smithi059.stdout:125 2023-09-21T00:19:48.783 INFO:teuthology.orchestra.run.smithi059.stdout:125.out 2023-09-21T00:19:48.783 INFO:teuthology.orchestra.run.smithi059.stdout:126 2023-09-21T00:19:48.783 INFO:teuthology.orchestra.run.smithi059.stdout:126.out 2023-09-21T00:19:48.783 INFO:teuthology.orchestra.run.smithi059.stdout:127 2023-09-21T00:19:48.783 INFO:teuthology.orchestra.run.smithi059.stdout:127.out 2023-09-21T00:19:48.784 INFO:teuthology.orchestra.run.smithi059.stdout:128 2023-09-21T00:19:48.784 INFO:teuthology.orchestra.run.smithi059.stdout:128.out 2023-09-21T00:19:48.784 INFO:teuthology.orchestra.run.smithi059.stdout:129 2023-09-21T00:19:48.784 INFO:teuthology.orchestra.run.smithi059.stdout:129.out 2023-09-21T00:19:48.784 INFO:teuthology.orchestra.run.smithi059.stdout:130 2023-09-21T00:19:48.784 INFO:teuthology.orchestra.run.smithi059.stdout:130.out 2023-09-21T00:19:48.785 INFO:teuthology.orchestra.run.smithi059.stdout:131 2023-09-21T00:19:48.785 INFO:teuthology.orchestra.run.smithi059.stdout:131.out 2023-09-21T00:19:48.785 INFO:teuthology.orchestra.run.smithi059.stdout:132 2023-09-21T00:19:48.785 INFO:teuthology.orchestra.run.smithi059.stdout:132.out 2023-09-21T00:19:48.785 INFO:teuthology.orchestra.run.smithi059.stdout:133 2023-09-21T00:19:48.786 INFO:teuthology.orchestra.run.smithi059.stdout:133.out 2023-09-21T00:19:48.786 INFO:teuthology.orchestra.run.smithi059.stdout:134 2023-09-21T00:19:48.786 INFO:teuthology.orchestra.run.smithi059.stdout:134.out 2023-09-21T00:19:48.786 INFO:teuthology.orchestra.run.smithi059.stdout:135 2023-09-21T00:19:48.786 INFO:teuthology.orchestra.run.smithi059.stdout:135.out 2023-09-21T00:19:48.787 INFO:teuthology.orchestra.run.smithi059.stdout:136 2023-09-21T00:19:48.787 INFO:teuthology.orchestra.run.smithi059.stdout:136.out 2023-09-21T00:19:48.787 INFO:teuthology.orchestra.run.smithi059.stdout:137 2023-09-21T00:19:48.787 INFO:teuthology.orchestra.run.smithi059.stdout:137.out 2023-09-21T00:19:48.787 INFO:teuthology.orchestra.run.smithi059.stdout:138 2023-09-21T00:19:48.787 INFO:teuthology.orchestra.run.smithi059.stdout:138.out 2023-09-21T00:19:48.788 INFO:teuthology.orchestra.run.smithi059.stdout:139 2023-09-21T00:19:48.788 INFO:teuthology.orchestra.run.smithi059.stdout:139.out 2023-09-21T00:19:48.788 INFO:teuthology.orchestra.run.smithi059.stdout:140 2023-09-21T00:19:48.788 INFO:teuthology.orchestra.run.smithi059.stdout:140.out 2023-09-21T00:19:48.788 INFO:teuthology.orchestra.run.smithi059.stdout:141 2023-09-21T00:19:48.789 INFO:teuthology.orchestra.run.smithi059.stdout:141.out 2023-09-21T00:19:48.789 INFO:teuthology.orchestra.run.smithi059.stdout:142 2023-09-21T00:19:48.789 INFO:teuthology.orchestra.run.smithi059.stdout:142.out 2023-09-21T00:19:48.789 INFO:teuthology.orchestra.run.smithi059.stdout:143 2023-09-21T00:19:48.789 INFO:teuthology.orchestra.run.smithi059.stdout:143.out 2023-09-21T00:19:48.789 INFO:teuthology.orchestra.run.smithi059.stdout:144 2023-09-21T00:19:48.790 INFO:teuthology.orchestra.run.smithi059.stdout:144.out 2023-09-21T00:19:48.790 INFO:teuthology.orchestra.run.smithi059.stdout:145 2023-09-21T00:19:48.790 INFO:teuthology.orchestra.run.smithi059.stdout:145.out 2023-09-21T00:19:48.790 INFO:teuthology.orchestra.run.smithi059.stdout:146 2023-09-21T00:19:48.790 INFO:teuthology.orchestra.run.smithi059.stdout:146.out 2023-09-21T00:19:48.791 INFO:teuthology.orchestra.run.smithi059.stdout:147 2023-09-21T00:19:48.791 INFO:teuthology.orchestra.run.smithi059.stdout:147.out 2023-09-21T00:19:48.791 INFO:teuthology.orchestra.run.smithi059.stdout:148 2023-09-21T00:19:48.791 INFO:teuthology.orchestra.run.smithi059.stdout:148.out 2023-09-21T00:19:48.791 INFO:teuthology.orchestra.run.smithi059.stdout:149 2023-09-21T00:19:48.791 INFO:teuthology.orchestra.run.smithi059.stdout:149.out 2023-09-21T00:19:48.792 INFO:teuthology.orchestra.run.smithi059.stdout:150 2023-09-21T00:19:48.792 INFO:teuthology.orchestra.run.smithi059.stdout:150.out 2023-09-21T00:19:48.792 INFO:teuthology.orchestra.run.smithi059.stdout:151 2023-09-21T00:19:48.792 INFO:teuthology.orchestra.run.smithi059.stdout:151.out 2023-09-21T00:19:48.792 INFO:teuthology.orchestra.run.smithi059.stdout:152 2023-09-21T00:19:48.793 INFO:teuthology.orchestra.run.smithi059.stdout:152.out 2023-09-21T00:19:48.793 INFO:teuthology.orchestra.run.smithi059.stdout:153 2023-09-21T00:19:48.793 INFO:teuthology.orchestra.run.smithi059.stdout:153.out 2023-09-21T00:19:48.793 INFO:teuthology.orchestra.run.smithi059.stdout:154 2023-09-21T00:19:48.793 INFO:teuthology.orchestra.run.smithi059.stdout:154.out 2023-09-21T00:19:48.793 INFO:teuthology.orchestra.run.smithi059.stdout:155 2023-09-21T00:19:48.794 INFO:teuthology.orchestra.run.smithi059.stdout:155.out 2023-09-21T00:19:48.794 INFO:teuthology.orchestra.run.smithi059.stdout:156 2023-09-21T00:19:48.794 INFO:teuthology.orchestra.run.smithi059.stdout:156.out 2023-09-21T00:19:48.794 INFO:teuthology.orchestra.run.smithi059.stdout:157 2023-09-21T00:19:48.794 INFO:teuthology.orchestra.run.smithi059.stdout:157.out 2023-09-21T00:19:48.795 INFO:teuthology.orchestra.run.smithi059.stdout:158 2023-09-21T00:19:48.795 INFO:teuthology.orchestra.run.smithi059.stdout:158.out 2023-09-21T00:19:48.795 INFO:teuthology.orchestra.run.smithi059.stdout:159 2023-09-21T00:19:48.795 INFO:teuthology.orchestra.run.smithi059.stdout:159.out 2023-09-21T00:19:48.795 INFO:teuthology.orchestra.run.smithi059.stdout:160 2023-09-21T00:19:48.795 INFO:teuthology.orchestra.run.smithi059.stdout:160.out 2023-09-21T00:19:48.796 INFO:teuthology.orchestra.run.smithi059.stdout:161 2023-09-21T00:19:48.796 INFO:teuthology.orchestra.run.smithi059.stdout:161.out 2023-09-21T00:19:48.796 INFO:teuthology.orchestra.run.smithi059.stdout:162 2023-09-21T00:19:48.796 INFO:teuthology.orchestra.run.smithi059.stdout:162.out 2023-09-21T00:19:48.796 INFO:teuthology.orchestra.run.smithi059.stdout:163 2023-09-21T00:19:48.797 INFO:teuthology.orchestra.run.smithi059.stdout:163.out 2023-09-21T00:19:48.797 INFO:teuthology.orchestra.run.smithi059.stdout:164 2023-09-21T00:19:48.797 INFO:teuthology.orchestra.run.smithi059.stdout:164.out 2023-09-21T00:19:48.797 INFO:teuthology.orchestra.run.smithi059.stdout:165 2023-09-21T00:19:48.797 INFO:teuthology.orchestra.run.smithi059.stdout:165.out 2023-09-21T00:19:48.797 INFO:teuthology.orchestra.run.smithi059.stdout:166 2023-09-21T00:19:48.798 INFO:teuthology.orchestra.run.smithi059.stdout:166.out 2023-09-21T00:19:48.798 INFO:teuthology.orchestra.run.smithi059.stdout:167 2023-09-21T00:19:48.798 INFO:teuthology.orchestra.run.smithi059.stdout:167.out 2023-09-21T00:19:48.798 INFO:teuthology.orchestra.run.smithi059.stdout:168 2023-09-21T00:19:48.798 INFO:teuthology.orchestra.run.smithi059.stdout:168.out 2023-09-21T00:19:48.799 INFO:teuthology.orchestra.run.smithi059.stdout:169 2023-09-21T00:19:48.799 INFO:teuthology.orchestra.run.smithi059.stdout:169.out 2023-09-21T00:19:48.799 INFO:teuthology.orchestra.run.smithi059.stdout:170 2023-09-21T00:19:48.799 INFO:teuthology.orchestra.run.smithi059.stdout:170.out 2023-09-21T00:19:48.799 INFO:teuthology.orchestra.run.smithi059.stdout:171 2023-09-21T00:19:48.799 INFO:teuthology.orchestra.run.smithi059.stdout:171.out 2023-09-21T00:19:48.800 INFO:teuthology.orchestra.run.smithi059.stdout:172 2023-09-21T00:19:48.800 INFO:teuthology.orchestra.run.smithi059.stdout:172.out 2023-09-21T00:19:48.800 INFO:teuthology.orchestra.run.smithi059.stdout:173 2023-09-21T00:19:48.800 INFO:teuthology.orchestra.run.smithi059.stdout:173.out 2023-09-21T00:19:48.800 INFO:teuthology.orchestra.run.smithi059.stdout:174 2023-09-21T00:19:48.801 INFO:teuthology.orchestra.run.smithi059.stdout:174.out 2023-09-21T00:19:48.801 INFO:teuthology.orchestra.run.smithi059.stdout:175 2023-09-21T00:19:48.801 INFO:teuthology.orchestra.run.smithi059.stdout:175.out 2023-09-21T00:19:48.801 INFO:teuthology.orchestra.run.smithi059.stdout:176 2023-09-21T00:19:48.801 INFO:teuthology.orchestra.run.smithi059.stdout:176.out 2023-09-21T00:19:48.802 INFO:teuthology.orchestra.run.smithi059.stdout:177 2023-09-21T00:19:48.802 INFO:teuthology.orchestra.run.smithi059.stdout:177.out 2023-09-21T00:19:48.802 INFO:teuthology.orchestra.run.smithi059.stdout:178 2023-09-21T00:19:48.802 INFO:teuthology.orchestra.run.smithi059.stdout:178.out 2023-09-21T00:19:48.802 INFO:teuthology.orchestra.run.smithi059.stdout:179 2023-09-21T00:19:48.803 INFO:teuthology.orchestra.run.smithi059.stdout:179.out 2023-09-21T00:19:48.803 INFO:teuthology.orchestra.run.smithi059.stdout:180 2023-09-21T00:19:48.803 INFO:teuthology.orchestra.run.smithi059.stdout:180.out 2023-09-21T00:19:48.803 INFO:teuthology.orchestra.run.smithi059.stdout:181 2023-09-21T00:19:48.803 INFO:teuthology.orchestra.run.smithi059.stdout:181.out 2023-09-21T00:19:48.803 INFO:teuthology.orchestra.run.smithi059.stdout:182 2023-09-21T00:19:48.804 INFO:teuthology.orchestra.run.smithi059.stdout:182.out 2023-09-21T00:19:48.804 INFO:teuthology.orchestra.run.smithi059.stdout:183 2023-09-21T00:19:48.804 INFO:teuthology.orchestra.run.smithi059.stdout:183.out 2023-09-21T00:19:48.804 INFO:teuthology.orchestra.run.smithi059.stdout:184 2023-09-21T00:19:48.804 INFO:teuthology.orchestra.run.smithi059.stdout:184.out 2023-09-21T00:19:48.804 INFO:teuthology.orchestra.run.smithi059.stdout:185 2023-09-21T00:19:48.805 INFO:teuthology.orchestra.run.smithi059.stdout:185.out 2023-09-21T00:19:48.805 INFO:teuthology.orchestra.run.smithi059.stdout:186 2023-09-21T00:19:48.805 INFO:teuthology.orchestra.run.smithi059.stdout:186.out 2023-09-21T00:19:48.805 INFO:teuthology.orchestra.run.smithi059.stdout:187 2023-09-21T00:19:48.805 INFO:teuthology.orchestra.run.smithi059.stdout:187.out 2023-09-21T00:19:48.806 INFO:teuthology.orchestra.run.smithi059.stdout:188 2023-09-21T00:19:48.806 INFO:teuthology.orchestra.run.smithi059.stdout:188.out 2023-09-21T00:19:48.806 INFO:teuthology.orchestra.run.smithi059.stdout:189 2023-09-21T00:19:48.806 INFO:teuthology.orchestra.run.smithi059.stdout:189.out 2023-09-21T00:19:48.806 INFO:teuthology.orchestra.run.smithi059.stdout:190 2023-09-21T00:19:48.807 INFO:teuthology.orchestra.run.smithi059.stdout:190.out 2023-09-21T00:19:48.807 INFO:teuthology.orchestra.run.smithi059.stdout:191 2023-09-21T00:19:48.807 INFO:teuthology.orchestra.run.smithi059.stdout:191.out 2023-09-21T00:19:48.807 INFO:teuthology.orchestra.run.smithi059.stdout:192 2023-09-21T00:19:48.807 INFO:teuthology.orchestra.run.smithi059.stdout:192.out 2023-09-21T00:19:48.807 INFO:teuthology.orchestra.run.smithi059.stdout:193 2023-09-21T00:19:48.808 INFO:teuthology.orchestra.run.smithi059.stdout:193.out 2023-09-21T00:19:48.808 INFO:teuthology.orchestra.run.smithi059.stdout:194 2023-09-21T00:19:48.808 INFO:teuthology.orchestra.run.smithi059.stdout:194.out 2023-09-21T00:19:48.808 INFO:teuthology.orchestra.run.smithi059.stdout:195 2023-09-21T00:19:48.808 INFO:teuthology.orchestra.run.smithi059.stdout:195.out 2023-09-21T00:19:48.809 INFO:teuthology.orchestra.run.smithi059.stdout:196 2023-09-21T00:19:48.809 INFO:teuthology.orchestra.run.smithi059.stdout:196.out 2023-09-21T00:19:48.809 INFO:teuthology.orchestra.run.smithi059.stdout:197 2023-09-21T00:19:48.809 INFO:teuthology.orchestra.run.smithi059.stdout:197.out 2023-09-21T00:19:48.809 INFO:teuthology.orchestra.run.smithi059.stdout:198 2023-09-21T00:19:48.809 INFO:teuthology.orchestra.run.smithi059.stdout:198.out 2023-09-21T00:19:48.810 INFO:teuthology.orchestra.run.smithi059.stdout:199 2023-09-21T00:19:48.810 INFO:teuthology.orchestra.run.smithi059.stdout:199.out 2023-09-21T00:19:48.810 INFO:teuthology.orchestra.run.smithi059.stdout:200 2023-09-21T00:19:48.810 INFO:teuthology.orchestra.run.smithi059.stdout:200.out 2023-09-21T00:19:48.810 INFO:teuthology.orchestra.run.smithi059.stdout:201 2023-09-21T00:19:48.811 INFO:teuthology.orchestra.run.smithi059.stdout:201.out 2023-09-21T00:19:48.811 INFO:teuthology.orchestra.run.smithi059.stdout:202 2023-09-21T00:19:48.811 INFO:teuthology.orchestra.run.smithi059.stdout:202.out 2023-09-21T00:19:48.811 INFO:teuthology.orchestra.run.smithi059.stdout:203 2023-09-21T00:19:48.811 INFO:teuthology.orchestra.run.smithi059.stdout:203.out 2023-09-21T00:19:48.811 INFO:teuthology.orchestra.run.smithi059.stdout:204 2023-09-21T00:19:48.812 INFO:teuthology.orchestra.run.smithi059.stdout:204.out 2023-09-21T00:19:48.812 INFO:teuthology.orchestra.run.smithi059.stdout:205 2023-09-21T00:19:48.812 INFO:teuthology.orchestra.run.smithi059.stdout:205.out 2023-09-21T00:19:48.812 INFO:teuthology.orchestra.run.smithi059.stdout:206 2023-09-21T00:19:48.812 INFO:teuthology.orchestra.run.smithi059.stdout:206.out 2023-09-21T00:19:48.813 INFO:teuthology.orchestra.run.smithi059.stdout:207 2023-09-21T00:19:48.813 INFO:teuthology.orchestra.run.smithi059.stdout:207.out 2023-09-21T00:19:48.813 INFO:teuthology.orchestra.run.smithi059.stdout:208 2023-09-21T00:19:48.813 INFO:teuthology.orchestra.run.smithi059.stdout:208.out 2023-09-21T00:19:48.813 INFO:teuthology.orchestra.run.smithi059.stdout:209 2023-09-21T00:19:48.813 INFO:teuthology.orchestra.run.smithi059.stdout:209.out 2023-09-21T00:19:48.814 INFO:teuthology.orchestra.run.smithi059.stdout:210 2023-09-21T00:19:48.814 INFO:teuthology.orchestra.run.smithi059.stdout:210.out 2023-09-21T00:19:48.814 INFO:teuthology.orchestra.run.smithi059.stdout:211 2023-09-21T00:19:48.814 INFO:teuthology.orchestra.run.smithi059.stdout:211.out 2023-09-21T00:19:48.814 INFO:teuthology.orchestra.run.smithi059.stdout:212 2023-09-21T00:19:48.815 INFO:teuthology.orchestra.run.smithi059.stdout:212.out 2023-09-21T00:19:48.815 INFO:teuthology.orchestra.run.smithi059.stdout:213 2023-09-21T00:19:48.815 INFO:teuthology.orchestra.run.smithi059.stdout:213.out 2023-09-21T00:19:48.815 INFO:teuthology.orchestra.run.smithi059.stdout:214 2023-09-21T00:19:48.815 INFO:teuthology.orchestra.run.smithi059.stdout:214.out 2023-09-21T00:19:48.815 INFO:teuthology.orchestra.run.smithi059.stdout:215 2023-09-21T00:19:48.816 INFO:teuthology.orchestra.run.smithi059.stdout:215.out 2023-09-21T00:19:48.816 INFO:teuthology.orchestra.run.smithi059.stdout:216 2023-09-21T00:19:48.816 INFO:teuthology.orchestra.run.smithi059.stdout:216.out 2023-09-21T00:19:48.816 INFO:teuthology.orchestra.run.smithi059.stdout:217 2023-09-21T00:19:48.816 INFO:teuthology.orchestra.run.smithi059.stdout:217.out 2023-09-21T00:19:48.817 INFO:teuthology.orchestra.run.smithi059.stdout:218 2023-09-21T00:19:48.817 INFO:teuthology.orchestra.run.smithi059.stdout:218.out 2023-09-21T00:19:48.817 INFO:teuthology.orchestra.run.smithi059.stdout:219 2023-09-21T00:19:48.817 INFO:teuthology.orchestra.run.smithi059.stdout:219.out 2023-09-21T00:19:48.817 INFO:teuthology.orchestra.run.smithi059.stdout:220 2023-09-21T00:19:48.817 INFO:teuthology.orchestra.run.smithi059.stdout:220.out 2023-09-21T00:19:48.818 INFO:teuthology.orchestra.run.smithi059.stdout:221 2023-09-21T00:19:48.818 INFO:teuthology.orchestra.run.smithi059.stdout:221.out 2023-09-21T00:19:48.818 INFO:teuthology.orchestra.run.smithi059.stdout:222 2023-09-21T00:19:48.818 INFO:teuthology.orchestra.run.smithi059.stdout:222.out 2023-09-21T00:19:48.818 INFO:teuthology.orchestra.run.smithi059.stdout:223 2023-09-21T00:19:48.819 INFO:teuthology.orchestra.run.smithi059.stdout:223.out 2023-09-21T00:19:48.819 INFO:teuthology.orchestra.run.smithi059.stdout:224 2023-09-21T00:19:48.819 INFO:teuthology.orchestra.run.smithi059.stdout:224.out 2023-09-21T00:19:48.819 INFO:teuthology.orchestra.run.smithi059.stdout:225 2023-09-21T00:19:48.819 INFO:teuthology.orchestra.run.smithi059.stdout:225.out 2023-09-21T00:19:48.819 INFO:teuthology.orchestra.run.smithi059.stdout:226 2023-09-21T00:19:48.820 INFO:teuthology.orchestra.run.smithi059.stdout:226.out 2023-09-21T00:19:48.820 INFO:teuthology.orchestra.run.smithi059.stdout:227 2023-09-21T00:19:48.820 INFO:teuthology.orchestra.run.smithi059.stdout:227.out 2023-09-21T00:19:48.820 INFO:teuthology.orchestra.run.smithi059.stdout:228 2023-09-21T00:19:48.820 INFO:teuthology.orchestra.run.smithi059.stdout:228.out 2023-09-21T00:19:48.821 INFO:teuthology.orchestra.run.smithi059.stdout:229 2023-09-21T00:19:48.821 INFO:teuthology.orchestra.run.smithi059.stdout:229.out 2023-09-21T00:19:48.821 INFO:teuthology.orchestra.run.smithi059.stdout:230 2023-09-21T00:19:48.821 INFO:teuthology.orchestra.run.smithi059.stdout:230.out 2023-09-21T00:19:48.821 INFO:teuthology.orchestra.run.smithi059.stdout:231 2023-09-21T00:19:48.822 INFO:teuthology.orchestra.run.smithi059.stdout:231.out 2023-09-21T00:19:48.822 INFO:teuthology.orchestra.run.smithi059.stdout:232 2023-09-21T00:19:48.822 INFO:teuthology.orchestra.run.smithi059.stdout:232.out 2023-09-21T00:19:48.822 INFO:teuthology.orchestra.run.smithi059.stdout:233 2023-09-21T00:19:48.822 INFO:teuthology.orchestra.run.smithi059.stdout:233.out 2023-09-21T00:19:48.823 INFO:teuthology.orchestra.run.smithi059.stdout:234 2023-09-21T00:19:48.823 INFO:teuthology.orchestra.run.smithi059.stdout:234.out 2023-09-21T00:19:48.823 INFO:teuthology.orchestra.run.smithi059.stdout:235 2023-09-21T00:19:48.823 INFO:teuthology.orchestra.run.smithi059.stdout:235.out 2023-09-21T00:19:48.823 INFO:teuthology.orchestra.run.smithi059.stdout:236 2023-09-21T00:19:48.823 INFO:teuthology.orchestra.run.smithi059.stdout:236.out 2023-09-21T00:19:48.824 INFO:teuthology.orchestra.run.smithi059.stdout:237 2023-09-21T00:19:48.824 INFO:teuthology.orchestra.run.smithi059.stdout:237.out 2023-09-21T00:19:48.824 INFO:teuthology.orchestra.run.smithi059.stdout:238 2023-09-21T00:19:48.824 INFO:teuthology.orchestra.run.smithi059.stdout:238.out 2023-09-21T00:19:48.824 INFO:teuthology.orchestra.run.smithi059.stdout:239 2023-09-21T00:19:48.825 INFO:teuthology.orchestra.run.smithi059.stdout:239.out 2023-09-21T00:19:48.825 INFO:teuthology.orchestra.run.smithi059.stdout:240 2023-09-21T00:19:48.825 INFO:teuthology.orchestra.run.smithi059.stdout:240.out 2023-09-21T00:19:48.825 INFO:teuthology.orchestra.run.smithi059.stdout:241 2023-09-21T00:19:48.825 INFO:teuthology.orchestra.run.smithi059.stdout:241.out 2023-09-21T00:19:48.825 INFO:teuthology.orchestra.run.smithi059.stdout:242 2023-09-21T00:19:48.826 INFO:teuthology.orchestra.run.smithi059.stdout:242.out 2023-09-21T00:19:48.826 INFO:teuthology.orchestra.run.smithi059.stdout:243 2023-09-21T00:19:48.826 INFO:teuthology.orchestra.run.smithi059.stdout:243.out 2023-09-21T00:19:48.826 INFO:teuthology.orchestra.run.smithi059.stdout:244 2023-09-21T00:19:48.826 INFO:teuthology.orchestra.run.smithi059.stdout:244.out 2023-09-21T00:19:48.827 INFO:teuthology.orchestra.run.smithi059.stdout:245 2023-09-21T00:19:48.827 INFO:teuthology.orchestra.run.smithi059.stdout:245.out 2023-09-21T00:19:48.827 INFO:teuthology.orchestra.run.smithi059.stdout:246 2023-09-21T00:19:48.827 INFO:teuthology.orchestra.run.smithi059.stdout:246.out 2023-09-21T00:19:48.827 INFO:teuthology.orchestra.run.smithi059.stdout:247 2023-09-21T00:19:48.827 INFO:teuthology.orchestra.run.smithi059.stdout:247.out 2023-09-21T00:19:48.828 INFO:teuthology.orchestra.run.smithi059.stdout:248 2023-09-21T00:19:48.828 INFO:teuthology.orchestra.run.smithi059.stdout:248.out 2023-09-21T00:19:48.828 INFO:teuthology.orchestra.run.smithi059.stdout:249 2023-09-21T00:19:48.828 INFO:teuthology.orchestra.run.smithi059.stdout:249.out 2023-09-21T00:19:48.828 INFO:teuthology.orchestra.run.smithi059.stdout:250 2023-09-21T00:19:48.829 INFO:teuthology.orchestra.run.smithi059.stdout:250.out 2023-09-21T00:19:48.829 INFO:teuthology.orchestra.run.smithi059.stdout:251 2023-09-21T00:19:48.829 INFO:teuthology.orchestra.run.smithi059.stdout:251.out 2023-09-21T00:19:48.829 INFO:teuthology.orchestra.run.smithi059.stdout:252 2023-09-21T00:19:48.829 INFO:teuthology.orchestra.run.smithi059.stdout:252.out 2023-09-21T00:19:48.829 INFO:teuthology.orchestra.run.smithi059.stdout:253 2023-09-21T00:19:48.830 INFO:teuthology.orchestra.run.smithi059.stdout:253.out 2023-09-21T00:19:48.830 INFO:teuthology.orchestra.run.smithi059.stdout:254 2023-09-21T00:19:48.830 INFO:teuthology.orchestra.run.smithi059.stdout:254.out 2023-09-21T00:19:48.830 INFO:teuthology.orchestra.run.smithi059.stdout:255 2023-09-21T00:19:48.830 INFO:teuthology.orchestra.run.smithi059.stdout:255.out 2023-09-21T00:19:48.831 INFO:teuthology.orchestra.run.smithi059.stdout:256 2023-09-21T00:19:48.831 INFO:teuthology.orchestra.run.smithi059.stdout:256.out 2023-09-21T00:19:48.831 INFO:teuthology.orchestra.run.smithi059.stdout:257 2023-09-21T00:19:48.831 INFO:teuthology.orchestra.run.smithi059.stdout:257.out 2023-09-21T00:19:48.831 INFO:teuthology.orchestra.run.smithi059.stdout:258 2023-09-21T00:19:48.831 INFO:teuthology.orchestra.run.smithi059.stdout:258.out 2023-09-21T00:19:48.832 INFO:teuthology.orchestra.run.smithi059.stdout:259 2023-09-21T00:19:48.832 INFO:teuthology.orchestra.run.smithi059.stdout:259.out 2023-09-21T00:19:48.832 INFO:teuthology.orchestra.run.smithi059.stdout:260 2023-09-21T00:19:48.832 INFO:teuthology.orchestra.run.smithi059.stdout:260.out 2023-09-21T00:19:48.832 INFO:teuthology.orchestra.run.smithi059.stdout:261 2023-09-21T00:19:48.832 INFO:teuthology.orchestra.run.smithi059.stdout:261.out 2023-09-21T00:19:48.833 INFO:teuthology.orchestra.run.smithi059.stdout:262 2023-09-21T00:19:48.833 INFO:teuthology.orchestra.run.smithi059.stdout:262.out 2023-09-21T00:19:48.833 INFO:teuthology.orchestra.run.smithi059.stdout:263 2023-09-21T00:19:48.833 INFO:teuthology.orchestra.run.smithi059.stdout:263.out 2023-09-21T00:19:48.833 INFO:teuthology.orchestra.run.smithi059.stdout:264 2023-09-21T00:19:48.834 INFO:teuthology.orchestra.run.smithi059.stdout:264.out 2023-09-21T00:19:48.834 INFO:teuthology.orchestra.run.smithi059.stdout:265 2023-09-21T00:19:48.834 INFO:teuthology.orchestra.run.smithi059.stdout:265.out 2023-09-21T00:19:48.834 INFO:teuthology.orchestra.run.smithi059.stdout:266 2023-09-21T00:19:48.834 INFO:teuthology.orchestra.run.smithi059.stdout:266.out 2023-09-21T00:19:48.834 INFO:teuthology.orchestra.run.smithi059.stdout:267 2023-09-21T00:19:48.835 INFO:teuthology.orchestra.run.smithi059.stdout:267.out 2023-09-21T00:19:48.835 INFO:teuthology.orchestra.run.smithi059.stdout:268 2023-09-21T00:19:48.835 INFO:teuthology.orchestra.run.smithi059.stdout:268.out 2023-09-21T00:19:48.835 INFO:teuthology.orchestra.run.smithi059.stdout:269 2023-09-21T00:19:48.835 INFO:teuthology.orchestra.run.smithi059.stdout:269.out 2023-09-21T00:19:48.836 INFO:teuthology.orchestra.run.smithi059.stdout:270 2023-09-21T00:19:48.836 INFO:teuthology.orchestra.run.smithi059.stdout:270.out 2023-09-21T00:19:48.836 INFO:teuthology.orchestra.run.smithi059.stdout:271 2023-09-21T00:19:48.836 INFO:teuthology.orchestra.run.smithi059.stdout:271.out 2023-09-21T00:19:48.836 INFO:teuthology.orchestra.run.smithi059.stdout:272 2023-09-21T00:19:48.836 INFO:teuthology.orchestra.run.smithi059.stdout:272.out 2023-09-21T00:19:48.837 INFO:teuthology.orchestra.run.smithi059.stdout:273 2023-09-21T00:19:48.837 INFO:teuthology.orchestra.run.smithi059.stdout:273.out 2023-09-21T00:19:48.837 INFO:teuthology.orchestra.run.smithi059.stdout:274 2023-09-21T00:19:48.837 INFO:teuthology.orchestra.run.smithi059.stdout:274.out 2023-09-21T00:19:48.837 INFO:teuthology.orchestra.run.smithi059.stdout:275 2023-09-21T00:19:48.837 INFO:teuthology.orchestra.run.smithi059.stdout:275.out 2023-09-21T00:19:48.838 INFO:teuthology.orchestra.run.smithi059.stdout:276 2023-09-21T00:19:48.838 INFO:teuthology.orchestra.run.smithi059.stdout:276.out 2023-09-21T00:19:48.838 INFO:teuthology.orchestra.run.smithi059.stdout:277 2023-09-21T00:19:48.838 INFO:teuthology.orchestra.run.smithi059.stdout:277.out 2023-09-21T00:19:48.838 INFO:teuthology.orchestra.run.smithi059.stdout:278 2023-09-21T00:19:48.839 INFO:teuthology.orchestra.run.smithi059.stdout:278.out 2023-09-21T00:19:48.839 INFO:teuthology.orchestra.run.smithi059.stdout:279 2023-09-21T00:19:48.839 INFO:teuthology.orchestra.run.smithi059.stdout:279.out 2023-09-21T00:19:48.839 INFO:teuthology.orchestra.run.smithi059.stdout:280 2023-09-21T00:19:48.839 INFO:teuthology.orchestra.run.smithi059.stdout:280.out 2023-09-21T00:19:48.839 INFO:teuthology.orchestra.run.smithi059.stdout:281 2023-09-21T00:19:48.840 INFO:teuthology.orchestra.run.smithi059.stdout:281.out 2023-09-21T00:19:48.840 INFO:teuthology.orchestra.run.smithi059.stdout:282 2023-09-21T00:19:48.840 INFO:teuthology.orchestra.run.smithi059.stdout:282.out 2023-09-21T00:19:48.840 INFO:teuthology.orchestra.run.smithi059.stdout:283 2023-09-21T00:19:48.840 INFO:teuthology.orchestra.run.smithi059.stdout:283.out 2023-09-21T00:19:48.841 INFO:teuthology.orchestra.run.smithi059.stdout:284 2023-09-21T00:19:48.841 INFO:teuthology.orchestra.run.smithi059.stdout:284.out 2023-09-21T00:19:48.841 INFO:teuthology.orchestra.run.smithi059.stdout:285 2023-09-21T00:19:48.841 INFO:teuthology.orchestra.run.smithi059.stdout:285.out 2023-09-21T00:19:48.841 INFO:teuthology.orchestra.run.smithi059.stdout:286 2023-09-21T00:19:48.841 INFO:teuthology.orchestra.run.smithi059.stdout:286.out 2023-09-21T00:19:48.842 INFO:teuthology.orchestra.run.smithi059.stdout:287 2023-09-21T00:19:48.842 INFO:teuthology.orchestra.run.smithi059.stdout:287.out 2023-09-21T00:19:48.842 INFO:teuthology.orchestra.run.smithi059.stdout:288 2023-09-21T00:19:48.842 INFO:teuthology.orchestra.run.smithi059.stdout:288.out 2023-09-21T00:19:48.842 INFO:teuthology.orchestra.run.smithi059.stdout:289 2023-09-21T00:19:48.843 INFO:teuthology.orchestra.run.smithi059.stdout:289.out 2023-09-21T00:19:48.843 INFO:teuthology.orchestra.run.smithi059.stdout:290 2023-09-21T00:19:48.843 INFO:teuthology.orchestra.run.smithi059.stdout:290.out 2023-09-21T00:19:48.843 INFO:teuthology.orchestra.run.smithi059.stdout:291 2023-09-21T00:19:48.843 INFO:teuthology.orchestra.run.smithi059.stdout:291.out 2023-09-21T00:19:48.844 INFO:teuthology.orchestra.run.smithi059.stdout:292 2023-09-21T00:19:48.844 INFO:teuthology.orchestra.run.smithi059.stdout:292.out 2023-09-21T00:19:48.844 INFO:teuthology.orchestra.run.smithi059.stdout:293 2023-09-21T00:19:48.844 INFO:teuthology.orchestra.run.smithi059.stdout:293.out 2023-09-21T00:19:48.844 INFO:teuthology.orchestra.run.smithi059.stdout:294 2023-09-21T00:19:48.844 INFO:teuthology.orchestra.run.smithi059.stdout:294.out 2023-09-21T00:19:48.845 INFO:teuthology.orchestra.run.smithi059.stdout:295 2023-09-21T00:19:48.845 INFO:teuthology.orchestra.run.smithi059.stdout:295.out 2023-09-21T00:19:48.845 INFO:teuthology.orchestra.run.smithi059.stdout:296 2023-09-21T00:19:48.845 INFO:teuthology.orchestra.run.smithi059.stdout:296.out 2023-09-21T00:19:48.845 INFO:teuthology.orchestra.run.smithi059.stdout:297 2023-09-21T00:19:48.845 INFO:teuthology.orchestra.run.smithi059.stdout:297.out 2023-09-21T00:19:48.846 INFO:teuthology.orchestra.run.smithi059.stdout:298 2023-09-21T00:19:48.846 INFO:teuthology.orchestra.run.smithi059.stdout:298.out 2023-09-21T00:19:48.846 INFO:teuthology.orchestra.run.smithi059.stdout:299 2023-09-21T00:19:48.846 INFO:teuthology.orchestra.run.smithi059.stdout:299.out 2023-09-21T00:19:48.846 INFO:teuthology.orchestra.run.smithi059.stdout:300 2023-09-21T00:19:48.847 INFO:teuthology.orchestra.run.smithi059.stdout:300.out 2023-09-21T00:19:48.847 INFO:teuthology.orchestra.run.smithi059.stdout:301 2023-09-21T00:19:48.847 INFO:teuthology.orchestra.run.smithi059.stdout:301.out 2023-09-21T00:19:48.847 INFO:teuthology.orchestra.run.smithi059.stdout:302 2023-09-21T00:19:48.847 INFO:teuthology.orchestra.run.smithi059.stdout:302.out 2023-09-21T00:19:48.847 INFO:teuthology.orchestra.run.smithi059.stdout:303 2023-09-21T00:19:48.848 INFO:teuthology.orchestra.run.smithi059.stdout:303.out 2023-09-21T00:19:48.848 INFO:teuthology.orchestra.run.smithi059.stdout:304 2023-09-21T00:19:48.848 INFO:teuthology.orchestra.run.smithi059.stdout:304.out 2023-09-21T00:19:48.848 INFO:teuthology.orchestra.run.smithi059.stdout:305 2023-09-21T00:19:48.848 INFO:teuthology.orchestra.run.smithi059.stdout:305.out 2023-09-21T00:19:48.849 INFO:teuthology.orchestra.run.smithi059.stdout:306 2023-09-21T00:19:48.849 INFO:teuthology.orchestra.run.smithi059.stdout:306.out 2023-09-21T00:19:48.849 INFO:teuthology.orchestra.run.smithi059.stdout:307 2023-09-21T00:19:48.849 INFO:teuthology.orchestra.run.smithi059.stdout:307.out 2023-09-21T00:19:48.849 INFO:teuthology.orchestra.run.smithi059.stdout:308 2023-09-21T00:19:48.849 INFO:teuthology.orchestra.run.smithi059.stdout:308.out 2023-09-21T00:19:48.850 INFO:teuthology.orchestra.run.smithi059.stdout:309 2023-09-21T00:19:48.850 INFO:teuthology.orchestra.run.smithi059.stdout:309.out 2023-09-21T00:19:48.850 INFO:teuthology.orchestra.run.smithi059.stdout:310 2023-09-21T00:19:48.850 INFO:teuthology.orchestra.run.smithi059.stdout:310.out 2023-09-21T00:19:48.850 INFO:teuthology.orchestra.run.smithi059.stdout:311 2023-09-21T00:19:48.851 INFO:teuthology.orchestra.run.smithi059.stdout:311.out 2023-09-21T00:19:48.851 INFO:teuthology.orchestra.run.smithi059.stdout:312 2023-09-21T00:19:48.851 INFO:teuthology.orchestra.run.smithi059.stdout:312.out 2023-09-21T00:19:48.851 INFO:teuthology.orchestra.run.smithi059.stdout:313 2023-09-21T00:19:48.851 INFO:teuthology.orchestra.run.smithi059.stdout:313.out 2023-09-21T00:19:48.852 INFO:teuthology.orchestra.run.smithi059.stdout:314 2023-09-21T00:19:48.852 INFO:teuthology.orchestra.run.smithi059.stdout:314.out 2023-09-21T00:19:48.852 INFO:teuthology.orchestra.run.smithi059.stdout:315 2023-09-21T00:19:48.852 INFO:teuthology.orchestra.run.smithi059.stdout:315.out 2023-09-21T00:19:48.852 INFO:teuthology.orchestra.run.smithi059.stdout:316 2023-09-21T00:19:48.852 INFO:teuthology.orchestra.run.smithi059.stdout:316.out 2023-09-21T00:19:48.853 INFO:teuthology.orchestra.run.smithi059.stdout:317 2023-09-21T00:19:48.853 INFO:teuthology.orchestra.run.smithi059.stdout:317.out 2023-09-21T00:19:48.853 INFO:teuthology.orchestra.run.smithi059.stdout:318 2023-09-21T00:19:48.853 INFO:teuthology.orchestra.run.smithi059.stdout:318.out 2023-09-21T00:19:48.853 INFO:teuthology.orchestra.run.smithi059.stdout:319 2023-09-21T00:19:48.854 INFO:teuthology.orchestra.run.smithi059.stdout:319.out 2023-09-21T00:19:48.854 INFO:teuthology.orchestra.run.smithi059.stdout:320 2023-09-21T00:19:48.854 INFO:teuthology.orchestra.run.smithi059.stdout:320.out 2023-09-21T00:19:48.854 INFO:teuthology.orchestra.run.smithi059.stdout:321 2023-09-21T00:19:48.854 INFO:teuthology.orchestra.run.smithi059.stdout:321.out 2023-09-21T00:19:48.854 INFO:teuthology.orchestra.run.smithi059.stdout:322 2023-09-21T00:19:48.855 INFO:teuthology.orchestra.run.smithi059.stdout:322.out 2023-09-21T00:19:48.855 INFO:teuthology.orchestra.run.smithi059.stdout:323 2023-09-21T00:19:48.855 INFO:teuthology.orchestra.run.smithi059.stdout:323.out 2023-09-21T00:19:48.855 INFO:teuthology.orchestra.run.smithi059.stdout:324 2023-09-21T00:19:48.855 INFO:teuthology.orchestra.run.smithi059.stdout:324.out 2023-09-21T00:19:48.856 INFO:teuthology.orchestra.run.smithi059.stdout:325 2023-09-21T00:19:48.856 INFO:teuthology.orchestra.run.smithi059.stdout:325.out 2023-09-21T00:19:48.856 INFO:teuthology.orchestra.run.smithi059.stdout:326 2023-09-21T00:19:48.856 INFO:teuthology.orchestra.run.smithi059.stdout:326.out 2023-09-21T00:19:48.856 INFO:teuthology.orchestra.run.smithi059.stdout:327 2023-09-21T00:19:48.856 INFO:teuthology.orchestra.run.smithi059.stdout:327.out 2023-09-21T00:19:48.857 INFO:teuthology.orchestra.run.smithi059.stdout:328 2023-09-21T00:19:48.857 INFO:teuthology.orchestra.run.smithi059.stdout:328.out 2023-09-21T00:19:48.857 INFO:teuthology.orchestra.run.smithi059.stdout:329 2023-09-21T00:19:48.857 INFO:teuthology.orchestra.run.smithi059.stdout:329.out 2023-09-21T00:19:48.857 INFO:teuthology.orchestra.run.smithi059.stdout:330 2023-09-21T00:19:48.858 INFO:teuthology.orchestra.run.smithi059.stdout:330.out 2023-09-21T00:19:48.858 INFO:teuthology.orchestra.run.smithi059.stdout:331 2023-09-21T00:19:48.858 INFO:teuthology.orchestra.run.smithi059.stdout:331.out 2023-09-21T00:19:48.859 INFO:teuthology.orchestra.run.smithi059.stdout:332 2023-09-21T00:19:48.859 INFO:teuthology.orchestra.run.smithi059.stdout:332.out 2023-09-21T00:19:48.859 INFO:teuthology.orchestra.run.smithi059.stdout:333 2023-09-21T00:19:48.860 INFO:teuthology.orchestra.run.smithi059.stdout:333.out 2023-09-21T00:19:48.860 INFO:teuthology.orchestra.run.smithi059.stdout:334 2023-09-21T00:19:48.860 INFO:teuthology.orchestra.run.smithi059.stdout:334.out 2023-09-21T00:19:48.860 INFO:teuthology.orchestra.run.smithi059.stdout:335 2023-09-21T00:19:48.861 INFO:teuthology.orchestra.run.smithi059.stdout:335.out 2023-09-21T00:19:48.861 INFO:teuthology.orchestra.run.smithi059.stdout:336 2023-09-21T00:19:48.861 INFO:teuthology.orchestra.run.smithi059.stdout:336.out 2023-09-21T00:19:48.861 INFO:teuthology.orchestra.run.smithi059.stdout:337 2023-09-21T00:19:48.861 INFO:teuthology.orchestra.run.smithi059.stdout:337.out 2023-09-21T00:19:48.862 INFO:teuthology.orchestra.run.smithi059.stdout:338 2023-09-21T00:19:48.862 INFO:teuthology.orchestra.run.smithi059.stdout:338.out 2023-09-21T00:19:48.862 INFO:teuthology.orchestra.run.smithi059.stdout:339 2023-09-21T00:19:48.862 INFO:teuthology.orchestra.run.smithi059.stdout:339.out 2023-09-21T00:19:48.862 INFO:teuthology.orchestra.run.smithi059.stdout:340 2023-09-21T00:19:48.862 INFO:teuthology.orchestra.run.smithi059.stdout:340.out 2023-09-21T00:19:48.863 INFO:teuthology.orchestra.run.smithi059.stdout:341 2023-09-21T00:19:48.863 INFO:teuthology.orchestra.run.smithi059.stdout:341.out 2023-09-21T00:19:48.863 INFO:teuthology.orchestra.run.smithi059.stdout:342 2023-09-21T00:19:48.863 INFO:teuthology.orchestra.run.smithi059.stdout:342.out 2023-09-21T00:19:48.863 INFO:teuthology.orchestra.run.smithi059.stdout:343 2023-09-21T00:19:48.864 INFO:teuthology.orchestra.run.smithi059.stdout:343.out 2023-09-21T00:19:48.864 INFO:teuthology.orchestra.run.smithi059.stdout:344 2023-09-21T00:19:48.864 INFO:teuthology.orchestra.run.smithi059.stdout:344.out 2023-09-21T00:19:48.864 INFO:teuthology.orchestra.run.smithi059.stdout:345 2023-09-21T00:19:48.864 INFO:teuthology.orchestra.run.smithi059.stdout:345.out 2023-09-21T00:19:48.864 INFO:teuthology.orchestra.run.smithi059.stdout:346 2023-09-21T00:19:48.865 INFO:teuthology.orchestra.run.smithi059.stdout:346.out 2023-09-21T00:19:48.865 INFO:teuthology.orchestra.run.smithi059.stdout:347 2023-09-21T00:19:48.865 INFO:teuthology.orchestra.run.smithi059.stdout:347.out 2023-09-21T00:19:48.865 INFO:teuthology.orchestra.run.smithi059.stdout:348 2023-09-21T00:19:48.865 INFO:teuthology.orchestra.run.smithi059.stdout:348.out 2023-09-21T00:19:48.866 INFO:teuthology.orchestra.run.smithi059.stdout:349 2023-09-21T00:19:48.866 INFO:teuthology.orchestra.run.smithi059.stdout:349.out 2023-09-21T00:19:48.866 INFO:teuthology.orchestra.run.smithi059.stdout:350 2023-09-21T00:19:48.866 INFO:teuthology.orchestra.run.smithi059.stdout:350.out 2023-09-21T00:19:48.866 INFO:teuthology.orchestra.run.smithi059.stdout:351 2023-09-21T00:19:48.866 INFO:teuthology.orchestra.run.smithi059.stdout:351.out 2023-09-21T00:19:48.867 INFO:teuthology.orchestra.run.smithi059.stdout:352 2023-09-21T00:19:48.867 INFO:teuthology.orchestra.run.smithi059.stdout:352.out 2023-09-21T00:19:48.867 INFO:teuthology.orchestra.run.smithi059.stdout:353 2023-09-21T00:19:48.867 INFO:teuthology.orchestra.run.smithi059.stdout:353.out 2023-09-21T00:19:48.867 INFO:teuthology.orchestra.run.smithi059.stdout:354 2023-09-21T00:19:48.868 INFO:teuthology.orchestra.run.smithi059.stdout:354.out 2023-09-21T00:19:48.868 INFO:teuthology.orchestra.run.smithi059.stdout:355 2023-09-21T00:19:48.868 INFO:teuthology.orchestra.run.smithi059.stdout:355.out 2023-09-21T00:19:48.868 INFO:teuthology.orchestra.run.smithi059.stdout:356 2023-09-21T00:19:48.868 INFO:teuthology.orchestra.run.smithi059.stdout:356.out 2023-09-21T00:19:48.869 INFO:teuthology.orchestra.run.smithi059.stdout:357 2023-09-21T00:19:48.869 INFO:teuthology.orchestra.run.smithi059.stdout:357.out 2023-09-21T00:19:48.869 INFO:teuthology.orchestra.run.smithi059.stdout:358 2023-09-21T00:19:48.869 INFO:teuthology.orchestra.run.smithi059.stdout:358.out 2023-09-21T00:19:48.869 INFO:teuthology.orchestra.run.smithi059.stdout:359 2023-09-21T00:19:48.869 INFO:teuthology.orchestra.run.smithi059.stdout:359.out 2023-09-21T00:19:48.870 INFO:teuthology.orchestra.run.smithi059.stdout:360 2023-09-21T00:19:48.870 INFO:teuthology.orchestra.run.smithi059.stdout:360.out 2023-09-21T00:19:48.870 INFO:teuthology.orchestra.run.smithi059.stdout:361 2023-09-21T00:19:48.870 INFO:teuthology.orchestra.run.smithi059.stdout:361.out 2023-09-21T00:19:48.870 INFO:teuthology.orchestra.run.smithi059.stdout:362 2023-09-21T00:19:48.871 INFO:teuthology.orchestra.run.smithi059.stdout:362.out 2023-09-21T00:19:48.871 INFO:teuthology.orchestra.run.smithi059.stdout:363 2023-09-21T00:19:48.871 INFO:teuthology.orchestra.run.smithi059.stdout:363.out 2023-09-21T00:19:48.871 INFO:teuthology.orchestra.run.smithi059.stdout:364 2023-09-21T00:19:48.871 INFO:teuthology.orchestra.run.smithi059.stdout:364.out 2023-09-21T00:19:48.871 INFO:teuthology.orchestra.run.smithi059.stdout:365 2023-09-21T00:19:48.872 INFO:teuthology.orchestra.run.smithi059.stdout:365.out 2023-09-21T00:19:48.872 INFO:teuthology.orchestra.run.smithi059.stdout:366 2023-09-21T00:19:48.872 INFO:teuthology.orchestra.run.smithi059.stdout:366.out 2023-09-21T00:19:48.872 INFO:teuthology.orchestra.run.smithi059.stdout:367 2023-09-21T00:19:48.872 INFO:teuthology.orchestra.run.smithi059.stdout:367.out 2023-09-21T00:19:48.872 INFO:teuthology.orchestra.run.smithi059.stdout:368 2023-09-21T00:19:48.873 INFO:teuthology.orchestra.run.smithi059.stdout:368.out 2023-09-21T00:19:48.873 INFO:teuthology.orchestra.run.smithi059.stdout:369 2023-09-21T00:19:48.873 INFO:teuthology.orchestra.run.smithi059.stdout:369.out 2023-09-21T00:19:48.873 INFO:teuthology.orchestra.run.smithi059.stdout:370 2023-09-21T00:19:48.873 INFO:teuthology.orchestra.run.smithi059.stdout:370.out 2023-09-21T00:19:48.874 INFO:teuthology.orchestra.run.smithi059.stdout:371 2023-09-21T00:19:48.874 INFO:teuthology.orchestra.run.smithi059.stdout:371.out 2023-09-21T00:19:48.874 INFO:teuthology.orchestra.run.smithi059.stdout:372 2023-09-21T00:19:48.874 INFO:teuthology.orchestra.run.smithi059.stdout:372.out 2023-09-21T00:19:48.874 INFO:teuthology.orchestra.run.smithi059.stdout:373 2023-09-21T00:19:48.874 INFO:teuthology.orchestra.run.smithi059.stdout:373.out 2023-09-21T00:19:48.875 INFO:teuthology.orchestra.run.smithi059.stdout:374 2023-09-21T00:19:48.875 INFO:teuthology.orchestra.run.smithi059.stdout:374.out 2023-09-21T00:19:48.875 INFO:teuthology.orchestra.run.smithi059.stdout:375 2023-09-21T00:19:48.875 INFO:teuthology.orchestra.run.smithi059.stdout:375.out 2023-09-21T00:19:48.875 INFO:teuthology.orchestra.run.smithi059.stdout:376 2023-09-21T00:19:48.876 INFO:teuthology.orchestra.run.smithi059.stdout:376.out 2023-09-21T00:19:48.876 INFO:teuthology.orchestra.run.smithi059.stdout:377 2023-09-21T00:19:48.876 INFO:teuthology.orchestra.run.smithi059.stdout:377.out 2023-09-21T00:19:48.876 INFO:teuthology.orchestra.run.smithi059.stdout:378 2023-09-21T00:19:48.876 INFO:teuthology.orchestra.run.smithi059.stdout:378.out 2023-09-21T00:19:48.876 INFO:teuthology.orchestra.run.smithi059.stdout:379 2023-09-21T00:19:48.877 INFO:teuthology.orchestra.run.smithi059.stdout:379.out 2023-09-21T00:19:48.877 INFO:teuthology.orchestra.run.smithi059.stdout:380 2023-09-21T00:19:48.877 INFO:teuthology.orchestra.run.smithi059.stdout:380.out 2023-09-21T00:19:48.877 INFO:teuthology.orchestra.run.smithi059.stdout:381 2023-09-21T00:19:48.877 INFO:teuthology.orchestra.run.smithi059.stdout:381.out 2023-09-21T00:19:48.877 INFO:teuthology.orchestra.run.smithi059.stdout:382 2023-09-21T00:19:48.878 INFO:teuthology.orchestra.run.smithi059.stdout:382.out 2023-09-21T00:19:48.878 INFO:teuthology.orchestra.run.smithi059.stdout:383 2023-09-21T00:19:48.878 INFO:teuthology.orchestra.run.smithi059.stdout:383.out 2023-09-21T00:19:48.878 INFO:teuthology.orchestra.run.smithi059.stdout:384 2023-09-21T00:19:48.878 INFO:teuthology.orchestra.run.smithi059.stdout:384.out 2023-09-21T00:19:48.879 INFO:teuthology.orchestra.run.smithi059.stdout:385 2023-09-21T00:19:48.879 INFO:teuthology.orchestra.run.smithi059.stdout:385.out 2023-09-21T00:19:48.879 INFO:teuthology.orchestra.run.smithi059.stdout:386 2023-09-21T00:19:48.879 INFO:teuthology.orchestra.run.smithi059.stdout:386.out 2023-09-21T00:19:48.879 INFO:teuthology.orchestra.run.smithi059.stdout:387 2023-09-21T00:19:48.879 INFO:teuthology.orchestra.run.smithi059.stdout:387.out 2023-09-21T00:19:48.880 INFO:teuthology.orchestra.run.smithi059.stdout:388 2023-09-21T00:19:48.880 INFO:teuthology.orchestra.run.smithi059.stdout:388.out 2023-09-21T00:19:48.880 INFO:teuthology.orchestra.run.smithi059.stdout:389 2023-09-21T00:19:48.880 INFO:teuthology.orchestra.run.smithi059.stdout:389.out 2023-09-21T00:19:48.880 INFO:teuthology.orchestra.run.smithi059.stdout:390 2023-09-21T00:19:48.881 INFO:teuthology.orchestra.run.smithi059.stdout:390.out 2023-09-21T00:19:48.881 INFO:teuthology.orchestra.run.smithi059.stdout:391 2023-09-21T00:19:48.881 INFO:teuthology.orchestra.run.smithi059.stdout:391.out 2023-09-21T00:19:48.881 INFO:teuthology.orchestra.run.smithi059.stdout:392 2023-09-21T00:19:48.881 INFO:teuthology.orchestra.run.smithi059.stdout:392.out 2023-09-21T00:19:48.881 INFO:teuthology.orchestra.run.smithi059.stdout:393 2023-09-21T00:19:48.882 INFO:teuthology.orchestra.run.smithi059.stdout:393.out 2023-09-21T00:19:48.882 INFO:teuthology.orchestra.run.smithi059.stdout:394 2023-09-21T00:19:48.882 INFO:teuthology.orchestra.run.smithi059.stdout:394.out 2023-09-21T00:19:48.882 INFO:teuthology.orchestra.run.smithi059.stdout:395 2023-09-21T00:19:48.882 INFO:teuthology.orchestra.run.smithi059.stdout:395.out 2023-09-21T00:19:48.883 INFO:teuthology.orchestra.run.smithi059.stdout:396 2023-09-21T00:19:48.883 INFO:teuthology.orchestra.run.smithi059.stdout:396.out 2023-09-21T00:19:48.883 INFO:teuthology.orchestra.run.smithi059.stdout:397 2023-09-21T00:19:48.883 INFO:teuthology.orchestra.run.smithi059.stdout:397.out 2023-09-21T00:19:48.883 INFO:teuthology.orchestra.run.smithi059.stdout:398 2023-09-21T00:19:48.883 INFO:teuthology.orchestra.run.smithi059.stdout:398.out 2023-09-21T00:19:48.884 INFO:teuthology.orchestra.run.smithi059.stdout:399 2023-09-21T00:19:48.884 INFO:teuthology.orchestra.run.smithi059.stdout:399.out 2023-09-21T00:19:48.884 INFO:teuthology.orchestra.run.smithi059.stdout:400 2023-09-21T00:19:48.884 INFO:teuthology.orchestra.run.smithi059.stdout:400.out 2023-09-21T00:19:48.884 INFO:teuthology.orchestra.run.smithi059.stdout:401 2023-09-21T00:19:48.885 INFO:teuthology.orchestra.run.smithi059.stdout:401.out 2023-09-21T00:19:48.885 INFO:teuthology.orchestra.run.smithi059.stdout:402 2023-09-21T00:19:48.885 INFO:teuthology.orchestra.run.smithi059.stdout:402.out 2023-09-21T00:19:48.885 INFO:teuthology.orchestra.run.smithi059.stdout:403 2023-09-21T00:19:48.885 INFO:teuthology.orchestra.run.smithi059.stdout:403.out 2023-09-21T00:19:48.885 INFO:teuthology.orchestra.run.smithi059.stdout:404 2023-09-21T00:19:48.886 INFO:teuthology.orchestra.run.smithi059.stdout:404.out 2023-09-21T00:19:48.886 INFO:teuthology.orchestra.run.smithi059.stdout:405 2023-09-21T00:19:48.886 INFO:teuthology.orchestra.run.smithi059.stdout:405.out 2023-09-21T00:19:48.886 INFO:teuthology.orchestra.run.smithi059.stdout:406 2023-09-21T00:19:48.886 INFO:teuthology.orchestra.run.smithi059.stdout:406.out 2023-09-21T00:19:48.886 INFO:teuthology.orchestra.run.smithi059.stdout:407 2023-09-21T00:19:48.887 INFO:teuthology.orchestra.run.smithi059.stdout:407.out 2023-09-21T00:19:48.887 INFO:teuthology.orchestra.run.smithi059.stdout:408 2023-09-21T00:19:48.887 INFO:teuthology.orchestra.run.smithi059.stdout:408.out 2023-09-21T00:19:48.887 INFO:teuthology.orchestra.run.smithi059.stdout:409 2023-09-21T00:19:48.887 INFO:teuthology.orchestra.run.smithi059.stdout:409.out 2023-09-21T00:19:48.888 INFO:teuthology.orchestra.run.smithi059.stdout:410 2023-09-21T00:19:48.888 INFO:teuthology.orchestra.run.smithi059.stdout:410.out 2023-09-21T00:19:48.888 INFO:teuthology.orchestra.run.smithi059.stdout:411 2023-09-21T00:19:48.888 INFO:teuthology.orchestra.run.smithi059.stdout:411.out 2023-09-21T00:19:48.888 INFO:teuthology.orchestra.run.smithi059.stdout:412 2023-09-21T00:19:48.888 INFO:teuthology.orchestra.run.smithi059.stdout:412.out 2023-09-21T00:19:48.889 INFO:teuthology.orchestra.run.smithi059.stdout:413 2023-09-21T00:19:48.889 INFO:teuthology.orchestra.run.smithi059.stdout:413.out 2023-09-21T00:19:48.889 INFO:teuthology.orchestra.run.smithi059.stdout:414 2023-09-21T00:19:48.889 INFO:teuthology.orchestra.run.smithi059.stdout:414.out 2023-09-21T00:19:48.889 INFO:teuthology.orchestra.run.smithi059.stdout:415 2023-09-21T00:19:48.890 INFO:teuthology.orchestra.run.smithi059.stdout:415.out 2023-09-21T00:19:48.890 INFO:teuthology.orchestra.run.smithi059.stdout:416 2023-09-21T00:19:48.890 INFO:teuthology.orchestra.run.smithi059.stdout:416.out 2023-09-21T00:19:48.890 INFO:teuthology.orchestra.run.smithi059.stdout:417 2023-09-21T00:19:48.890 INFO:teuthology.orchestra.run.smithi059.stdout:417.out 2023-09-21T00:19:48.891 INFO:teuthology.orchestra.run.smithi059.stdout:418 2023-09-21T00:19:48.891 INFO:teuthology.orchestra.run.smithi059.stdout:418.out 2023-09-21T00:19:48.891 INFO:teuthology.orchestra.run.smithi059.stdout:419 2023-09-21T00:19:48.891 INFO:teuthology.orchestra.run.smithi059.stdout:419.out 2023-09-21T00:19:48.891 INFO:teuthology.orchestra.run.smithi059.stdout:420 2023-09-21T00:19:48.891 INFO:teuthology.orchestra.run.smithi059.stdout:420.out 2023-09-21T00:19:48.892 INFO:teuthology.orchestra.run.smithi059.stdout:421 2023-09-21T00:19:48.892 INFO:teuthology.orchestra.run.smithi059.stdout:421.out 2023-09-21T00:19:48.892 INFO:teuthology.orchestra.run.smithi059.stdout:422 2023-09-21T00:19:48.892 INFO:teuthology.orchestra.run.smithi059.stdout:422.out 2023-09-21T00:19:48.892 INFO:teuthology.orchestra.run.smithi059.stdout:423 2023-09-21T00:19:48.893 INFO:teuthology.orchestra.run.smithi059.stdout:423.out 2023-09-21T00:19:48.893 INFO:teuthology.orchestra.run.smithi059.stdout:424 2023-09-21T00:19:48.893 INFO:teuthology.orchestra.run.smithi059.stdout:424.out 2023-09-21T00:19:48.893 INFO:teuthology.orchestra.run.smithi059.stdout:425 2023-09-21T00:19:48.893 INFO:teuthology.orchestra.run.smithi059.stdout:425.out 2023-09-21T00:19:48.893 INFO:teuthology.orchestra.run.smithi059.stdout:426 2023-09-21T00:19:48.894 INFO:teuthology.orchestra.run.smithi059.stdout:426.out 2023-09-21T00:19:48.894 INFO:teuthology.orchestra.run.smithi059.stdout:427 2023-09-21T00:19:48.894 INFO:teuthology.orchestra.run.smithi059.stdout:427.out 2023-09-21T00:19:48.894 INFO:teuthology.orchestra.run.smithi059.stdout:428 2023-09-21T00:19:48.894 INFO:teuthology.orchestra.run.smithi059.stdout:428.out 2023-09-21T00:19:48.894 INFO:teuthology.orchestra.run.smithi059.stdout:429 2023-09-21T00:19:48.895 INFO:teuthology.orchestra.run.smithi059.stdout:429.out 2023-09-21T00:19:48.895 INFO:teuthology.orchestra.run.smithi059.stdout:430 2023-09-21T00:19:48.895 INFO:teuthology.orchestra.run.smithi059.stdout:430.out 2023-09-21T00:19:48.895 INFO:teuthology.orchestra.run.smithi059.stdout:431 2023-09-21T00:19:48.895 INFO:teuthology.orchestra.run.smithi059.stdout:431.out 2023-09-21T00:19:48.896 INFO:teuthology.orchestra.run.smithi059.stdout:432 2023-09-21T00:19:48.896 INFO:teuthology.orchestra.run.smithi059.stdout:432.out 2023-09-21T00:19:48.896 INFO:teuthology.orchestra.run.smithi059.stdout:433 2023-09-21T00:19:48.896 INFO:teuthology.orchestra.run.smithi059.stdout:433.out 2023-09-21T00:19:48.896 INFO:teuthology.orchestra.run.smithi059.stdout:434 2023-09-21T00:19:48.896 INFO:teuthology.orchestra.run.smithi059.stdout:434.out 2023-09-21T00:19:48.897 INFO:teuthology.orchestra.run.smithi059.stdout:435 2023-09-21T00:19:48.897 INFO:teuthology.orchestra.run.smithi059.stdout:435.out 2023-09-21T00:19:48.897 INFO:teuthology.orchestra.run.smithi059.stdout:436 2023-09-21T00:19:48.897 INFO:teuthology.orchestra.run.smithi059.stdout:436.out 2023-09-21T00:19:48.897 INFO:teuthology.orchestra.run.smithi059.stdout:437 2023-09-21T00:19:48.898 INFO:teuthology.orchestra.run.smithi059.stdout:437.out 2023-09-21T00:19:48.898 INFO:teuthology.orchestra.run.smithi059.stdout:438 2023-09-21T00:19:48.898 INFO:teuthology.orchestra.run.smithi059.stdout:438.out 2023-09-21T00:19:48.898 INFO:teuthology.orchestra.run.smithi059.stdout:439 2023-09-21T00:19:48.898 INFO:teuthology.orchestra.run.smithi059.stdout:439.out 2023-09-21T00:19:48.898 INFO:teuthology.orchestra.run.smithi059.stdout:440 2023-09-21T00:19:48.899 INFO:teuthology.orchestra.run.smithi059.stdout:440.out 2023-09-21T00:19:48.899 INFO:teuthology.orchestra.run.smithi059.stdout:441 2023-09-21T00:19:48.899 INFO:teuthology.orchestra.run.smithi059.stdout:441.out 2023-09-21T00:19:48.899 INFO:teuthology.orchestra.run.smithi059.stdout:442 2023-09-21T00:19:48.899 INFO:teuthology.orchestra.run.smithi059.stdout:442.out 2023-09-21T00:19:48.899 INFO:teuthology.orchestra.run.smithi059.stdout:443 2023-09-21T00:19:48.900 INFO:teuthology.orchestra.run.smithi059.stdout:443.out 2023-09-21T00:19:48.900 INFO:teuthology.orchestra.run.smithi059.stdout:444 2023-09-21T00:19:48.900 INFO:teuthology.orchestra.run.smithi059.stdout:444.out 2023-09-21T00:19:48.900 INFO:teuthology.orchestra.run.smithi059.stdout:445 2023-09-21T00:19:48.900 INFO:teuthology.orchestra.run.smithi059.stdout:445.out 2023-09-21T00:19:48.901 INFO:teuthology.orchestra.run.smithi059.stdout:446 2023-09-21T00:19:48.901 INFO:teuthology.orchestra.run.smithi059.stdout:446.out 2023-09-21T00:19:48.901 INFO:teuthology.orchestra.run.smithi059.stdout:447 2023-09-21T00:19:48.901 INFO:teuthology.orchestra.run.smithi059.stdout:447.out 2023-09-21T00:19:48.901 INFO:teuthology.orchestra.run.smithi059.stdout:448 2023-09-21T00:19:48.901 INFO:teuthology.orchestra.run.smithi059.stdout:448.out 2023-09-21T00:19:48.902 INFO:teuthology.orchestra.run.smithi059.stdout:449 2023-09-21T00:19:48.902 INFO:teuthology.orchestra.run.smithi059.stdout:449.out 2023-09-21T00:19:48.902 INFO:teuthology.orchestra.run.smithi059.stdout:450 2023-09-21T00:19:48.902 INFO:teuthology.orchestra.run.smithi059.stdout:450.out 2023-09-21T00:19:48.902 INFO:teuthology.orchestra.run.smithi059.stdout:451 2023-09-21T00:19:48.903 INFO:teuthology.orchestra.run.smithi059.stdout:451.out 2023-09-21T00:19:48.903 INFO:teuthology.orchestra.run.smithi059.stdout:452 2023-09-21T00:19:48.903 INFO:teuthology.orchestra.run.smithi059.stdout:452.out 2023-09-21T00:19:48.903 INFO:teuthology.orchestra.run.smithi059.stdout:453 2023-09-21T00:19:48.903 INFO:teuthology.orchestra.run.smithi059.stdout:453.out 2023-09-21T00:19:48.903 INFO:teuthology.orchestra.run.smithi059.stdout:454 2023-09-21T00:19:48.904 INFO:teuthology.orchestra.run.smithi059.stdout:454.out 2023-09-21T00:19:48.904 INFO:teuthology.orchestra.run.smithi059.stdout:455 2023-09-21T00:19:48.904 INFO:teuthology.orchestra.run.smithi059.stdout:455.out 2023-09-21T00:19:48.904 INFO:teuthology.orchestra.run.smithi059.stdout:456 2023-09-21T00:19:48.904 INFO:teuthology.orchestra.run.smithi059.stdout:456.out 2023-09-21T00:19:48.905 INFO:teuthology.orchestra.run.smithi059.stdout:457 2023-09-21T00:19:48.905 INFO:teuthology.orchestra.run.smithi059.stdout:457.out 2023-09-21T00:19:48.905 INFO:teuthology.orchestra.run.smithi059.stdout:458 2023-09-21T00:19:48.905 INFO:teuthology.orchestra.run.smithi059.stdout:458.out 2023-09-21T00:19:48.905 INFO:teuthology.orchestra.run.smithi059.stdout:459 2023-09-21T00:19:48.905 INFO:teuthology.orchestra.run.smithi059.stdout:459.out 2023-09-21T00:19:48.906 INFO:teuthology.orchestra.run.smithi059.stdout:460 2023-09-21T00:19:48.906 INFO:teuthology.orchestra.run.smithi059.stdout:460.out 2023-09-21T00:19:48.906 INFO:teuthology.orchestra.run.smithi059.stdout:461 2023-09-21T00:19:48.906 INFO:teuthology.orchestra.run.smithi059.stdout:461.out 2023-09-21T00:19:48.906 INFO:teuthology.orchestra.run.smithi059.stdout:462 2023-09-21T00:19:48.907 INFO:teuthology.orchestra.run.smithi059.stdout:462.out 2023-09-21T00:19:48.907 INFO:teuthology.orchestra.run.smithi059.stdout:463 2023-09-21T00:19:48.907 INFO:teuthology.orchestra.run.smithi059.stdout:463.out 2023-09-21T00:19:48.907 INFO:teuthology.orchestra.run.smithi059.stdout:464 2023-09-21T00:19:48.907 INFO:teuthology.orchestra.run.smithi059.stdout:464.out 2023-09-21T00:19:48.908 INFO:teuthology.orchestra.run.smithi059.stdout:465 2023-09-21T00:19:48.908 INFO:teuthology.orchestra.run.smithi059.stdout:465.out 2023-09-21T00:19:48.908 INFO:teuthology.orchestra.run.smithi059.stdout:466 2023-09-21T00:19:48.908 INFO:teuthology.orchestra.run.smithi059.stdout:466.out 2023-09-21T00:19:48.908 INFO:teuthology.orchestra.run.smithi059.stdout:467 2023-09-21T00:19:48.908 INFO:teuthology.orchestra.run.smithi059.stdout:467.out 2023-09-21T00:19:48.909 INFO:teuthology.orchestra.run.smithi059.stdout:468 2023-09-21T00:19:48.909 INFO:teuthology.orchestra.run.smithi059.stdout:468.out 2023-09-21T00:19:48.909 INFO:teuthology.orchestra.run.smithi059.stdout:469 2023-09-21T00:19:48.909 INFO:teuthology.orchestra.run.smithi059.stdout:469.out 2023-09-21T00:19:48.909 INFO:teuthology.orchestra.run.smithi059.stdout:470 2023-09-21T00:19:48.910 INFO:teuthology.orchestra.run.smithi059.stdout:470.out 2023-09-21T00:19:48.910 INFO:teuthology.orchestra.run.smithi059.stdout:472 2023-09-21T00:19:48.910 INFO:teuthology.orchestra.run.smithi059.stdout:472.out 2023-09-21T00:19:48.910 INFO:teuthology.orchestra.run.smithi059.stdout:473 2023-09-21T00:19:48.910 INFO:teuthology.orchestra.run.smithi059.stdout:473.out 2023-09-21T00:19:48.911 INFO:teuthology.orchestra.run.smithi059.stdout:474 2023-09-21T00:19:48.911 INFO:teuthology.orchestra.run.smithi059.stdout:474.out 2023-09-21T00:19:48.911 INFO:teuthology.orchestra.run.smithi059.stdout:475 2023-09-21T00:19:48.911 INFO:teuthology.orchestra.run.smithi059.stdout:475.out 2023-09-21T00:19:48.911 INFO:teuthology.orchestra.run.smithi059.stdout:476 2023-09-21T00:19:48.911 INFO:teuthology.orchestra.run.smithi059.stdout:476.out 2023-09-21T00:19:48.912 INFO:teuthology.orchestra.run.smithi059.stdout:477 2023-09-21T00:19:48.912 INFO:teuthology.orchestra.run.smithi059.stdout:477.out 2023-09-21T00:19:48.912 INFO:teuthology.orchestra.run.smithi059.stdout:478 2023-09-21T00:19:48.912 INFO:teuthology.orchestra.run.smithi059.stdout:478.out 2023-09-21T00:19:48.912 INFO:teuthology.orchestra.run.smithi059.stdout:479 2023-09-21T00:19:48.913 INFO:teuthology.orchestra.run.smithi059.stdout:479.out 2023-09-21T00:19:48.913 INFO:teuthology.orchestra.run.smithi059.stdout:480 2023-09-21T00:19:48.913 INFO:teuthology.orchestra.run.smithi059.stdout:480.out 2023-09-21T00:19:48.913 INFO:teuthology.orchestra.run.smithi059.stdout:481 2023-09-21T00:19:48.913 INFO:teuthology.orchestra.run.smithi059.stdout:481.out 2023-09-21T00:19:48.913 INFO:teuthology.orchestra.run.smithi059.stdout:482 2023-09-21T00:19:48.914 INFO:teuthology.orchestra.run.smithi059.stdout:482.out 2023-09-21T00:19:48.914 INFO:teuthology.orchestra.run.smithi059.stdout:483 2023-09-21T00:19:48.914 INFO:teuthology.orchestra.run.smithi059.stdout:483.out 2023-09-21T00:19:48.914 INFO:teuthology.orchestra.run.smithi059.stdout:484 2023-09-21T00:19:48.914 INFO:teuthology.orchestra.run.smithi059.stdout:484.out 2023-09-21T00:19:48.915 INFO:teuthology.orchestra.run.smithi059.stdout:485 2023-09-21T00:19:48.915 INFO:teuthology.orchestra.run.smithi059.stdout:485.out 2023-09-21T00:19:48.915 INFO:teuthology.orchestra.run.smithi059.stdout:486 2023-09-21T00:19:48.915 INFO:teuthology.orchestra.run.smithi059.stdout:486.out 2023-09-21T00:19:48.915 INFO:teuthology.orchestra.run.smithi059.stdout:487 2023-09-21T00:19:48.915 INFO:teuthology.orchestra.run.smithi059.stdout:487.out 2023-09-21T00:19:48.916 INFO:teuthology.orchestra.run.smithi059.stdout:488 2023-09-21T00:19:48.916 INFO:teuthology.orchestra.run.smithi059.stdout:488.out 2023-09-21T00:19:48.916 INFO:teuthology.orchestra.run.smithi059.stdout:489 2023-09-21T00:19:48.916 INFO:teuthology.orchestra.run.smithi059.stdout:489.out 2023-09-21T00:19:48.916 INFO:teuthology.orchestra.run.smithi059.stdout:490 2023-09-21T00:19:48.917 INFO:teuthology.orchestra.run.smithi059.stdout:490.out 2023-09-21T00:19:48.917 INFO:teuthology.orchestra.run.smithi059.stdout:491 2023-09-21T00:19:48.917 INFO:teuthology.orchestra.run.smithi059.stdout:491.out 2023-09-21T00:19:48.917 INFO:teuthology.orchestra.run.smithi059.stdout:492 2023-09-21T00:19:48.917 INFO:teuthology.orchestra.run.smithi059.stdout:492.out 2023-09-21T00:19:48.917 INFO:teuthology.orchestra.run.smithi059.stdout:493 2023-09-21T00:19:48.918 INFO:teuthology.orchestra.run.smithi059.stdout:493.out 2023-09-21T00:19:48.918 INFO:teuthology.orchestra.run.smithi059.stdout:494 2023-09-21T00:19:48.918 INFO:teuthology.orchestra.run.smithi059.stdout:494.out 2023-09-21T00:19:48.918 INFO:teuthology.orchestra.run.smithi059.stdout:495 2023-09-21T00:19:48.918 INFO:teuthology.orchestra.run.smithi059.stdout:495.out 2023-09-21T00:19:48.919 INFO:teuthology.orchestra.run.smithi059.stdout:496 2023-09-21T00:19:48.919 INFO:teuthology.orchestra.run.smithi059.stdout:496.out 2023-09-21T00:19:48.919 INFO:teuthology.orchestra.run.smithi059.stdout:497 2023-09-21T00:19:48.919 INFO:teuthology.orchestra.run.smithi059.stdout:497.out 2023-09-21T00:19:48.919 INFO:teuthology.orchestra.run.smithi059.stdout:498 2023-09-21T00:19:48.920 INFO:teuthology.orchestra.run.smithi059.stdout:498.out 2023-09-21T00:19:48.920 INFO:teuthology.orchestra.run.smithi059.stdout:499 2023-09-21T00:19:48.920 INFO:teuthology.orchestra.run.smithi059.stdout:499.out 2023-09-21T00:19:48.920 INFO:teuthology.orchestra.run.smithi059.stdout:500 2023-09-21T00:19:48.920 INFO:teuthology.orchestra.run.smithi059.stdout:500.out 2023-09-21T00:19:48.920 INFO:teuthology.orchestra.run.smithi059.stdout:501 2023-09-21T00:19:48.921 INFO:teuthology.orchestra.run.smithi059.stdout:501.out 2023-09-21T00:19:48.921 INFO:teuthology.orchestra.run.smithi059.stdout:502 2023-09-21T00:19:48.921 INFO:teuthology.orchestra.run.smithi059.stdout:502.out 2023-09-21T00:19:48.921 INFO:teuthology.orchestra.run.smithi059.stdout:503 2023-09-21T00:19:48.921 INFO:teuthology.orchestra.run.smithi059.stdout:503.out 2023-09-21T00:19:48.922 INFO:teuthology.orchestra.run.smithi059.stdout:504 2023-09-21T00:19:48.922 INFO:teuthology.orchestra.run.smithi059.stdout:504.out 2023-09-21T00:19:48.922 INFO:teuthology.orchestra.run.smithi059.stdout:505 2023-09-21T00:19:48.922 INFO:teuthology.orchestra.run.smithi059.stdout:505.out 2023-09-21T00:19:48.922 INFO:teuthology.orchestra.run.smithi059.stdout:506 2023-09-21T00:19:48.922 INFO:teuthology.orchestra.run.smithi059.stdout:506.out 2023-09-21T00:19:48.923 INFO:teuthology.orchestra.run.smithi059.stdout:507 2023-09-21T00:19:48.923 INFO:teuthology.orchestra.run.smithi059.stdout:507.out 2023-09-21T00:19:48.923 INFO:teuthology.orchestra.run.smithi059.stdout:508 2023-09-21T00:19:48.923 INFO:teuthology.orchestra.run.smithi059.stdout:508.out 2023-09-21T00:19:48.923 INFO:teuthology.orchestra.run.smithi059.stdout:509 2023-09-21T00:19:48.924 INFO:teuthology.orchestra.run.smithi059.stdout:509.out 2023-09-21T00:19:48.924 INFO:teuthology.orchestra.run.smithi059.stdout:510 2023-09-21T00:19:48.924 INFO:teuthology.orchestra.run.smithi059.stdout:510.out 2023-09-21T00:19:48.924 INFO:teuthology.orchestra.run.smithi059.stdout:511 2023-09-21T00:19:48.924 INFO:teuthology.orchestra.run.smithi059.stdout:511.out 2023-09-21T00:19:48.925 INFO:teuthology.orchestra.run.smithi059.stdout:512 2023-09-21T00:19:48.925 INFO:teuthology.orchestra.run.smithi059.stdout:512.out 2023-09-21T00:19:48.925 INFO:teuthology.orchestra.run.smithi059.stdout:513 2023-09-21T00:19:48.925 INFO:teuthology.orchestra.run.smithi059.stdout:513.out 2023-09-21T00:19:48.925 INFO:teuthology.orchestra.run.smithi059.stdout:514 2023-09-21T00:19:48.925 INFO:teuthology.orchestra.run.smithi059.stdout:514.out 2023-09-21T00:19:48.926 INFO:teuthology.orchestra.run.smithi059.stdout:515 2023-09-21T00:19:48.926 INFO:teuthology.orchestra.run.smithi059.stdout:515.out 2023-09-21T00:19:48.926 INFO:teuthology.orchestra.run.smithi059.stdout:516 2023-09-21T00:19:48.926 INFO:teuthology.orchestra.run.smithi059.stdout:516.out 2023-09-21T00:19:48.926 INFO:teuthology.orchestra.run.smithi059.stdout:517 2023-09-21T00:19:48.927 INFO:teuthology.orchestra.run.smithi059.stdout:517.out 2023-09-21T00:19:48.927 INFO:teuthology.orchestra.run.smithi059.stdout:518 2023-09-21T00:19:48.927 INFO:teuthology.orchestra.run.smithi059.stdout:518.out 2023-09-21T00:19:48.927 INFO:teuthology.orchestra.run.smithi059.stdout:519 2023-09-21T00:19:48.927 INFO:teuthology.orchestra.run.smithi059.stdout:519.out 2023-09-21T00:19:48.927 INFO:teuthology.orchestra.run.smithi059.stdout:520 2023-09-21T00:19:48.928 INFO:teuthology.orchestra.run.smithi059.stdout:520.out 2023-09-21T00:19:48.928 INFO:teuthology.orchestra.run.smithi059.stdout:521 2023-09-21T00:19:48.928 INFO:teuthology.orchestra.run.smithi059.stdout:521.out 2023-09-21T00:19:48.928 INFO:teuthology.orchestra.run.smithi059.stdout:522 2023-09-21T00:19:48.928 INFO:teuthology.orchestra.run.smithi059.stdout:522.out 2023-09-21T00:19:48.929 INFO:teuthology.orchestra.run.smithi059.stdout:523 2023-09-21T00:19:48.929 INFO:teuthology.orchestra.run.smithi059.stdout:523.out 2023-09-21T00:19:48.929 INFO:teuthology.orchestra.run.smithi059.stdout:524 2023-09-21T00:19:48.929 INFO:teuthology.orchestra.run.smithi059.stdout:524.out 2023-09-21T00:19:48.929 INFO:teuthology.orchestra.run.smithi059.stdout:525 2023-09-21T00:19:48.929 INFO:teuthology.orchestra.run.smithi059.stdout:525.out 2023-09-21T00:19:48.930 INFO:teuthology.orchestra.run.smithi059.stdout:526 2023-09-21T00:19:48.930 INFO:teuthology.orchestra.run.smithi059.stdout:526.out 2023-09-21T00:19:48.930 INFO:teuthology.orchestra.run.smithi059.stdout:527 2023-09-21T00:19:48.930 INFO:teuthology.orchestra.run.smithi059.stdout:527.out 2023-09-21T00:19:48.930 INFO:teuthology.orchestra.run.smithi059.stdout:528 2023-09-21T00:19:48.931 INFO:teuthology.orchestra.run.smithi059.stdout:528.out 2023-09-21T00:19:48.931 INFO:teuthology.orchestra.run.smithi059.stdout:529 2023-09-21T00:19:48.931 INFO:teuthology.orchestra.run.smithi059.stdout:529.out 2023-09-21T00:19:48.931 INFO:teuthology.orchestra.run.smithi059.stdout:530 2023-09-21T00:19:48.931 INFO:teuthology.orchestra.run.smithi059.stdout:530.out 2023-09-21T00:19:48.931 INFO:teuthology.orchestra.run.smithi059.stdout:531 2023-09-21T00:19:48.932 INFO:teuthology.orchestra.run.smithi059.stdout:531.out 2023-09-21T00:19:48.932 INFO:teuthology.orchestra.run.smithi059.stdout:532 2023-09-21T00:19:48.932 INFO:teuthology.orchestra.run.smithi059.stdout:532.out 2023-09-21T00:19:48.932 INFO:teuthology.orchestra.run.smithi059.stdout:533 2023-09-21T00:19:48.932 INFO:teuthology.orchestra.run.smithi059.stdout:533.out 2023-09-21T00:19:48.933 INFO:teuthology.orchestra.run.smithi059.stdout:534 2023-09-21T00:19:48.933 INFO:teuthology.orchestra.run.smithi059.stdout:534.out 2023-09-21T00:19:48.933 INFO:teuthology.orchestra.run.smithi059.stdout:535 2023-09-21T00:19:48.933 INFO:teuthology.orchestra.run.smithi059.stdout:535.out 2023-09-21T00:19:48.933 INFO:teuthology.orchestra.run.smithi059.stdout:536 2023-09-21T00:19:48.933 INFO:teuthology.orchestra.run.smithi059.stdout:536.out 2023-09-21T00:19:48.934 INFO:teuthology.orchestra.run.smithi059.stdout:537 2023-09-21T00:19:48.934 INFO:teuthology.orchestra.run.smithi059.stdout:537.out 2023-09-21T00:19:48.934 INFO:teuthology.orchestra.run.smithi059.stdout:538 2023-09-21T00:19:48.934 INFO:teuthology.orchestra.run.smithi059.stdout:538.out 2023-09-21T00:19:48.934 INFO:teuthology.orchestra.run.smithi059.stdout:539 2023-09-21T00:19:48.935 INFO:teuthology.orchestra.run.smithi059.stdout:539.out 2023-09-21T00:19:48.935 INFO:teuthology.orchestra.run.smithi059.stdout:540 2023-09-21T00:19:48.935 INFO:teuthology.orchestra.run.smithi059.stdout:540.out 2023-09-21T00:19:48.935 INFO:teuthology.orchestra.run.smithi059.stdout:541 2023-09-21T00:19:48.935 INFO:teuthology.orchestra.run.smithi059.stdout:541.out 2023-09-21T00:19:48.935 INFO:teuthology.orchestra.run.smithi059.stdout:542 2023-09-21T00:19:48.936 INFO:teuthology.orchestra.run.smithi059.stdout:542.out 2023-09-21T00:19:48.936 INFO:teuthology.orchestra.run.smithi059.stdout:543 2023-09-21T00:19:48.936 INFO:teuthology.orchestra.run.smithi059.stdout:543.out 2023-09-21T00:19:48.936 INFO:teuthology.orchestra.run.smithi059.stdout:544 2023-09-21T00:19:48.936 INFO:teuthology.orchestra.run.smithi059.stdout:544.out 2023-09-21T00:19:48.936 INFO:teuthology.orchestra.run.smithi059.stdout:545 2023-09-21T00:19:48.937 INFO:teuthology.orchestra.run.smithi059.stdout:545.out 2023-09-21T00:19:48.937 INFO:teuthology.orchestra.run.smithi059.stdout:546 2023-09-21T00:19:48.937 INFO:teuthology.orchestra.run.smithi059.stdout:546.out 2023-09-21T00:19:48.937 INFO:teuthology.orchestra.run.smithi059.stdout:547 2023-09-21T00:19:48.937 INFO:teuthology.orchestra.run.smithi059.stdout:547.out 2023-09-21T00:19:48.938 INFO:teuthology.orchestra.run.smithi059.stdout:548 2023-09-21T00:19:48.938 INFO:teuthology.orchestra.run.smithi059.stdout:548.out 2023-09-21T00:19:48.938 INFO:teuthology.orchestra.run.smithi059.stdout:549 2023-09-21T00:19:48.938 INFO:teuthology.orchestra.run.smithi059.stdout:549.out 2023-09-21T00:19:48.938 INFO:teuthology.orchestra.run.smithi059.stdout:550 2023-09-21T00:19:48.939 INFO:teuthology.orchestra.run.smithi059.stdout:550.out 2023-09-21T00:19:48.939 INFO:teuthology.orchestra.run.smithi059.stdout:551 2023-09-21T00:19:48.939 INFO:teuthology.orchestra.run.smithi059.stdout:551.out 2023-09-21T00:19:48.939 INFO:teuthology.orchestra.run.smithi059.stdout:552 2023-09-21T00:19:48.939 INFO:teuthology.orchestra.run.smithi059.stdout:552.out 2023-09-21T00:19:48.939 INFO:teuthology.orchestra.run.smithi059.stdout:553 2023-09-21T00:19:48.940 INFO:teuthology.orchestra.run.smithi059.stdout:553.out 2023-09-21T00:19:48.940 INFO:teuthology.orchestra.run.smithi059.stdout:554 2023-09-21T00:19:48.940 INFO:teuthology.orchestra.run.smithi059.stdout:554.out 2023-09-21T00:19:48.940 INFO:teuthology.orchestra.run.smithi059.stdout:555 2023-09-21T00:19:48.940 INFO:teuthology.orchestra.run.smithi059.stdout:555.out 2023-09-21T00:19:48.940 INFO:teuthology.orchestra.run.smithi059.stdout:556 2023-09-21T00:19:48.941 INFO:teuthology.orchestra.run.smithi059.stdout:556.out 2023-09-21T00:19:48.941 INFO:teuthology.orchestra.run.smithi059.stdout:557 2023-09-21T00:19:48.941 INFO:teuthology.orchestra.run.smithi059.stdout:557.out 2023-09-21T00:19:48.941 INFO:teuthology.orchestra.run.smithi059.stdout:558 2023-09-21T00:19:48.941 INFO:teuthology.orchestra.run.smithi059.stdout:558.out 2023-09-21T00:19:48.942 INFO:teuthology.orchestra.run.smithi059.stdout:559 2023-09-21T00:19:48.942 INFO:teuthology.orchestra.run.smithi059.stdout:559.out 2023-09-21T00:19:48.942 INFO:teuthology.orchestra.run.smithi059.stdout:560 2023-09-21T00:19:48.942 INFO:teuthology.orchestra.run.smithi059.stdout:560.out 2023-09-21T00:19:48.942 INFO:teuthology.orchestra.run.smithi059.stdout:561 2023-09-21T00:19:48.942 INFO:teuthology.orchestra.run.smithi059.stdout:561.out 2023-09-21T00:19:48.943 INFO:teuthology.orchestra.run.smithi059.stdout:562 2023-09-21T00:19:48.943 INFO:teuthology.orchestra.run.smithi059.stdout:562.out 2023-09-21T00:19:48.943 INFO:teuthology.orchestra.run.smithi059.stdout:563 2023-09-21T00:19:48.943 INFO:teuthology.orchestra.run.smithi059.stdout:563.out 2023-09-21T00:19:48.943 INFO:teuthology.orchestra.run.smithi059.stdout:564 2023-09-21T00:19:48.944 INFO:teuthology.orchestra.run.smithi059.stdout:564.out 2023-09-21T00:19:48.944 INFO:teuthology.orchestra.run.smithi059.stdout:565 2023-09-21T00:19:48.944 INFO:teuthology.orchestra.run.smithi059.stdout:565.out 2023-09-21T00:19:48.944 INFO:teuthology.orchestra.run.smithi059.stdout:566 2023-09-21T00:19:48.944 INFO:teuthology.orchestra.run.smithi059.stdout:566.out 2023-09-21T00:19:48.944 INFO:teuthology.orchestra.run.smithi059.stdout:567 2023-09-21T00:19:48.945 INFO:teuthology.orchestra.run.smithi059.stdout:567.out 2023-09-21T00:19:48.945 INFO:teuthology.orchestra.run.smithi059.stdout:568 2023-09-21T00:19:48.945 INFO:teuthology.orchestra.run.smithi059.stdout:568.out 2023-09-21T00:19:48.945 INFO:teuthology.orchestra.run.smithi059.stdout:569 2023-09-21T00:19:48.945 INFO:teuthology.orchestra.run.smithi059.stdout:569.out 2023-09-21T00:19:48.945 INFO:teuthology.orchestra.run.smithi059.stdout:570 2023-09-21T00:19:48.946 INFO:teuthology.orchestra.run.smithi059.stdout:570.out 2023-09-21T00:19:48.946 INFO:teuthology.orchestra.run.smithi059.stdout:571 2023-09-21T00:19:48.946 INFO:teuthology.orchestra.run.smithi059.stdout:571.out 2023-09-21T00:19:48.946 INFO:teuthology.orchestra.run.smithi059.stdout:572 2023-09-21T00:19:48.946 INFO:teuthology.orchestra.run.smithi059.stdout:572.out 2023-09-21T00:19:48.947 INFO:teuthology.orchestra.run.smithi059.stdout:573 2023-09-21T00:19:48.947 INFO:teuthology.orchestra.run.smithi059.stdout:573.out 2023-09-21T00:19:48.947 INFO:teuthology.orchestra.run.smithi059.stdout:574 2023-09-21T00:19:48.947 INFO:teuthology.orchestra.run.smithi059.stdout:574.out 2023-09-21T00:19:48.947 INFO:teuthology.orchestra.run.smithi059.stdout:575 2023-09-21T00:19:48.947 INFO:teuthology.orchestra.run.smithi059.stdout:575.out 2023-09-21T00:19:48.948 INFO:teuthology.orchestra.run.smithi059.stdout:576 2023-09-21T00:19:48.948 INFO:teuthology.orchestra.run.smithi059.stdout:576.out 2023-09-21T00:19:48.948 INFO:teuthology.orchestra.run.smithi059.stdout:577 2023-09-21T00:19:48.948 INFO:teuthology.orchestra.run.smithi059.stdout:577.out 2023-09-21T00:19:48.948 INFO:teuthology.orchestra.run.smithi059.stdout:578 2023-09-21T00:19:48.949 INFO:teuthology.orchestra.run.smithi059.stdout:578.out 2023-09-21T00:19:48.949 INFO:teuthology.orchestra.run.smithi059.stdout:579 2023-09-21T00:19:48.949 INFO:teuthology.orchestra.run.smithi059.stdout:579.out 2023-09-21T00:19:48.949 INFO:teuthology.orchestra.run.smithi059.stdout:580 2023-09-21T00:19:48.949 INFO:teuthology.orchestra.run.smithi059.stdout:580.out 2023-09-21T00:19:48.949 INFO:teuthology.orchestra.run.smithi059.stdout:581 2023-09-21T00:19:48.950 INFO:teuthology.orchestra.run.smithi059.stdout:581.out 2023-09-21T00:19:48.950 INFO:teuthology.orchestra.run.smithi059.stdout:582 2023-09-21T00:19:48.950 INFO:teuthology.orchestra.run.smithi059.stdout:582.out 2023-09-21T00:19:48.950 INFO:teuthology.orchestra.run.smithi059.stdout:583 2023-09-21T00:19:48.950 INFO:teuthology.orchestra.run.smithi059.stdout:583.out 2023-09-21T00:19:48.950 INFO:teuthology.orchestra.run.smithi059.stdout:584 2023-09-21T00:19:48.951 INFO:teuthology.orchestra.run.smithi059.stdout:584.out 2023-09-21T00:19:48.951 INFO:teuthology.orchestra.run.smithi059.stdout:585 2023-09-21T00:19:48.951 INFO:teuthology.orchestra.run.smithi059.stdout:585.out 2023-09-21T00:19:48.951 INFO:teuthology.orchestra.run.smithi059.stdout:586 2023-09-21T00:19:48.951 INFO:teuthology.orchestra.run.smithi059.stdout:586.out 2023-09-21T00:19:48.952 INFO:teuthology.orchestra.run.smithi059.stdout:587 2023-09-21T00:19:48.952 INFO:teuthology.orchestra.run.smithi059.stdout:587.out 2023-09-21T00:19:48.952 INFO:teuthology.orchestra.run.smithi059.stdout:588 2023-09-21T00:19:48.952 INFO:teuthology.orchestra.run.smithi059.stdout:588.out 2023-09-21T00:19:48.952 INFO:teuthology.orchestra.run.smithi059.stdout:589 2023-09-21T00:19:48.952 INFO:teuthology.orchestra.run.smithi059.stdout:589.out 2023-09-21T00:19:48.953 INFO:teuthology.orchestra.run.smithi059.stdout:590 2023-09-21T00:19:48.953 INFO:teuthology.orchestra.run.smithi059.stdout:590.out 2023-09-21T00:19:48.953 INFO:teuthology.orchestra.run.smithi059.stdout:591 2023-09-21T00:19:48.953 INFO:teuthology.orchestra.run.smithi059.stdout:591.out 2023-09-21T00:19:48.953 INFO:teuthology.orchestra.run.smithi059.stdout:592 2023-09-21T00:19:48.954 INFO:teuthology.orchestra.run.smithi059.stdout:592.out 2023-09-21T00:19:48.954 INFO:teuthology.orchestra.run.smithi059.stdout:593 2023-09-21T00:19:48.954 INFO:teuthology.orchestra.run.smithi059.stdout:593.out 2023-09-21T00:19:48.954 INFO:teuthology.orchestra.run.smithi059.stdout:594 2023-09-21T00:19:48.954 INFO:teuthology.orchestra.run.smithi059.stdout:594.out 2023-09-21T00:19:48.954 INFO:teuthology.orchestra.run.smithi059.stdout:595 2023-09-21T00:19:48.955 INFO:teuthology.orchestra.run.smithi059.stdout:595.out 2023-09-21T00:19:48.955 INFO:teuthology.orchestra.run.smithi059.stdout:596 2023-09-21T00:19:48.955 INFO:teuthology.orchestra.run.smithi059.stdout:596.out 2023-09-21T00:19:48.955 INFO:teuthology.orchestra.run.smithi059.stdout:597 2023-09-21T00:19:48.955 INFO:teuthology.orchestra.run.smithi059.stdout:597.out 2023-09-21T00:19:48.955 INFO:teuthology.orchestra.run.smithi059.stdout:598 2023-09-21T00:19:48.956 INFO:teuthology.orchestra.run.smithi059.stdout:598.out 2023-09-21T00:19:48.956 INFO:teuthology.orchestra.run.smithi059.stdout:599 2023-09-21T00:19:48.956 INFO:teuthology.orchestra.run.smithi059.stdout:599.out 2023-09-21T00:19:48.956 INFO:teuthology.orchestra.run.smithi059.stdout:600 2023-09-21T00:19:48.956 INFO:teuthology.orchestra.run.smithi059.stdout:600.out 2023-09-21T00:19:48.957 INFO:teuthology.orchestra.run.smithi059.stdout:601 2023-09-21T00:19:48.957 INFO:teuthology.orchestra.run.smithi059.stdout:601.out 2023-09-21T00:19:48.957 INFO:teuthology.orchestra.run.smithi059.stdout:602 2023-09-21T00:19:48.957 INFO:teuthology.orchestra.run.smithi059.stdout:602.out 2023-09-21T00:19:48.957 INFO:teuthology.orchestra.run.smithi059.stdout:603 2023-09-21T00:19:48.957 INFO:teuthology.orchestra.run.smithi059.stdout:603.out 2023-09-21T00:19:48.958 INFO:teuthology.orchestra.run.smithi059.stdout:604 2023-09-21T00:19:48.958 INFO:teuthology.orchestra.run.smithi059.stdout:604.out 2023-09-21T00:19:48.958 INFO:teuthology.orchestra.run.smithi059.stdout:605 2023-09-21T00:19:48.958 INFO:teuthology.orchestra.run.smithi059.stdout:605.out 2023-09-21T00:19:48.958 INFO:teuthology.orchestra.run.smithi059.stdout:606 2023-09-21T00:19:48.959 INFO:teuthology.orchestra.run.smithi059.stdout:606.out 2023-09-21T00:19:48.959 INFO:teuthology.orchestra.run.smithi059.stdout:607 2023-09-21T00:19:48.959 INFO:teuthology.orchestra.run.smithi059.stdout:607.out 2023-09-21T00:19:48.959 INFO:teuthology.orchestra.run.smithi059.stdout:608 2023-09-21T00:19:48.959 INFO:teuthology.orchestra.run.smithi059.stdout:608.out 2023-09-21T00:19:48.959 INFO:teuthology.orchestra.run.smithi059.stdout:609 2023-09-21T00:19:48.960 INFO:teuthology.orchestra.run.smithi059.stdout:609.out 2023-09-21T00:19:48.960 INFO:teuthology.orchestra.run.smithi059.stdout:610 2023-09-21T00:19:48.960 INFO:teuthology.orchestra.run.smithi059.stdout:610.out 2023-09-21T00:19:48.960 INFO:teuthology.orchestra.run.smithi059.stdout:611 2023-09-21T00:19:48.960 INFO:teuthology.orchestra.run.smithi059.stdout:611.out 2023-09-21T00:19:48.961 INFO:teuthology.orchestra.run.smithi059.stdout:612 2023-09-21T00:19:48.961 INFO:teuthology.orchestra.run.smithi059.stdout:612.out 2023-09-21T00:19:48.961 INFO:teuthology.orchestra.run.smithi059.stdout:613 2023-09-21T00:19:48.961 INFO:teuthology.orchestra.run.smithi059.stdout:613.out 2023-09-21T00:19:48.961 INFO:teuthology.orchestra.run.smithi059.stdout:614 2023-09-21T00:19:48.961 INFO:teuthology.orchestra.run.smithi059.stdout:614.out 2023-09-21T00:19:48.962 INFO:teuthology.orchestra.run.smithi059.stdout:615 2023-09-21T00:19:48.962 INFO:teuthology.orchestra.run.smithi059.stdout:615.out 2023-09-21T00:19:48.962 INFO:teuthology.orchestra.run.smithi059.stdout:616 2023-09-21T00:19:48.962 INFO:teuthology.orchestra.run.smithi059.stdout:616.out 2023-09-21T00:19:48.962 INFO:teuthology.orchestra.run.smithi059.stdout:617 2023-09-21T00:19:48.963 INFO:teuthology.orchestra.run.smithi059.stdout:617.out 2023-09-21T00:19:48.963 INFO:teuthology.orchestra.run.smithi059.stdout:618 2023-09-21T00:19:48.963 INFO:teuthology.orchestra.run.smithi059.stdout:618.out 2023-09-21T00:19:48.963 INFO:teuthology.orchestra.run.smithi059.stdout:619 2023-09-21T00:19:48.963 INFO:teuthology.orchestra.run.smithi059.stdout:619.out 2023-09-21T00:19:48.963 INFO:teuthology.orchestra.run.smithi059.stdout:620 2023-09-21T00:19:48.964 INFO:teuthology.orchestra.run.smithi059.stdout:620.out 2023-09-21T00:19:48.964 INFO:teuthology.orchestra.run.smithi059.stdout:621 2023-09-21T00:19:48.964 INFO:teuthology.orchestra.run.smithi059.stdout:621.out 2023-09-21T00:19:48.964 INFO:teuthology.orchestra.run.smithi059.stdout:622 2023-09-21T00:19:48.964 INFO:teuthology.orchestra.run.smithi059.stdout:622.out 2023-09-21T00:19:48.965 INFO:teuthology.orchestra.run.smithi059.stdout:623 2023-09-21T00:19:48.965 INFO:teuthology.orchestra.run.smithi059.stdout:623.out 2023-09-21T00:19:48.965 INFO:teuthology.orchestra.run.smithi059.stdout:624 2023-09-21T00:19:48.965 INFO:teuthology.orchestra.run.smithi059.stdout:624.out 2023-09-21T00:19:48.965 INFO:teuthology.orchestra.run.smithi059.stdout:625 2023-09-21T00:19:48.965 INFO:teuthology.orchestra.run.smithi059.stdout:625.out 2023-09-21T00:19:48.966 INFO:teuthology.orchestra.run.smithi059.stdout:626 2023-09-21T00:19:48.966 INFO:teuthology.orchestra.run.smithi059.stdout:626.out 2023-09-21T00:19:48.966 INFO:teuthology.orchestra.run.smithi059.stdout:627 2023-09-21T00:19:48.966 INFO:teuthology.orchestra.run.smithi059.stdout:627.out 2023-09-21T00:19:48.966 INFO:teuthology.orchestra.run.smithi059.stdout:628 2023-09-21T00:19:48.967 INFO:teuthology.orchestra.run.smithi059.stdout:628.out 2023-09-21T00:19:48.967 INFO:teuthology.orchestra.run.smithi059.stdout:629 2023-09-21T00:19:48.967 INFO:teuthology.orchestra.run.smithi059.stdout:629.out 2023-09-21T00:19:48.967 INFO:teuthology.orchestra.run.smithi059.stdout:630 2023-09-21T00:19:48.967 INFO:teuthology.orchestra.run.smithi059.stdout:630.out 2023-09-21T00:19:48.967 INFO:teuthology.orchestra.run.smithi059.stdout:631 2023-09-21T00:19:48.968 INFO:teuthology.orchestra.run.smithi059.stdout:631.out 2023-09-21T00:19:48.968 INFO:teuthology.orchestra.run.smithi059.stdout:632 2023-09-21T00:19:48.968 INFO:teuthology.orchestra.run.smithi059.stdout:632.out 2023-09-21T00:19:48.968 INFO:teuthology.orchestra.run.smithi059.stdout:633 2023-09-21T00:19:48.968 INFO:teuthology.orchestra.run.smithi059.stdout:633.out 2023-09-21T00:19:48.969 INFO:teuthology.orchestra.run.smithi059.stdout:634 2023-09-21T00:19:48.969 INFO:teuthology.orchestra.run.smithi059.stdout:634.out 2023-09-21T00:19:48.969 INFO:teuthology.orchestra.run.smithi059.stdout:635 2023-09-21T00:19:48.969 INFO:teuthology.orchestra.run.smithi059.stdout:635.out 2023-09-21T00:19:48.969 INFO:teuthology.orchestra.run.smithi059.stdout:636 2023-09-21T00:19:48.969 INFO:teuthology.orchestra.run.smithi059.stdout:636.out 2023-09-21T00:19:48.970 INFO:teuthology.orchestra.run.smithi059.stdout:637 2023-09-21T00:19:48.970 INFO:teuthology.orchestra.run.smithi059.stdout:637.out 2023-09-21T00:19:48.970 INFO:teuthology.orchestra.run.smithi059.stdout:638 2023-09-21T00:19:48.970 INFO:teuthology.orchestra.run.smithi059.stdout:638.out 2023-09-21T00:19:48.973 INFO:teuthology.orchestra.run.smithi059.stdout:639 2023-09-21T00:19:48.973 INFO:teuthology.orchestra.run.smithi059.stdout:639.out 2023-09-21T00:19:48.973 INFO:teuthology.orchestra.run.smithi059.stdout:640 2023-09-21T00:19:48.973 INFO:teuthology.orchestra.run.smithi059.stdout:640.out 2023-09-21T00:19:48.973 INFO:teuthology.orchestra.run.smithi059.stdout:641 2023-09-21T00:19:48.973 INFO:teuthology.orchestra.run.smithi059.stdout:641.out 2023-09-21T00:19:48.974 INFO:teuthology.orchestra.run.smithi059.stdout:642 2023-09-21T00:19:48.974 INFO:teuthology.orchestra.run.smithi059.stdout:642.out 2023-09-21T00:19:48.974 INFO:teuthology.orchestra.run.smithi059.stdout:643 2023-09-21T00:19:48.974 INFO:teuthology.orchestra.run.smithi059.stdout:643.out 2023-09-21T00:19:48.974 INFO:teuthology.orchestra.run.smithi059.stdout:644 2023-09-21T00:19:48.975 INFO:teuthology.orchestra.run.smithi059.stdout:644.out 2023-09-21T00:19:48.975 INFO:teuthology.orchestra.run.smithi059.stdout:645 2023-09-21T00:19:48.975 INFO:teuthology.orchestra.run.smithi059.stdout:645.out 2023-09-21T00:19:48.975 INFO:teuthology.orchestra.run.smithi059.stdout:646 2023-09-21T00:19:48.975 INFO:teuthology.orchestra.run.smithi059.stdout:646.out 2023-09-21T00:19:48.975 INFO:teuthology.orchestra.run.smithi059.stdout:647 2023-09-21T00:19:48.976 INFO:teuthology.orchestra.run.smithi059.stdout:647.out 2023-09-21T00:19:48.976 INFO:teuthology.orchestra.run.smithi059.stdout:648 2023-09-21T00:19:48.976 INFO:teuthology.orchestra.run.smithi059.stdout:648.out 2023-09-21T00:19:48.976 INFO:teuthology.orchestra.run.smithi059.stdout:649 2023-09-21T00:19:48.976 INFO:teuthology.orchestra.run.smithi059.stdout:649.out 2023-09-21T00:19:48.977 INFO:teuthology.orchestra.run.smithi059.stdout:650 2023-09-21T00:19:48.977 INFO:teuthology.orchestra.run.smithi059.stdout:650.out 2023-09-21T00:19:48.977 INFO:teuthology.orchestra.run.smithi059.stdout:651 2023-09-21T00:19:48.977 INFO:teuthology.orchestra.run.smithi059.stdout:651.out 2023-09-21T00:19:48.977 INFO:teuthology.orchestra.run.smithi059.stdout:652 2023-09-21T00:19:48.977 INFO:teuthology.orchestra.run.smithi059.stdout:652.out 2023-09-21T00:19:48.978 INFO:teuthology.orchestra.run.smithi059.stdout:653 2023-09-21T00:19:48.978 INFO:teuthology.orchestra.run.smithi059.stdout:653.out 2023-09-21T00:19:48.978 INFO:teuthology.orchestra.run.smithi059.stdout:654 2023-09-21T00:19:48.978 INFO:teuthology.orchestra.run.smithi059.stdout:654.out 2023-09-21T00:19:48.978 INFO:teuthology.orchestra.run.smithi059.stdout:655 2023-09-21T00:19:48.979 INFO:teuthology.orchestra.run.smithi059.stdout:655.out 2023-09-21T00:19:48.979 INFO:teuthology.orchestra.run.smithi059.stdout:656 2023-09-21T00:19:48.979 INFO:teuthology.orchestra.run.smithi059.stdout:656.out 2023-09-21T00:19:48.979 INFO:teuthology.orchestra.run.smithi059.stdout:657 2023-09-21T00:19:48.979 INFO:teuthology.orchestra.run.smithi059.stdout:657.out 2023-09-21T00:19:48.979 INFO:teuthology.orchestra.run.smithi059.stdout:658 2023-09-21T00:19:48.980 INFO:teuthology.orchestra.run.smithi059.stdout:658.out 2023-09-21T00:19:48.980 INFO:teuthology.orchestra.run.smithi059.stdout:659 2023-09-21T00:19:48.980 INFO:teuthology.orchestra.run.smithi059.stdout:659.out 2023-09-21T00:19:48.980 INFO:teuthology.orchestra.run.smithi059.stdout:660 2023-09-21T00:19:48.980 INFO:teuthology.orchestra.run.smithi059.stdout:660.out 2023-09-21T00:19:48.980 INFO:teuthology.orchestra.run.smithi059.stdout:661 2023-09-21T00:19:48.981 INFO:teuthology.orchestra.run.smithi059.stdout:661.out 2023-09-21T00:19:48.981 INFO:teuthology.orchestra.run.smithi059.stdout:662 2023-09-21T00:19:48.981 INFO:teuthology.orchestra.run.smithi059.stdout:662.out 2023-09-21T00:19:48.981 INFO:teuthology.orchestra.run.smithi059.stdout:663 2023-09-21T00:19:48.981 INFO:teuthology.orchestra.run.smithi059.stdout:663.out 2023-09-21T00:19:48.982 INFO:teuthology.orchestra.run.smithi059.stdout:664 2023-09-21T00:19:48.982 INFO:teuthology.orchestra.run.smithi059.stdout:664.out 2023-09-21T00:19:48.982 INFO:teuthology.orchestra.run.smithi059.stdout:665 2023-09-21T00:19:48.982 INFO:teuthology.orchestra.run.smithi059.stdout:665.out 2023-09-21T00:19:48.982 INFO:teuthology.orchestra.run.smithi059.stdout:666 2023-09-21T00:19:48.982 INFO:teuthology.orchestra.run.smithi059.stdout:666.out 2023-09-21T00:19:48.983 INFO:teuthology.orchestra.run.smithi059.stdout:667 2023-09-21T00:19:48.983 INFO:teuthology.orchestra.run.smithi059.stdout:667.out 2023-09-21T00:19:48.983 INFO:teuthology.orchestra.run.smithi059.stdout:668 2023-09-21T00:19:48.983 INFO:teuthology.orchestra.run.smithi059.stdout:668.out 2023-09-21T00:19:48.983 INFO:teuthology.orchestra.run.smithi059.stdout:669 2023-09-21T00:19:48.984 INFO:teuthology.orchestra.run.smithi059.stdout:669.out 2023-09-21T00:19:48.984 INFO:teuthology.orchestra.run.smithi059.stdout:670 2023-09-21T00:19:48.984 INFO:teuthology.orchestra.run.smithi059.stdout:670.out 2023-09-21T00:19:48.984 INFO:teuthology.orchestra.run.smithi059.stdout:671 2023-09-21T00:19:48.984 INFO:teuthology.orchestra.run.smithi059.stdout:671.out 2023-09-21T00:19:48.984 INFO:teuthology.orchestra.run.smithi059.stdout:672 2023-09-21T00:19:48.985 INFO:teuthology.orchestra.run.smithi059.stdout:672.out 2023-09-21T00:19:48.985 INFO:teuthology.orchestra.run.smithi059.stdout:673 2023-09-21T00:19:48.985 INFO:teuthology.orchestra.run.smithi059.stdout:673.out 2023-09-21T00:19:48.985 INFO:teuthology.orchestra.run.smithi059.stdout:674 2023-09-21T00:19:48.985 INFO:teuthology.orchestra.run.smithi059.stdout:674.out 2023-09-21T00:19:48.985 INFO:teuthology.orchestra.run.smithi059.stdout:675 2023-09-21T00:19:48.986 INFO:teuthology.orchestra.run.smithi059.stdout:675.out 2023-09-21T00:19:48.986 INFO:teuthology.orchestra.run.smithi059.stdout:676 2023-09-21T00:19:48.986 INFO:teuthology.orchestra.run.smithi059.stdout:676.out 2023-09-21T00:19:48.986 INFO:teuthology.orchestra.run.smithi059.stdout:677 2023-09-21T00:19:48.986 INFO:teuthology.orchestra.run.smithi059.stdout:677.out 2023-09-21T00:19:48.987 INFO:teuthology.orchestra.run.smithi059.stdout:678 2023-09-21T00:19:48.987 INFO:teuthology.orchestra.run.smithi059.stdout:678.out 2023-09-21T00:19:48.987 INFO:teuthology.orchestra.run.smithi059.stdout:679 2023-09-21T00:19:48.987 INFO:teuthology.orchestra.run.smithi059.stdout:679.out 2023-09-21T00:19:48.987 INFO:teuthology.orchestra.run.smithi059.stdout:680 2023-09-21T00:19:48.987 INFO:teuthology.orchestra.run.smithi059.stdout:680.out 2023-09-21T00:19:48.988 INFO:teuthology.orchestra.run.smithi059.stdout:681 2023-09-21T00:19:48.988 INFO:teuthology.orchestra.run.smithi059.stdout:681.out 2023-09-21T00:19:48.988 INFO:teuthology.orchestra.run.smithi059.stdout:682 2023-09-21T00:19:48.988 INFO:teuthology.orchestra.run.smithi059.stdout:682.out 2023-09-21T00:19:48.988 INFO:teuthology.orchestra.run.smithi059.stdout:683 2023-09-21T00:19:48.989 INFO:teuthology.orchestra.run.smithi059.stdout:683.out 2023-09-21T00:19:48.989 INFO:teuthology.orchestra.run.smithi059.stdout:684 2023-09-21T00:19:48.989 INFO:teuthology.orchestra.run.smithi059.stdout:684.out 2023-09-21T00:19:48.989 INFO:teuthology.orchestra.run.smithi059.stdout:685 2023-09-21T00:19:48.989 INFO:teuthology.orchestra.run.smithi059.stdout:685.out 2023-09-21T00:19:48.990 INFO:teuthology.orchestra.run.smithi059.stdout:686 2023-09-21T00:19:48.990 INFO:teuthology.orchestra.run.smithi059.stdout:686.out 2023-09-21T00:19:48.990 INFO:teuthology.orchestra.run.smithi059.stdout:687 2023-09-21T00:19:48.990 INFO:teuthology.orchestra.run.smithi059.stdout:687.out 2023-09-21T00:19:48.990 INFO:teuthology.orchestra.run.smithi059.stdout:688 2023-09-21T00:19:48.990 INFO:teuthology.orchestra.run.smithi059.stdout:688.out 2023-09-21T00:19:48.991 INFO:teuthology.orchestra.run.smithi059.stdout:689 2023-09-21T00:19:48.991 INFO:teuthology.orchestra.run.smithi059.stdout:689.out 2023-09-21T00:19:48.991 INFO:teuthology.orchestra.run.smithi059.stdout:690 2023-09-21T00:19:48.991 INFO:teuthology.orchestra.run.smithi059.stdout:690.out 2023-09-21T00:19:48.991 INFO:teuthology.orchestra.run.smithi059.stdout:691 2023-09-21T00:19:48.992 INFO:teuthology.orchestra.run.smithi059.stdout:691.out 2023-09-21T00:19:48.992 INFO:teuthology.orchestra.run.smithi059.stdout:692 2023-09-21T00:19:48.992 INFO:teuthology.orchestra.run.smithi059.stdout:692.out 2023-09-21T00:19:48.992 INFO:teuthology.orchestra.run.smithi059.stdout:693 2023-09-21T00:19:48.992 INFO:teuthology.orchestra.run.smithi059.stdout:693.out 2023-09-21T00:19:48.992 INFO:teuthology.orchestra.run.smithi059.stdout:694 2023-09-21T00:19:48.993 INFO:teuthology.orchestra.run.smithi059.stdout:694.out 2023-09-21T00:19:48.993 INFO:teuthology.orchestra.run.smithi059.stdout:695 2023-09-21T00:19:48.993 INFO:teuthology.orchestra.run.smithi059.stdout:695.out 2023-09-21T00:19:48.993 INFO:teuthology.orchestra.run.smithi059.stdout:696 2023-09-21T00:19:48.993 INFO:teuthology.orchestra.run.smithi059.stdout:696.out 2023-09-21T00:19:48.993 INFO:teuthology.orchestra.run.smithi059.stdout:697 2023-09-21T00:19:48.994 INFO:teuthology.orchestra.run.smithi059.stdout:697.out 2023-09-21T00:19:48.994 INFO:teuthology.orchestra.run.smithi059.stdout:698 2023-09-21T00:19:48.994 INFO:teuthology.orchestra.run.smithi059.stdout:698.out 2023-09-21T00:19:48.994 INFO:teuthology.orchestra.run.smithi059.stdout:699 2023-09-21T00:19:48.994 INFO:teuthology.orchestra.run.smithi059.stdout:699.out 2023-09-21T00:19:48.995 INFO:teuthology.orchestra.run.smithi059.stdout:700 2023-09-21T00:19:48.995 INFO:teuthology.orchestra.run.smithi059.stdout:700.out 2023-09-21T00:19:48.995 INFO:teuthology.orchestra.run.smithi059.stdout:701 2023-09-21T00:19:48.995 INFO:teuthology.orchestra.run.smithi059.stdout:701.out 2023-09-21T00:19:48.995 INFO:teuthology.orchestra.run.smithi059.stdout:702 2023-09-21T00:19:48.995 INFO:teuthology.orchestra.run.smithi059.stdout:702.out 2023-09-21T00:19:48.996 INFO:teuthology.orchestra.run.smithi059.stdout:703 2023-09-21T00:19:48.996 INFO:teuthology.orchestra.run.smithi059.stdout:703.out 2023-09-21T00:19:48.996 INFO:teuthology.orchestra.run.smithi059.stdout:704 2023-09-21T00:19:48.996 INFO:teuthology.orchestra.run.smithi059.stdout:704.out 2023-09-21T00:19:48.996 INFO:teuthology.orchestra.run.smithi059.stdout:705 2023-09-21T00:19:48.997 INFO:teuthology.orchestra.run.smithi059.stdout:705.out 2023-09-21T00:19:48.997 INFO:teuthology.orchestra.run.smithi059.stdout:706 2023-09-21T00:19:48.997 INFO:teuthology.orchestra.run.smithi059.stdout:706.out 2023-09-21T00:19:48.997 INFO:teuthology.orchestra.run.smithi059.stdout:707 2023-09-21T00:19:48.997 INFO:teuthology.orchestra.run.smithi059.stdout:707.out 2023-09-21T00:19:48.997 INFO:teuthology.orchestra.run.smithi059.stdout:708 2023-09-21T00:19:48.998 INFO:teuthology.orchestra.run.smithi059.stdout:708.out 2023-09-21T00:19:48.998 INFO:teuthology.orchestra.run.smithi059.stdout:709 2023-09-21T00:19:48.998 INFO:teuthology.orchestra.run.smithi059.stdout:709.out 2023-09-21T00:19:48.998 INFO:teuthology.orchestra.run.smithi059.stdout:710 2023-09-21T00:19:48.998 INFO:teuthology.orchestra.run.smithi059.stdout:710.out 2023-09-21T00:19:48.999 INFO:teuthology.orchestra.run.smithi059.stdout:711 2023-09-21T00:19:48.999 INFO:teuthology.orchestra.run.smithi059.stdout:711.out 2023-09-21T00:19:48.999 INFO:teuthology.orchestra.run.smithi059.stdout:712 2023-09-21T00:19:48.999 INFO:teuthology.orchestra.run.smithi059.stdout:712.out 2023-09-21T00:19:48.999 INFO:teuthology.orchestra.run.smithi059.stdout:713 2023-09-21T00:19:48.999 INFO:teuthology.orchestra.run.smithi059.stdout:713.out 2023-09-21T00:19:49.000 INFO:teuthology.orchestra.run.smithi059.stdout:714 2023-09-21T00:19:49.000 INFO:teuthology.orchestra.run.smithi059.stdout:714.out 2023-09-21T00:19:49.000 INFO:teuthology.orchestra.run.smithi059.stdout:715 2023-09-21T00:19:49.000 INFO:teuthology.orchestra.run.smithi059.stdout:715.out 2023-09-21T00:19:49.000 INFO:teuthology.orchestra.run.smithi059.stdout:716 2023-09-21T00:19:49.000 INFO:teuthology.orchestra.run.smithi059.stdout:716.out 2023-09-21T00:19:49.001 INFO:teuthology.orchestra.run.smithi059.stdout:717 2023-09-21T00:19:49.001 INFO:teuthology.orchestra.run.smithi059.stdout:717.out 2023-09-21T00:19:49.001 INFO:teuthology.orchestra.run.smithi059.stdout:718 2023-09-21T00:19:49.001 INFO:teuthology.orchestra.run.smithi059.stdout:718.out 2023-09-21T00:19:49.001 INFO:teuthology.orchestra.run.smithi059.stdout:719 2023-09-21T00:19:49.002 INFO:teuthology.orchestra.run.smithi059.stdout:719.out 2023-09-21T00:19:49.002 INFO:teuthology.orchestra.run.smithi059.stdout:720 2023-09-21T00:19:49.002 INFO:teuthology.orchestra.run.smithi059.stdout:720.out 2023-09-21T00:19:49.002 INFO:teuthology.orchestra.run.smithi059.stdout:721 2023-09-21T00:19:49.002 INFO:teuthology.orchestra.run.smithi059.stdout:721.out 2023-09-21T00:19:49.002 INFO:teuthology.orchestra.run.smithi059.stdout:722 2023-09-21T00:19:49.003 INFO:teuthology.orchestra.run.smithi059.stdout:722.out 2023-09-21T00:19:49.003 INFO:teuthology.orchestra.run.smithi059.stdout:723 2023-09-21T00:19:49.003 INFO:teuthology.orchestra.run.smithi059.stdout:723.out 2023-09-21T00:19:49.003 INFO:teuthology.orchestra.run.smithi059.stdout:724 2023-09-21T00:19:49.003 INFO:teuthology.orchestra.run.smithi059.stdout:724.out 2023-09-21T00:19:49.003 INFO:teuthology.orchestra.run.smithi059.stdout:725 2023-09-21T00:19:49.004 INFO:teuthology.orchestra.run.smithi059.stdout:725.out 2023-09-21T00:19:49.004 INFO:teuthology.orchestra.run.smithi059.stdout:726 2023-09-21T00:19:49.004 INFO:teuthology.orchestra.run.smithi059.stdout:726.out 2023-09-21T00:19:49.004 INFO:teuthology.orchestra.run.smithi059.stdout:727 2023-09-21T00:19:49.004 INFO:teuthology.orchestra.run.smithi059.stdout:727.out 2023-09-21T00:19:49.005 INFO:teuthology.orchestra.run.smithi059.stdout:728 2023-09-21T00:19:49.005 INFO:teuthology.orchestra.run.smithi059.stdout:728.out 2023-09-21T00:19:49.005 INFO:teuthology.orchestra.run.smithi059.stdout:729 2023-09-21T00:19:49.005 INFO:teuthology.orchestra.run.smithi059.stdout:729.out 2023-09-21T00:19:49.005 INFO:teuthology.orchestra.run.smithi059.stdout:730 2023-09-21T00:19:49.005 INFO:teuthology.orchestra.run.smithi059.stdout:730.out 2023-09-21T00:19:49.006 INFO:teuthology.orchestra.run.smithi059.stdout:731 2023-09-21T00:19:49.006 INFO:teuthology.orchestra.run.smithi059.stdout:731.out 2023-09-21T00:19:49.006 INFO:teuthology.orchestra.run.smithi059.stdout:group.list 2023-09-21T00:19:49.006 INFO:teuthology.orchestra.run.smithi059.stdout:Makefile 2023-09-21T00:19:49.007 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-09-21T00:19:49.241 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:19:49.244 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:19:49.245 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:19:49.246 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:19:49.246 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:19:53.879 INFO:teuthology.orchestra.run.smithi059.stdout:generic/001 4s 2023-09-21T00:19:53.885 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/001 2023-09-21T00:19:53.886 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:19:53.886 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:19:54.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:19:54.601 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-09-21T00:19:54.830 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:19:54.834 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:19:54.834 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:19:54.835 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:19:54.836 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:19:55.366 INFO:teuthology.orchestra.run.smithi059.stdout:generic/002 0s 2023-09-21T00:19:55.374 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/002 2023-09-21T00:19:55.375 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:19:55.378 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:19:55.527 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:19:55.527 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-09-21T00:19:55.774 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:19:55.778 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:19:55.778 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:19:55.779 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:19:55.779 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:19:56.108 INFO:teuthology.orchestra.run.smithi059.stdout:generic/003 [not run] atime not maintained by ceph 2023-09-21T00:19:56.113 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/003 2023-09-21T00:19:56.113 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/003 2023-09-21T00:19:56.113 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:19:56.115 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:19:56.141 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:19:56.142 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-09-21T00:19:56.365 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:19:56.370 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:19:56.370 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:19:56.371 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:19:56.371 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:19:56.719 INFO:teuthology.orchestra.run.smithi059.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-09-21T00:19:56.723 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/004 2023-09-21T00:19:56.724 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/004 2023-09-21T00:19:56.724 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:19:56.725 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:19:56.753 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:19:56.754 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-09-21T00:19:56.978 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:19:56.982 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:19:56.983 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:19:56.983 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:19:56.983 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:19:57.486 INFO:teuthology.orchestra.run.smithi059.stdout:generic/005 0s 2023-09-21T00:19:57.490 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/005 2023-09-21T00:19:57.491 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:19:57.492 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:19:57.587 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:19:57.588 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-09-21T00:19:57.811 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:19:57.815 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:19:57.815 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:19:57.816 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:19:57.816 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:20:07.071 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:20:07.074 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:20:22.403 INFO:teuthology.orchestra.run.smithi059.stdout:generic/006 24s 2023-09-21T00:20:22.456 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/006 2023-09-21T00:20:22.457 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:20:22.458 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:20:22.558 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:20:22.558 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-09-21T00:20:22.879 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:20:22.883 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:20:22.883 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:20:22.884 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:20:22.884 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:20:37.312 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:20:37.315 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:21:07.615 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:21:07.618 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:21:11.959 INFO:teuthology.orchestra.run.smithi059.stdout:generic/007 48s 2023-09-21T00:21:11.964 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/007 2023-09-21T00:21:11.964 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:21:11.966 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:21:12.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:21:12.018 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-09-21T00:21:12.314 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:21:12.321 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:21:12.321 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:21:12.324 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:21:12.324 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:21:12.749 INFO:teuthology.orchestra.run.smithi059.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-09-21T00:21:12.753 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/008 2023-09-21T00:21:12.753 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/008 2023-09-21T00:21:12.753 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:21:12.755 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:21:12.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:21:12.778 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-09-21T00:21:12.997 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:21:13.001 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:21:13.002 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:21:13.003 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:21:13.003 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:21:13.401 INFO:teuthology.orchestra.run.smithi059.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-09-21T00:21:13.405 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/009 2023-09-21T00:21:13.405 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/009 2023-09-21T00:21:13.405 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:21:13.407 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:21:13.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:21:13.438 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-09-21T00:21:13.658 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:21:13.662 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:21:13.662 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:21:13.663 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:21:13.663 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:21:13.985 INFO:teuthology.orchestra.run.smithi059.stdout:generic/010 [not run] /tmp/tmp.evOnb5iVkLxfstests-dev/src/dbtest not built 2023-09-21T00:21:13.989 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/010 2023-09-21T00:21:13.989 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/010 2023-09-21T00:21:13.989 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:21:13.991 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:21:14.012 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:21:14.013 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-09-21T00:21:14.235 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:21:14.239 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:21:14.239 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:21:14.240 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:21:14.240 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:21:37.843 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:21:37.846 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:21:44.585 INFO:teuthology.orchestra.run.smithi059.stdout:generic/011 30s 2023-09-21T00:21:44.630 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/011 2023-09-21T00:21:44.631 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:21:44.632 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:21:44.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:21:44.932 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-09-21T00:21:45.153 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:21:45.157 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:21:45.158 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:21:45.159 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:21:45.159 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:21:45.616 INFO:teuthology.orchestra.run.smithi059.stdout:generic/012 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-21T00:21:45.625 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/012 2023-09-21T00:21:45.626 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/012 2023-09-21T00:21:45.626 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:21:45.629 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:21:45.765 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:21:45.765 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-09-21T00:21:45.987 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:21:45.992 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:21:45.992 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:21:45.993 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:21:45.993 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:22:07.913 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:22:07.916 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:22:38.353 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:22:38.357 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:22:46.231 INFO:teuthology.orchestra.run.smithi059.stdout:generic/013 60s 2023-09-21T00:22:46.237 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/013 2023-09-21T00:22:46.237 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:22:46.242 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:22:46.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:22:46.280 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-09-21T00:22:46.632 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:22:46.638 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:22:46.638 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:22:46.639 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:22:46.640 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:23:08.427 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:23:08.433 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:23:38.510 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:23:38.516 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:24:08.916 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:24:08.933 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:24:39.372 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:24:39.376 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:25:09.456 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:25:09.466 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:25:39.570 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:25:39.585 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:26:09.700 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:26:09.714 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:26:39.823 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:26:39.826 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:27:09.912 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:27:09.919 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:27:28.314 INFO:teuthology.orchestra.run.smithi059.stdout:generic/014 282s 2023-09-21T00:27:28.321 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/014 2023-09-21T00:27:28.321 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:27:28.324 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:27:28.361 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:27:28.361 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-09-21T00:27:28.706 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:27:28.717 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:27:28.718 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:27:28.718 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:27:28.718 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:27:29.184 INFO:teuthology.orchestra.run.smithi059.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-21T00:27:29.189 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/015 2023-09-21T00:27:29.189 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/015 2023-09-21T00:27:29.189 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:27:29.191 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:27:29.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:27:29.226 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-09-21T00:27:29.567 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:27:29.575 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:27:29.576 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:27:29.577 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:27:29.577 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:27:30.214 INFO:teuthology.orchestra.run.smithi059.stdout:generic/016 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-21T00:27:30.223 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/016 2023-09-21T00:27:30.223 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/016 2023-09-21T00:27:30.223 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:27:30.225 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:27:30.515 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:27:30.516 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-09-21T00:27:30.930 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:27:30.949 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:27:30.950 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:27:30.951 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:27:30.951 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:27:31.451 INFO:teuthology.orchestra.run.smithi059.stdout:generic/017 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-21T00:27:31.456 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/017 2023-09-21T00:27:31.456 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/017 2023-09-21T00:27:31.457 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:27:31.459 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:27:31.511 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:27:31.512 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-09-21T00:27:31.910 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:27:31.917 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:27:31.918 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:27:31.919 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:27:31.920 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:27:32.604 INFO:teuthology.orchestra.run.smithi059.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2023-09-21T00:27:32.626 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/018 2023-09-21T00:27:32.626 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/018 2023-09-21T00:27:32.626 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:27:32.628 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:27:32.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:27:32.657 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-09-21T00:27:33.023 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:27:33.030 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:27:33.031 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:27:33.032 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:27:33.032 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:27:33.503 INFO:teuthology.orchestra.run.smithi059.stdout:generic/019 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T00:27:33.508 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/019 2023-09-21T00:27:33.509 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/019 2023-09-21T00:27:33.509 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:27:33.512 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:27:33.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:27:33.540 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-09-21T00:27:33.894 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:27:33.898 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:27:33.899 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:27:33.900 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:27:33.900 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:27:37.552 INFO:teuthology.orchestra.run.smithi059.stdout:generic/020 3s 2023-09-21T00:27:37.563 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/020 2023-09-21T00:27:37.564 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:27:37.566 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:27:37.825 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:27:37.825 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-09-21T00:27:38.292 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:27:38.302 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:27:38.303 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:27:38.303 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:27:38.304 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:27:38.921 INFO:teuthology.orchestra.run.smithi059.stdout:generic/021 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-21T00:27:38.929 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/021 2023-09-21T00:27:38.929 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/021 2023-09-21T00:27:38.930 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:27:38.932 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:27:39.179 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:27:39.179 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-09-21T00:27:39.610 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:27:39.627 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:27:39.628 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:27:39.630 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:27:39.630 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:27:40.041 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:27:40.044 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:27:40.268 INFO:teuthology.orchestra.run.smithi059.stdout:generic/022 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-21T00:27:40.273 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/022 2023-09-21T00:27:40.273 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/022 2023-09-21T00:27:40.274 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:27:40.276 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:27:40.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:27:40.518 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-09-21T00:27:40.910 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:27:40.915 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:27:40.916 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:27:40.917 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:27:40.917 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:27:42.729 INFO:teuthology.orchestra.run.smithi059.stdout:generic/023 1s 2023-09-21T00:27:42.739 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/023 2023-09-21T00:27:42.740 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:27:42.748 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:27:43.116 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:27:43.117 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-09-21T00:27:43.487 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:27:43.492 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:27:43.492 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:27:43.493 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:27:43.493 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:27:44.045 INFO:teuthology.orchestra.run.smithi059.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-09-21T00:27:44.051 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/024 2023-09-21T00:27:44.051 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/024 2023-09-21T00:27:44.052 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:27:44.055 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:27:44.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:27:44.389 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-09-21T00:27:44.729 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:27:44.735 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:27:44.735 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:27:44.736 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:27:44.736 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:27:45.238 INFO:teuthology.orchestra.run.smithi059.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-09-21T00:27:45.245 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/025 2023-09-21T00:27:45.245 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/025 2023-09-21T00:27:45.245 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:27:45.247 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:27:45.516 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:27:45.517 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-09-21T00:27:45.935 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:27:45.940 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:27:45.941 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:27:45.942 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:27:45.942 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:27:46.506 INFO:teuthology.orchestra.run.smithi059.stdout:generic/026 [not run] ceph does not define maximum ACL count 2023-09-21T00:27:46.512 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/026 2023-09-21T00:27:46.512 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/026 2023-09-21T00:27:46.512 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:27:46.518 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:27:46.572 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:27:46.572 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-09-21T00:27:46.903 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:27:46.918 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:27:46.918 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:27:46.919 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:27:46.919 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:27:47.384 INFO:teuthology.orchestra.run.smithi059.stdout:generic/027 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-21T00:27:47.390 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/027 2023-09-21T00:27:47.390 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/027 2023-09-21T00:27:47.391 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:27:47.393 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:27:47.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:27:47.414 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-09-21T00:27:47.755 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:27:47.761 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:27:47.762 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:27:47.763 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:27:47.763 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:27:53.234 INFO:teuthology.orchestra.run.smithi059.stdout:generic/028 6s 2023-09-21T00:27:53.369 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/028 2023-09-21T00:27:53.369 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:27:53.371 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:27:53.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:27:53.401 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-09-21T00:27:53.746 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:27:53.753 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:27:53.754 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:27:53.755 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:27:53.755 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:27:55.771 INFO:teuthology.orchestra.run.smithi059.stdout:generic/029 2s 2023-09-21T00:27:55.777 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/029 2023-09-21T00:27:55.777 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:27:55.779 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:27:55.790 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:27:55.791 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-09-21T00:27:56.156 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:27:56.166 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:27:56.166 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:27:56.167 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:27:56.167 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:00.837 INFO:teuthology.orchestra.run.smithi059.stdout:generic/030 4s 2023-09-21T00:28:00.845 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/030 2023-09-21T00:28:00.845 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:28:00.852 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:00.871 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:28:00.872 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-09-21T00:28:01.233 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:28:01.237 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:28:01.238 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:28:01.239 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:28:01.239 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:01.816 INFO:teuthology.orchestra.run.smithi059.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-09-21T00:28:01.821 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/031 2023-09-21T00:28:01.822 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/031 2023-09-21T00:28:01.822 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:28:01.824 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:01.850 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:28:01.851 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-09-21T00:28:02.224 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:28:02.230 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:28:02.231 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:28:02.235 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:28:02.235 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:02.695 INFO:teuthology.orchestra.run.smithi059.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-21T00:28:02.700 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/032 2023-09-21T00:28:02.701 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/032 2023-09-21T00:28:02.701 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:28:02.703 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:02.732 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:28:02.733 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-09-21T00:28:03.065 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:28:03.076 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:28:03.076 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:28:03.077 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:28:03.078 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:03.651 INFO:teuthology.orchestra.run.smithi059.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-09-21T00:28:03.655 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/033 2023-09-21T00:28:03.656 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/033 2023-09-21T00:28:03.656 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:28:03.658 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:03.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:28:03.693 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-09-21T00:28:04.059 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:28:04.071 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:28:04.072 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:28:04.073 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:28:04.073 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:04.543 INFO:teuthology.orchestra.run.smithi059.stdout:generic/034 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T00:28:04.552 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/034 2023-09-21T00:28:04.552 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/034 2023-09-21T00:28:04.553 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:28:04.554 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:04.586 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:28:04.587 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-09-21T00:28:04.906 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:28:04.915 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:28:04.915 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:28:04.917 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:28:04.917 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:05.484 INFO:teuthology.orchestra.run.smithi059.stdout:generic/035 0s 2023-09-21T00:28:05.492 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/035 2023-09-21T00:28:05.492 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:28:05.495 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:05.750 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:28:05.750 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-09-21T00:28:06.238 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:28:06.242 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:28:06.243 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:28:06.244 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:28:06.244 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:10.558 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:28:10.561 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:28:16.881 INFO:teuthology.orchestra.run.smithi059.stdout:generic/036 10s 2023-09-21T00:28:16.890 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/036 2023-09-21T00:28:16.890 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:28:16.896 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:17.207 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:28:17.208 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-09-21T00:28:17.579 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:28:17.583 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:28:17.584 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:28:17.585 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:28:17.585 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:23.951 INFO:teuthology.orchestra.run.smithi059.stdout:generic/037 6s 2023-09-21T00:28:24.003 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/037 2023-09-21T00:28:24.003 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:28:24.006 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:24.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:28:24.018 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-09-21T00:28:24.406 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:28:24.418 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:28:24.419 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:28:24.421 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:28:24.421 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:24.915 INFO:teuthology.orchestra.run.smithi059.stdout:generic/038 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-21T00:28:24.921 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/038 2023-09-21T00:28:24.921 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/038 2023-09-21T00:28:24.921 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:28:24.923 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:24.949 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:28:24.950 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-09-21T00:28:25.317 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:28:25.324 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:28:25.326 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:28:25.327 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:28:25.327 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:25.919 INFO:teuthology.orchestra.run.smithi059.stdout:generic/039 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T00:28:25.924 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/039 2023-09-21T00:28:25.924 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/039 2023-09-21T00:28:25.925 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:28:25.927 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:25.956 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:28:25.957 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-09-21T00:28:26.330 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:28:26.339 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:28:26.341 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:28:26.342 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:28:26.343 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:26.858 INFO:teuthology.orchestra.run.smithi059.stdout:generic/040 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T00:28:26.863 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/040 2023-09-21T00:28:26.863 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/040 2023-09-21T00:28:26.863 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:28:26.865 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:26.900 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:28:26.900 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-09-21T00:28:27.265 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:28:27.272 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:28:27.273 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:28:27.273 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:28:27.274 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:27.763 INFO:teuthology.orchestra.run.smithi059.stdout:generic/041 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T00:28:27.771 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/041 2023-09-21T00:28:27.772 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/041 2023-09-21T00:28:27.772 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:28:27.774 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:27.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:28:27.799 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-09-21T00:28:28.198 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:28:28.203 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:28:28.204 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:28:28.207 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:28:28.207 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:28.916 INFO:teuthology.orchestra.run.smithi059.stdout:generic/042 [not run] ceph does not support shutdown 2023-09-21T00:28:28.939 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/042 2023-09-21T00:28:28.940 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/042 2023-09-21T00:28:28.940 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:28:28.942 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:28.976 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:28:28.977 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-09-21T00:28:29.320 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:28:29.325 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:28:29.326 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:28:29.330 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:28:29.330 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:30.008 INFO:teuthology.orchestra.run.smithi059.stdout:generic/043 [not run] ceph does not support shutdown 2023-09-21T00:28:30.028 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/043 2023-09-21T00:28:30.029 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/043 2023-09-21T00:28:30.029 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:28:30.031 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:30.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:28:30.064 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-09-21T00:28:30.431 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:28:30.437 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:28:30.437 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:28:30.438 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:28:30.439 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:31.142 INFO:teuthology.orchestra.run.smithi059.stdout:generic/044 [not run] ceph does not support shutdown 2023-09-21T00:28:31.161 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/044 2023-09-21T00:28:31.161 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/044 2023-09-21T00:28:31.161 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:28:31.163 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:31.186 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:28:31.187 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-09-21T00:28:31.531 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:28:31.535 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:28:31.536 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:28:31.538 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:28:31.538 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:32.234 INFO:teuthology.orchestra.run.smithi059.stdout:generic/045 [not run] ceph does not support shutdown 2023-09-21T00:28:32.257 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/045 2023-09-21T00:28:32.258 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/045 2023-09-21T00:28:32.258 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:28:32.260 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:32.295 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:28:32.295 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-09-21T00:28:32.669 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:28:32.673 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:28:32.674 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:28:32.675 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:28:32.675 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:33.429 INFO:teuthology.orchestra.run.smithi059.stdout:generic/046 [not run] ceph does not support shutdown 2023-09-21T00:28:33.454 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/046 2023-09-21T00:28:33.454 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/046 2023-09-21T00:28:33.454 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:28:33.457 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:33.490 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:28:33.490 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-09-21T00:28:33.853 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:28:33.862 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:28:33.863 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:28:33.864 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:28:33.864 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:34.602 INFO:teuthology.orchestra.run.smithi059.stdout:generic/047 [not run] ceph does not support shutdown 2023-09-21T00:28:34.626 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/047 2023-09-21T00:28:34.626 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/047 2023-09-21T00:28:34.627 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:28:34.629 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:34.652 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:28:34.653 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-09-21T00:28:35.020 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:28:35.028 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:28:35.028 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:28:35.030 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:28:35.030 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:35.718 INFO:teuthology.orchestra.run.smithi059.stdout:generic/048 [not run] ceph does not support shutdown 2023-09-21T00:28:35.738 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/048 2023-09-21T00:28:35.738 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/048 2023-09-21T00:28:35.739 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:28:35.740 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:35.766 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:28:35.767 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-09-21T00:28:36.135 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:28:36.142 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:28:36.142 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:28:36.144 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:28:36.144 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:36.812 INFO:teuthology.orchestra.run.smithi059.stdout:generic/049 [not run] ceph does not support shutdown 2023-09-21T00:28:36.834 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/049 2023-09-21T00:28:36.834 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/049 2023-09-21T00:28:36.834 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:28:36.838 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:36.877 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:28:36.877 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-09-21T00:28:37.236 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:28:37.240 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:28:37.241 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:28:37.242 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:28:37.242 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:37.762 INFO:teuthology.orchestra.run.smithi059.stdout:generic/050 [not run] ceph does not support shutdown 2023-09-21T00:28:37.777 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/050 2023-09-21T00:28:37.777 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/050 2023-09-21T00:28:37.778 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:28:37.779 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:37.807 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:28:37.807 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-09-21T00:28:38.029 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:28:38.033 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:28:38.033 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:28:38.034 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:28:38.034 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:38.535 INFO:teuthology.orchestra.run.smithi059.stdout:generic/051 [not run] ceph does not support shutdown 2023-09-21T00:28:38.539 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/051 2023-09-21T00:28:38.539 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/051 2023-09-21T00:28:38.539 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:28:38.541 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:38.562 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:28:38.563 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-09-21T00:28:38.779 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:28:38.783 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:28:38.783 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:28:38.784 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:28:38.784 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:39.293 INFO:teuthology.orchestra.run.smithi059.stdout:generic/052 [not run] ceph does not support shutdown 2023-09-21T00:28:39.315 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/052 2023-09-21T00:28:39.315 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/052 2023-09-21T00:28:39.315 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:28:39.317 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:39.344 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:28:39.345 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-09-21T00:28:39.560 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:28:39.564 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:28:39.564 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:28:39.565 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:28:39.566 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:40.462 INFO:teuthology.orchestra.run.smithi059.stdout:generic/053 1s 2023-09-21T00:28:40.489 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/053 2023-09-21T00:28:40.489 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:28:40.495 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:40.506 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:28:40.506 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-09-21T00:28:40.649 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:28:40.653 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:28:40.735 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:28:40.739 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:28:40.740 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:28:40.741 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:28:40.741 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:41.262 INFO:teuthology.orchestra.run.smithi059.stdout:generic/054 [not run] ceph does not support shutdown 2023-09-21T00:28:41.283 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/054 2023-09-21T00:28:41.284 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/054 2023-09-21T00:28:41.284 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:28:41.286 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:41.313 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:28:41.313 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-09-21T00:28:41.577 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:28:41.581 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:28:41.582 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:28:41.583 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:28:41.583 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:42.083 INFO:teuthology.orchestra.run.smithi059.stdout:generic/055 [not run] ceph does not support shutdown 2023-09-21T00:28:42.099 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/055 2023-09-21T00:28:42.100 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/055 2023-09-21T00:28:42.100 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:28:42.102 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:42.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:28:42.136 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-09-21T00:28:42.355 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:28:42.359 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:28:42.359 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:28:42.360 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:28:42.360 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:42.710 INFO:teuthology.orchestra.run.smithi059.stdout:generic/056 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T00:28:42.714 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/056 2023-09-21T00:28:42.714 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/056 2023-09-21T00:28:42.714 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:28:42.716 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:42.741 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:28:42.742 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-09-21T00:28:42.959 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:28:42.963 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:28:42.963 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:28:42.964 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:28:42.965 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:43.320 INFO:teuthology.orchestra.run.smithi059.stdout:generic/057 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T00:28:43.324 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/057 2023-09-21T00:28:43.324 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/057 2023-09-21T00:28:43.325 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:28:43.326 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:43.360 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:28:43.360 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-09-21T00:28:43.576 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:28:43.580 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:28:43.580 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:28:43.581 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:28:43.581 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:44.019 INFO:teuthology.orchestra.run.smithi059.stdout:generic/058 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-21T00:28:44.023 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/058 2023-09-21T00:28:44.023 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/058 2023-09-21T00:28:44.023 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:28:44.025 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:44.098 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:28:44.099 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-09-21T00:28:44.579 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:28:44.583 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:28:44.584 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:28:44.584 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:28:44.585 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:44.927 INFO:teuthology.orchestra.run.smithi059.stdout:generic/059 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T00:28:44.931 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/059 2023-09-21T00:28:44.931 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/059 2023-09-21T00:28:44.932 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:28:44.933 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:44.963 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:28:44.963 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-09-21T00:28:45.191 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:28:45.195 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:28:45.195 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:28:45.196 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:28:45.197 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:45.638 INFO:teuthology.orchestra.run.smithi059.stdout:generic/060 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-21T00:28:45.642 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/060 2023-09-21T00:28:45.642 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/060 2023-09-21T00:28:45.642 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:28:45.644 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:45.830 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:28:45.831 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-09-21T00:28:46.185 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:28:46.189 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:28:46.190 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:28:46.190 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:28:46.191 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:46.635 INFO:teuthology.orchestra.run.smithi059.stdout:generic/061 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-21T00:28:46.639 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/061 2023-09-21T00:28:46.639 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/061 2023-09-21T00:28:46.640 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:28:46.641 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:46.981 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:28:46.982 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-09-21T00:28:47.207 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:28:47.211 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:28:47.212 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:28:47.213 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:28:47.213 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:49.029 INFO:teuthology.orchestra.run.smithi059.stdout:generic/062 2s 2023-09-21T00:28:49.037 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/062 2023-09-21T00:28:49.037 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:28:49.040 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:49.053 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:28:49.054 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-09-21T00:28:49.272 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:28:49.276 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:28:49.277 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:28:49.278 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:28:49.278 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:49.743 INFO:teuthology.orchestra.run.smithi059.stdout:generic/063 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-21T00:28:49.747 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/063 2023-09-21T00:28:49.747 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/063 2023-09-21T00:28:49.748 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:28:49.749 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:50.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:28:50.017 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-09-21T00:28:50.328 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:28:50.332 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:28:50.332 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:28:50.333 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:28:50.333 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:50.687 INFO:teuthology.orchestra.run.smithi059.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-21T00:28:50.691 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/064 2023-09-21T00:28:50.691 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/064 2023-09-21T00:28:50.692 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:28:50.693 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:50.723 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:28:50.723 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-09-21T00:28:50.941 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:28:50.945 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:28:50.946 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:28:50.947 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:28:50.947 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:51.302 INFO:teuthology.orchestra.run.smithi059.stdout:generic/065 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T00:28:51.306 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/065 2023-09-21T00:28:51.306 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/065 2023-09-21T00:28:51.306 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:28:51.308 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:51.338 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:28:51.339 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-09-21T00:28:51.560 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:28:51.564 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:28:51.564 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:28:51.566 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:28:51.566 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:51.906 INFO:teuthology.orchestra.run.smithi059.stdout:generic/066 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T00:28:51.910 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/066 2023-09-21T00:28:51.910 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/066 2023-09-21T00:28:51.910 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:28:51.912 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:51.940 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:28:51.941 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-09-21T00:28:52.163 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:28:52.167 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:28:52.167 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:28:52.168 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:28:52.168 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:52.576 INFO:teuthology.orchestra.run.smithi059.stdout:generic/067 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T00:28:52.580 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/067 2023-09-21T00:28:52.580 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/067 2023-09-21T00:28:52.581 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:28:52.582 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:52.612 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:28:52.613 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-09-21T00:28:52.835 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:28:52.839 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:28:52.840 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:28:52.841 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:28:52.841 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:53.204 INFO:teuthology.orchestra.run.smithi059.stdout:generic/068 [not run] ceph does not support freezing 2023-09-21T00:28:53.207 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/068 2023-09-21T00:28:53.208 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/068 2023-09-21T00:28:53.208 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:28:53.210 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:28:53.235 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:28:53.236 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-09-21T00:28:53.458 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:28:53.462 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:28:53.463 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:28:53.464 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:28:53.464 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:29:00.362 INFO:teuthology.orchestra.run.smithi059.stdout:generic/069 7s 2023-09-21T00:29:00.368 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/069 2023-09-21T00:29:00.369 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:29:00.371 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:29:00.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:29:00.380 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-09-21T00:29:00.601 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:29:00.605 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:29:00.605 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:29:00.606 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:29:00.606 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:29:10.739 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:29:10.742 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:29:23.199 INFO:teuthology.orchestra.run.smithi059.stdout:generic/070 23s 2023-09-21T00:29:23.212 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/070 2023-09-21T00:29:23.213 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:29:23.221 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:29:23.507 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:29:23.508 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-09-21T00:29:24.008 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:29:24.017 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:29:24.017 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:29:24.019 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:29:24.019 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:29:24.554 INFO:teuthology.orchestra.run.smithi059.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-09-21T00:29:24.561 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/071 2023-09-21T00:29:24.562 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/071 2023-09-21T00:29:24.562 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:29:24.564 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:29:24.589 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:29:24.590 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-09-21T00:29:24.941 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:29:24.947 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:29:24.947 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:29:24.948 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:29:24.949 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:29:25.578 INFO:teuthology.orchestra.run.smithi059.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-09-21T00:29:25.583 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/072 2023-09-21T00:29:25.583 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/072 2023-09-21T00:29:25.584 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:29:25.590 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:29:25.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:29:25.621 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-09-21T00:29:25.989 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:29:25.994 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:29:25.994 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:29:25.995 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:29:25.995 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:29:26.486 INFO:teuthology.orchestra.run.smithi059.stdout:generic/073 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T00:29:26.496 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/073 2023-09-21T00:29:26.496 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/073 2023-09-21T00:29:26.496 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:29:26.499 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:29:26.520 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:29:26.520 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-09-21T00:29:26.871 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:29:26.889 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:29:26.889 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:29:26.890 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:29:26.891 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:29:40.809 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:29:40.817 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:29:41.068 INFO:tasks.ceph.mds.c.smithi059.stderr:2023-09-21T00:29:41.067+0000 7fa085432700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 210877) UID: 0 2023-09-21T00:29:41.069 INFO:tasks.ceph.mds.a.smithi059.stderr:2023-09-21T00:29:41.067+0000 7facd961b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 210877) UID: 0 2023-09-21T00:29:47.914 INFO:teuthology.orchestra.run.smithi059.stdout:generic/074 20s 2023-09-21T00:29:47.944 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/074 2023-09-21T00:29:47.945 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:29:47.948 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:29:48.831 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:29:48.832 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-09-21T00:29:50.050 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:29:50.055 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:29:50.056 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:29:50.057 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:29:50.057 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:30:23.511 INFO:teuthology.orchestra.run.smithi059.stdout:generic/075 33s 2023-09-21T00:30:23.573 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/075 2023-09-21T00:30:23.573 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:30:23.576 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:30:23.908 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:30:23.909 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-09-21T00:30:24.494 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:30:24.509 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:30:24.511 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:30:24.514 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:30:24.514 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:30:24.988 INFO:teuthology.orchestra.run.smithi059.stdout:generic/076 [not run] require 172.21.15.59:6789:/scratch to be local device 2023-09-21T00:30:24.993 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/076 2023-09-21T00:30:24.994 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/076 2023-09-21T00:30:24.994 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:30:25.004 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:30:25.029 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:30:25.030 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-09-21T00:30:25.490 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:30:25.494 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:30:25.494 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:30:25.495 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:30:25.496 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:30:32.329 INFO:teuthology.orchestra.run.smithi059.stdout:generic/077 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-21T00:30:32.344 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/077 2023-09-21T00:30:32.344 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/077 2023-09-21T00:30:32.344 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:30:32.347 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:30:32.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:30:32.741 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-09-21T00:30:33.241 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:30:33.249 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:30:33.250 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:30:33.254 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:30:33.254 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:30:33.903 INFO:teuthology.orchestra.run.smithi059.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-09-21T00:30:33.908 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/078 2023-09-21T00:30:33.908 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/078 2023-09-21T00:30:33.908 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:30:33.912 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:30:34.193 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:30:34.194 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-09-21T00:30:34.735 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:30:34.751 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:30:34.751 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:30:34.753 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:30:34.753 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:30:35.384 INFO:teuthology.orchestra.run.smithi059.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-09-21T00:30:35.390 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/079 2023-09-21T00:30:35.390 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/079 2023-09-21T00:30:35.391 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:30:35.393 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:30:35.445 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:30:35.445 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-09-21T00:30:35.891 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:30:35.895 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:30:35.896 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:30:35.901 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:30:35.901 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:30:38.596 INFO:teuthology.orchestra.run.smithi059.stdout:generic/080 2s 2023-09-21T00:30:38.611 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/080 2023-09-21T00:30:38.611 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:30:38.613 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:30:38.677 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:30:38.677 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-09-21T00:30:39.129 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:30:39.134 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:30:39.134 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:30:39.140 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:30:39.140 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:30:39.755 INFO:teuthology.orchestra.run.smithi059.stdout:generic/081 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T00:30:39.761 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/081 2023-09-21T00:30:39.761 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/081 2023-09-21T00:30:39.761 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:30:39.766 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:30:39.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:30:39.800 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-09-21T00:30:40.242 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:30:40.247 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:30:40.248 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:30:40.249 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:30:40.249 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:30:40.814 INFO:teuthology.orchestra.run.smithi059.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-21T00:30:40.819 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/082 2023-09-21T00:30:40.820 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/082 2023-09-21T00:30:40.820 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:30:40.822 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:30:40.857 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:30:40.858 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-09-21T00:30:41.314 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:30:41.319 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:30:41.320 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:30:41.323 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:30:41.324 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:30:41.938 INFO:teuthology.orchestra.run.smithi059.stdout:generic/083 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-21T00:30:41.945 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/083 2023-09-21T00:30:41.945 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/083 2023-09-21T00:30:41.945 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:30:41.952 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:30:41.993 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:30:41.994 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-09-21T00:30:42.470 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:30:42.478 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:30:42.494 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:30:42.495 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:30:42.496 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:30:48.832 INFO:teuthology.orchestra.run.smithi059.stdout:generic/084 6s 2023-09-21T00:30:48.841 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/084 2023-09-21T00:30:48.841 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:30:48.844 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:30:48.856 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:30:48.857 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-09-21T00:30:49.354 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:30:49.365 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:30:49.366 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:30:49.367 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:30:49.367 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:30:49.994 INFO:teuthology.orchestra.run.smithi059.stdout:generic/085 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T00:30:49.998 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/085 2023-09-21T00:30:49.998 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/085 2023-09-21T00:30:49.999 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:30:50.001 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:30:50.041 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:30:50.042 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-09-21T00:30:50.472 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:30:50.478 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:30:50.479 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:30:50.480 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:30:50.480 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:30:51.058 INFO:teuthology.orchestra.run.smithi059.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-21T00:30:51.063 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/086 2023-09-21T00:30:51.064 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/086 2023-09-21T00:30:51.064 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:30:51.066 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:30:51.102 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:30:51.103 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-09-21T00:30:51.628 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:30:51.637 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:30:51.638 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:30:51.639 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:30:51.639 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:30:52.468 INFO:teuthology.orchestra.run.smithi059.stdout:generic/087 1s 2023-09-21T00:30:52.486 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/087 2023-09-21T00:30:52.486 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:30:52.489 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:30:52.803 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:30:52.804 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-09-21T00:30:53.401 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:30:53.412 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:30:53.412 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:30:53.419 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:30:53.419 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:30:54.066 INFO:teuthology.orchestra.run.smithi059.stdout:generic/088 1s 2023-09-21T00:30:54.079 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/088 2023-09-21T00:30:54.079 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:30:54.082 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:30:54.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:30:54.401 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-09-21T00:30:54.889 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:30:54.894 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:30:54.895 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:30:54.896 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:30:54.896 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:32:46.841 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:32:46.844 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:33:17.538 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:33:17.541 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:33:47.885 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:33:47.888 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:34:18.158 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:34:18.161 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:34:48.241 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:34:48.244 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:34:48.286 INFO:tasks.ceph.mds.a.smithi059.stderr:2023-09-21T00:34:48.284+0000 7facd961b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 219648) UID: 0 2023-09-21T00:34:48.287 INFO:tasks.ceph.mds.c.smithi059.stderr:2023-09-21T00:34:48.284+0000 7fa085432700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 219648) UID: 0 2023-09-21T00:37:45.702 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:37:45.705 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:38:15.769 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:38:15.772 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:38:46.101 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:38:46.104 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:38:46.142 INFO:tasks.ceph.mds.a.smithi059.stderr:2023-09-21T00:38:46.140+0000 7facd961b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 221950) UID: 0 2023-09-21T00:38:46.142 INFO:tasks.ceph.mds.c.smithi059.stderr:2023-09-21T00:38:46.140+0000 7fa085432700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 221950) UID: 0 2023-09-21T00:39:01.519 INFO:teuthology.orchestra.run.smithi059.stdout:generic/089 486s 2023-09-21T00:39:01.524 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/089 2023-09-21T00:39:01.525 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:39:01.526 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:39:03.041 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:39:03.042 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2023-09-21T00:39:04.018 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:39:04.022 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:39:04.022 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:39:04.023 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:39:04.023 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:39:04.409 INFO:teuthology.orchestra.run.smithi059.stdout:generic/090 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T00:39:04.413 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/090 2023-09-21T00:39:04.414 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/090 2023-09-21T00:39:04.414 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:39:04.415 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:39:04.440 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:39:04.440 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2023-09-21T00:39:04.665 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:39:04.669 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:39:04.669 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:39:04.670 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:39:04.670 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:40:50.634 INFO:teuthology.orchestra.run.smithi059.stdout:generic/091 106s 2023-09-21T00:40:50.639 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/091 2023-09-21T00:40:50.639 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:40:50.641 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:40:50.793 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:40:50.794 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2023-09-21T00:40:51.282 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:40:51.285 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:40:51.286 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:40:51.287 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:40:51.287 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:40:51.644 INFO:teuthology.orchestra.run.smithi059.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-21T00:40:51.649 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/092 2023-09-21T00:40:51.649 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/092 2023-09-21T00:40:51.649 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:40:51.650 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:40:51.682 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:40:51.682 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2023-09-21T00:40:51.914 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:40:51.918 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:40:51.918 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:40:51.919 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:40:51.920 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:40:52.540 INFO:teuthology.orchestra.run.smithi059.stdout:generic/093 0s 2023-09-21T00:40:52.545 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/093 2023-09-21T00:40:52.545 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:40:52.547 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:40:52.959 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:40:52.960 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2023-09-21T00:40:53.187 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:40:53.191 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:40:53.192 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:40:53.193 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:40:53.193 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:40:53.586 INFO:teuthology.orchestra.run.smithi059.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-21T00:40:53.590 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/094 2023-09-21T00:40:53.590 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/094 2023-09-21T00:40:53.590 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:40:53.592 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:40:53.863 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:40:53.863 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2023-09-21T00:40:54.246 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:40:54.250 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:40:54.251 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:40:54.252 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:40:54.252 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:41:07.421 INFO:teuthology.orchestra.run.smithi059.stdout:generic/095 13s 2023-09-21T00:41:07.430 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/095 2023-09-21T00:41:07.431 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:41:07.432 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:41:07.441 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:41:07.442 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2023-09-21T00:41:07.667 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:41:07.671 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:41:07.671 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:41:07.672 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:41:07.672 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:41:08.082 INFO:teuthology.orchestra.run.smithi059.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-09-21T00:41:08.086 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/096 2023-09-21T00:41:08.086 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/096 2023-09-21T00:41:08.087 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:41:08.088 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:41:08.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:41:08.121 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2023-09-21T00:41:08.348 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:41:08.352 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:41:08.352 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:41:08.353 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:41:08.353 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:41:09.218 INFO:teuthology.orchestra.run.smithi059.stdout:generic/097 1s 2023-09-21T00:41:09.223 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/097 2023-09-21T00:41:09.223 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:41:09.225 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:41:09.253 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:41:09.253 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2023-09-21T00:41:09.471 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:41:09.475 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:41:09.475 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:41:09.476 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:41:09.476 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:41:11.640 INFO:teuthology.orchestra.run.smithi059.stdout:generic/098 2s 2023-09-21T00:41:11.645 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/098 2023-09-21T00:41:11.645 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:41:11.647 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:41:11.655 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:41:11.656 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2023-09-21T00:41:11.878 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:41:11.882 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:41:11.883 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:41:11.883 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:41:11.884 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:41:12.817 INFO:teuthology.orchestra.run.smithi059.stdout:generic/099 0s 2023-09-21T00:41:12.822 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/099 2023-09-21T00:41:12.823 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:41:12.824 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:41:13.165 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:41:13.166 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2023-09-21T00:41:13.447 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:41:13.451 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:41:13.452 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:41:13.453 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:41:13.453 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:41:25.238 INFO:teuthology.orchestra.run.smithi059.stdout:generic/100 12s 2023-09-21T00:41:25.242 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/100 2023-09-21T00:41:25.242 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:41:25.244 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:41:29.250 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:41:29.251 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2023-09-21T00:41:29.593 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:41:29.597 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:41:29.597 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:41:29.598 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:41:29.599 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:41:29.944 INFO:teuthology.orchestra.run.smithi059.stdout:generic/101 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T00:41:29.948 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/101 2023-09-21T00:41:29.948 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/101 2023-09-21T00:41:29.949 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:41:29.950 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:41:29.977 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:41:29.978 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2023-09-21T00:41:30.198 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:41:30.202 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:41:30.203 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:41:30.204 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:41:30.204 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:41:30.507 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:41:30.509 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:41:30.511 INFO:teuthology.orchestra.run.smithi059.stdout:generic/102 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-21T00:41:30.515 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/102 2023-09-21T00:41:30.515 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/102 2023-09-21T00:41:30.515 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:41:30.517 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:41:30.565 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:41:30.566 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2023-09-21T00:41:30.825 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:41:30.829 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:41:30.829 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:41:30.830 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:41:30.830 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:41:31.164 INFO:teuthology.orchestra.run.smithi059.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-21T00:41:31.169 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/103 2023-09-21T00:41:31.169 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/103 2023-09-21T00:41:31.169 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:41:31.170 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:41:31.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:41:31.536 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2023-09-21T00:41:31.766 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:41:31.770 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:41:31.770 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:41:31.771 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:41:31.771 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:41:32.099 INFO:teuthology.orchestra.run.smithi059.stdout:generic/104 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T00:41:32.103 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/104 2023-09-21T00:41:32.103 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/104 2023-09-21T00:41:32.103 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:41:32.105 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:41:32.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:41:32.136 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2023-09-21T00:41:32.353 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:41:32.358 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:41:32.358 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:41:32.359 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:41:32.359 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:41:33.354 INFO:teuthology.orchestra.run.smithi059.stdout:generic/105 1s 2023-09-21T00:41:33.360 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/105 2023-09-21T00:41:33.360 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:41:33.362 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:41:33.371 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:41:33.371 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2023-09-21T00:41:33.588 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:41:33.592 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:41:33.593 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:41:33.594 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:41:33.594 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:41:33.932 INFO:teuthology.orchestra.run.smithi059.stdout:generic/106 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T00:41:33.936 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/106 2023-09-21T00:41:33.936 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/106 2023-09-21T00:41:33.936 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:41:33.938 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:41:33.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:41:33.962 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2023-09-21T00:41:34.182 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:41:34.186 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:41:34.186 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:41:34.187 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:41:34.187 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:41:34.554 INFO:teuthology.orchestra.run.smithi059.stdout:generic/107 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T00:41:34.557 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/107 2023-09-21T00:41:34.558 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/107 2023-09-21T00:41:34.558 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:41:34.560 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:41:34.586 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:41:34.587 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2023-09-21T00:41:34.810 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:41:34.814 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:41:34.814 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:41:34.815 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:41:34.815 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:41:35.297 INFO:teuthology.orchestra.run.smithi059.stdout:generic/108 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T00:41:35.301 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/108 2023-09-21T00:41:35.301 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/108 2023-09-21T00:41:35.301 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:41:35.303 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:41:35.325 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:41:35.325 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2023-09-21T00:41:35.544 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:41:35.549 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:41:35.549 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:41:35.550 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:41:35.550 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:41:45.807 INFO:teuthology.orchestra.run.smithi059.stdout:generic/109 10s 2023-09-21T00:41:45.816 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/109 2023-09-21T00:41:45.816 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:41:45.828 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:41:45.853 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:41:45.854 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2023-09-21T00:41:46.833 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:41:46.837 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:41:46.837 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:41:46.838 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:41:46.838 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:42:00.580 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:42:00.587 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:42:07.050 INFO:teuthology.orchestra.run.smithi059.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2023-09-21T00:42:07.054 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/110 2023-09-21T00:42:07.055 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/110 2023-09-21T00:42:07.055 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:42:07.057 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:42:07.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:42:07.543 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2023-09-21T00:42:07.848 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:42:07.852 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:42:07.853 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:42:07.854 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:42:07.854 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:42:08.214 INFO:teuthology.orchestra.run.smithi059.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2023-09-21T00:42:08.218 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/111 2023-09-21T00:42:08.219 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/111 2023-09-21T00:42:08.219 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:42:08.221 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:42:08.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:42:08.585 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2023-09-21T00:42:08.825 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:42:08.829 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:42:08.830 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:42:08.831 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:42:08.831 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:42:24.593 INFO:teuthology.orchestra.run.smithi059.stdout:generic/112 15s 2023-09-21T00:42:24.598 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/112 2023-09-21T00:42:24.598 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:42:24.600 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:42:24.877 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:42:24.877 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2023-09-21T00:42:25.201 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:42:25.205 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:42:25.205 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:42:25.206 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:42:25.206 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:42:30.718 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:42:30.732 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:42:40.201 INFO:teuthology.orchestra.run.smithi059.stdout:generic/113 15s 2023-09-21T00:42:40.228 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/113 2023-09-21T00:42:40.228 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:42:40.230 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:42:40.612 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:42:40.613 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2023-09-21T00:42:40.840 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:42:40.844 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:42:40.844 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:42:40.845 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:42:40.846 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:42:41.372 INFO:teuthology.orchestra.run.smithi059.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-09-21T00:42:41.376 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/114 2023-09-21T00:42:41.376 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/114 2023-09-21T00:42:41.376 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:42:41.378 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:42:41.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:42:41.411 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2023-09-21T00:42:41.632 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:42:41.636 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:42:41.636 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:42:41.637 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:42:41.637 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:42:42.030 INFO:teuthology.orchestra.run.smithi059.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2023-09-21T00:42:42.034 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/115 2023-09-21T00:42:42.035 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/115 2023-09-21T00:42:42.035 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:42:42.036 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:42:42.123 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:42:42.124 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2023-09-21T00:42:42.644 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:42:42.648 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:42:42.649 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:42:42.650 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:42:42.650 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:42:43.013 INFO:teuthology.orchestra.run.smithi059.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2023-09-21T00:42:43.017 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/116 2023-09-21T00:42:43.018 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/116 2023-09-21T00:42:43.018 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:42:43.019 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:42:43.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:42:43.385 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2023-09-21T00:42:43.638 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:42:43.642 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:42:43.642 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:42:43.643 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:42:43.644 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:42:55.999 INFO:teuthology.orchestra.run.smithi059.stdout:generic/117 12s 2023-09-21T00:42:56.004 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/117 2023-09-21T00:42:56.005 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:42:56.006 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:42:56.015 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:42:56.015 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2023-09-21T00:42:56.308 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:42:56.312 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:42:56.312 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:42:56.313 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:42:56.314 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:42:56.992 INFO:teuthology.orchestra.run.smithi059.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2023-09-21T00:42:56.996 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/118 2023-09-21T00:42:56.996 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/118 2023-09-21T00:42:56.996 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:42:56.998 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:42:57.340 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:42:57.340 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2023-09-21T00:42:57.696 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:42:57.700 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:42:57.700 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:42:57.701 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:42:57.702 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:42:58.062 INFO:teuthology.orchestra.run.smithi059.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2023-09-21T00:42:58.066 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/119 2023-09-21T00:42:58.066 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/119 2023-09-21T00:42:58.066 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:42:58.068 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:42:58.395 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:42:58.396 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2023-09-21T00:42:58.663 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:42:58.667 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:42:58.667 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:42:58.668 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:42:58.669 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:42:58.998 INFO:teuthology.orchestra.run.smithi059.stdout:generic/120 [not run] atime not maintained by ceph 2023-09-21T00:42:59.002 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/120 2023-09-21T00:42:59.002 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/120 2023-09-21T00:42:59.002 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:42:59.004 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:42:59.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:42:59.026 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2023-09-21T00:42:59.245 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:42:59.249 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:42:59.249 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:42:59.250 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:42:59.250 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:42:59.618 INFO:teuthology.orchestra.run.smithi059.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2023-09-21T00:42:59.622 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/121 2023-09-21T00:42:59.622 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/121 2023-09-21T00:42:59.623 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:42:59.624 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:42:59.928 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:42:59.928 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2023-09-21T00:43:00.207 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:43:00.211 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:43:00.212 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:43:00.213 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:43:00.213 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:43:00.576 INFO:teuthology.orchestra.run.smithi059.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2023-09-21T00:43:00.580 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/122 2023-09-21T00:43:00.580 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/122 2023-09-21T00:43:00.581 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:43:00.582 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:43:00.923 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:43:00.927 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:43:00.958 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:43:00.959 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2023-09-21T00:43:01.219 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:43:01.223 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:43:01.224 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:43:01.224 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:43:01.225 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:43:01.730 INFO:teuthology.orchestra.run.smithi059.stdout:generic/123 0s 2023-09-21T00:43:01.734 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/123 2023-09-21T00:43:01.735 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:43:01.736 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:43:02.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:43:02.061 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2023-09-21T00:43:02.347 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:43:02.351 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:43:02.352 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:43:02.352 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:43:02.353 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:43:04.660 INFO:teuthology.orchestra.run.smithi059.stdout:generic/124 2s 2023-09-21T00:43:04.677 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/124 2023-09-21T00:43:04.678 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:43:04.680 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:43:05.193 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:43:05.193 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2023-09-21T00:43:05.599 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:43:05.603 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:43:05.604 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:43:05.605 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:43:05.605 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:43:31.065 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:43:31.068 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:44:01.138 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:44:01.142 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:44:07.107 INFO:teuthology.orchestra.run.smithi059.stdout:generic/125 62s 2023-09-21T00:44:07.113 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/125 2023-09-21T00:44:07.113 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:44:07.115 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:44:07.427 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:44:07.427 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2023-09-21T00:44:07.706 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:44:07.710 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:44:07.711 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:44:07.712 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:44:07.712 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:44:08.215 INFO:teuthology.orchestra.run.smithi059.stdout:generic/126 1s 2023-09-21T00:44:08.220 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/126 2023-09-21T00:44:08.221 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:44:08.223 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:44:08.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:44:08.543 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2023-09-21T00:44:08.847 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:44:08.851 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:44:08.852 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:44:08.853 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:44:08.853 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:44:31.210 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:44:31.213 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:45:01.285 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:45:01.288 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:45:31.355 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:45:31.358 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:46:01.412 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:46:01.415 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:46:31.485 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:46:31.488 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:47:01.841 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:47:01.843 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:47:31.914 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:47:31.917 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:48:01.971 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:48:01.974 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:48:32.049 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:48:32.052 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:49:02.114 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:49:02.117 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:49:32.214 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:49:32.216 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:50:02.647 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:50:02.649 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:50:33.021 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:50:33.024 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:51:03.127 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:51:03.129 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:51:33.253 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:51:33.258 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:52:03.308 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:52:03.311 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:52:33.365 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:52:33.368 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:52:57.726 INFO:teuthology.orchestra.run.smithi059.stdout:generic/127 528s 2023-09-21T00:52:57.731 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/127 2023-09-21T00:52:57.731 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:52:57.733 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:52:58.103 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:52:58.104 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2023-09-21T00:52:58.328 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:52:58.332 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:52:58.333 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:52:58.333 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:52:58.333 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:52:59.418 INFO:teuthology.orchestra.run.smithi059.stdout:generic/128 1s 2023-09-21T00:52:59.423 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/128 2023-09-21T00:52:59.423 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T00:52:59.425 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:52:59.434 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T00:52:59.434 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2023-09-21T00:52:59.659 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T00:52:59.663 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T00:52:59.663 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T00:52:59.664 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T00:52:59.664 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T00:53:03.438 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:53:03.441 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:53:33.510 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:53:33.513 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:54:04.051 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:54:04.053 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:54:34.165 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:54:34.198 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:55:04.766 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:55:04.769 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:55:34.980 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:55:35.012 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:56:05.118 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:56:05.121 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:56:35.279 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:56:35.295 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:57:05.467 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:57:05.472 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:57:35.586 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:57:35.645 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:58:06.134 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:58:06.163 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T00:58:06.260 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-09-21T00:58:06.258+0000 7fae7ed95700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 116360) UID: 0 2023-09-21T00:58:06.261 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-09-21T00:58:06.258+0000 7fe56ff7b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 116360) UID: 0 2023-09-21T00:58:06.262 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-09-21T00:58:06.259+0000 7f6a304c5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 116360) UID: 0 2023-09-21T00:58:06.262 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-09-21T00:58:06.260+0000 7fceb8335700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 116360) UID: 0 2023-09-21T00:58:06.331 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-09-21T00:58:06.330+0000 7fadc2fd5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 261585) UID: 0 2023-09-21T00:58:06.332 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-09-21T00:58:06.330+0000 7f7948a08700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 261585) UID: 0 2023-09-21T00:58:06.332 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-09-21T00:58:06.330+0000 7fc5c83b6700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 261585) UID: 0 2023-09-21T00:58:06.333 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-09-21T00:58:06.330+0000 7f9692588700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 261585) UID: 0 2023-09-21T01:05:53.959 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:05:53.962 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:05:54.158 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-09-21T01:05:54.155+0000 7fadc2fd5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 261692) UID: 0 2023-09-21T01:05:54.158 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-09-21T01:05:54.155+0000 7fc5c83b6700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 261692) UID: 0 2023-09-21T01:05:54.159 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-09-21T01:05:54.155+0000 7f7948a08700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 261692) UID: 0 2023-09-21T01:05:54.159 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-09-21T01:05:54.155+0000 7f9692588700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 261692) UID: 0 2023-09-21T01:05:54.282 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-09-21T01:05:54.280+0000 7fae7ed95700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 116463) UID: 0 2023-09-21T01:05:54.282 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-09-21T01:05:54.280+0000 7f6a304c5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 116463) UID: 0 2023-09-21T01:05:54.283 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-09-21T01:05:54.280+0000 7fe56ff7b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 116463) UID: 0 2023-09-21T01:05:54.284 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-09-21T01:05:54.282+0000 7fceb8335700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 116463) UID: 0 2023-09-21T01:13:29.362 INFO:teuthology.orchestra.run.smithi059.stdout:generic/129 1230s 2023-09-21T01:13:29.384 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/129 2023-09-21T01:13:29.384 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:13:29.386 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:13:29.395 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:13:29.396 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2023-09-21T01:13:29.840 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:13:29.844 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:13:29.844 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:13:29.845 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:13:29.846 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:13:42.483 INFO:teuthology.orchestra.run.smithi059.stdout:generic/130 12s 2023-09-21T01:13:42.492 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/130 2023-09-21T01:13:42.492 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:13:42.494 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:13:42.503 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:13:42.504 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2023-09-21T01:13:42.731 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:13:42.735 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:13:42.736 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:13:42.736 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:13:42.737 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:13:44.438 INFO:teuthology.orchestra.run.smithi059.stdout:generic/131 2s 2023-09-21T01:13:44.456 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/131 2023-09-21T01:13:44.456 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:13:44.458 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:13:44.923 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:13:44.924 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2023-09-21T01:13:45.422 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:13:45.429 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:13:45.430 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:13:45.431 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:13:45.431 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:14:00.328 INFO:teuthology.orchestra.run.smithi059.stdout:generic/132 15s 2023-09-21T01:14:00.333 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/132 2023-09-21T01:14:00.333 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:14:00.335 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:14:00.344 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:14:00.345 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2023-09-21T01:14:00.572 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:14:00.576 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:14:00.576 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:14:00.577 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:14:00.577 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:15:09.426 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:15:09.429 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:15:09.472 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-09-21T01:15:09.471+0000 7fc5c83b6700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 265403) UID: 0 2023-09-21T01:15:09.473 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-09-21T01:15:09.471+0000 7f7948a08700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 265403) UID: 0 2023-09-21T01:15:09.473 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-09-21T01:15:09.471+0000 7fadc2fd5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 265403) UID: 0 2023-09-21T01:15:09.473 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-09-21T01:15:09.471+0000 7f9692588700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 265403) UID: 0 2023-09-21T01:15:09.501 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-09-21T01:15:09.500+0000 7fe56ff7b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117517) UID: 0 2023-09-21T01:15:09.501 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-09-21T01:15:09.500+0000 7f6a304c5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117517) UID: 0 2023-09-21T01:15:09.502 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-09-21T01:15:09.500+0000 7fceb8335700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117517) UID: 0 2023-09-21T01:15:09.502 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-09-21T01:15:09.500+0000 7fae7ed95700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117517) UID: 0 2023-09-21T01:18:26.913 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:18:26.916 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:18:46.917 INFO:teuthology.orchestra.run.smithi059.stdout:generic/133 286s 2023-09-21T01:18:46.919 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/133 2023-09-21T01:18:46.919 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:18:46.921 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:18:47.115 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:18:47.116 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2023-09-21T01:18:47.753 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:18:47.757 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:18:47.757 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:18:47.758 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:18:47.759 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:18:48.135 INFO:teuthology.orchestra.run.smithi059.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph 2023-09-21T01:18:48.139 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/134 2023-09-21T01:18:48.140 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/134 2023-09-21T01:18:48.140 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:18:48.141 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:18:48.280 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:18:48.281 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2023-09-21T01:18:48.748 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:18:48.752 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:18:48.752 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:18:48.753 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:18:48.753 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:18:49.941 INFO:teuthology.orchestra.run.smithi059.stdout:generic/135 1s 2023-09-21T01:18:49.946 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/135 2023-09-21T01:18:49.946 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:18:49.948 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:18:49.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:18:49.957 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2023-09-21T01:18:50.186 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:18:50.190 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:18:50.191 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:18:50.192 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:18:50.192 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:18:50.554 INFO:teuthology.orchestra.run.smithi059.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph 2023-09-21T01:18:50.558 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/136 2023-09-21T01:18:50.558 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/136 2023-09-21T01:18:50.559 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:18:50.560 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:18:50.970 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:18:50.971 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2023-09-21T01:18:51.198 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:18:51.202 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:18:51.203 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:18:51.204 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:18:51.204 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:18:51.571 INFO:teuthology.orchestra.run.smithi059.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph 2023-09-21T01:18:51.575 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/137 2023-09-21T01:18:51.575 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/137 2023-09-21T01:18:51.576 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:18:51.577 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:18:51.958 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:18:51.958 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2023-09-21T01:18:52.207 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:18:52.211 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:18:52.211 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:18:52.212 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:18:52.212 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:18:52.582 INFO:teuthology.orchestra.run.smithi059.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph 2023-09-21T01:18:52.586 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/138 2023-09-21T01:18:52.586 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/138 2023-09-21T01:18:52.586 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:18:52.588 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:18:52.992 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:18:52.992 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2023-09-21T01:18:53.232 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:18:53.236 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:18:53.237 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:18:53.238 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:18:53.238 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:18:53.612 INFO:teuthology.orchestra.run.smithi059.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph 2023-09-21T01:18:53.616 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/139 2023-09-21T01:18:53.616 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/139 2023-09-21T01:18:53.617 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:18:53.618 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:18:53.998 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:18:53.999 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2023-09-21T01:18:54.241 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:18:54.245 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:18:54.246 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:18:54.246 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:18:54.247 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:18:54.622 INFO:teuthology.orchestra.run.smithi059.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph 2023-09-21T01:18:54.627 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/140 2023-09-21T01:18:54.627 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/140 2023-09-21T01:18:54.627 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:18:54.629 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:18:54.724 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:18:54.724 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2023-09-21T01:18:55.266 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:18:55.270 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:18:55.270 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:18:55.271 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:18:55.272 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:18:55.865 INFO:teuthology.orchestra.run.smithi059.stdout:generic/141 0s 2023-09-21T01:18:55.870 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/141 2023-09-21T01:18:55.870 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:18:55.872 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:18:55.881 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:18:55.881 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2023-09-21T01:18:56.108 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:18:56.112 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:18:56.112 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:18:56.113 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:18:56.114 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:18:56.489 INFO:teuthology.orchestra.run.smithi059.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph 2023-09-21T01:18:56.494 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/142 2023-09-21T01:18:56.494 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/142 2023-09-21T01:18:56.494 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:18:56.496 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:18:56.804 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:18:56.805 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2023-09-21T01:18:56.992 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:18:56.994 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:18:57.115 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:18:57.119 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:18:57.119 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:18:57.120 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:18:57.120 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:18:57.495 INFO:teuthology.orchestra.run.smithi059.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph 2023-09-21T01:18:57.499 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/143 2023-09-21T01:18:57.500 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/143 2023-09-21T01:18:57.500 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:18:57.501 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:18:57.901 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:18:57.901 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2023-09-21T01:18:58.137 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:18:58.141 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:18:58.141 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:18:58.142 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:18:58.142 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:18:58.523 INFO:teuthology.orchestra.run.smithi059.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph 2023-09-21T01:18:58.526 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/144 2023-09-21T01:18:58.527 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/144 2023-09-21T01:18:58.527 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:18:58.529 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:18:58.915 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:18:58.916 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2023-09-21T01:18:59.161 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:18:59.165 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:18:59.166 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:18:59.167 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:18:59.167 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:18:59.530 INFO:teuthology.orchestra.run.smithi059.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph 2023-09-21T01:18:59.534 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/145 2023-09-21T01:18:59.534 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/145 2023-09-21T01:18:59.535 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:18:59.536 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:18:59.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:18:59.910 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2023-09-21T01:19:00.165 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:00.169 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:00.169 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:00.170 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:00.170 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:00.528 INFO:teuthology.orchestra.run.smithi059.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph 2023-09-21T01:19:00.532 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/146 2023-09-21T01:19:00.532 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/146 2023-09-21T01:19:00.532 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:00.534 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:00.896 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:00.897 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2023-09-21T01:19:01.160 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:01.164 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:01.165 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:01.166 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:01.166 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:01.534 INFO:teuthology.orchestra.run.smithi059.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph 2023-09-21T01:19:01.539 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/147 2023-09-21T01:19:01.539 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/147 2023-09-21T01:19:01.539 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:01.541 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:01.857 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:01.857 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2023-09-21T01:19:02.160 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:02.164 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:02.164 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:02.165 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:02.166 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:02.536 INFO:teuthology.orchestra.run.smithi059.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph 2023-09-21T01:19:02.540 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/148 2023-09-21T01:19:02.540 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/148 2023-09-21T01:19:02.540 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:02.542 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:02.946 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:02.947 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2023-09-21T01:19:03.171 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:03.175 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:03.176 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:03.177 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:03.177 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:03.526 INFO:teuthology.orchestra.run.smithi059.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph 2023-09-21T01:19:03.531 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/149 2023-09-21T01:19:03.531 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/149 2023-09-21T01:19:03.531 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:03.533 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:03.837 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:03.838 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2023-09-21T01:19:04.162 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:04.167 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:04.167 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:04.168 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:04.168 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:04.542 INFO:teuthology.orchestra.run.smithi059.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph 2023-09-21T01:19:04.546 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/150 2023-09-21T01:19:04.546 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/150 2023-09-21T01:19:04.547 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:04.548 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:04.816 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:04.816 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2023-09-21T01:19:05.168 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:05.173 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:05.173 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:05.174 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:05.174 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:05.538 INFO:teuthology.orchestra.run.smithi059.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph 2023-09-21T01:19:05.542 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/151 2023-09-21T01:19:05.543 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/151 2023-09-21T01:19:05.543 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:05.545 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:05.604 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:05.605 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2023-09-21T01:19:06.167 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:06.171 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:06.172 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:06.173 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:06.173 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:06.535 INFO:teuthology.orchestra.run.smithi059.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph 2023-09-21T01:19:06.539 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/152 2023-09-21T01:19:06.539 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/152 2023-09-21T01:19:06.539 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:06.541 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:06.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:06.899 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2023-09-21T01:19:07.169 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:07.173 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:07.173 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:07.174 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:07.175 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:07.548 INFO:teuthology.orchestra.run.smithi059.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph 2023-09-21T01:19:07.552 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/153 2023-09-21T01:19:07.553 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/153 2023-09-21T01:19:07.553 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:07.555 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:07.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:07.868 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2023-09-21T01:19:08.196 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:08.200 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:08.201 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:08.202 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:08.202 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:08.574 INFO:teuthology.orchestra.run.smithi059.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph 2023-09-21T01:19:08.578 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/154 2023-09-21T01:19:08.579 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/154 2023-09-21T01:19:08.579 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:08.580 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:08.988 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:08.989 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2023-09-21T01:19:09.213 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:09.217 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:09.218 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:09.219 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:09.219 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:09.590 INFO:teuthology.orchestra.run.smithi059.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph 2023-09-21T01:19:09.594 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/155 2023-09-21T01:19:09.594 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/155 2023-09-21T01:19:09.594 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:09.596 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:09.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:09.818 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2023-09-21T01:19:10.226 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:10.230 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:10.230 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:10.231 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:10.231 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:10.588 INFO:teuthology.orchestra.run.smithi059.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph 2023-09-21T01:19:10.592 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/156 2023-09-21T01:19:10.593 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/156 2023-09-21T01:19:10.593 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:10.595 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:10.857 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:10.858 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2023-09-21T01:19:11.248 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:11.252 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:11.252 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:11.253 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:11.254 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:11.620 INFO:teuthology.orchestra.run.smithi059.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph 2023-09-21T01:19:11.624 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/157 2023-09-21T01:19:11.624 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/157 2023-09-21T01:19:11.624 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:11.626 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:11.801 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:11.802 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2023-09-21T01:19:12.255 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:12.259 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:12.260 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:12.261 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:12.261 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:12.631 INFO:teuthology.orchestra.run.smithi059.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph 2023-09-21T01:19:12.635 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/158 2023-09-21T01:19:12.636 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/158 2023-09-21T01:19:12.636 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:12.638 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:13.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:13.025 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2023-09-21T01:19:13.258 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:13.263 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:13.263 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:13.264 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:13.264 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:13.646 INFO:teuthology.orchestra.run.smithi059.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-09-21T01:19:13.650 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/159 2023-09-21T01:19:13.650 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/159 2023-09-21T01:19:13.651 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:13.653 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:13.684 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:13.685 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2023-09-21T01:19:13.904 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:13.908 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:13.908 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:13.909 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:13.909 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:14.275 INFO:teuthology.orchestra.run.smithi059.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-09-21T01:19:14.279 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/160 2023-09-21T01:19:14.279 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/160 2023-09-21T01:19:14.279 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:14.281 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:14.315 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:14.315 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2023-09-21T01:19:14.535 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:14.539 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:14.540 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:14.541 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:14.541 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:15.469 INFO:teuthology.orchestra.run.smithi059.stdout:generic/161 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:19:15.478 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/161 2023-09-21T01:19:15.479 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/161 2023-09-21T01:19:15.479 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:15.481 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:15.506 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:15.507 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2023-09-21T01:19:15.734 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:15.739 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:15.739 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:15.740 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:15.740 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:16.270 INFO:teuthology.orchestra.run.smithi059.stdout:generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-09-21T01:19:16.592 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/162 2023-09-21T01:19:16.592 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/162 2023-09-21T01:19:16.592 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:16.606 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:16.695 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:16.695 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2023-09-21T01:19:16.919 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:16.923 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:16.924 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:16.925 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:16.925 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:17.472 INFO:teuthology.orchestra.run.smithi059.stdout:generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-09-21T01:19:17.661 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/163 2023-09-21T01:19:17.661 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/163 2023-09-21T01:19:17.662 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:17.664 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:17.881 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:17.882 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2023-09-21T01:19:18.110 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:18.114 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:18.115 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:18.116 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:18.116 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:18.839 INFO:teuthology.orchestra.run.smithi059.stdout:generic/164 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:19:18.921 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/164 2023-09-21T01:19:18.921 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/164 2023-09-21T01:19:18.921 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:18.925 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:19.067 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:19.068 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2023-09-21T01:19:19.294 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:19.298 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:19.299 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:19.300 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:19.300 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:20.205 INFO:teuthology.orchestra.run.smithi059.stdout:generic/165 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:19:20.226 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/165 2023-09-21T01:19:20.227 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/165 2023-09-21T01:19:20.227 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:20.239 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:20.263 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:20.264 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2023-09-21T01:19:20.486 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:20.490 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:20.491 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:20.492 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:20.492 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:21.284 INFO:teuthology.orchestra.run.smithi059.stdout:generic/166 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:19:21.365 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/166 2023-09-21T01:19:21.366 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/166 2023-09-21T01:19:21.366 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:21.369 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:21.438 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:21.439 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2023-09-21T01:19:21.664 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:21.668 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:21.668 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:21.669 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:21.669 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:22.282 INFO:teuthology.orchestra.run.smithi059.stdout:generic/167 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:19:22.480 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/167 2023-09-21T01:19:22.480 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/167 2023-09-21T01:19:22.480 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:22.591 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:22.633 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:22.634 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2023-09-21T01:19:22.865 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:22.869 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:22.870 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:22.870 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:22.871 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:23.733 INFO:teuthology.orchestra.run.smithi059.stdout:generic/168 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:19:23.752 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/168 2023-09-21T01:19:23.752 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/168 2023-09-21T01:19:23.753 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:23.794 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:23.829 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:23.829 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2023-09-21T01:19:24.057 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:24.061 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:24.061 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:24.062 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:24.063 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:24.878 INFO:teuthology.orchestra.run.smithi059.stdout:generic/169 0s 2023-09-21T01:19:24.886 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/169 2023-09-21T01:19:24.887 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:24.887 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:24.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:24.894 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2023-09-21T01:19:25.118 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:25.123 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:25.123 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:25.124 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:25.124 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:25.946 INFO:teuthology.orchestra.run.smithi059.stdout:generic/170 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:19:26.054 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/170 2023-09-21T01:19:26.054 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/170 2023-09-21T01:19:26.054 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:26.074 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:26.113 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:26.114 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2023-09-21T01:19:26.338 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:26.342 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:26.343 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:26.344 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:26.344 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:27.029 INFO:teuthology.orchestra.run.smithi059.stdout:generic/171 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:19:27.060 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:19:27.195 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:19:27.237 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/171 2023-09-21T01:19:27.238 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/171 2023-09-21T01:19:27.238 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:27.298 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:27.347 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:27.349 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2023-09-21T01:19:27.570 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:27.574 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:27.575 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:27.576 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:27.576 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:28.462 INFO:teuthology.orchestra.run.smithi059.stdout:generic/172 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:19:28.479 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/172 2023-09-21T01:19:28.479 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/172 2023-09-21T01:19:28.479 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:28.531 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:28.569 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:28.570 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2023-09-21T01:19:28.789 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:28.793 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:28.793 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:28.794 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:28.795 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:29.692 INFO:teuthology.orchestra.run.smithi059.stdout:generic/173 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:19:29.710 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/173 2023-09-21T01:19:29.710 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/173 2023-09-21T01:19:29.710 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:29.739 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:29.773 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:29.774 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2023-09-21T01:19:29.993 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:29.998 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:29.998 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:29.999 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:29.999 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:30.942 INFO:teuthology.orchestra.run.smithi059.stdout:generic/174 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:19:30.948 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/174 2023-09-21T01:19:30.948 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/174 2023-09-21T01:19:30.948 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:30.950 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:30.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:30.975 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2023-09-21T01:19:31.200 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:31.204 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:31.204 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:31.205 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:31.205 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:31.929 INFO:teuthology.orchestra.run.smithi059.stdout:generic/175 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:19:31.957 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/175 2023-09-21T01:19:31.957 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/175 2023-09-21T01:19:31.957 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:32.087 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:32.175 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:32.176 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2023-09-21T01:19:32.397 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:32.401 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:32.401 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:32.402 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:32.402 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:33.274 INFO:teuthology.orchestra.run.smithi059.stdout:generic/176 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:19:33.337 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/176 2023-09-21T01:19:33.338 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/176 2023-09-21T01:19:33.338 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:33.353 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:33.383 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:33.384 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2023-09-21T01:19:33.609 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:33.613 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:33.614 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:33.615 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:33.615 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:34.105 INFO:teuthology.orchestra.run.smithi059.stdout:generic/177 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-21T01:19:34.109 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/177 2023-09-21T01:19:34.109 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/177 2023-09-21T01:19:34.110 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:34.111 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:34.506 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:34.507 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2023-09-21T01:19:34.741 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:34.744 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:34.745 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:34.746 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:34.746 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:35.133 INFO:teuthology.orchestra.run.smithi059.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph 2023-09-21T01:19:35.137 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/178 2023-09-21T01:19:35.137 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/178 2023-09-21T01:19:35.137 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:35.139 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:35.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:35.548 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2023-09-21T01:19:35.783 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:35.787 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:35.788 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:35.788 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:35.789 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:36.159 INFO:teuthology.orchestra.run.smithi059.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph 2023-09-21T01:19:36.163 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/179 2023-09-21T01:19:36.163 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/179 2023-09-21T01:19:36.163 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:36.165 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:36.511 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:36.511 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2023-09-21T01:19:36.798 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:36.802 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:36.802 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:36.803 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:36.803 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:37.179 INFO:teuthology.orchestra.run.smithi059.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph 2023-09-21T01:19:37.183 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/180 2023-09-21T01:19:37.184 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/180 2023-09-21T01:19:37.185 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:37.186 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:37.431 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:37.431 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2023-09-21T01:19:37.824 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:37.828 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:37.828 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:37.829 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:37.830 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:38.205 INFO:teuthology.orchestra.run.smithi059.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph 2023-09-21T01:19:38.209 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/181 2023-09-21T01:19:38.209 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/181 2023-09-21T01:19:38.210 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:38.211 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:38.453 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:38.453 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2023-09-21T01:19:38.849 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:38.853 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:38.854 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:38.855 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:38.855 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:39.236 INFO:teuthology.orchestra.run.smithi059.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph 2023-09-21T01:19:39.240 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/182 2023-09-21T01:19:39.241 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/182 2023-09-21T01:19:39.241 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:39.243 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:39.502 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:39.503 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2023-09-21T01:19:39.879 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:39.883 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:39.883 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:39.884 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:39.884 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:40.752 INFO:teuthology.orchestra.run.smithi059.stdout:generic/183 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:19:40.783 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/183 2023-09-21T01:19:40.784 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/183 2023-09-21T01:19:40.784 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:40.791 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:40.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:40.855 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2023-09-21T01:19:41.077 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:41.081 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:41.082 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:41.083 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:41.083 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:41.451 INFO:teuthology.orchestra.run.smithi059.stdout:generic/184 0s 2023-09-21T01:19:41.456 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/184 2023-09-21T01:19:41.456 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:41.458 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:41.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:41.483 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2023-09-21T01:19:41.705 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:41.709 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:41.709 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:41.710 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:41.710 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:42.592 INFO:teuthology.orchestra.run.smithi059.stdout:generic/185 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:19:42.636 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/185 2023-09-21T01:19:42.636 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/185 2023-09-21T01:19:42.637 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:42.641 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:42.667 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:42.668 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2023-09-21T01:19:42.892 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:42.896 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:42.896 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:42.897 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:42.897 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:43.781 INFO:teuthology.orchestra.run.smithi059.stdout:generic/186 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:19:43.801 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/186 2023-09-21T01:19:43.801 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/186 2023-09-21T01:19:43.801 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:43.803 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:43.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:43.859 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2023-09-21T01:19:44.090 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:44.094 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:44.094 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:44.095 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:44.095 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:44.799 INFO:teuthology.orchestra.run.smithi059.stdout:generic/187 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:19:44.869 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/187 2023-09-21T01:19:44.869 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/187 2023-09-21T01:19:44.870 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:45.015 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:45.052 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:45.053 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2023-09-21T01:19:45.277 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:45.281 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:45.281 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:45.282 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:45.282 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:45.944 INFO:teuthology.orchestra.run.smithi059.stdout:generic/188 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:19:46.240 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/188 2023-09-21T01:19:46.240 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/188 2023-09-21T01:19:46.240 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:46.248 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:46.275 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:46.275 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2023-09-21T01:19:46.498 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:46.502 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:46.503 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:46.504 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:46.504 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:47.323 INFO:teuthology.orchestra.run.smithi059.stdout:generic/189 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:19:47.410 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/189 2023-09-21T01:19:47.411 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/189 2023-09-21T01:19:47.411 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:47.415 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:47.472 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:47.472 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2023-09-21T01:19:47.701 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:47.705 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:47.706 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:47.707 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:47.707 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:48.661 INFO:teuthology.orchestra.run.smithi059.stdout:generic/190 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:19:48.666 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/190 2023-09-21T01:19:48.667 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/190 2023-09-21T01:19:48.667 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:48.669 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:48.695 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:48.696 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2023-09-21T01:19:48.915 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:48.919 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:48.919 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:48.920 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:48.921 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:49.753 INFO:teuthology.orchestra.run.smithi059.stdout:generic/191 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:19:49.771 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/191 2023-09-21T01:19:49.772 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/191 2023-09-21T01:19:49.772 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:49.824 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:49.892 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:49.893 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2023-09-21T01:19:50.115 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:50.119 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:50.120 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:50.121 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:50.121 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:50.466 INFO:teuthology.orchestra.run.smithi059.stdout:generic/192 [not run] atime not maintained by ceph 2023-09-21T01:19:50.470 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/192 2023-09-21T01:19:50.470 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/192 2023-09-21T01:19:50.471 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:50.472 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:50.497 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:50.497 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2023-09-21T01:19:50.715 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:50.719 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:50.720 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:50.720 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:50.721 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:51.569 INFO:teuthology.orchestra.run.smithi059.stdout:generic/193 1s 2023-09-21T01:19:51.574 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/193 2023-09-21T01:19:51.574 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:51.576 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:51.911 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:51.912 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2023-09-21T01:19:52.227 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:52.231 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:52.232 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:52.233 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:52.233 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:53.074 INFO:teuthology.orchestra.run.smithi059.stdout:generic/194 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:19:53.200 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/194 2023-09-21T01:19:53.200 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/194 2023-09-21T01:19:53.200 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:53.201 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:53.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:53.226 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2023-09-21T01:19:53.447 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:53.451 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:53.451 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:53.452 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:53.452 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:54.163 INFO:teuthology.orchestra.run.smithi059.stdout:generic/195 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:19:54.193 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/195 2023-09-21T01:19:54.193 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/195 2023-09-21T01:19:54.193 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:54.196 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:54.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:54.408 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2023-09-21T01:19:54.635 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:54.640 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:54.640 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:54.641 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:54.641 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:55.572 INFO:teuthology.orchestra.run.smithi059.stdout:generic/196 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:19:55.589 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/196 2023-09-21T01:19:55.590 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/196 2023-09-21T01:19:55.590 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:55.595 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:55.632 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:55.633 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2023-09-21T01:19:55.857 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:55.861 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:55.862 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:55.863 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:55.863 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:56.678 INFO:teuthology.orchestra.run.smithi059.stdout:generic/197 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:19:56.695 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/197 2023-09-21T01:19:56.695 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/197 2023-09-21T01:19:56.695 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:56.704 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:56.828 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:56.829 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2023-09-21T01:19:57.053 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:57.057 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:57.057 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:57.059 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:57.059 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:57.381 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:19:57.383 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:19:57.798 INFO:teuthology.orchestra.run.smithi059.stdout:generic/198 0s 2023-09-21T01:19:57.803 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/198 2023-09-21T01:19:57.804 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:57.805 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:58.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:58.130 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2023-09-21T01:19:58.531 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:58.535 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:58.535 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:58.536 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:58.536 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:59.215 INFO:teuthology.orchestra.run.smithi059.stdout:generic/199 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:19:59.216 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/199 2023-09-21T01:19:59.216 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/199 2023-09-21T01:19:59.217 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:19:59.392 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:19:59.473 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:19:59.474 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2023-09-21T01:19:59.699 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:19:59.706 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:19:59.706 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:19:59.707 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:19:59.707 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:20:00.330 INFO:teuthology.orchestra.run.smithi059.stdout:generic/200 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:20:00.359 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/200 2023-09-21T01:20:00.359 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/200 2023-09-21T01:20:00.359 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:20:00.620 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:20:00.679 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:20:00.679 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2023-09-21T01:20:00.900 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:20:00.904 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:20:00.904 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:20:00.905 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:20:00.905 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:20:01.792 INFO:teuthology.orchestra.run.smithi059.stdout:generic/201 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:20:01.807 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/201 2023-09-21T01:20:01.807 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/201 2023-09-21T01:20:01.808 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:20:01.810 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:20:01.864 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:20:01.865 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2023-09-21T01:20:02.088 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:20:02.092 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:20:02.093 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:20:02.094 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:20:02.094 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:20:02.961 INFO:teuthology.orchestra.run.smithi059.stdout:generic/202 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:20:02.974 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/202 2023-09-21T01:20:02.975 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/202 2023-09-21T01:20:02.975 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:20:03.014 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:20:03.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:20:03.057 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2023-09-21T01:20:03.281 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:20:03.285 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:20:03.286 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:20:03.286 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:20:03.286 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:20:04.214 INFO:teuthology.orchestra.run.smithi059.stdout:generic/203 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:20:04.239 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/203 2023-09-21T01:20:04.239 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/203 2023-09-21T01:20:04.239 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:20:04.242 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:20:04.269 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:20:04.270 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2023-09-21T01:20:04.495 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:20:04.499 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:20:04.500 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:20:04.501 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:20:04.501 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:20:06.033 INFO:teuthology.orchestra.run.smithi059.stdout:generic/204 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-21T01:20:06.039 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/204 2023-09-21T01:20:06.039 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/204 2023-09-21T01:20:06.039 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:20:06.041 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:20:06.071 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:20:06.071 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2023-09-21T01:20:06.302 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:20:06.306 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:20:06.307 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:20:06.308 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:20:06.308 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:20:07.173 INFO:teuthology.orchestra.run.smithi059.stdout:generic/205 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:20:07.234 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/205 2023-09-21T01:20:07.234 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/205 2023-09-21T01:20:07.234 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:20:07.243 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:20:07.269 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:20:07.270 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2023-09-21T01:20:07.489 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:20:07.494 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:20:07.494 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:20:07.495 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:20:07.495 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:20:08.385 INFO:teuthology.orchestra.run.smithi059.stdout:generic/206 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:20:08.410 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/206 2023-09-21T01:20:08.410 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/206 2023-09-21T01:20:08.411 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:20:08.414 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:20:08.450 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:20:08.451 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2023-09-21T01:20:08.671 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:20:08.675 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:20:08.675 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:20:08.676 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:20:08.676 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:20:14.795 INFO:teuthology.orchestra.run.smithi059.stdout:generic/207 6s 2023-09-21T01:20:14.801 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/207 2023-09-21T01:20:14.801 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:20:14.803 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:20:15.112 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:20:15.113 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2023-09-21T01:20:15.463 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:20:15.467 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:20:15.468 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:20:15.469 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:20:15.469 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:20:27.436 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:20:27.439 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:20:58.116 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:20:58.125 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:21:28.235 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:21:28.238 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:21:58.566 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:21:58.569 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:22:28.640 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:22:28.646 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:22:58.981 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:22:58.985 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:23:29.077 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:23:29.080 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:23:35.958 INFO:teuthology.orchestra.run.smithi059.stdout:generic/208 200s 2023-09-21T01:23:36.022 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/208 2023-09-21T01:23:36.023 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:23:36.024 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:23:36.326 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:23:36.326 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2023-09-21T01:23:36.672 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:23:36.676 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:23:36.676 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:23:36.677 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:23:36.677 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:23:59.151 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:23:59.154 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:24:14.772 INFO:teuthology.orchestra.run.smithi059.stdout:generic/209 38s 2023-09-21T01:24:14.777 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/209 2023-09-21T01:24:14.777 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:24:14.779 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:14.883 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:24:14.884 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2023-09-21T01:24:15.431 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:24:15.435 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:24:15.436 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:24:15.437 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:24:15.437 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:15.893 INFO:teuthology.orchestra.run.smithi059.stdout:generic/210 0s 2023-09-21T01:24:15.899 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/210 2023-09-21T01:24:15.900 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:24:15.901 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:16.188 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:24:16.189 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2023-09-21T01:24:16.526 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:24:16.531 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:24:16.531 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:24:16.532 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:24:16.532 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:17.034 INFO:teuthology.orchestra.run.smithi059.stdout:generic/211 1s 2023-09-21T01:24:17.039 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/211 2023-09-21T01:24:17.039 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:24:17.041 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:17.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:24:17.069 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2023-09-21T01:24:17.291 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:24:17.296 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:24:17.296 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:24:17.297 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:24:17.298 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:17.728 INFO:teuthology.orchestra.run.smithi059.stdout:generic/212 0s 2023-09-21T01:24:17.733 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/212 2023-09-21T01:24:17.733 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:24:17.735 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:17.774 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:24:17.774 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2023-09-21T01:24:17.997 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:24:18.001 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:24:18.001 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:24:18.002 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:24:18.003 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:18.354 INFO:teuthology.orchestra.run.smithi059.stdout:generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-21T01:24:18.358 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/213 2023-09-21T01:24:18.359 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/213 2023-09-21T01:24:18.359 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:24:18.361 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:18.390 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:24:18.391 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2023-09-21T01:24:18.617 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:24:18.621 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:24:18.621 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:24:18.623 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:24:18.623 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:18.974 INFO:teuthology.orchestra.run.smithi059.stdout:generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-21T01:24:18.978 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/214 2023-09-21T01:24:18.978 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/214 2023-09-21T01:24:18.978 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:24:18.980 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:19.004 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:24:19.005 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2023-09-21T01:24:19.231 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:24:19.235 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:24:19.236 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:24:19.236 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:24:19.237 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:21.646 INFO:teuthology.orchestra.run.smithi059.stdout:generic/215 2s 2023-09-21T01:24:21.652 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/215 2023-09-21T01:24:21.652 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:24:21.655 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:21.699 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:24:21.699 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2023-09-21T01:24:21.925 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:24:21.929 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:24:21.929 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:24:21.930 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:24:21.930 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:22.626 INFO:teuthology.orchestra.run.smithi059.stdout:generic/216 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:24:22.632 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/216 2023-09-21T01:24:22.632 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/216 2023-09-21T01:24:22.632 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:24:22.735 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:22.871 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:24:22.872 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2023-09-21T01:24:23.100 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:24:23.105 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:24:23.105 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:24:23.106 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:24:23.106 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:23.903 INFO:teuthology.orchestra.run.smithi059.stdout:generic/217 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:24:23.922 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/217 2023-09-21T01:24:23.923 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/217 2023-09-21T01:24:23.923 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:24:23.926 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:24.057 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:24:24.058 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2023-09-21T01:24:24.298 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:24:24.302 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:24:24.302 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:24:24.303 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:24:24.304 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:25.046 INFO:teuthology.orchestra.run.smithi059.stdout:generic/218 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:24:25.225 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/218 2023-09-21T01:24:25.226 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/218 2023-09-21T01:24:25.226 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:24:25.236 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:25.264 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:24:25.264 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2023-09-21T01:24:25.489 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:24:25.493 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:24:25.494 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:24:25.495 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:24:25.495 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:25.830 INFO:teuthology.orchestra.run.smithi059.stdout:generic/219 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-21T01:24:25.833 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/219 2023-09-21T01:24:25.834 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/219 2023-09-21T01:24:25.834 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:24:25.836 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:25.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:24:25.870 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2023-09-21T01:24:26.093 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:24:26.097 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:24:26.097 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:24:26.098 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:24:26.098 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:26.912 INFO:teuthology.orchestra.run.smithi059.stdout:generic/220 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:24:26.980 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/220 2023-09-21T01:24:26.980 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/220 2023-09-21T01:24:26.980 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:24:27.006 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:27.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:24:27.061 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2023-09-21T01:24:27.285 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:24:27.289 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:24:27.289 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:24:27.290 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:24:27.291 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:28.652 INFO:teuthology.orchestra.run.smithi059.stdout:generic/221 1s 2023-09-21T01:24:28.658 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/221 2023-09-21T01:24:28.658 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:24:28.661 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:28.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:24:28.699 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2023-09-21T01:24:28.931 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:24:28.935 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:24:28.935 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:24:28.936 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:24:28.936 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:29.542 INFO:teuthology.orchestra.run.smithi059.stdout:generic/222 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:24:29.551 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/222 2023-09-21T01:24:29.551 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/222 2023-09-21T01:24:29.551 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:24:29.555 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:29.739 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:24:29.749 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:24:29.841 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:24:29.842 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2023-09-21T01:24:29.888 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-09-21T01:24:29.887+0000 7fadc2fd5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 310870) UID: 0 2023-09-21T01:24:29.889 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-09-21T01:24:29.887+0000 7f7948a08700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 310870) UID: 0 2023-09-21T01:24:29.889 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-09-21T01:24:29.887+0000 7fc5c83b6700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 310870) UID: 0 2023-09-21T01:24:29.890 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-09-21T01:24:29.888+0000 7f9692588700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 310870) UID: 0 2023-09-21T01:24:30.096 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:24:30.099 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:24:30.100 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:24:30.101 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:24:30.101 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:30.478 INFO:teuthology.orchestra.run.smithi059.stdout:generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-21T01:24:30.482 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/223 2023-09-21T01:24:30.482 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/223 2023-09-21T01:24:30.482 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:24:30.484 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:30.512 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:24:30.512 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2023-09-21T01:24:30.778 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:24:30.782 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:24:30.782 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:24:30.783 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:24:30.784 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:31.119 INFO:teuthology.orchestra.run.smithi059.stdout:generic/224 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-21T01:24:31.123 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/224 2023-09-21T01:24:31.124 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/224 2023-09-21T01:24:31.124 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:24:31.126 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:31.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:24:31.150 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2023-09-21T01:24:31.375 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:24:31.379 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:24:31.380 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:24:31.381 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:24:31.381 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:31.792 INFO:teuthology.orchestra.run.smithi059.stdout:generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-21T01:24:31.796 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/225 2023-09-21T01:24:31.797 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/225 2023-09-21T01:24:31.797 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:24:31.798 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:32.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:24:32.074 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2023-09-21T01:24:32.464 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:24:32.468 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:24:32.468 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:24:32.469 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:24:32.470 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:32.845 INFO:teuthology.orchestra.run.smithi059.stdout:generic/226 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-21T01:24:32.850 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/226 2023-09-21T01:24:32.850 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/226 2023-09-21T01:24:32.850 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:24:32.852 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:32.878 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:24:32.879 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2023-09-21T01:24:33.103 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:24:33.107 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:24:33.107 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:24:33.108 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:24:33.109 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:33.878 INFO:teuthology.orchestra.run.smithi059.stdout:generic/227 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:24:34.022 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/227 2023-09-21T01:24:34.022 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/227 2023-09-21T01:24:34.022 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:24:34.050 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:34.085 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:24:34.085 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2023-09-21T01:24:34.309 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:24:34.313 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:24:34.313 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:24:34.314 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:24:34.314 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:34.693 INFO:teuthology.orchestra.run.smithi059.stdout:generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-21T01:24:34.697 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/228 2023-09-21T01:24:34.697 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/228 2023-09-21T01:24:34.697 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:24:34.699 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:34.718 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:24:34.719 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2023-09-21T01:24:34.956 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:24:34.960 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:24:34.961 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:24:34.962 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:24:34.962 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:35.699 INFO:teuthology.orchestra.run.smithi059.stdout:generic/229 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:24:35.749 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/229 2023-09-21T01:24:35.749 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/229 2023-09-21T01:24:35.750 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:24:35.753 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:35.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:24:35.922 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2023-09-21T01:24:36.149 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:24:36.153 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:24:36.154 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:24:36.154 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:24:36.155 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:36.492 INFO:teuthology.orchestra.run.smithi059.stdout:generic/230 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-21T01:24:36.496 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/230 2023-09-21T01:24:36.496 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/230 2023-09-21T01:24:36.496 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:24:36.498 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:36.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:24:36.523 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2023-09-21T01:24:36.754 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:24:36.758 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:24:36.759 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:24:36.760 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:24:36.760 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:37.101 INFO:teuthology.orchestra.run.smithi059.stdout:generic/231 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-21T01:24:37.105 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/231 2023-09-21T01:24:37.105 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/231 2023-09-21T01:24:37.105 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:24:37.107 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:37.136 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:24:37.136 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2023-09-21T01:24:37.371 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:24:37.375 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:24:37.375 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:24:37.376 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:24:37.376 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:37.711 INFO:teuthology.orchestra.run.smithi059.stdout:generic/232 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-21T01:24:37.715 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/232 2023-09-21T01:24:37.715 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/232 2023-09-21T01:24:37.715 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:24:37.717 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:37.741 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:24:37.741 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2023-09-21T01:24:37.964 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:24:37.968 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:24:37.969 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:24:37.970 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:24:37.970 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:38.307 INFO:teuthology.orchestra.run.smithi059.stdout:generic/233 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-21T01:24:38.311 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/233 2023-09-21T01:24:38.311 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/233 2023-09-21T01:24:38.311 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:24:38.313 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:38.338 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:24:38.338 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2023-09-21T01:24:38.566 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:24:38.570 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:24:38.570 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:24:38.571 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:24:38.571 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:38.915 INFO:teuthology.orchestra.run.smithi059.stdout:generic/234 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-21T01:24:38.919 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/234 2023-09-21T01:24:38.919 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/234 2023-09-21T01:24:38.920 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:24:38.921 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:38.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:24:38.943 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2023-09-21T01:24:39.172 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:24:39.176 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:24:39.177 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:24:39.177 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:24:39.178 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:39.524 INFO:teuthology.orchestra.run.smithi059.stdout:generic/235 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-21T01:24:39.528 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/235 2023-09-21T01:24:39.528 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/235 2023-09-21T01:24:39.528 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:24:39.530 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:39.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:24:39.555 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2023-09-21T01:24:39.785 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:24:39.789 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:24:39.789 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:24:39.790 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:24:39.790 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:41.249 INFO:teuthology.orchestra.run.smithi059.stdout:generic/236 2s 2023-09-21T01:24:41.291 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/236 2023-09-21T01:24:41.291 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:24:41.293 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:41.705 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:24:41.706 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2023-09-21T01:24:41.955 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:24:41.959 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:24:41.959 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:24:41.960 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:24:41.961 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:42.406 INFO:teuthology.orchestra.run.smithi059.stdout:generic/237 0s 2023-09-21T01:24:42.411 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/237 2023-09-21T01:24:42.411 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:24:42.413 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:42.842 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:24:42.842 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2023-09-21T01:24:43.080 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:24:43.084 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:24:43.085 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:24:43.086 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:24:43.086 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:43.992 INFO:teuthology.orchestra.run.smithi059.stdout:generic/238 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:24:44.039 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/238 2023-09-21T01:24:44.039 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/238 2023-09-21T01:24:44.039 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:24:44.048 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:24:44.076 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:24:44.076 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2023-09-21T01:24:44.303 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:24:44.307 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:24:44.307 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:24:44.308 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:24:44.309 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:26:51.046 INFO:teuthology.orchestra.run.smithi059.stdout:generic/239 127s 2023-09-21T01:26:51.061 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/239 2023-09-21T01:26:51.062 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:26:51.064 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:26:51.473 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:26:51.474 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2023-09-21T01:26:52.021 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:26:52.025 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:26:52.026 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:26:52.027 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:26:52.027 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:26:52.923 INFO:teuthology.orchestra.run.smithi059.stdout:generic/240 0s 2023-09-21T01:26:52.929 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/240 2023-09-21T01:26:52.929 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:26:52.931 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:26:53.221 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:26:53.221 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2023-09-21T01:26:53.594 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:26:53.598 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:26:53.598 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:26:53.599 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:26:53.600 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:28:06.924 INFO:teuthology.orchestra.run.smithi059.stdout:generic/241 73s 2023-09-21T01:28:06.929 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/241 2023-09-21T01:28:06.929 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:28:06.931 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:28:08.042 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:28:08.043 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2023-09-21T01:28:08.279 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:28:08.283 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:28:08.283 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:28:08.284 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:28:08.285 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:28:09.577 INFO:teuthology.orchestra.run.smithi059.stdout:generic/242 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:28:09.639 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/242 2023-09-21T01:28:09.640 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/242 2023-09-21T01:28:09.640 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:28:09.643 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:28:09.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:28:09.675 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2023-09-21T01:28:09.897 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:28:09.902 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:28:09.902 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:28:09.903 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:28:09.903 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:28:10.855 INFO:teuthology.orchestra.run.smithi059.stdout:generic/243 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:28:10.866 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/243 2023-09-21T01:28:10.866 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/243 2023-09-21T01:28:10.866 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:28:10.868 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:28:10.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:28:10.891 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2023-09-21T01:28:11.111 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:28:11.115 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:28:11.116 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:28:11.116 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:28:11.117 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:28:11.463 INFO:teuthology.orchestra.run.smithi059.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-21T01:28:11.468 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/244 2023-09-21T01:28:11.468 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/244 2023-09-21T01:28:11.468 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:28:11.470 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:28:11.496 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:28:11.497 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2023-09-21T01:28:11.723 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:28:11.727 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:28:11.728 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:28:11.729 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:28:11.729 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:28:12.182 INFO:teuthology.orchestra.run.smithi059.stdout:generic/245 1s 2023-09-21T01:28:12.244 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/245 2023-09-21T01:28:12.245 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:28:12.246 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:28:12.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:28:12.627 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2023-09-21T01:28:12.881 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:28:12.885 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:28:12.886 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:28:12.887 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:28:12.887 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:28:13.369 INFO:teuthology.orchestra.run.smithi059.stdout:generic/246 0s 2023-09-21T01:28:13.408 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/246 2023-09-21T01:28:13.408 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:28:13.410 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:28:13.631 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:28:13.631 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2023-09-21T01:28:14.041 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:28:14.045 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:28:14.045 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:28:14.046 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:28:14.047 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:28:24.079 INFO:teuthology.orchestra.run.smithi059.stdout:generic/247 10s 2023-09-21T01:28:24.084 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/247 2023-09-21T01:28:24.084 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:28:24.086 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:28:24.094 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:28:24.095 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2023-09-21T01:28:24.316 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:28:24.320 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:28:24.321 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:28:24.322 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:28:24.322 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:28:24.703 INFO:teuthology.orchestra.run.smithi059.stdout:generic/248 0s 2023-09-21T01:28:24.707 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/248 2023-09-21T01:28:24.708 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:28:24.710 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:28:24.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:28:24.746 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2023-09-21T01:28:24.966 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:28:24.971 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:28:24.971 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:28:24.972 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:28:24.972 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:28:25.539 INFO:teuthology.orchestra.run.smithi059.stdout:generic/249 0s 2023-09-21T01:28:25.544 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/249 2023-09-21T01:28:25.544 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:28:25.546 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:28:25.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:28:25.927 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2023-09-21T01:28:26.182 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:28:26.186 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:28:26.186 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:28:26.187 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:28:26.188 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:28:26.581 INFO:teuthology.orchestra.run.smithi059.stdout:generic/250 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T01:28:26.585 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/250 2023-09-21T01:28:26.586 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/250 2023-09-21T01:28:26.586 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:28:26.587 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:28:26.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:28:26.617 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2023-09-21T01:28:26.839 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:28:26.844 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:28:26.844 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:28:26.845 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:28:26.845 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:28:27.366 INFO:teuthology.orchestra.run.smithi059.stdout:generic/251 [not run] FITRIM not supported on /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:28:27.392 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/251 2023-09-21T01:28:27.392 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/251 2023-09-21T01:28:27.392 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:28:27.394 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:28:27.428 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:28:27.429 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2023-09-21T01:28:27.650 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:28:27.654 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:28:27.655 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:28:27.656 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:28:27.656 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:28:28.003 INFO:teuthology.orchestra.run.smithi059.stdout:generic/252 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T01:28:28.007 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/252 2023-09-21T01:28:28.007 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/252 2023-09-21T01:28:28.007 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:28:28.009 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:28:28.034 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:28:28.035 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2023-09-21T01:28:28.254 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:28:28.258 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:28:28.259 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:28:28.260 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:28:28.260 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:28:29.094 INFO:teuthology.orchestra.run.smithi059.stdout:generic/253 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:28:29.155 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/253 2023-09-21T01:28:29.155 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/253 2023-09-21T01:28:29.156 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:28:29.161 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:28:29.213 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:28:29.214 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2023-09-21T01:28:29.436 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:28:29.440 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:28:29.440 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:28:29.441 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:28:29.441 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:28:29.552 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:28:29.555 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:28:29.612 INFO:tasks.ceph.mds.c.smithi059.stderr:2023-09-21T01:28:29.612+0000 7fa085432700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 327971) UID: 0 2023-09-21T01:28:29.612 INFO:tasks.ceph.mds.a.smithi059.stderr:2023-09-21T01:28:29.612+0000 7facd961b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 327971) UID: 0 2023-09-21T01:28:30.464 INFO:teuthology.orchestra.run.smithi059.stdout:generic/254 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:28:30.469 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/254 2023-09-21T01:28:30.470 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/254 2023-09-21T01:28:30.470 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:28:30.472 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:28:30.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:28:30.494 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2023-09-21T01:28:30.719 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:28:30.724 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:28:30.724 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:28:30.725 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:28:30.725 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:28:31.195 INFO:teuthology.orchestra.run.smithi059.stdout:generic/255 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-21T01:28:31.199 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/255 2023-09-21T01:28:31.199 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/255 2023-09-21T01:28:31.199 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:28:31.201 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:28:31.498 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:28:31.498 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2023-09-21T01:28:31.890 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:28:31.894 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:28:31.895 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:28:31.896 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:28:31.896 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:28:32.757 INFO:teuthology.orchestra.run.smithi059.stdout:generic/256 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-21T01:28:32.760 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/256 2023-09-21T01:28:32.761 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/256 2023-09-21T01:28:32.761 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:28:32.763 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:28:32.801 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:28:32.801 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2023-09-21T01:28:33.028 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:28:33.032 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:28:33.032 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:28:33.033 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:28:33.033 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:28:33.899 INFO:teuthology.orchestra.run.smithi059.stdout:generic/257 0s 2023-09-21T01:28:33.907 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/257 2023-09-21T01:28:33.908 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:28:33.909 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:28:34.351 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:28:34.351 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2023-09-21T01:28:34.784 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:28:34.788 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:28:34.788 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:28:34.789 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:28:34.789 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:28:35.112 INFO:teuthology.orchestra.run.smithi059.stdout:generic/258 [not run] ceph does not support negative timestamps 2023-09-21T01:28:35.117 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/258 2023-09-21T01:28:35.117 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/258 2023-09-21T01:28:35.117 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:28:35.119 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:28:35.137 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:28:35.137 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2023-09-21T01:28:35.362 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:28:35.366 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:28:35.367 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:28:35.368 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:28:35.368 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:28:36.241 INFO:teuthology.orchestra.run.smithi059.stdout:generic/259 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:28:36.247 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/259 2023-09-21T01:28:36.248 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/259 2023-09-21T01:28:36.248 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:28:36.303 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:28:36.359 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:28:36.359 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2023-09-21T01:28:36.585 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:28:36.590 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:28:36.590 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:28:36.591 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:28:36.591 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:28:37.102 INFO:teuthology.orchestra.run.smithi059.stdout:generic/260 [not run] FITRIM not supported on /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:28:37.127 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/260 2023-09-21T01:28:37.127 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/260 2023-09-21T01:28:37.127 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:28:37.129 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:28:37.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:28:37.149 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2023-09-21T01:28:37.379 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:28:37.383 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:28:37.383 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:28:37.384 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:28:37.385 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:28:38.365 INFO:teuthology.orchestra.run.smithi059.stdout:generic/261 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:28:38.389 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/261 2023-09-21T01:28:38.390 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/261 2023-09-21T01:28:38.390 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:28:38.395 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:28:38.422 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:28:38.423 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2023-09-21T01:28:38.653 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:28:38.657 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:28:38.658 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:28:38.659 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:28:38.659 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:28:39.566 INFO:teuthology.orchestra.run.smithi059.stdout:generic/262 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:28:39.616 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/262 2023-09-21T01:28:39.616 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/262 2023-09-21T01:28:39.616 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:28:39.659 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:28:39.699 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:28:39.699 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2023-09-21T01:28:39.927 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:28:39.931 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:28:39.932 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:28:39.933 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:28:39.933 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:20.058 INFO:teuthology.orchestra.run.smithi059.stdout:generic/263 40s 2023-09-21T01:29:20.063 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/263 2023-09-21T01:29:20.063 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:29:20.065 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:20.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:29:20.408 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2023-09-21T01:29:20.728 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:29:20.732 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:29:20.732 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:29:20.733 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:29:20.734 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:21.675 INFO:teuthology.orchestra.run.smithi059.stdout:generic/264 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:29:21.683 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/264 2023-09-21T01:29:21.683 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/264 2023-09-21T01:29:21.684 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:29:21.687 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:21.716 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:29:21.716 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2023-09-21T01:29:21.943 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:29:21.947 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:29:21.947 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:29:21.948 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:29:21.948 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:22.871 INFO:teuthology.orchestra.run.smithi059.stdout:generic/265 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:29:22.887 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/265 2023-09-21T01:29:22.888 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/265 2023-09-21T01:29:22.888 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:29:22.892 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:22.915 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:29:22.916 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2023-09-21T01:29:23.133 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:29:23.137 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:29:23.138 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:29:23.139 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:29:23.139 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:24.017 INFO:teuthology.orchestra.run.smithi059.stdout:generic/266 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:29:24.052 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/266 2023-09-21T01:29:24.053 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/266 2023-09-21T01:29:24.053 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:29:24.056 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:24.089 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:29:24.090 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2023-09-21T01:29:24.315 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:29:24.319 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:29:24.320 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:29:24.321 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:29:24.321 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:25.275 INFO:teuthology.orchestra.run.smithi059.stdout:generic/267 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:29:25.287 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/267 2023-09-21T01:29:25.288 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/267 2023-09-21T01:29:25.288 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:29:25.299 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:25.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:29:25.336 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2023-09-21T01:29:25.564 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:29:25.568 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:29:25.568 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:29:25.570 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:29:25.570 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:26.372 INFO:teuthology.orchestra.run.smithi059.stdout:generic/268 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:29:26.482 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/268 2023-09-21T01:29:26.483 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/268 2023-09-21T01:29:26.483 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:29:26.515 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:26.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:29:26.539 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2023-09-21T01:29:26.770 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:29:26.774 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:29:26.774 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:29:26.775 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:29:26.775 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:27.098 INFO:teuthology.orchestra.run.smithi059.stdout:generic/269 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-21T01:29:27.102 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/269 2023-09-21T01:29:27.102 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/269 2023-09-21T01:29:27.102 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:29:27.104 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:27.127 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:29:27.128 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2023-09-21T01:29:27.355 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:29:27.360 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:29:27.360 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:29:27.361 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:29:27.361 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:27.685 INFO:teuthology.orchestra.run.smithi059.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-21T01:29:27.689 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/270 2023-09-21T01:29:27.689 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/270 2023-09-21T01:29:27.689 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:29:27.691 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:27.719 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:29:27.720 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2023-09-21T01:29:27.941 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:29:27.945 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:29:27.946 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:29:27.947 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:29:27.947 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:28.858 INFO:teuthology.orchestra.run.smithi059.stdout:generic/271 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:29:28.865 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/271 2023-09-21T01:29:28.865 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/271 2023-09-21T01:29:28.865 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:29:28.877 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:28.905 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:29:28.906 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2023-09-21T01:29:29.126 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:29:29.129 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:29:29.130 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:29:29.131 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:29:29.131 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:30.058 INFO:teuthology.orchestra.run.smithi059.stdout:generic/272 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:29:30.065 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/272 2023-09-21T01:29:30.065 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/272 2023-09-21T01:29:30.065 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:29:30.068 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:30.110 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:29:30.111 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2023-09-21T01:29:30.335 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:29:30.339 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:29:30.339 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:29:30.340 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:29:30.340 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:30.678 INFO:teuthology.orchestra.run.smithi059.stdout:generic/273 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-21T01:29:30.682 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/273 2023-09-21T01:29:30.683 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/273 2023-09-21T01:29:30.683 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:29:30.684 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:30.716 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:29:30.716 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2023-09-21T01:29:30.948 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:29:30.952 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:29:30.953 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:29:30.953 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:29:30.954 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:31.301 INFO:teuthology.orchestra.run.smithi059.stdout:generic/274 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-09-21T01:29:31.305 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/274 2023-09-21T01:29:31.305 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/274 2023-09-21T01:29:31.306 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:29:31.307 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:31.333 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:29:31.334 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2023-09-21T01:29:31.560 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:29:31.564 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:29:31.564 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:29:31.565 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:29:31.566 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:31.905 INFO:teuthology.orchestra.run.smithi059.stdout:generic/275 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-21T01:29:31.909 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/275 2023-09-21T01:29:31.910 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/275 2023-09-21T01:29:31.910 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:29:31.911 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:31.937 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:29:31.937 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2023-09-21T01:29:32.155 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:29:32.159 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:29:32.160 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:29:32.160 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:29:32.161 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:32.919 INFO:teuthology.orchestra.run.smithi059.stdout:generic/276 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:29:33.121 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/276 2023-09-21T01:29:33.121 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/276 2023-09-21T01:29:33.121 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:29:33.140 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:33.161 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:29:33.161 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2023-09-21T01:29:33.391 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:29:33.395 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:29:33.395 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:29:33.396 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:29:33.396 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:33.823 INFO:teuthology.orchestra.run.smithi059.stdout:generic/277 [not run] file system doesn't support chattr +A 2023-09-21T01:29:33.827 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/277 2023-09-21T01:29:33.827 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/277 2023-09-21T01:29:33.827 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:29:33.829 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:33.860 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:29:33.861 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2023-09-21T01:29:34.085 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:29:34.089 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:29:34.090 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:29:34.091 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:29:34.091 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:35.008 INFO:teuthology.orchestra.run.smithi059.stdout:generic/278 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:29:35.027 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/278 2023-09-21T01:29:35.027 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/278 2023-09-21T01:29:35.028 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:29:35.036 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:35.058 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:29:35.059 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2023-09-21T01:29:35.277 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:29:35.281 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:29:35.282 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:29:35.283 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:29:35.283 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:36.187 INFO:teuthology.orchestra.run.smithi059.stdout:generic/279 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:29:36.240 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/279 2023-09-21T01:29:36.241 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/279 2023-09-21T01:29:36.241 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:29:36.262 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:36.289 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:29:36.290 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2023-09-21T01:29:36.512 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:29:36.516 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:29:36.517 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:29:36.518 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:29:36.518 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:36.876 INFO:teuthology.orchestra.run.smithi059.stdout:generic/280 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-21T01:29:36.880 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/280 2023-09-21T01:29:36.880 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/280 2023-09-21T01:29:36.880 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:29:36.882 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:36.902 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:29:36.902 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2023-09-21T01:29:37.128 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:29:37.132 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:29:37.133 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:29:37.134 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:29:37.134 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:38.049 INFO:teuthology.orchestra.run.smithi059.stdout:generic/281 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:29:38.059 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/281 2023-09-21T01:29:38.060 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/281 2023-09-21T01:29:38.060 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:29:38.071 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:38.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:29:38.106 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2023-09-21T01:29:38.328 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:29:38.332 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:29:38.333 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:29:38.334 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:29:38.334 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:39.250 INFO:teuthology.orchestra.run.smithi059.stdout:generic/282 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:29:39.287 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/282 2023-09-21T01:29:39.288 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/282 2023-09-21T01:29:39.288 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:29:39.302 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:39.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:29:39.324 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2023-09-21T01:29:39.541 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:29:39.545 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:29:39.545 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:29:39.546 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:29:39.547 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:40.533 INFO:teuthology.orchestra.run.smithi059.stdout:generic/283 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:29:40.612 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/283 2023-09-21T01:29:40.613 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/283 2023-09-21T01:29:40.613 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:29:40.618 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:40.641 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:29:40.641 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2023-09-21T01:29:40.864 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:29:40.867 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:29:40.868 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:29:40.869 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:29:40.869 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:41.572 INFO:teuthology.orchestra.run.smithi059.stdout:generic/284 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:29:41.804 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/284 2023-09-21T01:29:41.804 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/284 2023-09-21T01:29:41.804 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:29:41.810 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:41.831 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:29:41.831 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2023-09-21T01:29:42.049 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:29:42.053 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:29:42.054 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:29:42.054 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:29:42.055 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:43.153 INFO:teuthology.orchestra.run.smithi059.stdout:generic/285 1s 2023-09-21T01:29:43.162 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/285 2023-09-21T01:29:43.162 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:29:43.164 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:43.979 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:29:43.979 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2023-09-21T01:29:44.200 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:29:44.204 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:29:44.204 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:29:44.205 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:29:44.205 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:44.661 INFO:teuthology.orchestra.run.smithi059.stdout:generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-21T01:29:44.666 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/286 2023-09-21T01:29:44.666 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/286 2023-09-21T01:29:44.666 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:29:44.669 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:44.702 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:29:44.703 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2023-09-21T01:29:45.176 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:29:45.186 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:29:45.188 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:29:45.191 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:29:45.191 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:46.302 INFO:teuthology.orchestra.run.smithi059.stdout:generic/287 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:29:46.375 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/287 2023-09-21T01:29:46.375 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/287 2023-09-21T01:29:46.376 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:29:46.386 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:46.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:29:46.466 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2023-09-21T01:29:46.953 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:29:46.969 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:29:46.970 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:29:46.971 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:29:46.971 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:47.820 INFO:teuthology.orchestra.run.smithi059.stdout:generic/288 [not run] FITRIM not supported on /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:29:47.836 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/288 2023-09-21T01:29:47.836 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/288 2023-09-21T01:29:47.836 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:29:47.838 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:47.863 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:29:47.864 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2023-09-21T01:29:48.314 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:29:48.319 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:29:48.320 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:29:48.321 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:29:48.321 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:49.554 INFO:teuthology.orchestra.run.smithi059.stdout:generic/289 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:29:49.563 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/289 2023-09-21T01:29:49.575 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/289 2023-09-21T01:29:49.575 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:29:49.575 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:49.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:29:49.681 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2023-09-21T01:29:50.096 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:29:50.104 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:29:50.105 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:29:50.107 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:29:50.107 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:51.235 INFO:teuthology.orchestra.run.smithi059.stdout:generic/290 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:29:51.252 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/290 2023-09-21T01:29:51.252 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/290 2023-09-21T01:29:51.252 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:29:51.259 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:51.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:29:51.298 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2023-09-21T01:29:51.531 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:29:51.535 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:29:51.535 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:29:51.536 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:29:51.537 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:52.457 INFO:teuthology.orchestra.run.smithi059.stdout:generic/291 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:29:52.465 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/291 2023-09-21T01:29:52.465 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/291 2023-09-21T01:29:52.465 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:29:52.469 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:52.511 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:29:52.512 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2023-09-21T01:29:52.743 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:29:52.747 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:29:52.748 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:29:52.749 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:29:52.749 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:53.593 INFO:teuthology.orchestra.run.smithi059.stdout:generic/292 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:29:53.650 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/292 2023-09-21T01:29:53.650 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/292 2023-09-21T01:29:53.651 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:29:53.704 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:53.731 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:29:53.732 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2023-09-21T01:29:53.950 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:29:53.954 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:29:53.955 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:29:53.956 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:29:53.956 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:54.812 INFO:teuthology.orchestra.run.smithi059.stdout:generic/293 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:29:54.830 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/293 2023-09-21T01:29:54.830 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/293 2023-09-21T01:29:54.831 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:29:54.857 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:54.933 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:29:54.934 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2023-09-21T01:29:55.157 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:29:55.161 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:29:55.162 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:29:55.162 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:29:55.163 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:56.169 INFO:teuthology.orchestra.run.smithi059.stdout:generic/294 1s 2023-09-21T01:29:56.174 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/294 2023-09-21T01:29:56.174 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:29:56.176 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:56.186 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:29:56.187 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2023-09-21T01:29:56.415 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:29:56.419 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:29:56.419 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:29:56.420 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:29:56.420 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:57.331 INFO:teuthology.orchestra.run.smithi059.stdout:generic/295 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:29:57.358 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/295 2023-09-21T01:29:57.358 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/295 2023-09-21T01:29:57.358 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:29:57.376 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:57.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:29:57.415 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2023-09-21T01:29:57.642 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:29:57.646 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:29:57.647 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:29:57.648 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:29:57.648 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:58.459 INFO:teuthology.orchestra.run.smithi059.stdout:generic/296 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:29:58.468 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/296 2023-09-21T01:29:58.469 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/296 2023-09-21T01:29:58.469 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:29:58.507 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:58.613 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:29:58.613 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2023-09-21T01:29:58.847 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:29:58.851 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:29:58.852 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:29:58.853 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:29:58.853 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:59.677 INFO:teuthology.orchestra.run.smithi059.stdout:generic/297 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:29:59.704 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/297 2023-09-21T01:29:59.704 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/297 2023-09-21T01:29:59.705 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:29:59.708 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:29:59.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:29:59.848 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2023-09-21T01:30:00.074 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:30:00.078 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:30:00.078 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:30:00.079 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:30:00.079 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:30:00.864 INFO:teuthology.orchestra.run.smithi059.stdout:generic/298 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:30:00.878 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/298 2023-09-21T01:30:00.878 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/298 2023-09-21T01:30:00.878 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:30:00.938 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:30:01.018 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:30:01.019 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2023-09-21T01:30:01.244 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:30:01.248 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:30:01.249 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:30:01.250 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:30:01.250 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:30:01.654 INFO:teuthology.orchestra.run.smithi059.stdout:generic/299 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T01:30:01.658 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/299 2023-09-21T01:30:01.658 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/299 2023-09-21T01:30:01.659 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:30:01.660 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:30:01.686 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:30:01.687 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2023-09-21T01:30:01.912 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:30:01.916 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:30:01.917 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:30:01.918 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:30:01.918 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:30:02.311 INFO:teuthology.orchestra.run.smithi059.stdout:generic/300 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T01:30:02.316 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/300 2023-09-21T01:30:02.316 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/300 2023-09-21T01:30:02.316 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:30:02.318 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:30:02.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:30:02.347 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2023-09-21T01:30:02.585 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:30:02.589 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:30:02.590 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:30:02.591 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:30:02.591 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:30:03.505 INFO:teuthology.orchestra.run.smithi059.stdout:generic/301 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:30:03.512 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/301 2023-09-21T01:30:03.513 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/301 2023-09-21T01:30:03.513 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:30:03.517 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:30:03.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:30:03.551 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2023-09-21T01:30:03.778 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:30:03.782 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:30:03.782 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:30:03.783 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:30:03.783 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:30:04.449 INFO:teuthology.orchestra.run.smithi059.stdout:generic/302 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:30:04.456 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/302 2023-09-21T01:30:04.456 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/302 2023-09-21T01:30:04.456 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:30:04.472 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:30:04.754 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:30:04.755 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2023-09-21T01:30:04.998 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:30:05.003 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:30:05.003 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:30:05.004 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:30:05.004 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:30:05.376 INFO:teuthology.orchestra.run.smithi059.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph 2023-09-21T01:30:05.380 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/303 2023-09-21T01:30:05.380 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/303 2023-09-21T01:30:05.380 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:30:05.382 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:30:05.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:30:05.731 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2023-09-21T01:30:06.037 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:30:06.041 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:30:06.041 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:30:06.042 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:30:06.043 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:30:06.421 INFO:teuthology.orchestra.run.smithi059.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph 2023-09-21T01:30:06.425 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/304 2023-09-21T01:30:06.426 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/304 2023-09-21T01:30:06.426 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:30:06.428 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:30:06.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:30:06.798 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2023-09-21T01:30:07.106 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:30:07.110 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:30:07.110 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:30:07.111 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:30:07.111 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:30:08.020 INFO:teuthology.orchestra.run.smithi059.stdout:generic/305 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:30:08.039 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/305 2023-09-21T01:30:08.039 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/305 2023-09-21T01:30:08.039 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:30:08.066 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:30:08.107 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:30:08.107 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2023-09-21T01:30:08.333 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:30:08.337 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:30:08.337 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:30:08.338 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:30:08.338 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:30:09.395 INFO:teuthology.orchestra.run.smithi059.stdout:generic/306 1s 2023-09-21T01:30:09.405 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/306 2023-09-21T01:30:09.405 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:30:09.410 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:30:09.734 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:30:09.734 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2023-09-21T01:30:10.067 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:30:10.071 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:30:10.072 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:30:10.072 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:30:10.073 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:30:11.976 INFO:teuthology.orchestra.run.smithi059.stdout:generic/307 1s 2023-09-21T01:30:11.998 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/307 2023-09-21T01:30:11.999 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:30:12.001 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:30:12.009 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:30:12.009 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2023-09-21T01:30:12.231 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:30:12.234 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:30:12.235 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:30:12.236 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:30:12.236 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:30:12.632 INFO:teuthology.orchestra.run.smithi059.stdout:generic/308 0s 2023-09-21T01:30:12.767 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/308 2023-09-21T01:30:12.767 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:30:12.769 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:30:12.793 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:30:12.793 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2023-09-21T01:30:13.011 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:30:13.015 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:30:13.015 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:30:13.016 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:30:13.017 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:30:14.404 INFO:teuthology.orchestra.run.smithi059.stdout:generic/309 1s 2023-09-21T01:30:14.413 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/309 2023-09-21T01:30:14.413 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:30:14.415 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:30:14.710 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:30:14.711 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2023-09-21T01:30:15.089 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:30:15.115 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:30:15.116 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:30:15.117 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:30:15.117 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:31:32.061 INFO:teuthology.orchestra.run.smithi059.stdout:generic/310 77s 2023-09-21T01:31:32.068 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/310 2023-09-21T01:31:32.068 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:31:32.070 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:31:32.515 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:31:32.516 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2023-09-21T01:31:32.835 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:31:32.839 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:31:32.840 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:31:32.841 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:31:32.841 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:31:33.248 INFO:teuthology.orchestra.run.smithi059.stdout:generic/311 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T01:31:33.252 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/311 2023-09-21T01:31:33.252 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/311 2023-09-21T01:31:33.253 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:31:33.254 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:31:33.287 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:31:33.288 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2023-09-21T01:31:33.508 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:31:33.512 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:31:33.512 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:31:33.513 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:31:33.514 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:31:33.853 INFO:teuthology.orchestra.run.smithi059.stdout:generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-21T01:31:33.857 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/312 2023-09-21T01:31:33.857 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/312 2023-09-21T01:31:33.857 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:31:33.859 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:31:33.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:31:33.891 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2023-09-21T01:31:34.109 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:31:34.113 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:31:34.113 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:31:34.114 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:31:34.114 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:31:38.504 INFO:teuthology.orchestra.run.smithi059.stdout:generic/313 4s 2023-09-21T01:31:38.510 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/313 2023-09-21T01:31:38.510 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:31:38.513 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:31:38.552 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:31:38.553 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2023-09-21T01:31:38.786 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:31:38.790 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:31:38.791 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:31:38.792 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:31:38.792 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:31:39.692 INFO:teuthology.orchestra.run.smithi059.stdout:generic/314 1s 2023-09-21T01:31:39.697 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/314 2023-09-21T01:31:39.697 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:31:39.699 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:31:39.733 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:31:39.733 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2023-09-21T01:31:39.952 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:31:39.956 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:31:39.956 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:31:39.957 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:31:39.958 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:31:40.313 INFO:teuthology.orchestra.run.smithi059.stdout:generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-09-21T01:31:40.318 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/315 2023-09-21T01:31:40.318 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/315 2023-09-21T01:31:40.318 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:31:40.320 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:31:40.355 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:31:40.356 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2023-09-21T01:31:40.575 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:31:40.579 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:31:40.580 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:31:40.580 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:31:40.581 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:31:41.061 INFO:teuthology.orchestra.run.smithi059.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-21T01:31:41.065 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/316 2023-09-21T01:31:41.065 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/316 2023-09-21T01:31:41.065 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:31:41.067 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:31:41.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:31:41.460 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2023-09-21T01:31:41.692 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:31:41.696 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:31:41.697 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:31:41.698 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:31:41.698 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:31:45.398 INFO:teuthology.orchestra.run.smithi059.stdout:generic/317 4s 2023-09-21T01:31:45.404 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/317 2023-09-21T01:31:45.404 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:31:45.406 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:31:45.415 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:31:45.415 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2023-09-21T01:31:45.640 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:31:45.644 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:31:45.645 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:31:45.646 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:31:45.646 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:31:46.514 INFO:teuthology.orchestra.run.smithi059.stdout:generic/318 1s 2023-09-21T01:31:46.518 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/318 2023-09-21T01:31:46.518 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:31:46.520 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:31:46.529 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:31:46.529 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2023-09-21T01:31:46.751 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:31:46.755 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:31:46.756 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:31:46.757 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:31:46.757 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:31:47.357 INFO:teuthology.orchestra.run.smithi059.stdout:generic/319 1s 2023-09-21T01:31:47.362 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/319 2023-09-21T01:31:47.362 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:31:47.364 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:31:47.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:31:47.373 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2023-09-21T01:31:47.597 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:31:47.601 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:31:47.602 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:31:47.603 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:31:47.603 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:31:47.962 INFO:teuthology.orchestra.run.smithi059.stdout:generic/320 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-21T01:31:47.966 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/320 2023-09-21T01:31:47.966 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/320 2023-09-21T01:31:47.966 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:31:47.968 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:31:47.995 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:31:47.996 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2023-09-21T01:31:48.213 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:31:48.217 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:31:48.217 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:31:48.218 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:31:48.218 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:31:48.589 INFO:teuthology.orchestra.run.smithi059.stdout:generic/321 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T01:31:48.593 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/321 2023-09-21T01:31:48.593 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/321 2023-09-21T01:31:48.594 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:31:48.595 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:31:48.622 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:31:48.623 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2023-09-21T01:31:48.845 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:31:48.849 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:31:48.850 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:31:48.851 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:31:48.851 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:31:49.204 INFO:teuthology.orchestra.run.smithi059.stdout:generic/322 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T01:31:49.208 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/322 2023-09-21T01:31:49.208 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/322 2023-09-21T01:31:49.208 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:31:49.210 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:31:49.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:31:49.240 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2023-09-21T01:31:49.467 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:31:49.471 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:31:49.473 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:31:49.473 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:31:49.474 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:32:05.856 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:32:05.859 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:32:35.964 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:32:35.967 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:33:06.245 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:33:06.247 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:33:06.309 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-09-21T01:33:06.310+0000 7fadc2fd5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 366866) UID: 0 2023-09-21T01:33:06.310 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-09-21T01:33:06.310+0000 7f7948a08700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 366866) UID: 0 2023-09-21T01:33:06.310 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-09-21T01:33:06.310+0000 7f9692588700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 366866) UID: 0 2023-09-21T01:33:06.311 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-09-21T01:33:06.310+0000 7fc5c83b6700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 366866) UID: 0 2023-09-21T01:33:50.450 INFO:teuthology.orchestra.run.smithi059.stdout:generic/323 121s 2023-09-21T01:33:50.630 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/323 2023-09-21T01:33:50.630 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:33:50.632 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:33:51.046 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:33:51.047 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2023-09-21T01:33:51.359 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:33:51.363 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:33:51.364 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:33:51.365 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:33:51.365 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:33:51.693 INFO:teuthology.orchestra.run.smithi059.stdout:generic/324 [not run] defragmentation not supported for fstype "ceph" 2023-09-21T01:33:51.697 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/324 2023-09-21T01:33:51.697 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/324 2023-09-21T01:33:51.697 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:33:51.699 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:33:51.720 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:33:51.721 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2023-09-21T01:33:51.995 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:33:51.999 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:33:52.000 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:33:52.000 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:33:52.001 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:33:52.335 INFO:teuthology.orchestra.run.smithi059.stdout:generic/325 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T01:33:52.339 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/325 2023-09-21T01:33:52.339 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/325 2023-09-21T01:33:52.339 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:33:52.341 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:33:52.363 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:33:52.364 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2023-09-21T01:33:52.608 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:33:52.612 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:33:52.613 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:33:52.614 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:33:52.614 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:33:53.586 INFO:teuthology.orchestra.run.smithi059.stdout:generic/326 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:33:53.598 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/326 2023-09-21T01:33:53.598 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/326 2023-09-21T01:33:53.598 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:33:53.609 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:33:53.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:33:53.640 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2023-09-21T01:33:53.862 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:33:53.865 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:33:53.866 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:33:53.867 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:33:53.867 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:33:54.577 INFO:teuthology.orchestra.run.smithi059.stdout:generic/327 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:33:54.804 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/327 2023-09-21T01:33:54.804 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/327 2023-09-21T01:33:54.805 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:33:54.827 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:33:54.880 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:33:54.880 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2023-09-21T01:33:55.109 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:33:55.113 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:33:55.113 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:33:55.114 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:33:55.114 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:33:55.905 INFO:teuthology.orchestra.run.smithi059.stdout:generic/328 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:33:56.008 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/328 2023-09-21T01:33:56.009 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/328 2023-09-21T01:33:56.009 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:33:56.012 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:33:56.104 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:33:56.105 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2023-09-21T01:33:56.333 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:33:56.337 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:33:56.338 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:33:56.339 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:33:56.339 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:33:57.298 INFO:teuthology.orchestra.run.smithi059.stdout:generic/329 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:33:57.396 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/329 2023-09-21T01:33:57.396 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/329 2023-09-21T01:33:57.396 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:33:57.424 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:33:57.450 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:33:57.451 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2023-09-21T01:33:57.669 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:33:57.673 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:33:57.673 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:33:57.674 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:33:57.674 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:33:58.623 INFO:teuthology.orchestra.run.smithi059.stdout:generic/330 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:33:58.634 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/330 2023-09-21T01:33:58.635 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/330 2023-09-21T01:33:58.635 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:33:58.641 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:33:58.666 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:33:58.666 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2023-09-21T01:33:58.886 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:33:58.891 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:33:58.891 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:33:58.892 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:33:58.892 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:33:59.854 INFO:teuthology.orchestra.run.smithi059.stdout:generic/331 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:33:59.870 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/331 2023-09-21T01:33:59.870 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/331 2023-09-21T01:33:59.870 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:33:59.871 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:33:59.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:33:59.891 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2023-09-21T01:34:00.110 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:34:00.114 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:34:00.115 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:34:00.116 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:34:00.116 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:34:00.957 INFO:teuthology.orchestra.run.smithi059.stdout:generic/332 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:34:00.965 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/332 2023-09-21T01:34:00.965 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/332 2023-09-21T01:34:00.966 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:34:01.008 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:34:01.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:34:01.100 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2023-09-21T01:34:01.333 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:34:01.337 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:34:01.337 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:34:01.338 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:34:01.338 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:34:02.218 INFO:teuthology.orchestra.run.smithi059.stdout:generic/333 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:34:02.296 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/333 2023-09-21T01:34:02.297 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/333 2023-09-21T01:34:02.297 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:34:02.321 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:34:02.349 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:34:02.349 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2023-09-21T01:34:02.570 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:34:02.574 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:34:02.574 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:34:02.575 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:34:02.575 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:34:03.501 INFO:teuthology.orchestra.run.smithi059.stdout:generic/334 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:34:03.512 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/334 2023-09-21T01:34:03.513 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/334 2023-09-21T01:34:03.513 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:34:03.516 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:34:03.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:34:03.547 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2023-09-21T01:34:03.769 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:34:03.773 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:34:03.774 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:34:03.775 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:34:03.775 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:34:04.123 INFO:teuthology.orchestra.run.smithi059.stdout:generic/335 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T01:34:04.127 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/335 2023-09-21T01:34:04.127 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/335 2023-09-21T01:34:04.128 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:34:04.129 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:34:04.150 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:34:04.151 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2023-09-21T01:34:04.373 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:34:04.378 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:34:04.378 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:34:04.381 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:34:04.381 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:34:04.946 INFO:teuthology.orchestra.run.smithi059.stdout:generic/336 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T01:34:04.950 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/336 2023-09-21T01:34:04.950 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/336 2023-09-21T01:34:04.950 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:34:04.952 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:34:04.981 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:34:04.982 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2023-09-21T01:34:05.200 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:34:05.204 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:34:05.204 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:34:05.205 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:34:05.205 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:34:06.064 INFO:teuthology.orchestra.run.smithi059.stdout:generic/337 1s 2023-09-21T01:34:06.198 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/337 2023-09-21T01:34:06.198 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:34:06.200 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:34:06.208 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:34:06.209 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2023-09-21T01:34:06.439 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:34:06.443 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:34:06.443 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:34:06.444 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:34:06.444 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:34:06.794 INFO:teuthology.orchestra.run.smithi059.stdout:generic/338 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T01:34:06.799 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/338 2023-09-21T01:34:06.799 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/338 2023-09-21T01:34:06.799 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:34:06.801 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:34:06.825 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:34:06.825 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2023-09-21T01:34:07.052 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:34:07.055 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:34:07.056 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:34:07.057 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:34:07.057 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:03.320 INFO:teuthology.orchestra.run.smithi059.stdout:generic/339 56s 2023-09-21T01:35:03.373 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/339 2023-09-21T01:35:03.373 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:35:03.375 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:03.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:35:03.385 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2023-09-21T01:35:03.848 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:35:03.852 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:35:03.853 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:35:03.854 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:35:03.854 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:07.061 INFO:teuthology.orchestra.run.smithi059.stdout:generic/340 2s 2023-09-21T01:35:07.120 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/340 2023-09-21T01:35:07.120 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:35:07.123 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:07.134 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:35:07.135 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2023-09-21T01:35:07.360 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:35:07.365 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:35:07.365 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:35:07.366 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:35:07.366 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:08.040 INFO:teuthology.orchestra.run.smithi059.stdout:generic/341 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T01:35:08.045 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/341 2023-09-21T01:35:08.045 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/341 2023-09-21T01:35:08.045 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:35:08.047 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:08.077 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:35:08.078 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2023-09-21T01:35:08.301 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:35:08.305 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:35:08.305 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:35:08.306 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:35:08.306 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:08.667 INFO:teuthology.orchestra.run.smithi059.stdout:generic/342 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T01:35:08.671 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/342 2023-09-21T01:35:08.672 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/342 2023-09-21T01:35:08.672 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:35:08.674 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:08.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:35:08.701 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2023-09-21T01:35:08.922 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:35:08.926 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:35:08.927 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:35:08.928 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:35:08.928 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:09.301 INFO:teuthology.orchestra.run.smithi059.stdout:generic/343 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T01:35:09.305 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/343 2023-09-21T01:35:09.306 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/343 2023-09-21T01:35:09.306 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:35:09.307 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:09.339 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:35:09.339 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2023-09-21T01:35:09.588 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:35:09.592 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:35:09.593 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:35:09.593 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:35:09.594 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:14.544 INFO:teuthology.orchestra.run.smithi059.stdout:generic/344 5s 2023-09-21T01:35:14.554 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/344 2023-09-21T01:35:14.555 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:35:14.558 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:14.871 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:35:14.872 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2023-09-21T01:35:15.440 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:35:15.445 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:35:15.445 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:35:15.446 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:35:15.446 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:21.214 INFO:teuthology.orchestra.run.smithi059.stdout:generic/345 6s 2023-09-21T01:35:21.371 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/345 2023-09-21T01:35:21.371 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:35:21.381 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:21.399 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:35:21.400 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2023-09-21T01:35:21.957 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:35:21.963 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:35:21.964 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:35:21.965 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:35:21.965 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:25.545 INFO:teuthology.orchestra.run.smithi059.stdout:generic/346 3s 2023-09-21T01:35:25.555 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/346 2023-09-21T01:35:25.556 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:35:25.562 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:25.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:35:25.582 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2023-09-21T01:35:26.017 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:35:26.039 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:35:26.040 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:35:26.041 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:35:26.042 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:26.484 INFO:teuthology.orchestra.run.smithi059.stdout:generic/347 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T01:35:26.488 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/347 2023-09-21T01:35:26.488 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/347 2023-09-21T01:35:26.489 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:35:26.490 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:26.513 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:35:26.513 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2023-09-21T01:35:26.740 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:35:26.744 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:35:26.745 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:35:26.746 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:35:26.746 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:27.119 INFO:teuthology.orchestra.run.smithi059.stdout:generic/348 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T01:35:27.124 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/348 2023-09-21T01:35:27.124 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/348 2023-09-21T01:35:27.124 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:35:27.126 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:27.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:35:27.162 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2023-09-21T01:35:27.380 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:35:27.384 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:35:27.385 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:35:27.386 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:35:27.386 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:27.847 INFO:teuthology.orchestra.run.smithi059.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-09-21T01:35:27.851 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/349 2023-09-21T01:35:27.851 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/349 2023-09-21T01:35:27.852 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:35:27.853 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:27.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:35:27.891 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2023-09-21T01:35:28.111 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:35:28.115 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:35:28.115 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:35:28.116 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:35:28.117 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:29.048 INFO:teuthology.orchestra.run.smithi059.stdout:generic/350 1s 2023-09-21T01:35:29.053 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/350 2023-09-21T01:35:29.053 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:35:29.055 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:29.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:35:29.064 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2023-09-21T01:35:29.289 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:35:29.293 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:35:29.294 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:35:29.295 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:35:29.295 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:29.675 INFO:teuthology.orchestra.run.smithi059.stdout:generic/351 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-21T01:35:29.679 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/351 2023-09-21T01:35:29.679 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/351 2023-09-21T01:35:29.680 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:35:29.681 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:29.714 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:35:29.715 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2023-09-21T01:35:29.938 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:35:29.942 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:35:29.942 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:35:29.943 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:35:29.943 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:30.982 INFO:teuthology.orchestra.run.smithi059.stdout:generic/352 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:35:31.002 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/352 2023-09-21T01:35:31.003 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/352 2023-09-21T01:35:31.003 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:35:31.007 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:31.087 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:35:31.088 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2023-09-21T01:35:31.312 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:35:31.316 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:35:31.316 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:35:31.317 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:35:31.318 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:32.214 INFO:teuthology.orchestra.run.smithi059.stdout:generic/353 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:35:32.237 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/353 2023-09-21T01:35:32.238 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/353 2023-09-21T01:35:32.238 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:35:32.240 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:32.271 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:35:32.272 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2023-09-21T01:35:32.497 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:35:32.501 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:35:32.501 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:35:32.502 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:35:32.502 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:37.806 INFO:teuthology.orchestra.run.smithi059.stdout:generic/354 5s 2023-09-21T01:35:37.818 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/354 2023-09-21T01:35:37.818 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:35:37.821 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:37.834 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:35:37.835 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2023-09-21T01:35:38.182 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:35:38.187 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:35:38.187 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:35:38.188 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:35:38.188 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:39.193 INFO:teuthology.orchestra.run.smithi059.stdout:generic/355 1s 2023-09-21T01:35:39.197 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/355 2023-09-21T01:35:39.198 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:35:39.200 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:39.481 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:35:39.481 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2023-09-21T01:35:39.821 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:35:39.825 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:35:39.826 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:35:39.827 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:35:39.827 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:40.456 INFO:teuthology.orchestra.run.smithi059.stdout:generic/356 [not run] swapfiles are not supported 2023-09-21T01:35:40.460 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/356 2023-09-21T01:35:40.460 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/356 2023-09-21T01:35:40.460 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:35:40.462 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:40.496 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:35:40.497 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2023-09-21T01:35:40.717 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:35:40.720 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:35:40.721 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:35:40.722 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:35:40.722 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:41.327 INFO:teuthology.orchestra.run.smithi059.stdout:generic/357 [not run] swapfiles are not supported 2023-09-21T01:35:41.331 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/357 2023-09-21T01:35:41.332 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/357 2023-09-21T01:35:41.332 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:35:41.333 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:41.362 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:35:41.365 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2023-09-21T01:35:41.585 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:35:41.589 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:35:41.589 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:35:41.590 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:35:41.590 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:42.447 INFO:teuthology.orchestra.run.smithi059.stdout:generic/358 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:35:42.515 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/358 2023-09-21T01:35:42.515 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/358 2023-09-21T01:35:42.516 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:35:42.523 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:42.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:35:42.585 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2023-09-21T01:35:42.815 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:35:42.819 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:35:42.820 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:35:42.821 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:35:42.821 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:43.573 INFO:teuthology.orchestra.run.smithi059.stdout:generic/359 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:35:43.627 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/359 2023-09-21T01:35:43.627 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/359 2023-09-21T01:35:43.627 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:35:43.746 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:43.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:35:43.797 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2023-09-21T01:35:44.016 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:35:44.021 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:35:44.021 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:35:44.022 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:35:44.022 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:44.414 INFO:teuthology.orchestra.run.smithi059.stdout:generic/360 0s 2023-09-21T01:35:44.418 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/360 2023-09-21T01:35:44.419 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:35:44.421 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:44.462 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:35:44.463 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2023-09-21T01:35:44.690 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:35:44.694 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:35:44.694 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:35:44.695 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:35:44.696 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:45.035 INFO:teuthology.orchestra.run.smithi059.stdout:generic/361 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T01:35:45.039 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/361 2023-09-21T01:35:45.040 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/361 2023-09-21T01:35:45.040 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:35:45.041 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:45.070 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:35:45.070 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2023-09-21T01:35:45.291 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:35:45.296 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:35:45.296 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:35:45.297 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:35:45.297 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:45.639 INFO:teuthology.orchestra.run.smithi059.stdout:generic/362 [not run] this test requires richacl support on $SCRATCH_DEV 2023-09-21T01:35:45.643 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/362 2023-09-21T01:35:45.643 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/362 2023-09-21T01:35:45.643 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:35:45.645 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:45.670 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:35:45.671 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2023-09-21T01:35:45.894 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:35:45.898 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:35:45.899 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:35:45.900 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:35:45.900 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:46.226 INFO:teuthology.orchestra.run.smithi059.stdout:generic/363 [not run] this test requires richacl support on $SCRATCH_DEV 2023-09-21T01:35:46.230 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/363 2023-09-21T01:35:46.230 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/363 2023-09-21T01:35:46.231 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:35:46.232 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:46.264 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:35:46.265 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2023-09-21T01:35:46.485 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:35:46.489 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:35:46.490 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:35:46.491 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:35:46.491 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:46.833 INFO:teuthology.orchestra.run.smithi059.stdout:generic/364 [not run] this test requires richacl support on $SCRATCH_DEV 2023-09-21T01:35:46.837 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/364 2023-09-21T01:35:46.837 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/364 2023-09-21T01:35:46.837 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:35:46.839 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:46.863 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:35:46.863 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2023-09-21T01:35:47.084 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:35:47.088 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:35:47.088 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:35:47.089 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:35:47.089 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:47.422 INFO:teuthology.orchestra.run.smithi059.stdout:generic/365 [not run] this test requires richacl support on $SCRATCH_DEV 2023-09-21T01:35:47.426 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/365 2023-09-21T01:35:47.426 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/365 2023-09-21T01:35:47.427 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:35:47.428 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:47.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:35:47.452 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2023-09-21T01:35:47.673 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:35:47.677 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:35:47.678 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:35:47.679 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:35:47.679 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:48.010 INFO:teuthology.orchestra.run.smithi059.stdout:generic/366 [not run] this test requires richacl support on $SCRATCH_DEV 2023-09-21T01:35:48.014 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/366 2023-09-21T01:35:48.014 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/366 2023-09-21T01:35:48.015 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:35:48.016 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:48.043 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:35:48.044 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2023-09-21T01:35:48.270 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:35:48.275 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:35:48.275 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:35:48.276 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:35:48.276 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:48.620 INFO:teuthology.orchestra.run.smithi059.stdout:generic/367 [not run] this test requires richacl support on $SCRATCH_DEV 2023-09-21T01:35:48.624 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/367 2023-09-21T01:35:48.624 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/367 2023-09-21T01:35:48.624 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:35:48.626 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:48.650 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:35:48.651 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2023-09-21T01:35:48.870 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:35:48.874 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:35:48.874 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:35:48.875 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:35:48.876 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:49.217 INFO:teuthology.orchestra.run.smithi059.stdout:generic/368 [not run] this test requires richacl support on $SCRATCH_DEV 2023-09-21T01:35:49.222 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/368 2023-09-21T01:35:49.222 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/368 2023-09-21T01:35:49.222 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:35:49.224 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:49.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:35:49.248 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2023-09-21T01:35:49.467 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:35:49.471 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:35:49.472 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:35:49.473 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:35:49.473 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:49.808 INFO:teuthology.orchestra.run.smithi059.stdout:generic/369 [not run] this test requires richacl support on $SCRATCH_DEV 2023-09-21T01:35:49.812 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/369 2023-09-21T01:35:49.812 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/369 2023-09-21T01:35:49.813 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:35:49.814 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:49.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:35:49.840 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2023-09-21T01:35:50.060 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:35:50.064 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:35:50.065 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:35:50.066 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:35:50.066 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:50.403 INFO:teuthology.orchestra.run.smithi059.stdout:generic/370 [not run] this test requires richacl support on $SCRATCH_DEV 2023-09-21T01:35:50.407 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/370 2023-09-21T01:35:50.408 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/370 2023-09-21T01:35:50.408 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:35:50.409 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:50.436 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:35:50.437 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2023-09-21T01:35:50.657 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:35:50.661 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:35:50.662 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:35:50.663 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:35:50.663 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:51.023 INFO:teuthology.orchestra.run.smithi059.stdout:generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-21T01:35:51.028 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/371 2023-09-21T01:35:51.028 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/371 2023-09-21T01:35:51.028 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:35:51.030 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:51.070 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:35:51.070 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2023-09-21T01:35:51.290 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:35:51.294 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:35:51.295 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:35:51.296 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:35:51.296 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:52.055 INFO:teuthology.orchestra.run.smithi059.stdout:generic/372 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:35:52.068 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/372 2023-09-21T01:35:52.068 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/372 2023-09-21T01:35:52.069 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:35:52.206 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:52.302 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:35:52.303 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2023-09-21T01:35:52.521 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:35:52.525 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:35:52.525 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:35:52.526 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:35:52.526 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:53.410 INFO:teuthology.orchestra.run.smithi059.stdout:generic/373 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:35:53.449 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/373 2023-09-21T01:35:53.449 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/373 2023-09-21T01:35:53.450 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:35:53.456 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:53.499 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:35:53.499 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2023-09-21T01:35:53.720 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:35:53.724 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:35:53.725 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:35:53.726 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:35:53.726 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:54.278 INFO:teuthology.orchestra.run.smithi059.stdout:generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-09-21T01:35:54.655 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/374 2023-09-21T01:35:54.655 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/374 2023-09-21T01:35:54.656 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:35:54.660 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:54.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:35:54.722 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2023-09-21T01:35:54.940 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:35:54.944 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:35:54.945 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:35:54.946 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:35:54.946 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:55.365 INFO:teuthology.orchestra.run.smithi059.stdout:generic/375 0s 2023-09-21T01:35:55.371 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/375 2023-09-21T01:35:55.371 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:35:55.373 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:55.661 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:35:55.662 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2023-09-21T01:35:56.004 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:35:56.008 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:35:56.009 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:35:56.010 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:35:56.010 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:56.049 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:35:56.055 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:35:56.124 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-09-21T01:35:56.124+0000 7fe56ff7b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119034) UID: 0 2023-09-21T01:35:56.124 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-09-21T01:35:56.124+0000 7fae7ed95700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119034) UID: 0 2023-09-21T01:35:56.125 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-09-21T01:35:56.124+0000 7f6a304c5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119034) UID: 0 2023-09-21T01:35:56.125 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-09-21T01:35:56.124+0000 7fceb8335700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119034) UID: 0 2023-09-21T01:35:56.352 INFO:teuthology.orchestra.run.smithi059.stdout:generic/376 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T01:35:56.356 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/376 2023-09-21T01:35:56.356 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/376 2023-09-21T01:35:56.356 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:35:56.358 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:56.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:35:56.391 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2023-09-21T01:35:56.612 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:35:56.616 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:35:56.616 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:35:56.617 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:35:56.618 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:57.232 INFO:teuthology.orchestra.run.smithi059.stdout:generic/377 1s 2023-09-21T01:35:57.238 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/377 2023-09-21T01:35:57.238 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:35:57.240 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:57.248 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:35:57.249 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2023-09-21T01:35:57.476 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:35:57.480 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:35:57.481 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:35:57.481 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:35:57.482 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:57.963 INFO:teuthology.orchestra.run.smithi059.stdout:generic/378 0s 2023-09-21T01:35:57.975 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/378 2023-09-21T01:35:57.975 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:35:57.976 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:58.393 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:35:58.394 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2023-09-21T01:35:58.625 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:35:58.629 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:35:58.630 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:35:58.631 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:35:58.631 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:58.986 INFO:teuthology.orchestra.run.smithi059.stdout:generic/379 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-21T01:35:58.991 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/379 2023-09-21T01:35:58.991 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/379 2023-09-21T01:35:58.991 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:35:58.993 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:59.016 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:35:59.016 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2023-09-21T01:35:59.241 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:35:59.245 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:35:59.246 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:35:59.247 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:35:59.247 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:59.588 INFO:teuthology.orchestra.run.smithi059.stdout:generic/380 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-21T01:35:59.592 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/380 2023-09-21T01:35:59.592 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/380 2023-09-21T01:35:59.592 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:35:59.594 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:35:59.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:35:59.621 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2023-09-21T01:35:59.841 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:35:59.846 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:35:59.846 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:35:59.847 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:35:59.847 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:00.187 INFO:teuthology.orchestra.run.smithi059.stdout:generic/381 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-21T01:36:00.191 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/381 2023-09-21T01:36:00.192 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/381 2023-09-21T01:36:00.192 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:36:00.193 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:00.218 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:36:00.219 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2023-09-21T01:36:00.439 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:36:00.443 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:36:00.443 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:36:00.444 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:36:00.444 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:00.794 INFO:teuthology.orchestra.run.smithi059.stdout:generic/382 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-21T01:36:00.798 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/382 2023-09-21T01:36:00.798 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/382 2023-09-21T01:36:00.799 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:36:00.800 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:00.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:36:00.827 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2023-09-21T01:36:01.049 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:36:01.053 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:36:01.054 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:36:01.055 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:36:01.056 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:01.401 INFO:teuthology.orchestra.run.smithi059.stdout:generic/383 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-21T01:36:01.406 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/383 2023-09-21T01:36:01.406 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/383 2023-09-21T01:36:01.406 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:36:01.408 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:01.431 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:36:01.432 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2023-09-21T01:36:01.656 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:36:01.660 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:36:01.660 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:36:01.661 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:36:01.662 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:02.007 INFO:teuthology.orchestra.run.smithi059.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-21T01:36:02.011 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/384 2023-09-21T01:36:02.011 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/384 2023-09-21T01:36:02.011 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:36:02.013 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:02.037 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:36:02.037 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2023-09-21T01:36:02.261 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:36:02.265 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:36:02.266 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:36:02.267 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:36:02.267 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:02.611 INFO:teuthology.orchestra.run.smithi059.stdout:generic/385 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-21T01:36:02.615 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/385 2023-09-21T01:36:02.616 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/385 2023-09-21T01:36:02.616 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:36:02.618 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:02.650 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:36:02.650 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2023-09-21T01:36:02.879 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:36:02.885 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:36:02.886 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:36:02.886 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:36:02.886 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:03.210 INFO:teuthology.orchestra.run.smithi059.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-21T01:36:03.214 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/386 2023-09-21T01:36:03.214 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/386 2023-09-21T01:36:03.214 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:36:03.216 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:03.245 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:36:03.245 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2023-09-21T01:36:03.463 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:36:03.468 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:36:03.468 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:36:03.469 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:36:03.469 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:04.351 INFO:teuthology.orchestra.run.smithi059.stdout:generic/387 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:36:04.396 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/387 2023-09-21T01:36:04.396 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/387 2023-09-21T01:36:04.396 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:36:04.409 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:04.452 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:36:04.453 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2023-09-21T01:36:04.673 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:36:04.679 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:36:04.680 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:36:04.680 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:36:04.680 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:05.038 INFO:teuthology.orchestra.run.smithi059.stdout:generic/388 [not run] require 172.21.15.59:6789:/scratch to be local device 2023-09-21T01:36:05.042 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/388 2023-09-21T01:36:05.042 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/388 2023-09-21T01:36:05.042 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:36:05.044 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:05.075 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:36:05.076 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2023-09-21T01:36:05.295 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:36:05.299 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:36:05.300 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:36:05.300 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:36:05.301 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:05.651 INFO:teuthology.orchestra.run.smithi059.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-09-21T01:36:05.655 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/389 2023-09-21T01:36:05.655 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/389 2023-09-21T01:36:05.656 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:36:05.657 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:05.684 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:36:05.685 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2023-09-21T01:36:05.905 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:36:05.909 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:36:05.910 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:36:05.910 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:36:05.911 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:06.270 INFO:teuthology.orchestra.run.smithi059.stdout:generic/390 [not run] ceph does not support freezing 2023-09-21T01:36:06.274 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/390 2023-09-21T01:36:06.274 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/390 2023-09-21T01:36:06.274 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:36:06.276 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:06.305 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:36:06.306 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2023-09-21T01:36:06.525 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:36:06.529 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:36:06.529 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:36:06.530 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:36:06.530 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:06.896 INFO:teuthology.orchestra.run.smithi059.stdout:generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-21T01:36:06.900 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/391 2023-09-21T01:36:06.900 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/391 2023-09-21T01:36:06.901 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:36:06.902 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:06.937 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:36:06.937 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2023-09-21T01:36:07.161 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:36:07.165 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:36:07.166 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:36:07.168 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:36:07.168 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:07.675 INFO:teuthology.orchestra.run.smithi059.stdout:generic/392 [not run] ceph does not support shutdown 2023-09-21T01:36:07.698 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/392 2023-09-21T01:36:07.698 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/392 2023-09-21T01:36:07.699 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:36:07.700 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:07.732 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:36:07.733 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2023-09-21T01:36:07.954 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:36:07.958 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:36:07.959 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:36:07.960 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:36:07.960 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:09.131 INFO:teuthology.orchestra.run.smithi059.stdout:generic/393 1s 2023-09-21T01:36:09.136 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/393 2023-09-21T01:36:09.136 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:36:09.138 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:09.147 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:36:09.148 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2023-09-21T01:36:09.367 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:36:09.371 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:36:09.372 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:36:09.372 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:36:09.373 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:09.757 INFO:teuthology.orchestra.run.smithi059.stdout:generic/394 0s 2023-09-21T01:36:09.762 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/394 2023-09-21T01:36:09.762 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:36:09.764 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:10.158 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:36:10.159 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2023-09-21T01:36:10.404 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:36:10.409 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:36:10.409 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:36:10.410 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:36:10.410 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:11.174 INFO:teuthology.orchestra.run.smithi059.stdout:generic/395 [not run] kernel does not support ceph encryption 2023-09-21T01:36:11.199 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/395 2023-09-21T01:36:11.200 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/395 2023-09-21T01:36:11.200 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:36:11.202 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:11.238 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:36:11.239 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2023-09-21T01:36:11.561 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:36:11.566 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:36:11.566 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:36:11.567 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:36:11.567 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:12.337 INFO:teuthology.orchestra.run.smithi059.stdout:generic/396 [not run] kernel does not support ceph encryption 2023-09-21T01:36:12.360 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/396 2023-09-21T01:36:12.360 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/396 2023-09-21T01:36:12.361 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:36:12.362 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:12.383 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:36:12.383 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2023-09-21T01:36:12.604 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:36:12.608 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:36:12.609 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:36:12.610 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:36:12.610 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:13.199 INFO:teuthology.orchestra.run.smithi059.stdout:generic/397 [not run] kernel does not support ceph encryption 2023-09-21T01:36:13.226 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/397 2023-09-21T01:36:13.226 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/397 2023-09-21T01:36:13.227 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:36:13.228 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:13.255 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:36:13.256 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2023-09-21T01:36:13.480 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:36:13.484 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:36:13.485 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:36:13.486 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:36:13.486 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:14.057 INFO:teuthology.orchestra.run.smithi059.stdout:generic/398 [not run] kernel does not support ceph encryption 2023-09-21T01:36:14.083 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/398 2023-09-21T01:36:14.083 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/398 2023-09-21T01:36:14.083 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:36:14.085 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:14.109 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:36:14.109 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2023-09-21T01:36:14.337 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:36:14.341 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:36:14.342 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:36:14.343 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:36:14.343 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:14.912 INFO:teuthology.orchestra.run.smithi059.stdout:generic/399 [not run] kernel does not support ceph encryption 2023-09-21T01:36:14.935 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/399 2023-09-21T01:36:14.935 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/399 2023-09-21T01:36:14.936 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:36:14.937 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:14.970 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:36:14.971 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2023-09-21T01:36:15.190 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:36:15.194 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:36:15.195 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:36:15.196 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:36:15.196 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:15.532 INFO:teuthology.orchestra.run.smithi059.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-21T01:36:15.536 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/400 2023-09-21T01:36:15.536 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/400 2023-09-21T01:36:15.536 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:36:15.538 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:15.566 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:36:15.566 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2023-09-21T01:36:15.786 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:36:15.790 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:36:15.790 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:36:15.791 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:36:15.791 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:16.769 INFO:teuthology.orchestra.run.smithi059.stdout:generic/401 1s 2023-09-21T01:36:16.778 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/401 2023-09-21T01:36:16.779 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:36:16.780 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:16.790 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:36:16.790 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2023-09-21T01:36:17.022 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:36:17.026 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:36:17.029 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:36:17.029 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:36:17.030 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:17.596 INFO:teuthology.orchestra.run.smithi059.stdout:generic/402 [not run] filesystem ceph timestamp bounds are unknown 2023-09-21T01:36:17.622 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/402 2023-09-21T01:36:17.622 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/402 2023-09-21T01:36:17.623 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:36:17.624 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:17.654 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:36:17.654 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2023-09-21T01:36:17.876 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:36:17.880 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:36:17.881 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:36:17.882 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:36:17.882 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:18.632 INFO:teuthology.orchestra.run.smithi059.stdout:generic/403 0s 2023-09-21T01:36:18.637 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/403 2023-09-21T01:36:18.637 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:36:18.639 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:18.648 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:36:18.648 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2023-09-21T01:36:18.870 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:36:18.874 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:36:18.875 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:36:18.875 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:36:18.875 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:19.239 INFO:teuthology.orchestra.run.smithi059.stdout:generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-21T01:36:19.243 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/404 2023-09-21T01:36:19.243 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/404 2023-09-21T01:36:19.243 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:36:19.245 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:19.285 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:36:19.286 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2023-09-21T01:36:19.509 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:36:19.513 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:36:19.514 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:36:19.515 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:36:19.515 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:19.903 INFO:teuthology.orchestra.run.smithi059.stdout:generic/405 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T01:36:19.907 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/405 2023-09-21T01:36:19.907 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/405 2023-09-21T01:36:19.907 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:36:19.909 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:19.939 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:36:19.939 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2023-09-21T01:36:20.161 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:36:20.166 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:36:20.166 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:36:20.167 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:36:20.167 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:22.046 INFO:teuthology.orchestra.run.smithi059.stdout:generic/406 2s 2023-09-21T01:36:22.051 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/406 2023-09-21T01:36:22.051 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:36:22.053 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:22.062 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:36:22.063 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2023-09-21T01:36:22.284 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:36:22.288 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:36:22.288 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:36:22.289 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:36:22.289 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:22.713 INFO:teuthology.orchestra.run.smithi059.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph 2023-09-21T01:36:22.717 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/407 2023-09-21T01:36:22.718 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/407 2023-09-21T01:36:22.718 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:36:22.720 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:22.994 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:36:22.995 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2023-09-21T01:36:23.334 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:36:23.338 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:36:23.339 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:36:23.340 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:36:23.340 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:23.725 INFO:teuthology.orchestra.run.smithi059.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph 2023-09-21T01:36:23.729 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/408 2023-09-21T01:36:23.729 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/408 2023-09-21T01:36:23.730 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:36:23.731 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:24.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:36:24.129 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2023-09-21T01:36:24.364 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:36:24.368 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:36:24.368 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:36:24.369 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:36:24.370 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:24.719 INFO:teuthology.orchestra.run.smithi059.stdout:generic/409 [not run] require 172.21.15.59:6789:/scratch to be local device 2023-09-21T01:36:24.723 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/409 2023-09-21T01:36:24.724 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/409 2023-09-21T01:36:24.724 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:36:24.725 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:24.749 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:36:24.750 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2023-09-21T01:36:24.974 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:36:24.978 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:36:24.978 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:36:24.979 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:36:24.980 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:25.314 INFO:teuthology.orchestra.run.smithi059.stdout:generic/410 [not run] require 172.21.15.59:6789:/scratch to be local device 2023-09-21T01:36:25.318 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/410 2023-09-21T01:36:25.318 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/410 2023-09-21T01:36:25.319 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:36:25.320 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:25.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:36:25.347 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2023-09-21T01:36:25.570 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:36:25.574 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:36:25.574 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:36:25.575 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:36:25.575 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:25.929 INFO:teuthology.orchestra.run.smithi059.stdout:generic/411 [not run] require 172.21.15.59:6789:/scratch to be local device 2023-09-21T01:36:25.934 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/411 2023-09-21T01:36:25.934 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/411 2023-09-21T01:36:25.934 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:36:25.935 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:25.969 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:36:25.970 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2023-09-21T01:36:26.193 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:36:26.197 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:36:26.198 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:36:26.199 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:36:26.199 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:26.961 INFO:teuthology.orchestra.run.smithi059.stdout:generic/412 0s 2023-09-21T01:36:26.966 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/412 2023-09-21T01:36:26.966 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:36:26.968 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:26.977 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:36:26.977 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2023-09-21T01:36:27.198 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:36:27.202 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:36:27.203 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:36:27.204 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:36:27.204 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:27.691 INFO:teuthology.orchestra.run.smithi059.stdout:generic/413 [not run] mount 172.21.15.59:6789:/scratch with dax failed 2023-09-21T01:36:27.697 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/413 2023-09-21T01:36:27.698 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/413 2023-09-21T01:36:27.698 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:36:27.698 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:27.724 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:36:27.724 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2023-09-21T01:36:27.941 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:36:27.945 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:36:27.946 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:36:27.947 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:36:27.947 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:28.627 INFO:teuthology.orchestra.run.smithi059.stdout:generic/414 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:36:28.633 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/414 2023-09-21T01:36:28.633 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/414 2023-09-21T01:36:28.634 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:36:28.651 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:28.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:36:28.962 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2023-09-21T01:36:29.181 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:36:29.185 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:36:29.186 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:36:29.187 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:36:29.187 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:30.105 INFO:teuthology.orchestra.run.smithi059.stdout:generic/415 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:36:30.134 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/415 2023-09-21T01:36:30.134 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/415 2023-09-21T01:36:30.134 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:36:30.140 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:30.181 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:36:30.181 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2023-09-21T01:36:30.404 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:36:30.408 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:36:30.409 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:36:30.410 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:36:30.410 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:30.752 INFO:teuthology.orchestra.run.smithi059.stdout:generic/416 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-21T01:36:30.757 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/416 2023-09-21T01:36:30.758 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/416 2023-09-21T01:36:30.758 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:36:30.758 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:30.781 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:36:30.781 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2023-09-21T01:36:31.002 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:36:31.006 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:36:31.007 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:36:31.008 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:36:31.008 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:31.515 INFO:teuthology.orchestra.run.smithi059.stdout:generic/417 [not run] ceph does not support shutdown 2023-09-21T01:36:31.536 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/417 2023-09-21T01:36:31.537 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/417 2023-09-21T01:36:31.537 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:36:31.538 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:31.564 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:36:31.564 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2023-09-21T01:36:31.786 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:36:31.790 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:36:31.790 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:36:31.791 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:36:31.791 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:32.170 INFO:teuthology.orchestra.run.smithi059.stdout:generic/418 [not run] require 172.21.15.59:6789:/test to be valid block disk 2023-09-21T01:36:32.174 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/418 2023-09-21T01:36:32.175 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/418 2023-09-21T01:36:32.175 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:36:32.176 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:32.210 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:36:32.211 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2023-09-21T01:36:32.437 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:36:32.441 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:36:32.441 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:36:32.442 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:36:32.443 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:33.011 INFO:teuthology.orchestra.run.smithi059.stdout:generic/419 [not run] kernel does not support ceph encryption 2023-09-21T01:36:33.035 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/419 2023-09-21T01:36:33.036 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/419 2023-09-21T01:36:33.036 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:36:33.037 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:33.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:36:33.064 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2023-09-21T01:36:33.284 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:36:33.288 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:36:33.288 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:36:33.289 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:36:33.289 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:33.775 INFO:teuthology.orchestra.run.smithi059.stdout:generic/420 0s 2023-09-21T01:36:33.779 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/420 2023-09-21T01:36:33.780 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:36:33.782 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:34.153 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:36:34.154 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2023-09-21T01:36:34.408 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:36:34.411 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:36:34.412 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:36:34.413 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:36:34.413 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:34.984 INFO:teuthology.orchestra.run.smithi059.stdout:generic/421 [not run] kernel does not support ceph encryption 2023-09-21T01:36:35.009 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/421 2023-09-21T01:36:35.009 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/421 2023-09-21T01:36:35.009 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:36:35.011 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:35.034 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:36:35.035 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2023-09-21T01:36:35.256 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:36:35.260 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:36:35.261 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:36:35.262 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:36:35.262 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:35.622 INFO:teuthology.orchestra.run.smithi059.stdout:generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-09-21T01:36:35.626 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/422 2023-09-21T01:36:35.627 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/422 2023-09-21T01:36:35.627 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:36:35.629 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:35.658 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:36:35.659 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2023-09-21T01:36:35.887 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:36:35.891 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:36:35.891 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:36:35.892 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:36:35.893 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:36.317 INFO:teuthology.orchestra.run.smithi059.stdout:generic/423 0s 2023-09-21T01:36:36.322 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/423 2023-09-21T01:36:36.323 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:36:36.325 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:36.738 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:36:36.738 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2023-09-21T01:36:36.974 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:36:36.978 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:36:36.979 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:36:36.980 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:36:36.980 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:37.335 INFO:teuthology.orchestra.run.smithi059.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2023-09-21T01:36:37.339 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/424 2023-09-21T01:36:37.339 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/424 2023-09-21T01:36:37.339 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:36:37.341 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:37.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:36:37.388 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2023-09-21T01:36:37.610 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:36:37.614 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:36:37.615 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:36:37.616 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:36:37.616 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:37.996 INFO:teuthology.orchestra.run.smithi059.stdout:generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) 2023-09-21T01:36:38.000 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/425 2023-09-21T01:36:38.000 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/425 2023-09-21T01:36:38.000 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:36:38.002 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:36:38.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:36:38.375 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2023-09-21T01:36:38.629 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:36:38.633 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:36:38.634 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:36:38.635 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:36:38.635 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:37:27.081 INFO:teuthology.orchestra.run.smithi059.stdout:generic/426 48s 2023-09-21T01:37:27.173 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/426 2023-09-21T01:37:27.173 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:37:27.175 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:37:27.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:37:27.593 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2023-09-21T01:37:28.594 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:37:28.599 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:37:28.599 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:37:28.600 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:37:28.600 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:37:29.038 INFO:teuthology.orchestra.run.smithi059.stdout:generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-21T01:37:29.042 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/427 2023-09-21T01:37:29.042 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/427 2023-09-21T01:37:29.042 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:37:29.044 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:37:29.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:37:29.069 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2023-09-21T01:37:29.294 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:37:29.298 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:37:29.298 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:37:29.299 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:37:29.300 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:37:29.662 INFO:teuthology.orchestra.run.smithi059.stdout:generic/428 0s 2023-09-21T01:37:29.667 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/428 2023-09-21T01:37:29.667 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:37:29.669 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:37:29.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:37:29.697 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2023-09-21T01:37:29.920 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:37:29.924 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:37:29.925 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:37:29.926 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:37:29.926 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:37:30.505 INFO:teuthology.orchestra.run.smithi059.stdout:generic/429 [not run] kernel does not support ceph encryption 2023-09-21T01:37:30.521 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/429 2023-09-21T01:37:30.521 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/429 2023-09-21T01:37:30.521 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:37:30.523 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:37:30.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:37:30.549 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2023-09-21T01:37:30.768 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:37:30.772 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:37:30.772 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:37:30.773 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:37:30.774 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:37:31.200 INFO:teuthology.orchestra.run.smithi059.stdout:generic/430 1s 2023-09-21T01:37:31.205 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/430 2023-09-21T01:37:31.205 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:37:31.207 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:37:31.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:37:31.582 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2023-09-21T01:37:31.868 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:37:31.872 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:37:31.872 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:37:31.873 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:37:31.874 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:37:32.282 INFO:teuthology.orchestra.run.smithi059.stdout:generic/431 0s 2023-09-21T01:37:32.287 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/431 2023-09-21T01:37:32.287 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:37:32.289 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:37:32.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:37:32.602 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2023-09-21T01:37:32.944 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:37:32.948 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:37:32.948 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:37:32.949 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:37:32.949 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:37:33.375 INFO:teuthology.orchestra.run.smithi059.stdout:generic/432 0s 2023-09-21T01:37:33.380 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/432 2023-09-21T01:37:33.381 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:37:33.382 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:37:33.716 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:37:33.717 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2023-09-21T01:37:34.032 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:37:34.036 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:37:34.036 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:37:34.037 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:37:34.037 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:37:34.443 INFO:teuthology.orchestra.run.smithi059.stdout:generic/433 0s 2023-09-21T01:37:34.448 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/433 2023-09-21T01:37:34.448 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:37:34.450 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:37:34.739 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:37:34.740 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2023-09-21T01:37:35.090 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:37:35.094 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:37:35.095 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:37:35.096 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:37:35.096 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:37:35.512 INFO:teuthology.orchestra.run.smithi059.stdout:generic/434 0s 2023-09-21T01:37:35.517 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/434 2023-09-21T01:37:35.517 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:37:35.519 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:37:35.901 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:37:35.902 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2023-09-21T01:37:36.178 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:37:36.182 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:37:36.182 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:37:36.184 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:37:36.184 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:37:36.740 INFO:teuthology.orchestra.run.smithi059.stdout:generic/435 [not run] kernel does not support ceph encryption 2023-09-21T01:37:36.755 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/435 2023-09-21T01:37:36.756 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/435 2023-09-21T01:37:36.756 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:37:36.757 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:37:36.776 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:37:36.777 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2023-09-21T01:37:37.013 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:37:37.017 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:37:37.018 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:37:37.018 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:37:37.018 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:37:37.628 INFO:teuthology.orchestra.run.smithi059.stdout:generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-21T01:37:37.632 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/436 2023-09-21T01:37:37.632 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/436 2023-09-21T01:37:37.632 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:37:37.634 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:37:37.763 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:37:37.764 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2023-09-21T01:37:38.254 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:37:38.258 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:37:38.258 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:37:38.259 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:37:38.259 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:37:39.243 INFO:teuthology.orchestra.run.smithi059.stdout:generic/437 1s 2023-09-21T01:37:39.248 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/437 2023-09-21T01:37:39.249 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:37:39.250 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:37:39.281 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:37:39.282 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2023-09-21T01:37:39.509 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:37:39.513 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:37:39.513 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:37:39.514 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:37:39.514 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:38:30.954 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:38:30.958 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:38:51.826 INFO:teuthology.orchestra.run.smithi059.stdout:generic/438 72s 2023-09-21T01:38:51.831 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/438 2023-09-21T01:38:51.831 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:38:51.833 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:38:51.865 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:38:51.866 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2023-09-21T01:38:52.091 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:38:52.095 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:38:52.096 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:38:52.096 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:38:52.097 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:38:53.272 INFO:teuthology.orchestra.run.smithi059.stdout:generic/439 1s 2023-09-21T01:38:53.282 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/439 2023-09-21T01:38:53.282 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:38:53.284 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:38:53.313 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:38:53.313 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2023-09-21T01:38:53.534 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:38:53.538 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:38:53.538 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:38:53.539 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:38:53.540 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:38:54.110 INFO:teuthology.orchestra.run.smithi059.stdout:generic/440 [not run] kernel does not support ceph encryption 2023-09-21T01:38:54.129 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/440 2023-09-21T01:38:54.129 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/440 2023-09-21T01:38:54.129 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:38:54.131 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:38:54.158 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:38:54.159 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2023-09-21T01:38:54.381 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:38:54.385 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:38:54.386 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:38:54.387 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:38:54.387 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:38:54.808 INFO:teuthology.orchestra.run.smithi059.stdout:generic/441 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T01:38:54.812 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/441 2023-09-21T01:38:54.813 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/441 2023-09-21T01:38:54.813 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:38:54.814 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:38:54.838 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:38:54.838 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2023-09-21T01:38:55.064 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:38:55.068 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:38:55.069 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:38:55.070 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:38:55.070 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:38:55.421 INFO:teuthology.orchestra.run.smithi059.stdout:generic/442 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T01:38:55.425 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/442 2023-09-21T01:38:55.425 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/442 2023-09-21T01:38:55.425 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:38:55.427 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:38:55.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:38:55.458 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2023-09-21T01:38:55.686 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:38:55.690 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:38:55.691 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:38:55.692 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:38:55.692 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:38:56.069 INFO:teuthology.orchestra.run.smithi059.stdout:generic/443 1s 2023-09-21T01:38:56.074 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/443 2023-09-21T01:38:56.074 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:38:56.076 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:38:56.111 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:38:56.112 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2023-09-21T01:38:56.336 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:38:56.340 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:38:56.341 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:38:56.342 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:38:56.342 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:38:56.765 INFO:teuthology.orchestra.run.smithi059.stdout:generic/444 0s 2023-09-21T01:38:56.770 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/444 2023-09-21T01:38:56.770 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:38:56.772 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:38:56.806 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:38:56.807 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2023-09-21T01:38:57.042 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:38:57.046 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:38:57.046 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:38:57.047 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:38:57.047 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:38:57.855 INFO:teuthology.orchestra.run.smithi059.stdout:generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-21T01:38:57.859 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/445 2023-09-21T01:38:57.859 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/445 2023-09-21T01:38:57.859 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:38:57.861 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:38:58.276 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:38:58.277 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2023-09-21T01:38:58.502 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:38:58.506 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:38:58.507 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:38:58.508 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:38:58.508 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:39:01.141 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:39:01.143 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:39:21.513 INFO:teuthology.orchestra.run.smithi059.stdout:generic/446 23s 2023-09-21T01:39:21.570 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/446 2023-09-21T01:39:21.571 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:39:21.595 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:39:21.604 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:39:21.605 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2023-09-21T01:39:21.845 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:39:21.849 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:39:21.850 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:39:21.851 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:39:21.851 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:39:22.780 INFO:teuthology.orchestra.run.smithi059.stdout:generic/447 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:39:22.815 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/447 2023-09-21T01:39:22.815 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/447 2023-09-21T01:39:22.816 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:39:22.824 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:39:22.850 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:39:22.850 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2023-09-21T01:39:23.072 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:39:23.076 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:39:23.077 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:39:23.078 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:39:23.078 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:39:24.032 INFO:teuthology.orchestra.run.smithi059.stdout:generic/448 1s 2023-09-21T01:39:24.037 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/448 2023-09-21T01:39:24.037 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:39:24.039 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:39:24.404 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:39:24.404 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2023-09-21T01:39:24.667 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:39:24.671 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:39:24.671 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:39:24.672 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:39:24.673 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:39:25.066 INFO:teuthology.orchestra.run.smithi059.stdout:generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-21T01:39:25.070 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/449 2023-09-21T01:39:25.070 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/449 2023-09-21T01:39:25.070 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:39:25.072 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:39:25.294 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:39:25.295 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2023-09-21T01:39:25.701 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:39:25.705 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:39:25.705 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:39:25.706 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:39:25.707 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:39:26.427 INFO:teuthology.orchestra.run.smithi059.stdout:generic/450 1s 2023-09-21T01:39:26.431 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/450 2023-09-21T01:39:26.432 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:39:26.434 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:39:26.724 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:39:26.725 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2023-09-21T01:39:27.081 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:39:27.085 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:39:27.085 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:39:27.086 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:39:27.086 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:39:31.200 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:39:31.202 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:39:57.559 INFO:teuthology.orchestra.run.smithi059.stdout:generic/451 30s 2023-09-21T01:39:57.564 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/451 2023-09-21T01:39:57.564 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:39:57.566 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:39:57.808 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:39:57.809 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2023-09-21T01:39:58.195 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:39:58.199 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:39:58.199 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:39:58.200 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:39:58.200 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:39:58.840 INFO:teuthology.orchestra.run.smithi059.stdout:generic/452 0s 2023-09-21T01:39:58.845 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/452 2023-09-21T01:39:58.846 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:39:58.848 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:39:58.856 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:39:58.857 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2023-09-21T01:39:59.092 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:39:59.097 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:39:59.097 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:39:59.098 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:39:59.098 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:39:59.432 INFO:teuthology.orchestra.run.smithi059.stdout:generic/453 [not run] ceph does not allow unrestricted byte streams for names 2023-09-21T01:39:59.436 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/453 2023-09-21T01:39:59.437 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/453 2023-09-21T01:39:59.437 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:39:59.439 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:39:59.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:39:59.460 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2023-09-21T01:39:59.688 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:39:59.692 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:39:59.693 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:39:59.693 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:39:59.694 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:40:00.045 INFO:teuthology.orchestra.run.smithi059.stdout:generic/454 [not run] ceph does not allow unrestricted byte streams for names 2023-09-21T01:40:00.049 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/454 2023-09-21T01:40:00.049 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/454 2023-09-21T01:40:00.050 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:40:00.051 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:40:00.082 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:40:00.083 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2023-09-21T01:40:00.308 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:40:00.313 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:40:00.313 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:40:00.314 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:40:00.314 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:40:00.712 INFO:teuthology.orchestra.run.smithi059.stdout:generic/455 [not run] This test requires a valid $LOGWRITES_DEV 2023-09-21T01:40:00.716 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/455 2023-09-21T01:40:00.717 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/455 2023-09-21T01:40:00.717 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:40:00.719 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:40:00.746 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:40:00.747 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2023-09-21T01:40:00.968 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:40:00.971 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:40:00.972 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:40:00.973 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:40:00.973 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:40:01.320 INFO:teuthology.orchestra.run.smithi059.stdout:generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-21T01:40:01.324 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/456 2023-09-21T01:40:01.325 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/456 2023-09-21T01:40:01.325 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:40:01.327 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:40:01.362 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:40:01.362 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2023-09-21T01:40:01.453 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:40:01.455 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:40:01.583 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:40:01.587 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:40:01.588 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:40:01.589 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:40:01.589 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:40:02.425 INFO:teuthology.orchestra.run.smithi059.stdout:generic/457 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:40:02.431 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/457 2023-09-21T01:40:02.431 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/457 2023-09-21T01:40:02.432 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:40:02.436 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:40:02.560 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:40:02.560 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2023-09-21T01:40:02.780 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:40:02.784 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:40:02.785 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:40:02.786 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:40:02.786 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:40:03.716 INFO:teuthology.orchestra.run.smithi059.stdout:generic/458 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T01:40:03.752 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/458 2023-09-21T01:40:03.752 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/458 2023-09-21T01:40:03.752 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:40:03.755 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:40:03.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:40:03.777 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2023-09-21T01:40:04.001 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:40:04.005 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:40:04.006 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:40:04.006 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:40:04.007 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:40:04.966 INFO:teuthology.orchestra.run.smithi059.stdout:generic/459 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T01:40:04.971 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/459 2023-09-21T01:40:04.971 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/459 2023-09-21T01:40:04.971 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:40:04.973 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:40:05.008 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:40:05.009 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2023-09-21T01:40:05.256 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:40:05.261 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:40:05.262 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:40:05.263 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:40:05.263 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:40:07.268 INFO:teuthology.orchestra.run.smithi059.stdout:generic/460 2s 2023-09-21T01:40:07.272 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/460 2023-09-21T01:40:07.273 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:40:07.275 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:40:07.283 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:40:07.284 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2023-09-21T01:40:07.506 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:40:07.511 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:40:07.511 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:40:07.512 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:40:07.512 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:40:08.148 INFO:teuthology.orchestra.run.smithi059.stdout:generic/461 [not run] ceph does not support shutdown 2023-09-21T01:40:08.153 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/461 2023-09-21T01:40:08.153 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/461 2023-09-21T01:40:08.153 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:40:08.155 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:40:08.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:40:08.204 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2023-09-21T01:40:08.455 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:40:08.459 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:40:08.459 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:40:08.461 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:40:08.461 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:40:08.943 INFO:teuthology.orchestra.run.smithi059.stdout:generic/462 [not run] mount 172.21.15.59:6789:/scratch with dax failed 2023-09-21T01:40:08.947 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/462 2023-09-21T01:40:08.948 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/462 2023-09-21T01:40:08.948 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:40:08.950 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:40:08.976 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:40:08.977 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2023-09-21T01:40:09.207 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:40:09.211 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:40:09.212 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:40:09.213 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:40:09.213 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:40:09.592 INFO:teuthology.orchestra.run.smithi059.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph 2023-09-21T01:40:09.596 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/463 2023-09-21T01:40:09.596 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/463 2023-09-21T01:40:09.596 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:40:09.598 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:40:10.029 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:40:10.030 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2023-09-21T01:40:10.254 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:40:10.258 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:40:10.259 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:40:10.260 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:40:10.260 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:40:31.536 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:40:31.550 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:41:01.709 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:41:01.712 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:41:07.634 INFO:teuthology.orchestra.run.smithi059.stdout:generic/464 57s 2023-09-21T01:41:07.639 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/464 2023-09-21T01:41:07.639 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:41:07.641 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:41:07.650 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:41:07.651 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2023-09-21T01:41:07.874 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:41:07.878 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:41:07.878 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:41:07.879 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:41:07.879 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:41:12.514 INFO:teuthology.orchestra.run.smithi059.stdout:generic/465 4s 2023-09-21T01:41:12.531 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/465 2023-09-21T01:41:12.532 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:41:12.535 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:41:12.545 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:41:12.546 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2023-09-21T01:41:12.762 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:41:12.766 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:41:12.767 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:41:12.767 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:41:12.768 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:41:13.170 INFO:teuthology.orchestra.run.smithi059.stdout:generic/466 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T01:41:13.182 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/466 2023-09-21T01:41:13.182 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/466 2023-09-21T01:41:13.183 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:41:13.185 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:41:13.213 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:41:13.214 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2023-09-21T01:41:13.434 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:41:13.438 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:41:13.439 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:41:13.440 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:41:13.440 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:41:31.811 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:41:31.837 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:42:02.592 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:42:02.608 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:42:12.740 INFO:teuthology.orchestra.run.smithi059.stdout:generic/467 59s 2023-09-21T01:42:12.819 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/467 2023-09-21T01:42:12.819 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:42:12.824 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:42:13.132 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:42:13.133 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2023-09-21T01:42:14.207 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:42:14.211 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:42:14.211 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:42:14.212 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:42:14.213 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:42:14.806 INFO:teuthology.orchestra.run.smithi059.stdout:generic/468 [not run] ceph does not support shutdown 2023-09-21T01:42:14.832 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/468 2023-09-21T01:42:14.832 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/468 2023-09-21T01:42:14.833 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:42:14.834 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:42:14.856 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:42:14.856 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2023-09-21T01:42:15.085 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:42:15.089 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:42:15.089 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:42:15.090 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:42:15.091 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:42:15.441 INFO:teuthology.orchestra.run.smithi059.stdout:generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-09-21T01:42:15.445 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/469 2023-09-21T01:42:15.445 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/469 2023-09-21T01:42:15.445 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:42:15.447 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:42:15.473 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:42:15.474 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2023-09-21T01:42:15.701 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:42:15.702 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:42:15.703 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:42:15.704 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:42:15.704 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:42:16.105 INFO:teuthology.orchestra.run.smithi059.stdout:generic/470 [not run] This test requires a valid $LOGWRITES_DEV 2023-09-21T01:42:16.107 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/470 2023-09-21T01:42:16.107 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/470 2023-09-21T01:42:16.108 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:42:16.109 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:42:16.131 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:42:16.131 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2023-09-21T01:42:16.373 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:42:16.377 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:42:16.377 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:42:16.378 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:42:16.378 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:42:17.019 INFO:teuthology.orchestra.run.smithi059.stdout:generic/472 [not run] swapfiles are not supported 2023-09-21T01:42:17.024 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/472 2023-09-21T01:42:17.024 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/472 2023-09-21T01:42:17.024 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:42:17.026 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:42:17.063 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:42:17.064 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2023-09-21T01:42:17.284 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:42:17.288 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:42:17.289 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:42:17.290 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:42:17.290 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:42:17.685 INFO:teuthology.orchestra.run.smithi059.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-21T01:42:17.689 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/473 2023-09-21T01:42:17.689 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/473 2023-09-21T01:42:17.690 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:42:17.691 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:42:17.726 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:42:17.726 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2023-09-21T01:42:17.952 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:42:17.956 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:42:17.956 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:42:17.957 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:42:17.957 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:42:18.474 INFO:teuthology.orchestra.run.smithi059.stdout:generic/474 [not run] ceph does not support shutdown 2023-09-21T01:42:18.492 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/474 2023-09-21T01:42:18.492 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/474 2023-09-21T01:42:18.493 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:42:18.494 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:42:18.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:42:18.519 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2023-09-21T01:42:18.741 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:42:18.745 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:42:18.745 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:42:18.746 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:42:18.747 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:42:19.114 INFO:teuthology.orchestra.run.smithi059.stdout:generic/475 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T01:42:19.118 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/475 2023-09-21T01:42:19.118 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/475 2023-09-21T01:42:19.118 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T01:42:19.120 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:42:19.147 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T01:42:19.148 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2023-09-21T01:42:19.378 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T01:42:19.382 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T01:42:19.383 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T01:42:19.384 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T01:42:19.384 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T01:42:33.170 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:42:33.220 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:43:03.972 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:43:03.977 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:43:34.221 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:43:34.224 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:44:05.217 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:44:05.241 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:44:05.464 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-09-21T01:44:05.457+0000 7fe56ff7b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119480) UID: 0 2023-09-21T01:44:05.479 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-09-21T01:44:05.475+0000 7fae7ed95700 -1 received signal: Hangup from (PID: 119480) UID: 0 2023-09-21T01:44:05.483 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-09-21T01:44:05.475+0000 7f6a304c5700 -1 received signal: Hangup from (PID: 119480) UID: 0 2023-09-21T01:44:05.487 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-09-21T01:44:05.486+0000 7fceb8335700 -1 Fail to open '/proc/119480/cmdline' error = (2) No such file or directory 2023-09-21T01:44:05.488 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-09-21T01:44:05.486+0000 7fceb8335700 -1 received signal: Hangup from (PID: 119480) UID: 0 2023-09-21T01:48:38.162 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:48:38.235 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:49:08.408 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:49:08.472 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:49:08.796 INFO:tasks.ceph.mds.a.smithi059.stderr:2023-09-21T01:49:08.796+0000 7facd961b700 -1 Fail to open '/proc/614060/cmdline' error = (2) No such file or directory 2023-09-21T01:49:08.796 INFO:tasks.ceph.mds.a.smithi059.stderr:2023-09-21T01:49:08.796+0000 7facd961b700 -1 received signal: Hangup from (PID: 614060) UID: 0 2023-09-21T01:49:08.796 INFO:tasks.ceph.mds.c.smithi059.stderr:2023-09-21T01:49:08.796+0000 7fa085432700 -1 Fail to open '/proc/614060/cmdline' error = (2) No such file or directory 2023-09-21T01:49:08.796 INFO:tasks.ceph.mds.c.smithi059.stderr:2023-09-21T01:49:08.796+0000 7fa085432700 -1 received signal: Hangup from (PID: 614060) UID: 0 2023-09-21T01:53:32.729 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:53:32.737 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:53:32.860 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-09-21T01:53:32.860+0000 7fe56ff7b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120005) UID: 0 2023-09-21T01:53:32.860 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-09-21T01:53:32.860+0000 7fae7ed95700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120005) UID: 0 2023-09-21T01:53:32.861 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-09-21T01:53:32.862+0000 7f6a304c5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120005) UID: 0 2023-09-21T01:53:32.861 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-09-21T01:53:32.862+0000 7fceb8335700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120005) UID: 0 2023-09-21T01:58:10.572 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:58:10.592 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T01:58:10.944 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-09-21T01:58:10.944+0000 7f9692588700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 614592) UID: 0 2023-09-21T01:58:10.951 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-09-21T01:58:10.942+0000 7f7948a08700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 614592) UID: 0 2023-09-21T01:58:10.952 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-09-21T01:58:10.941+0000 7fadc2fd5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 614592) UID: 0 2023-09-21T01:58:10.970 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-09-21T01:58:10.945+0000 7fc5c83b6700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 614592) UID: 0 2023-09-21T02:02:37.184 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T02:02:37.190 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T02:02:37.672 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-09-21T02:02:37.668+0000 7fc5c83b6700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 614696) UID: 0 2023-09-21T02:02:37.683 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-09-21T02:02:37.664+0000 7fadc2fd5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 614696) UID: 0 2023-09-21T02:02:37.683 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-09-21T02:02:37.665+0000 7f9692588700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 614696) UID: 0 2023-09-21T02:02:37.691 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-09-21T02:02:37.664+0000 7f7948a08700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 614696) UID: 0 2023-09-21T02:14:45.598 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T02:14:45.604 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T02:14:45.955 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-09-21T02:14:45.956+0000 7fe56ff7b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120406) UID: 0 2023-09-21T02:14:45.955 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-09-21T02:14:45.956+0000 7fae7ed95700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120406) UID: 0 2023-09-21T02:14:45.956 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-09-21T02:14:45.957+0000 7fceb8335700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120406) UID: 0 2023-09-21T02:14:45.956 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-09-21T02:14:45.957+0000 7f6a304c5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120406) UID: 0 2023-09-21T02:14:46.555 INFO:tasks.ceph.mds.c.smithi059.stderr:2023-09-21T02:14:46.556+0000 7fa085432700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 614938) UID: 0 2023-09-21T02:14:46.566 INFO:tasks.ceph.mds.a.smithi059.stderr:2023-09-21T02:14:46.559+0000 7facd961b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 614938) UID: 0 2023-09-21T02:24:39.469 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T02:24:39.475 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T02:24:40.292 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-09-21T02:24:40.288+0000 7f6a304c5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120578) UID: 0 2023-09-21T02:24:40.292 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-09-21T02:24:40.286+0000 7fe56ff7b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120578) UID: 0 2023-09-21T02:24:40.296 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-09-21T02:24:40.293+0000 7fceb8335700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120578) UID: 0 2023-09-21T02:24:40.299 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-09-21T02:24:40.293+0000 7fae7ed95700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120578) UID: 0 2023-09-21T02:33:32.504 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T02:33:32.507 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T02:33:32.736 INFO:tasks.ceph.mds.a.smithi059.stderr:2023-09-21T02:33:32.733+0000 7facd961b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 615194) UID: 0 2023-09-21T02:33:32.737 INFO:tasks.ceph.mds.c.smithi059.stderr:2023-09-21T02:33:32.733+0000 7fa085432700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 615194) UID: 0 2023-09-21T02:39:33.386 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-09-21T02:39:33.384+0000 7fc5c83b6700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 615255) UID: 0 2023-09-21T02:39:33.387 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-09-21T02:39:33.384+0000 7f7948a08700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 615255) UID: 0 2023-09-21T02:39:33.387 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-09-21T02:39:33.384+0000 7fadc2fd5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 615255) UID: 0 2023-09-21T02:39:33.388 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-09-21T02:39:33.384+0000 7f9692588700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 615255) UID: 0 2023-09-21T02:44:38.879 INFO:teuthology.orchestra.run.smithi059.stdout:generic/476 3739s 2023-09-21T02:44:39.084 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/476 2023-09-21T02:44:39.085 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T02:44:39.093 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:44:39.122 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T02:44:39.122 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2023-09-21T02:44:52.473 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T02:44:52.478 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T02:44:52.479 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T02:44:52.480 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T02:44:52.481 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:52:21.304 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T02:52:21.306 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T02:52:21.435 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-09-21T02:52:21.433+0000 7fe56ff7b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120912) UID: 0 2023-09-21T02:52:21.435 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-09-21T02:52:21.433+0000 7f6a304c5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120912) UID: 0 2023-09-21T02:52:21.436 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-09-21T02:52:21.433+0000 7fae7ed95700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120912) UID: 0 2023-09-21T02:52:21.436 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-09-21T02:52:21.434+0000 7fceb8335700 -1 Fail to open '/proc/120912/cmdline' error = (2) No such file or directory 2023-09-21T02:52:21.437 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-09-21T02:52:21.434+0000 7fceb8335700 -1 received signal: Hangup from (PID: 120912) UID: 0 2023-09-21T02:52:21.551 INFO:tasks.ceph.mds.c.smithi059.stderr:2023-09-21T02:52:21.548+0000 7fa085432700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 615691) UID: 0 2023-09-21T02:52:21.551 INFO:tasks.ceph.mds.a.smithi059.stderr:2023-09-21T02:52:21.549+0000 7facd961b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 615691) UID: 0 2023-09-21T02:53:45.310 INFO:teuthology.orchestra.run.smithi059.stdout:generic/477 53s 2023-09-21T02:53:45.481 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/477 2023-09-21T02:53:45.481 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T02:53:45.516 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:53:45.742 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T02:53:45.742 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2023-09-21T02:53:48.708 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T02:53:48.714 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T02:53:48.714 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T02:53:48.718 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T02:53:48.718 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:00.270 INFO:teuthology.orchestra.run.smithi059.stdout:generic/478 11s 2023-09-21T02:54:00.276 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/478 2023-09-21T02:54:00.276 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T02:54:00.280 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:00.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T02:54:00.341 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2023-09-21T02:54:00.919 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T02:54:00.937 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T02:54:00.937 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T02:54:00.938 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T02:54:00.938 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:01.903 INFO:teuthology.orchestra.run.smithi059.stdout:generic/479 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T02:54:01.909 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/479 2023-09-21T02:54:01.909 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/479 2023-09-21T02:54:01.909 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T02:54:01.916 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:01.983 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T02:54:01.983 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2023-09-21T02:54:02.427 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T02:54:02.431 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T02:54:02.431 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T02:54:02.433 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T02:54:02.433 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:03.042 INFO:teuthology.orchestra.run.smithi059.stdout:generic/480 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T02:54:03.047 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/480 2023-09-21T02:54:03.047 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/480 2023-09-21T02:54:03.047 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T02:54:03.053 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:03.127 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T02:54:03.128 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2023-09-21T02:54:03.579 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T02:54:03.584 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T02:54:03.585 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T02:54:03.586 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T02:54:03.586 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:04.250 INFO:teuthology.orchestra.run.smithi059.stdout:generic/481 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T02:54:04.257 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/481 2023-09-21T02:54:04.257 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/481 2023-09-21T02:54:04.257 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T02:54:04.261 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:04.282 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T02:54:04.283 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2023-09-21T02:54:04.714 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T02:54:04.724 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T02:54:04.725 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T02:54:04.726 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T02:54:04.726 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:05.485 INFO:teuthology.orchestra.run.smithi059.stdout:generic/482 [not run] This test requires a valid $LOGWRITES_DEV 2023-09-21T02:54:05.493 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/482 2023-09-21T02:54:05.493 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/482 2023-09-21T02:54:05.493 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T02:54:05.496 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:05.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T02:54:05.529 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2023-09-21T02:54:06.031 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T02:54:06.051 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T02:54:06.058 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T02:54:06.058 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T02:54:06.059 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:06.744 INFO:teuthology.orchestra.run.smithi059.stdout:generic/483 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T02:54:06.750 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/483 2023-09-21T02:54:06.750 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/483 2023-09-21T02:54:06.751 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T02:54:06.754 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:06.783 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T02:54:06.784 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2023-09-21T02:54:07.217 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T02:54:07.236 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T02:54:07.237 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T02:54:07.242 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T02:54:07.243 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:07.957 INFO:teuthology.orchestra.run.smithi059.stdout:generic/484 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T02:54:07.974 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/484 2023-09-21T02:54:07.974 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/484 2023-09-21T02:54:07.974 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T02:54:07.977 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:08.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T02:54:08.038 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2023-09-21T02:54:08.455 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T02:54:08.460 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T02:54:08.460 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T02:54:08.461 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T02:54:08.461 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:09.102 INFO:teuthology.orchestra.run.smithi059.stdout:generic/485 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-09-21T02:54:09.107 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/485 2023-09-21T02:54:09.107 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/485 2023-09-21T02:54:09.107 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T02:54:09.113 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:09.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T02:54:09.167 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2023-09-21T02:54:09.641 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T02:54:09.652 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T02:54:09.653 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T02:54:09.654 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T02:54:09.654 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:11.247 INFO:teuthology.orchestra.run.smithi059.stdout:generic/486 2s 2023-09-21T02:54:11.318 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/486 2023-09-21T02:54:11.318 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T02:54:11.320 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:11.331 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T02:54:11.332 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2023-09-21T02:54:11.695 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T02:54:11.701 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T02:54:11.702 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T02:54:11.703 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T02:54:11.703 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:12.511 INFO:teuthology.orchestra.run.smithi059.stdout:generic/487 [not run] This test requires a valid $SCRATCH_LOGDEV 2023-09-21T02:54:12.523 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/487 2023-09-21T02:54:12.523 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/487 2023-09-21T02:54:12.523 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T02:54:12.531 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:12.567 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T02:54:12.568 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2023-09-21T02:54:13.000 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T02:54:13.006 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T02:54:13.006 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T02:54:13.007 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T02:54:13.007 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:13.661 INFO:teuthology.orchestra.run.smithi059.stdout:generic/488 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-09-21T02:54:13.666 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/488 2023-09-21T02:54:13.666 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/488 2023-09-21T02:54:13.667 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T02:54:13.668 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:13.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T02:54:13.704 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2023-09-21T02:54:14.112 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T02:54:14.119 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T02:54:14.120 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T02:54:14.120 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T02:54:14.121 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:14.765 INFO:teuthology.orchestra.run.smithi059.stdout:generic/489 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T02:54:14.770 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/489 2023-09-21T02:54:14.770 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/489 2023-09-21T02:54:14.770 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T02:54:14.772 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:14.815 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T02:54:14.815 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2023-09-21T02:54:15.226 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T02:54:15.234 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T02:54:15.234 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T02:54:15.235 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T02:54:15.236 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:18.070 INFO:teuthology.orchestra.run.smithi059.stdout:generic/490 3s 2023-09-21T02:54:18.093 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/490 2023-09-21T02:54:18.093 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T02:54:18.102 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:18.570 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T02:54:18.571 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2023-09-21T02:54:19.140 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T02:54:19.144 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T02:54:19.149 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T02:54:19.149 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T02:54:19.149 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:19.817 INFO:teuthology.orchestra.run.smithi059.stdout:generic/491 [not run] ceph does not support freezing 2023-09-21T02:54:19.829 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/491 2023-09-21T02:54:19.829 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/491 2023-09-21T02:54:19.830 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T02:54:19.837 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:19.897 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T02:54:19.898 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2023-09-21T02:54:20.386 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T02:54:20.391 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T02:54:20.397 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T02:54:20.398 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T02:54:20.398 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:20.926 INFO:teuthology.orchestra.run.smithi059.stdout:generic/492 [not run] xfs_io label failed (old kernel/wrong fs?) 2023-09-21T02:54:20.935 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/492 2023-09-21T02:54:20.935 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/492 2023-09-21T02:54:20.936 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T02:54:20.938 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:20.998 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T02:54:20.999 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2023-09-21T02:54:21.445 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T02:54:21.460 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T02:54:21.466 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T02:54:21.466 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T02:54:21.466 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:22.581 INFO:teuthology.orchestra.run.smithi059.stdout:generic/493 [not run] swapfiles are not supported 2023-09-21T02:54:22.591 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/493 2023-09-21T02:54:22.592 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/493 2023-09-21T02:54:22.592 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T02:54:22.595 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:22.656 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T02:54:22.656 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2023-09-21T02:54:23.077 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T02:54:23.086 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T02:54:23.086 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T02:54:23.087 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T02:54:23.088 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:24.103 INFO:teuthology.orchestra.run.smithi059.stdout:generic/494 [not run] swapfiles are not supported 2023-09-21T02:54:24.114 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/494 2023-09-21T02:54:24.114 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/494 2023-09-21T02:54:24.115 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T02:54:24.116 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:24.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T02:54:24.160 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2023-09-21T02:54:24.624 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T02:54:24.635 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T02:54:24.635 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T02:54:24.637 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T02:54:24.637 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:25.551 INFO:teuthology.orchestra.run.smithi059.stdout:generic/495 [not run] swapfiles are not supported 2023-09-21T02:54:25.556 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/495 2023-09-21T02:54:25.556 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/495 2023-09-21T02:54:25.556 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T02:54:25.558 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:25.595 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T02:54:25.596 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2023-09-21T02:54:26.040 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T02:54:26.047 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T02:54:26.047 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T02:54:26.048 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T02:54:26.049 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:27.091 INFO:teuthology.orchestra.run.smithi059.stdout:generic/496 [not run] swapfiles are not supported 2023-09-21T02:54:27.096 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/496 2023-09-21T02:54:27.096 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/496 2023-09-21T02:54:27.097 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T02:54:27.099 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:27.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T02:54:27.148 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2023-09-21T02:54:27.552 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T02:54:27.562 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T02:54:27.562 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T02:54:27.563 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T02:54:27.564 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:28.612 INFO:teuthology.orchestra.run.smithi059.stdout:generic/497 [not run] swapfiles are not supported 2023-09-21T02:54:28.616 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/497 2023-09-21T02:54:28.617 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/497 2023-09-21T02:54:28.617 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T02:54:28.619 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:28.655 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T02:54:28.656 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2023-09-21T02:54:29.099 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T02:54:29.111 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T02:54:29.112 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T02:54:29.113 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T02:54:29.113 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:29.817 INFO:teuthology.orchestra.run.smithi059.stdout:generic/498 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T02:54:29.822 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/498 2023-09-21T02:54:29.822 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/498 2023-09-21T02:54:29.822 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T02:54:29.825 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:29.887 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T02:54:29.888 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2023-09-21T02:54:30.385 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T02:54:30.390 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T02:54:30.390 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T02:54:30.391 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T02:54:30.391 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:30.922 INFO:teuthology.orchestra.run.smithi059.stdout:generic/499 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-09-21T02:54:30.928 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/499 2023-09-21T02:54:30.928 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/499 2023-09-21T02:54:30.928 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T02:54:30.933 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:30.984 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T02:54:30.985 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2023-09-21T02:54:31.412 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T02:54:31.417 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T02:54:31.418 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T02:54:31.420 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T02:54:31.420 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:32.044 INFO:teuthology.orchestra.run.smithi059.stdout:generic/500 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T02:54:32.054 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/500 2023-09-21T02:54:32.054 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/500 2023-09-21T02:54:32.054 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T02:54:32.058 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:32.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T02:54:32.095 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2023-09-21T02:54:32.570 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T02:54:32.584 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T02:54:32.584 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T02:54:32.587 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T02:54:32.587 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:34.110 INFO:teuthology.orchestra.run.smithi059.stdout:generic/501 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T02:54:34.122 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/501 2023-09-21T02:54:34.122 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/501 2023-09-21T02:54:34.122 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T02:54:34.131 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:34.169 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T02:54:34.170 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2023-09-21T02:54:34.563 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T02:54:34.573 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T02:54:34.577 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T02:54:34.585 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T02:54:34.585 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:35.182 INFO:teuthology.orchestra.run.smithi059.stdout:generic/502 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T02:54:35.190 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/502 2023-09-21T02:54:35.190 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/502 2023-09-21T02:54:35.191 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T02:54:35.193 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:35.257 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T02:54:35.258 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2023-09-21T02:54:35.679 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T02:54:35.690 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T02:54:35.691 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T02:54:35.692 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T02:54:35.692 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:36.309 INFO:teuthology.orchestra.run.smithi059.stdout:generic/503 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-21T02:54:36.315 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/503 2023-09-21T02:54:36.315 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/503 2023-09-21T02:54:36.315 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T02:54:36.317 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:36.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T02:54:36.381 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2023-09-21T02:54:36.795 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T02:54:36.803 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T02:54:36.803 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T02:54:36.804 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T02:54:36.805 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:37.520 INFO:teuthology.orchestra.run.smithi059.stdout:generic/504 0s 2023-09-21T02:54:37.525 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/504 2023-09-21T02:54:37.526 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T02:54:37.528 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:37.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T02:54:37.592 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2023-09-21T02:54:38.125 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T02:54:38.132 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T02:54:38.138 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T02:54:38.139 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T02:54:38.140 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:38.983 INFO:teuthology.orchestra.run.smithi059.stdout:generic/505 [not run] ceph does not support shutdown 2023-09-21T02:54:39.007 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/505 2023-09-21T02:54:39.007 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/505 2023-09-21T02:54:39.008 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T02:54:39.010 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:39.041 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T02:54:39.042 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2023-09-21T02:54:39.479 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T02:54:39.485 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T02:54:39.485 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T02:54:39.486 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T02:54:39.487 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:40.088 INFO:teuthology.orchestra.run.smithi059.stdout:generic/506 [not run] disk quotas not supported by this filesystem type: ceph 2023-09-21T02:54:40.095 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/506 2023-09-21T02:54:40.096 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/506 2023-09-21T02:54:40.096 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T02:54:40.098 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:40.124 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T02:54:40.125 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2023-09-21T02:54:40.523 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T02:54:40.532 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T02:54:40.532 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T02:54:40.533 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T02:54:40.533 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:41.227 INFO:teuthology.orchestra.run.smithi059.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2023-09-21T02:54:41.238 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/507 2023-09-21T02:54:41.239 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/507 2023-09-21T02:54:41.239 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T02:54:41.241 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:41.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T02:54:41.319 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2023-09-21T02:54:41.789 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T02:54:41.821 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T02:54:41.822 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T02:54:41.823 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T02:54:41.823 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:42.450 INFO:teuthology.orchestra.run.smithi059.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph 2023-09-21T02:54:42.455 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/508 2023-09-21T02:54:42.455 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/508 2023-09-21T02:54:42.456 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T02:54:42.458 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:42.500 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T02:54:42.500 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2023-09-21T02:54:42.940 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T02:54:42.951 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T02:54:42.952 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T02:54:42.952 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T02:54:42.953 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:43.527 INFO:teuthology.orchestra.run.smithi059.stdout:generic/509 [not run] O_TMPFILE is not supported 2023-09-21T02:54:43.532 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/509 2023-09-21T02:54:43.532 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/509 2023-09-21T02:54:43.532 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T02:54:43.538 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:43.562 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T02:54:43.563 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2023-09-21T02:54:43.924 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T02:54:43.928 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T02:54:43.929 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T02:54:43.933 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T02:54:43.933 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:44.547 INFO:teuthology.orchestra.run.smithi059.stdout:generic/510 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T02:54:44.551 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/510 2023-09-21T02:54:44.552 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/510 2023-09-21T02:54:44.552 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T02:54:44.554 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:44.578 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T02:54:44.579 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2023-09-21T02:54:45.099 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T02:54:45.104 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T02:54:45.105 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T02:54:45.106 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T02:54:45.106 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:45.716 INFO:teuthology.orchestra.run.smithi059.stdout:generic/511 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-09-21T02:54:45.729 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/511 2023-09-21T02:54:45.730 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/511 2023-09-21T02:54:45.730 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T02:54:45.737 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:45.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T02:54:45.797 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2023-09-21T02:54:46.161 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T02:54:46.176 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T02:54:46.176 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T02:54:46.177 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T02:54:46.178 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:46.821 INFO:teuthology.orchestra.run.smithi059.stdout:generic/512 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-21T02:54:46.825 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/512 2023-09-21T02:54:46.826 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/512 2023-09-21T02:54:46.826 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T02:54:46.831 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:46.876 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T02:54:46.877 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2023-09-21T02:54:47.382 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T02:54:47.386 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T02:54:47.387 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T02:54:47.388 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T02:54:47.388 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:48.690 INFO:teuthology.orchestra.run.smithi059.stdout:generic/513 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T02:54:48.719 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/513 2023-09-21T02:54:48.720 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/513 2023-09-21T02:54:48.720 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T02:54:48.728 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:48.765 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T02:54:48.765 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2023-09-21T02:54:49.215 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T02:54:49.220 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T02:54:49.221 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T02:54:49.222 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T02:54:49.222 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:50.513 INFO:teuthology.orchestra.run.smithi059.stdout:generic/514 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T02:54:50.588 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/514 2023-09-21T02:54:50.589 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/514 2023-09-21T02:54:50.589 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T02:54:50.592 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:50.638 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T02:54:50.639 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2023-09-21T02:54:51.119 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T02:54:51.127 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T02:54:51.131 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T02:54:51.132 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T02:54:51.132 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:52.477 INFO:teuthology.orchestra.run.smithi059.stdout:generic/515 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T02:54:52.561 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/515 2023-09-21T02:54:52.561 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/515 2023-09-21T02:54:52.561 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T02:54:52.589 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:52.711 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T02:54:52.712 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2023-09-21T02:54:53.128 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T02:54:53.133 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T02:54:53.133 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T02:54:53.134 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T02:54:53.134 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:53.788 INFO:teuthology.orchestra.run.smithi059.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph 2023-09-21T02:54:53.794 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/516 2023-09-21T02:54:53.794 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/516 2023-09-21T02:54:53.794 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T02:54:53.797 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:54.251 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T02:54:54.251 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2023-09-21T02:54:54.759 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T02:54:54.785 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T02:54:54.785 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T02:54:54.787 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T02:54:54.787 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:55.676 INFO:teuthology.orchestra.run.smithi059.stdout:generic/517 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-09-21T02:54:55.893 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/517 2023-09-21T02:54:55.894 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/517 2023-09-21T02:54:55.894 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T02:54:56.158 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:56.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T02:54:56.225 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2023-09-21T02:54:56.601 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T02:54:56.612 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T02:54:56.613 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T02:54:56.613 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T02:54:56.614 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:58.031 INFO:teuthology.orchestra.run.smithi059.stdout:generic/518 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T02:54:58.094 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/518 2023-09-21T02:54:58.094 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/518 2023-09-21T02:54:58.094 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T02:54:58.097 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:58.151 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T02:54:58.152 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2023-09-21T02:54:58.636 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T02:54:58.644 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T02:54:58.645 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T02:54:58.646 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T02:54:58.646 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:59.359 INFO:teuthology.orchestra.run.smithi059.stdout:generic/519 [not run] FIBMAP not supported by this filesystem 2023-09-21T02:54:59.364 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/519 2023-09-21T02:54:59.364 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/519 2023-09-21T02:54:59.364 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T02:54:59.366 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:54:59.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T02:54:59.756 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2023-09-21T02:55:00.284 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T02:55:00.296 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T02:55:00.297 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T02:55:00.298 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T02:55:00.299 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:55:00.857 INFO:teuthology.orchestra.run.smithi059.stdout:generic/520 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T02:55:00.862 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/520 2023-09-21T02:55:00.862 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/520 2023-09-21T02:55:00.862 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T02:55:00.865 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:55:00.900 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T02:55:00.900 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2023-09-21T02:55:01.378 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T02:55:01.396 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T02:55:01.396 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T02:55:01.399 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T02:55:01.399 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T02:59:06.875 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-09-21T02:59:06.870+0000 7fadc2fd5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 638152) UID: 0 2023-09-21T02:59:06.877 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-09-21T02:59:06.871+0000 7f7948a08700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 638152) UID: 0 2023-09-21T02:59:06.877 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-09-21T02:59:06.872+0000 7f9692588700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 638152) UID: 0 2023-09-21T02:59:06.878 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-09-21T02:59:06.871+0000 7fc5c83b6700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 638152) UID: 0 2023-09-21T03:03:36.321 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:03:36.324 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:03:36.488 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-09-21T03:03:36.486+0000 7fe56ff7b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121045) UID: 0 2023-09-21T03:03:36.489 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-09-21T03:03:36.486+0000 7fae7ed95700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121045) UID: 0 2023-09-21T03:03:36.489 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-09-21T03:03:36.487+0000 7fceb8335700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121045) UID: 0 2023-09-21T03:03:36.490 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-09-21T03:03:36.488+0000 7f6a304c5700 -1 Fail to open '/proc/121045/cmdline' error = (2) No such file or directory 2023-09-21T03:03:36.490 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-09-21T03:03:36.488+0000 7f6a304c5700 -1 received signal: Hangup from (PID: 121045) UID: 0 2023-09-21T03:13:37.771 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:13:37.776 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:13:37.870 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-09-21T03:13:37.867+0000 7f9692588700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 638368) UID: 0 2023-09-21T03:13:37.870 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-09-21T03:13:37.867+0000 7f7948a08700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 638368) UID: 0 2023-09-21T03:13:37.871 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-09-21T03:13:37.868+0000 7fc5c83b6700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 638368) UID: 0 2023-09-21T03:13:37.871 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-09-21T03:13:37.868+0000 7fadc2fd5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 638368) UID: 0 2023-09-21T03:17:28.419 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:17:28.423 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:17:28.658 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-09-21T03:17:28.657+0000 7fadc2fd5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 638426) UID: 0 2023-09-21T03:17:28.659 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-09-21T03:17:28.657+0000 7fc5c83b6700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 638426) UID: 0 2023-09-21T03:17:28.660 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-09-21T03:17:28.658+0000 7f7948a08700 -1 Fail to open '/proc/638426/cmdline' error = (2) No such file or directory 2023-09-21T03:17:28.660 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-09-21T03:17:28.658+0000 7f7948a08700 -1 received signal: Hangup from (PID: 638426) UID: 0 2023-09-21T03:17:28.663 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-09-21T03:17:28.658+0000 7f9692588700 -1 Fail to open '/proc/638426/cmdline' error = (2) No such file or directory 2023-09-21T03:17:28.663 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-09-21T03:17:28.658+0000 7f9692588700 -1 received signal: Hangup from (PID: 638426) UID: 0 2023-09-21T03:21:03.860 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:21:03.866 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:21:33.958 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:21:33.963 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:22:04.227 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:22:04.232 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:22:34.304 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:22:34.315 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:23:04.403 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:23:04.407 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:23:34.513 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:23:34.516 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:24:04.835 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:24:04.838 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:24:34.916 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:24:34.919 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:24:34.988 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-09-21T03:24:34.987+0000 7fe56ff7b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121476) UID: 0 2023-09-21T03:24:34.989 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-09-21T03:24:34.987+0000 7fae7ed95700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121476) UID: 0 2023-09-21T03:24:34.989 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-09-21T03:24:34.987+0000 7fceb8335700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121476) UID: 0 2023-09-21T03:24:34.994 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-09-21T03:24:34.987+0000 7f6a304c5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121476) UID: 0 2023-09-21T03:27:47.458 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:27:47.461 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:27:47.535 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-09-21T03:27:47.533+0000 7f9692588700 -1 received signal: Hangup from (PID: 638710) UID: 0 2023-09-21T03:27:47.536 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-09-21T03:27:47.533+0000 7f7948a08700 -1 received signal: Hangup from (PID: 638710) UID: 0 2023-09-21T03:27:47.536 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-09-21T03:27:47.533+0000 7fc5c83b6700 -1 received signal: Hangup from (PID: 638710) UID: 0 2023-09-21T03:27:47.538 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-09-21T03:27:47.532+0000 7fadc2fd5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 638710) UID: 0 2023-09-21T03:31:22.897 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:31:22.900 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:31:53.152 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:31:53.155 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:32:23.534 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:32:23.537 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:32:53.615 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:32:53.622 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:33:23.705 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:33:23.711 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:33:53.835 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:33:53.838 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:34:23.925 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:34:23.928 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:34:54.080 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:34:54.086 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:35:24.173 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:35:24.176 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:35:54.561 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:35:54.564 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:35:54.627 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-09-21T03:35:54.626+0000 7fe56ff7b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122000) UID: 0 2023-09-21T03:35:54.627 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-09-21T03:35:54.626+0000 7fae7ed95700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122000) UID: 0 2023-09-21T03:35:54.628 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-09-21T03:35:54.626+0000 7f6a304c5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122000) UID: 0 2023-09-21T03:35:54.752 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-09-21T03:35:54.626+0000 7fceb8335700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122000) UID: 0 2023-09-21T03:39:16.403 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:39:16.407 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:39:16.480 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-09-21T03:39:16.478+0000 7fadc2fd5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 639052) UID: 0 2023-09-21T03:39:16.480 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-09-21T03:39:16.478+0000 7fc5c83b6700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 639052) UID: 0 2023-09-21T03:39:16.481 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-09-21T03:39:16.479+0000 7f9692588700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 639052) UID: 0 2023-09-21T03:39:16.481 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-09-21T03:39:16.479+0000 7f7948a08700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 639052) UID: 0 2023-09-21T03:42:53.938 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:42:53.947 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:42:54.068 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-09-21T03:42:54.067+0000 7fe56ff7b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122108) UID: 0 2023-09-21T03:42:54.069 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-09-21T03:42:54.067+0000 7fceb8335700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122108) UID: 0 2023-09-21T03:42:54.070 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-09-21T03:42:54.068+0000 7fae7ed95700 -1 received signal: Hangup from (PID: 122108) UID: 0 2023-09-21T03:42:54.070 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-09-21T03:42:54.068+0000 7f6a304c5700 -1 received signal: Hangup from (PID: 122108) UID: 0 2023-09-21T03:46:16.345 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:46:16.348 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:46:46.453 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:46:46.456 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:47:16.994 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:47:16.997 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:47:47.074 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:47:47.077 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:48:17.180 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:48:17.183 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:48:17.228 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-09-21T03:48:17.227+0000 7fadc2fd5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 639264) UID: 0 2023-09-21T03:48:17.229 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-09-21T03:48:17.227+0000 7fc5c83b6700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 639264) UID: 0 2023-09-21T03:48:17.229 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-09-21T03:48:17.227+0000 7f7948a08700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 639264) UID: 0 2023-09-21T03:48:17.229 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-09-21T03:48:17.227+0000 7f9692588700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 639264) UID: 0 2023-09-21T03:51:41.672 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:51:41.676 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:51:41.892 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-09-21T03:51:41.891+0000 7fadc2fd5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 639319) UID: 0 2023-09-21T03:51:41.892 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-09-21T03:51:41.891+0000 7f7948a08700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 639319) UID: 0 2023-09-21T03:51:41.893 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-09-21T03:51:41.891+0000 7fc5c83b6700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 639319) UID: 0 2023-09-21T03:51:41.893 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-09-21T03:51:41.891+0000 7f9692588700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 639319) UID: 0 2023-09-21T03:55:09.908 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:55:09.924 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T03:55:09.971 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-09-21T03:55:09.970+0000 7fe56ff7b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122373) UID: 0 2023-09-21T03:55:09.971 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-09-21T03:55:09.970+0000 7f6a304c5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122373) UID: 0 2023-09-21T03:55:09.972 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-09-21T03:55:09.970+0000 7fae7ed95700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122373) UID: 0 2023-09-21T03:55:09.972 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-09-21T03:55:09.970+0000 7fceb8335700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122373) UID: 0 2023-09-21T04:01:28.473 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:01:28.478 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:01:58.607 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:01:58.610 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:02:28.706 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:02:28.710 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:02:58.793 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:02:58.796 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:03:28.881 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:03:28.884 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:03:28.954 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-09-21T04:03:28.954+0000 7fadc2fd5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 639564) UID: 0 2023-09-21T04:03:28.955 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-09-21T04:03:28.954+0000 7fc5c83b6700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 639564) UID: 0 2023-09-21T04:03:28.956 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-09-21T04:03:28.954+0000 7f7948a08700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 639564) UID: 0 2023-09-21T04:03:28.956 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-09-21T04:03:28.955+0000 7f9692588700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 639564) UID: 0 2023-09-21T04:06:55.684 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:06:55.687 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:07:26.030 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:07:26.035 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:07:56.128 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:07:56.131 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:08:26.253 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:08:26.256 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:08:56.410 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:08:56.413 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:08:56.522 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-09-21T04:08:56.522+0000 7fe56ff7b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122711) UID: 0 2023-09-21T04:08:56.523 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-09-21T04:08:56.522+0000 7fceb8335700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122711) UID: 0 2023-09-21T04:08:56.526 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-09-21T04:08:56.526+0000 7f6a304c5700 -1 Fail to open '/proc/122711/cmdline' error = (2) No such file or directory 2023-09-21T04:08:56.527 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-09-21T04:08:56.526+0000 7f6a304c5700 -1 received signal: Hangup from (PID: 122711) UID: 0 2023-09-21T04:08:56.529 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-09-21T04:08:56.526+0000 7fae7ed95700 -1 Fail to open '/proc/122711/cmdline' error = (2) No such file or directory 2023-09-21T04:08:56.530 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-09-21T04:08:56.526+0000 7fae7ed95700 -1 received signal: Hangup from (PID: 122711) UID: 0 2023-09-21T04:12:25.651 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:12:25.658 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:12:55.811 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:12:55.816 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:13:25.890 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:13:25.896 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:13:55.990 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:13:56.005 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:14:26.346 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:14:26.351 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:14:26.418 INFO:tasks.ceph.mds.a.smithi059.stderr:2023-09-21T04:14:26.418+0000 7facd961b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 639874) UID: 0 2023-09-21T04:14:26.418 INFO:tasks.ceph.mds.c.smithi059.stderr:2023-09-21T04:14:26.417+0000 7fa085432700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 639874) UID: 0 2023-09-21T04:17:15.044 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-09-21T04:17:15.044+0000 7fadc2fd5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 639903) UID: 0 2023-09-21T04:17:15.045 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-09-21T04:17:15.044+0000 7fc5c83b6700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 639903) UID: 0 2023-09-21T04:17:15.045 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-09-21T04:17:15.045+0000 7f7948a08700 -1 received signal: Hangup from (PID: 639903) UID: 0 2023-09-21T04:17:15.046 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-09-21T04:17:15.046+0000 7f9692588700 -1 Fail to open '/proc/639903/cmdline' error = (2) No such file or directory 2023-09-21T04:17:15.046 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-09-21T04:17:15.046+0000 7f9692588700 -1 received signal: Hangup from (PID: 639903) UID: 0 2023-09-21T04:20:42.409 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:20:42.413 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:20:42.491 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-09-21T04:20:42.490+0000 7fae7ed95700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122951) UID: 0 2023-09-21T04:20:42.491 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-09-21T04:20:42.490+0000 7fe56ff7b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122951) UID: 0 2023-09-21T04:20:42.493 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-09-21T04:20:42.493+0000 7fceb8335700 -1 Fail to open '/proc/122951/cmdline' error = (2) No such file or directory 2023-09-21T04:20:42.493 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-09-21T04:20:42.493+0000 7fceb8335700 -1 received signal: Hangup from (PID: 122951) UID: 0 2023-09-21T04:20:42.494 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-09-21T04:20:42.494+0000 7f6a304c5700 -1 Fail to open '/proc/122951/cmdline' error = (2) No such file or directory 2023-09-21T04:20:42.494 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-09-21T04:20:42.494+0000 7f6a304c5700 -1 received signal: Hangup from (PID: 122951) UID: 0 2023-09-21T04:24:03.837 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:24:03.840 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:24:34.018 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:24:34.021 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:25:04.173 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:25:04.177 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:25:04.258 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-09-21T04:25:04.255+0000 7fe56ff7b700 -1 Fail to open '/proc/123050/cmdline' error = (2) No such file or directory 2023-09-21T04:25:04.258 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-09-21T04:25:04.255+0000 7fe56ff7b700 -1 received signal: Hangup from (PID: 123050) UID: 0 2023-09-21T04:25:04.258 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-09-21T04:25:04.253+0000 7f6a304c5700 -1 Fail to open '/proc/123050/cmdline' error = (2) No such file or directory 2023-09-21T04:25:04.259 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-09-21T04:25:04.253+0000 7f6a304c5700 -1 received signal: Hangup from (PID: 123050) UID: 0 2023-09-21T04:25:04.259 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-09-21T04:25:04.253+0000 7fae7ed95700 -1 Fail to open '/proc/123050/cmdline' error = (2) No such file or directory 2023-09-21T04:25:04.259 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-09-21T04:25:04.253+0000 7fae7ed95700 -1 received signal: Hangup from (PID: 123050) UID: 0 2023-09-21T04:25:04.260 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-09-21T04:25:04.252+0000 7fceb8335700 -1 received signal: Hangup from (PID: 123050) UID: 0 2023-09-21T04:28:17.842 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:28:17.845 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:28:17.907 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-09-21T04:28:17.905+0000 7fadc2fd5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 640110) UID: 0 2023-09-21T04:28:17.908 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-09-21T04:28:17.906+0000 7fc5c83b6700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 640110) UID: 0 2023-09-21T04:28:17.908 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-09-21T04:28:17.906+0000 7f9692588700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 640110) UID: 0 2023-09-21T04:28:17.909 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-09-21T04:28:17.907+0000 7f7948a08700 -1 received signal: Hangup from (PID: 640110) UID: 0 2023-09-21T04:30:22.336 INFO:teuthology.orchestra.run.smithi059.stdout:generic/521 5721s 2023-09-21T04:30:22.372 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/521 2023-09-21T04:30:22.372 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T04:30:22.374 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T04:30:22.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T04:30:22.989 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2023-09-21T04:30:23.756 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T04:30:23.769 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T04:30:23.769 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T04:30:23.771 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T04:30:23.771 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T04:34:50.428 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:34:50.431 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:35:20.533 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:35:20.537 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:35:50.607 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:35:50.610 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:36:20.735 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:36:20.737 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:36:50.861 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:36:50.864 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:37:21.246 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:37:21.249 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:37:51.562 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:37:51.565 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:38:21.628 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:38:21.633 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:38:21.726 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-09-21T04:38:21.726+0000 7fc5c83b6700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 641061) UID: 0 2023-09-21T04:38:21.728 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-09-21T04:38:21.728+0000 7f7948a08700 -1 Fail to open '/proc/641061/cmdline' error = (2) No such file or directory 2023-09-21T04:38:21.729 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-09-21T04:38:21.728+0000 7f7948a08700 -1 received signal: Hangup from (PID: 641061) UID: 0 2023-09-21T04:38:21.729 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-09-21T04:38:21.726+0000 7fadc2fd5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 641061) UID: 0 2023-09-21T04:38:21.730 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-09-21T04:38:21.728+0000 7f9692588700 -1 Fail to open '/proc/641061/cmdline' error = (2) No such file or directory 2023-09-21T04:38:21.730 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-09-21T04:38:21.728+0000 7f9692588700 -1 received signal: Hangup from (PID: 641061) UID: 0 2023-09-21T04:41:47.269 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:41:47.272 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:41:47.338 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-09-21T04:41:47.338+0000 7fae7ed95700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123417) UID: 0 2023-09-21T04:41:47.339 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-09-21T04:41:47.338+0000 7fceb8335700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123417) UID: 0 2023-09-21T04:41:47.340 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-09-21T04:41:47.338+0000 7f6a304c5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123417) UID: 0 2023-09-21T04:41:47.340 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-09-21T04:41:47.339+0000 7fe56ff7b700 -1 Fail to open '/proc/123417/cmdline' error = (2) No such file or directory 2023-09-21T04:41:47.340 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-09-21T04:41:47.339+0000 7fe56ff7b700 -1 received signal: Hangup from (PID: 123417) UID: 0 2023-09-21T04:45:22.158 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:45:22.161 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:45:22.401 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-09-21T04:45:22.401+0000 7fe56ff7b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123475) UID: 0 2023-09-21T04:45:22.402 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-09-21T04:45:22.401+0000 7f6a304c5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123475) UID: 0 2023-09-21T04:45:22.403 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-09-21T04:45:22.401+0000 7fae7ed95700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123475) UID: 0 2023-09-21T04:45:22.404 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-09-21T04:45:22.402+0000 7fceb8335700 -1 Fail to open '/proc/123475/cmdline' error = (2) No such file or directory 2023-09-21T04:45:22.404 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-09-21T04:45:22.402+0000 7fceb8335700 -1 received signal: Hangup from (PID: 123475) UID: 0 2023-09-21T04:48:41.818 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:48:41.821 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:49:12.076 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:49:12.079 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:49:42.157 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:49:42.160 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:50:12.234 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:50:12.237 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:50:42.305 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:50:42.307 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:51:12.665 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:51:12.668 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:51:42.767 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:51:42.770 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:52:12.841 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:52:12.844 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:52:42.934 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:52:42.937 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:53:13.011 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:53:13.015 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:53:43.127 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:53:43.130 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:54:13.600 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:54:13.603 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:54:43.744 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:54:43.747 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:55:13.855 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:55:13.858 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:55:43.929 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:55:43.932 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:56:14.100 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:56:14.102 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:56:14.146 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-09-21T04:56:14.146+0000 7fe56ff7b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123912) UID: 0 2023-09-21T04:56:14.147 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-09-21T04:56:14.146+0000 7f6a304c5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123912) UID: 0 2023-09-21T04:56:14.147 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-09-21T04:56:14.146+0000 7fae7ed95700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123912) UID: 0 2023-09-21T04:56:14.148 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-09-21T04:56:14.147+0000 7fceb8335700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123912) UID: 0 2023-09-21T04:59:30.495 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:59:30.498 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T04:59:30.609 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-09-21T04:59:30.608+0000 7fe56ff7b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123962) UID: 0 2023-09-21T04:59:30.611 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-09-21T04:59:30.611+0000 7fceb8335700 -1 Fail to open '/proc/123962/cmdline' error = (2) No such file or directory 2023-09-21T04:59:30.612 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-09-21T04:59:30.611+0000 7fceb8335700 -1 received signal: Hangup from (PID: 123962) UID: 0 2023-09-21T04:59:30.613 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-09-21T04:59:30.612+0000 7fae7ed95700 -1 Fail to open '/proc/123962/cmdline' error = (2) No such file or directory 2023-09-21T04:59:30.613 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-09-21T04:59:30.612+0000 7fae7ed95700 -1 received signal: Hangup from (PID: 123962) UID: 0 2023-09-21T04:59:30.614 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-09-21T04:59:30.613+0000 7f6a304c5700 -1 Fail to open '/proc/123962/cmdline' error = (2) No such file or directory 2023-09-21T04:59:30.614 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-09-21T04:59:30.613+0000 7f6a304c5700 -1 received signal: Hangup from (PID: 123962) UID: 0 2023-09-21T05:03:01.998 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:03:02.001 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:03:02.074 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-09-21T05:03:02.074+0000 7fadc2fd5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 641718) UID: 0 2023-09-21T05:03:02.075 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-09-21T05:03:02.074+0000 7f7948a08700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 641718) UID: 0 2023-09-21T05:03:02.076 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-09-21T05:03:02.074+0000 7fc5c83b6700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 641718) UID: 0 2023-09-21T05:03:02.076 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-09-21T05:03:02.075+0000 7f9692588700 -1 received signal: Hangup from (PID: 641718) UID: 0 2023-09-21T05:09:36.449 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:09:36.452 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:09:36.526 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-09-21T05:09:36.526+0000 7fadc2fd5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 641803) UID: 0 2023-09-21T05:09:36.526 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-09-21T05:09:36.526+0000 7fc5c83b6700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 641803) UID: 0 2023-09-21T05:09:36.527 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-09-21T05:09:36.526+0000 7f7948a08700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 641803) UID: 0 2023-09-21T05:09:36.527 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-09-21T05:09:36.526+0000 7f9692588700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 641803) UID: 0 2023-09-21T05:13:26.158 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:13:26.164 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:13:26.225 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-09-21T05:13:26.225+0000 7fae7ed95700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124163) UID: 0 2023-09-21T05:13:26.226 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-09-21T05:13:26.225+0000 7f6a304c5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124163) UID: 0 2023-09-21T05:13:26.226 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-09-21T05:13:26.226+0000 7fceb8335700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124163) UID: 0 2023-09-21T05:13:26.228 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-09-21T05:13:26.225+0000 7fe56ff7b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124163) UID: 0 2023-09-21T05:17:06.371 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:17:06.374 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:17:36.530 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:17:36.533 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:18:06.607 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:18:06.610 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:18:36.714 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:18:36.718 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:19:07.304 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:19:07.307 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:19:37.909 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:19:37.912 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:20:07.994 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:20:08.002 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:20:38.109 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:20:38.112 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:21:08.197 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:21:08.199 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:21:38.321 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:21:38.324 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:22:08.419 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:22:08.421 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:22:38.549 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:22:38.552 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:23:08.633 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:23:08.637 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:23:38.960 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:23:38.963 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:24:09.366 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:24:09.369 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:24:39.468 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:24:39.471 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:25:09.576 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:25:09.579 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:25:39.731 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:25:39.735 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:26:10.078 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:26:10.145 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:26:10.201 INFO:tasks.ceph.mds.a.smithi059.stderr:2023-09-21T05:26:10.199+0000 7facd961b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 642379) UID: 0 2023-09-21T05:26:10.203 INFO:tasks.ceph.mds.c.smithi059.stderr:2023-09-21T05:26:10.199+0000 7fa085432700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 642379) UID: 0 2023-09-21T05:28:56.318 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-09-21T05:28:56.318+0000 7f7948a08700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 642401) UID: 0 2023-09-21T05:28:56.319 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-09-21T05:28:56.317+0000 7fc5c83b6700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 642401) UID: 0 2023-09-21T05:28:56.319 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-09-21T05:28:56.317+0000 7fadc2fd5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 642401) UID: 0 2023-09-21T05:28:56.319 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-09-21T05:28:56.319+0000 7f9692588700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 642401) UID: 0 2023-09-21T05:32:23.091 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:32:23.095 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:32:23.268 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-09-21T05:32:23.268+0000 7fe56ff7b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124758) UID: 0 2023-09-21T05:32:23.269 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-09-21T05:32:23.268+0000 7fae7ed95700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124758) UID: 0 2023-09-21T05:32:23.269 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-09-21T05:32:23.268+0000 7f6a304c5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124758) UID: 0 2023-09-21T05:32:23.269 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-09-21T05:32:23.269+0000 7fceb8335700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124758) UID: 0 2023-09-21T05:39:00.608 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:39:00.613 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:39:00.691 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-09-21T05:39:00.692+0000 7fadc2fd5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 642534) UID: 0 2023-09-21T05:39:00.692 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-09-21T05:39:00.693+0000 7fc5c83b6700 -1 Fail to open '/proc/642534/cmdline' error = (2) No such file or directory 2023-09-21T05:39:00.693 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-09-21T05:39:00.693+0000 7fc5c83b6700 -1 received signal: Hangup from (PID: 642534) UID: 0 2023-09-21T05:39:00.696 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-09-21T05:39:00.692+0000 7f7948a08700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 642534) UID: 0 2023-09-21T05:39:00.697 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-09-21T05:39:00.697+0000 7f9692588700 -1 Fail to open '/proc/642534/cmdline' error = (2) No such file or directory 2023-09-21T05:39:00.697 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-09-21T05:39:00.697+0000 7f9692588700 -1 received signal: Hangup from (PID: 642534) UID: 0 2023-09-21T05:39:00.744 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-09-21T05:39:00.744+0000 7fe56ff7b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124833) UID: 0 2023-09-21T05:39:00.745 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-09-21T05:39:00.744+0000 7f6a304c5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124833) UID: 0 2023-09-21T05:39:00.745 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-09-21T05:39:00.744+0000 7fae7ed95700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124833) UID: 0 2023-09-21T05:39:00.746 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-09-21T05:39:00.744+0000 7fceb8335700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124833) UID: 0 2023-09-21T05:39:15.776 INFO:teuthology.orchestra.run.smithi059.stdout:generic/522 4131s 2023-09-21T05:39:15.991 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/522 2023-09-21T05:39:15.992 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T05:39:15.994 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:39:16.059 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T05:39:16.083 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2023-09-21T05:39:17.876 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T05:39:17.887 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T05:39:17.887 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T05:39:17.893 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T05:39:17.893 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:39:19.031 INFO:teuthology.orchestra.run.smithi059.stdout:generic/523 1s 2023-09-21T05:39:19.043 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/523 2023-09-21T05:39:19.043 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T05:39:19.048 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:39:19.066 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T05:39:19.066 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2023-09-21T05:39:19.496 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T05:39:19.514 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T05:39:19.515 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T05:39:19.516 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T05:39:19.516 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:39:26.329 INFO:teuthology.orchestra.run.smithi059.stdout:generic/524 7s 2023-09-21T05:39:26.341 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/524 2023-09-21T05:39:26.341 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T05:39:26.343 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:39:26.371 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T05:39:26.372 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2023-09-21T05:39:26.788 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T05:39:26.795 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T05:39:26.796 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T05:39:26.797 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T05:39:26.798 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:39:27.690 INFO:teuthology.orchestra.run.smithi059.stdout:generic/525 [not run] filesystem does not support huge file size 2023-09-21T05:39:27.723 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/525 2023-09-21T05:39:27.724 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/525 2023-09-21T05:39:27.724 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T05:39:27.733 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:39:27.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T05:39:27.783 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2023-09-21T05:39:28.174 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T05:39:28.186 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T05:39:28.187 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T05:39:28.191 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T05:39:28.191 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:39:28.939 INFO:teuthology.orchestra.run.smithi059.stdout:generic/526 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T05:39:28.943 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/526 2023-09-21T05:39:28.944 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/526 2023-09-21T05:39:28.944 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T05:39:28.946 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:39:29.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T05:39:29.001 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2023-09-21T05:39:29.416 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T05:39:29.429 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T05:39:29.430 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T05:39:29.434 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T05:39:29.434 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:39:30.100 INFO:teuthology.orchestra.run.smithi059.stdout:generic/527 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T05:39:30.114 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/527 2023-09-21T05:39:30.114 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/527 2023-09-21T05:39:30.115 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T05:39:30.116 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:39:30.163 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T05:39:30.164 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2023-09-21T05:39:30.555 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T05:39:30.562 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T05:39:30.562 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T05:39:30.563 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T05:39:30.564 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:39:31.727 INFO:teuthology.orchestra.run.smithi059.stdout:generic/528 1s 2023-09-21T05:39:31.788 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/528 2023-09-21T05:39:31.788 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T05:39:31.862 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:39:32.291 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T05:39:32.291 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2023-09-21T05:39:32.902 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T05:39:32.907 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T05:39:32.907 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T05:39:32.909 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T05:39:32.910 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:39:34.381 INFO:teuthology.orchestra.run.smithi059.stdout:generic/529 1s 2023-09-21T05:39:34.402 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/529 2023-09-21T05:39:34.402 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T05:39:34.405 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:39:34.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T05:39:34.419 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2023-09-21T05:39:34.869 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T05:39:34.877 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T05:39:34.878 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T05:39:34.879 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T05:39:34.879 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:39:35.773 INFO:teuthology.orchestra.run.smithi059.stdout:generic/530 [not run] ceph does not support shutdown 2023-09-21T05:39:35.806 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/530 2023-09-21T05:39:35.806 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/530 2023-09-21T05:39:35.806 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T05:39:35.808 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:39:35.845 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T05:39:35.845 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2023-09-21T05:39:36.335 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T05:39:36.340 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T05:39:36.341 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T05:39:36.342 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T05:39:36.342 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:39:36.908 INFO:teuthology.orchestra.run.smithi059.stdout:generic/531 [not run] O_TMPFILE is not supported 2023-09-21T05:39:36.913 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/531 2023-09-21T05:39:36.913 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/531 2023-09-21T05:39:36.913 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T05:39:36.916 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:39:36.964 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T05:39:36.964 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2023-09-21T05:39:37.428 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T05:39:37.441 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T05:39:37.441 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T05:39:37.444 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T05:39:37.444 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:39:38.071 INFO:teuthology.orchestra.run.smithi059.stdout:generic/532 1s 2023-09-21T05:39:38.080 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/532 2023-09-21T05:39:38.080 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T05:39:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:39:38.139 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T05:39:38.139 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2023-09-21T05:39:38.571 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T05:39:38.577 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T05:39:38.579 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T05:39:38.580 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T05:39:38.580 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:39:40.222 INFO:teuthology.orchestra.run.smithi059.stdout:generic/533 2s 2023-09-21T05:39:40.235 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/533 2023-09-21T05:39:40.235 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T05:39:40.239 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:39:40.280 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T05:39:40.281 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2023-09-21T05:39:40.706 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T05:39:40.729 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T05:39:40.729 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T05:39:40.730 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T05:39:40.730 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:39:41.351 INFO:teuthology.orchestra.run.smithi059.stdout:generic/534 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T05:39:41.357 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/534 2023-09-21T05:39:41.357 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/534 2023-09-21T05:39:41.357 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T05:39:41.363 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:39:41.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T05:39:41.400 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2023-09-21T05:39:41.901 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T05:39:41.906 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T05:39:41.907 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T05:39:41.908 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T05:39:41.908 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:39:42.540 INFO:teuthology.orchestra.run.smithi059.stdout:generic/535 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T05:39:42.551 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/535 2023-09-21T05:39:42.551 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/535 2023-09-21T05:39:42.551 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T05:39:42.554 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:39:42.613 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T05:39:42.614 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2023-09-21T05:39:43.064 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T05:39:43.077 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T05:39:43.077 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T05:39:43.079 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T05:39:43.080 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:39:43.990 INFO:teuthology.orchestra.run.smithi059.stdout:generic/536 [not run] ceph does not support shutdown 2023-09-21T05:39:44.041 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/536 2023-09-21T05:39:44.041 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/536 2023-09-21T05:39:44.041 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T05:39:44.050 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:39:44.080 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T05:39:44.081 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2023-09-21T05:39:44.473 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T05:39:44.480 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T05:39:44.481 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T05:39:44.483 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T05:39:44.483 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:39:45.385 INFO:teuthology.orchestra.run.smithi059.stdout:generic/537 [not run] FSTRIM not supported 2023-09-21T05:39:45.403 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/537 2023-09-21T05:39:45.404 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/537 2023-09-21T05:39:45.404 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T05:39:45.407 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:39:45.447 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T05:39:45.448 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2023-09-21T05:39:45.909 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T05:39:45.920 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T05:39:45.920 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T05:39:45.921 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T05:39:45.921 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:42:41.458 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:42:41.461 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:42:41.531 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-09-21T05:42:41.531+0000 7fae7ed95700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125396) UID: 0 2023-09-21T05:42:41.532 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-09-21T05:42:41.531+0000 7fceb8335700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125396) UID: 0 2023-09-21T05:42:41.534 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-09-21T05:42:41.533+0000 7fe56ff7b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125396) UID: 0 2023-09-21T05:42:41.534 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-09-21T05:42:41.531+0000 7f6a304c5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125396) UID: 0 2023-09-21T05:46:03.622 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:46:03.625 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:46:03.713 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-09-21T05:46:03.713+0000 7fadc2fd5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 655443) UID: 0 2023-09-21T05:46:03.713 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-09-21T05:46:03.713+0000 7f7948a08700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 655443) UID: 0 2023-09-21T05:46:03.713 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-09-21T05:46:03.713+0000 7f9692588700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 655443) UID: 0 2023-09-21T05:46:03.715 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-09-21T05:46:03.713+0000 7fc5c83b6700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 655443) UID: 0 2023-09-21T05:49:21.615 INFO:teuthology.orchestra.run.smithi059.stdout:generic/538 575s 2023-09-21T05:49:21.624 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/538 2023-09-21T05:49:21.624 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T05:49:21.627 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:49:22.200 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T05:49:22.201 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2023-09-21T05:49:22.573 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T05:49:22.579 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T05:49:22.580 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T05:49:22.583 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T05:49:22.583 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:49:25.179 INFO:teuthology.orchestra.run.smithi059.stdout:generic/539 3s 2023-09-21T05:49:25.190 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/539 2023-09-21T05:49:25.190 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T05:49:25.193 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:49:25.511 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T05:49:25.511 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2023-09-21T05:49:26.020 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T05:49:26.026 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T05:49:26.026 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T05:49:26.027 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T05:49:26.028 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:49:27.098 INFO:teuthology.orchestra.run.smithi059.stdout:generic/540 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T05:49:27.257 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/540 2023-09-21T05:49:27.257 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/540 2023-09-21T05:49:27.258 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T05:49:27.306 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:49:27.376 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T05:49:27.377 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2023-09-21T05:49:27.751 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T05:49:27.759 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T05:49:27.759 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T05:49:27.760 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T05:49:27.761 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:49:28.970 INFO:teuthology.orchestra.run.smithi059.stdout:generic/541 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T05:49:28.999 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/541 2023-09-21T05:49:28.999 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/541 2023-09-21T05:49:28.999 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T05:49:29.028 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:49:29.075 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T05:49:29.075 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2023-09-21T05:49:29.458 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T05:49:29.473 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T05:49:29.474 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T05:49:29.475 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T05:49:29.476 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:49:30.770 INFO:teuthology.orchestra.run.smithi059.stdout:generic/542 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T05:49:30.795 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/542 2023-09-21T05:49:30.795 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/542 2023-09-21T05:49:30.795 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T05:49:30.801 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:49:30.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T05:49:30.836 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2023-09-21T05:49:31.229 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T05:49:31.234 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T05:49:31.234 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T05:49:31.235 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T05:49:31.237 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:49:32.494 INFO:teuthology.orchestra.run.smithi059.stdout:generic/543 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T05:49:32.517 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/543 2023-09-21T05:49:32.517 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/543 2023-09-21T05:49:32.517 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T05:49:32.519 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:49:32.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T05:49:32.569 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2023-09-21T05:49:32.897 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T05:49:32.903 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T05:49:32.903 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T05:49:32.904 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T05:49:32.904 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:49:34.105 INFO:teuthology.orchestra.run.smithi059.stdout:generic/544 [not run] Reflink not supported by scratch filesystem type: ceph 2023-09-21T05:49:34.151 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/544 2023-09-21T05:49:34.151 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/544 2023-09-21T05:49:34.151 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T05:49:34.196 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:49:34.256 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T05:49:34.257 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2023-09-21T05:49:34.639 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T05:49:34.643 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T05:49:34.644 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T05:49:34.645 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T05:49:34.645 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:49:35.286 INFO:teuthology.orchestra.run.smithi059.stdout:generic/545 [not run] file system doesn't support chattr +i 2023-09-21T05:49:35.292 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/545 2023-09-21T05:49:35.293 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/545 2023-09-21T05:49:35.293 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T05:49:35.296 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:49:35.343 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T05:49:35.343 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2023-09-21T05:49:35.710 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T05:49:35.715 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T05:49:35.715 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T05:49:35.717 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T05:49:35.717 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:49:36.342 INFO:teuthology.orchestra.run.smithi059.stdout:generic/546 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-09-21T05:49:36.347 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/546 2023-09-21T05:49:36.347 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/546 2023-09-21T05:49:36.347 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T05:49:36.349 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:49:36.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T05:49:36.401 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2023-09-21T05:49:36.795 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T05:49:36.799 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T05:49:36.801 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T05:49:36.806 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T05:49:36.806 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:49:37.331 INFO:teuthology.orchestra.run.smithi059.stdout:generic/547 [not run] require 172.21.15.59:6789:/scratch to be valid block disk 2023-09-21T05:49:37.336 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/547 2023-09-21T05:49:37.336 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/547 2023-09-21T05:49:37.337 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T05:49:37.339 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:49:37.370 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T05:49:37.371 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2023-09-21T05:49:37.751 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T05:49:37.758 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T05:49:37.759 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T05:49:37.760 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T05:49:37.760 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:49:38.626 INFO:teuthology.orchestra.run.smithi059.stdout:generic/548 [not run] kernel does not support ceph encryption 2023-09-21T05:49:38.659 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/548 2023-09-21T05:49:38.659 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/548 2023-09-21T05:49:38.659 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T05:49:38.661 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:49:38.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T05:49:38.698 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2023-09-21T05:49:39.097 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T05:49:39.102 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T05:49:39.103 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T05:49:39.104 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T05:49:39.104 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:49:39.971 INFO:teuthology.orchestra.run.smithi059.stdout:generic/549 [not run] kernel does not support ceph encryption 2023-09-21T05:49:39.991 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/549 2023-09-21T05:49:39.992 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/549 2023-09-21T05:49:39.992 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T05:49:40.001 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:49:40.028 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T05:49:40.029 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2023-09-21T05:49:40.437 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T05:49:40.442 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T05:49:40.442 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T05:49:40.443 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T05:49:40.443 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:49:41.307 INFO:teuthology.orchestra.run.smithi059.stdout:generic/550 [not run] kernel does not support ceph encryption 2023-09-21T05:49:41.349 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/550 2023-09-21T05:49:41.349 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/550 2023-09-21T05:49:41.349 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-09-21T05:49:41.351 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:49:41.378 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-21T05:49:41.379 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.evOnb5iVkLxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2023-09-21T05:49:41.725 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph 2023-09-21T05:49:41.731 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-09-21T05:49:41.731 INFO:teuthology.orchestra.run.smithi059.stdout:MKFS_OPTIONS -- 172.21.15.59:6789:/scratch 2023-09-21T05:49:41.732 INFO:teuthology.orchestra.run.smithi059.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBIiwtlZZaHKRAAZXJuxdwD1f77RSpdCpwE+g== -o context=system_u:object_r:root_t:s0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch 2023-09-21T05:49:41.733 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T05:49:45.302 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:49:45.305 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:49:45.375 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-09-21T05:49:45.375+0000 7fadc2fd5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 664294) UID: 0 2023-09-21T05:49:45.375 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-09-21T05:49:45.375+0000 7fc5c83b6700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 664294) UID: 0 2023-09-21T05:49:45.376 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-09-21T05:49:45.376+0000 7f7948a08700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 664294) UID: 0 2023-09-21T05:49:45.382 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-09-21T05:49:45.382+0000 7f9692588700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 664294) UID: 0 2023-09-21T05:53:34.939 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:53:34.942 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:54:05.111 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:54:05.114 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:54:35.218 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:54:35.222 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:55:05.287 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:55:05.295 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:55:35.417 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:55:35.420 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:56:05.782 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:56:05.785 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:56:35.877 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:56:35.884 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:57:06.033 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:57:06.040 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:57:36.173 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:57:36.181 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T05:57:36.324 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-09-21T05:57:36.325+0000 7fe56ff7b700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127691) UID: 0 2023-09-21T05:57:36.325 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-09-21T05:57:36.325+0000 7fae7ed95700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127691) UID: 0 2023-09-21T05:57:36.325 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-09-21T05:57:36.325+0000 7f6a304c5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127691) UID: 0 2023-09-21T05:57:36.326 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-09-21T05:57:36.327+0000 7fceb8335700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127691) UID: 0 2023-09-21T05:58:20.084 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-09-21T05:58:20.065+0000 7f968895f700 -1 bdev(0x559d31e42000 /var/lib/ceph/osd/ceph-3/block) _aio_thread got r=-28 ((28) No space left on device) 2023-09-21T05:58:20.131 INFO:tasks.ceph.osd.3.smithi059.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6213-gbf8a061f/rpm/el8/BUILD/ceph-18.0.0-6213-gbf8a061f/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f968895f700 time 2023-09-21T05:58:20.101807+0000 2023-09-21T05:58:20.132 INFO:tasks.ceph.osd.3.smithi059.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6213-gbf8a061f/rpm/el8/BUILD/ceph-18.0.0-6213-gbf8a061f/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-09-21T05:58:20.132 INFO:tasks.ceph.osd.3.smithi059.stderr: ceph version 18.0.0-6213-gbf8a061f (bf8a061ff16ac1d393cf108f740d92dfa49f2e54) reef (dev) 2023-09-21T05:58:20.132 INFO:tasks.ceph.osd.3.smithi059.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x559d2d54f0cd] 2023-09-21T05:58:20.132 INFO:tasks.ceph.osd.3.smithi059.stderr: 2: (KernelDevice::_aio_thread()+0x1686) [0x559d2e197196] 2023-09-21T05:58:20.132 INFO:tasks.ceph.osd.3.smithi059.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x559d2e19cbb1] 2023-09-21T05:58:20.133 INFO:tasks.ceph.osd.3.smithi059.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7f969ac851cf] 2023-09-21T05:58:20.133 INFO:tasks.ceph.osd.3.smithi059.stderr: 5: clone() 2023-09-21T05:58:20.133 INFO:tasks.ceph.osd.3.smithi059.stderr:*** Caught signal (Aborted) ** 2023-09-21T05:58:20.133 INFO:tasks.ceph.osd.3.smithi059.stderr: in thread 7f968895f700 thread_name:bstore_aio 2023-09-21T05:58:20.133 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-09-21T05:58:20.130+0000 7f968895f700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6213-gbf8a061f/rpm/el8/BUILD/ceph-18.0.0-6213-gbf8a061f/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f968895f700 time 2023-09-21T05:58:20.101807+0000 2023-09-21T05:58:20.133 INFO:tasks.ceph.osd.3.smithi059.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6213-gbf8a061f/rpm/el8/BUILD/ceph-18.0.0-6213-gbf8a061f/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-09-21T05:58:20.134 INFO:tasks.ceph.osd.3.smithi059.stderr: 2023-09-21T05:58:20.134 INFO:tasks.ceph.osd.3.smithi059.stderr: ceph version 18.0.0-6213-gbf8a061f (bf8a061ff16ac1d393cf108f740d92dfa49f2e54) reef (dev) 2023-09-21T05:58:20.134 INFO:tasks.ceph.osd.3.smithi059.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x559d2d54f0cd] 2023-09-21T05:58:20.135 INFO:tasks.ceph.osd.3.smithi059.stderr: 2: (KernelDevice::_aio_thread()+0x1686) [0x559d2e197196] 2023-09-21T05:58:20.135 INFO:tasks.ceph.osd.3.smithi059.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x559d2e19cbb1] 2023-09-21T05:58:20.135 INFO:tasks.ceph.osd.3.smithi059.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7f969ac851cf] 2023-09-21T05:58:20.135 INFO:tasks.ceph.osd.3.smithi059.stderr: 5: clone() 2023-09-21T05:58:20.135 INFO:tasks.ceph.osd.3.smithi059.stderr: 2023-09-21T05:58:20.144 INFO:tasks.ceph.osd.3.smithi059.stderr: ceph version 18.0.0-6213-gbf8a061f (bf8a061ff16ac1d393cf108f740d92dfa49f2e54) reef (dev) 2023-09-21T05:58:20.144 INFO:tasks.ceph.osd.3.smithi059.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f969ac8fce0] 2023-09-21T05:58:20.144 INFO:tasks.ceph.osd.3.smithi059.stderr: 2: gsignal() 2023-09-21T05:58:20.144 INFO:tasks.ceph.osd.3.smithi059.stderr: 3: abort() 2023-09-21T05:58:20.144 INFO:tasks.ceph.osd.3.smithi059.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x559d2d54f18d] 2023-09-21T05:58:20.145 INFO:tasks.ceph.osd.3.smithi059.stderr: 5: (KernelDevice::_aio_thread()+0x1686) [0x559d2e197196] 2023-09-21T05:58:20.145 INFO:tasks.ceph.osd.3.smithi059.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x559d2e19cbb1] 2023-09-21T05:58:20.145 INFO:tasks.ceph.osd.3.smithi059.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7f969ac851cf] 2023-09-21T05:58:20.145 INFO:tasks.ceph.osd.3.smithi059.stderr: 8: clone() 2023-09-21T05:58:20.236 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-09-21T05:58:20.229+0000 7f968895f700 -1 *** Caught signal (Aborted) ** 2023-09-21T05:58:20.237 INFO:tasks.ceph.osd.3.smithi059.stderr: in thread 7f968895f700 thread_name:bstore_aio 2023-09-21T05:58:20.237 INFO:tasks.ceph.osd.3.smithi059.stderr: 2023-09-21T05:58:20.237 INFO:tasks.ceph.osd.3.smithi059.stderr: ceph version 18.0.0-6213-gbf8a061f (bf8a061ff16ac1d393cf108f740d92dfa49f2e54) reef (dev) 2023-09-21T05:58:20.237 INFO:tasks.ceph.osd.3.smithi059.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f969ac8fce0] 2023-09-21T05:58:20.238 INFO:tasks.ceph.osd.3.smithi059.stderr: 2: gsignal() 2023-09-21T05:58:20.238 INFO:tasks.ceph.osd.3.smithi059.stderr: 3: abort() 2023-09-21T05:58:20.238 INFO:tasks.ceph.osd.3.smithi059.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x559d2d54f18d] 2023-09-21T05:58:20.238 INFO:tasks.ceph.osd.3.smithi059.stderr: 5: (KernelDevice::_aio_thread()+0x1686) [0x559d2e197196] 2023-09-21T05:58:20.238 INFO:tasks.ceph.osd.3.smithi059.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x559d2e19cbb1] 2023-09-21T05:58:20.239 INFO:tasks.ceph.osd.3.smithi059.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7f969ac851cf] 2023-09-21T05:58:20.239 INFO:tasks.ceph.osd.3.smithi059.stderr: 8: clone() 2023-09-21T05:58:20.239 INFO:tasks.ceph.osd.3.smithi059.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-09-21T05:58:20.239 INFO:tasks.ceph.osd.3.smithi059.stderr: 2023-09-21T05:58:20.240 INFO:tasks.ceph.osd.3.smithi059.stderr: -9182> 2023-09-21T05:58:20.130+0000 7f968895f700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6213-gbf8a061f/rpm/el8/BUILD/ceph-18.0.0-6213-gbf8a061f/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f968895f700 time 2023-09-21T05:58:20.101807+0000 2023-09-21T05:58:20.240 INFO:tasks.ceph.osd.3.smithi059.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6213-gbf8a061f/rpm/el8/BUILD/ceph-18.0.0-6213-gbf8a061f/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-09-21T05:58:20.240 INFO:tasks.ceph.osd.3.smithi059.stderr: 2023-09-21T05:58:20.240 INFO:tasks.ceph.osd.3.smithi059.stderr: ceph version 18.0.0-6213-gbf8a061f (bf8a061ff16ac1d393cf108f740d92dfa49f2e54) reef (dev) 2023-09-21T05:58:20.240 INFO:tasks.ceph.osd.3.smithi059.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x559d2d54f0cd] 2023-09-21T05:58:20.241 INFO:tasks.ceph.osd.3.smithi059.stderr: 2: (KernelDevice::_aio_thread()+0x1686) [0x559d2e197196] 2023-09-21T05:58:20.241 INFO:tasks.ceph.osd.3.smithi059.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x559d2e19cbb1] 2023-09-21T05:58:20.241 INFO:tasks.ceph.osd.3.smithi059.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7f969ac851cf] 2023-09-21T05:58:20.241 INFO:tasks.ceph.osd.3.smithi059.stderr: 5: clone() 2023-09-21T05:58:20.241 INFO:tasks.ceph.osd.3.smithi059.stderr: 2023-09-21T05:58:20.260 INFO:tasks.ceph.osd.3.smithi059.stderr: 0> 2023-09-21T05:58:20.229+0000 7f968895f700 -1 *** Caught signal (Aborted) ** 2023-09-21T05:58:20.261 INFO:tasks.ceph.osd.3.smithi059.stderr: in thread 7f968895f700 thread_name:bstore_aio 2023-09-21T05:58:20.261 INFO:tasks.ceph.osd.3.smithi059.stderr: 2023-09-21T05:58:20.261 INFO:tasks.ceph.osd.3.smithi059.stderr: ceph version 18.0.0-6213-gbf8a061f (bf8a061ff16ac1d393cf108f740d92dfa49f2e54) reef (dev) 2023-09-21T05:58:20.261 INFO:tasks.ceph.osd.3.smithi059.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f969ac8fce0] 2023-09-21T05:58:20.261 INFO:tasks.ceph.osd.3.smithi059.stderr: 2: gsignal() 2023-09-21T05:58:20.262 INFO:tasks.ceph.osd.3.smithi059.stderr: 3: abort() 2023-09-21T05:58:20.262 INFO:tasks.ceph.osd.3.smithi059.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x559d2d54f18d] 2023-09-21T05:58:20.262 INFO:tasks.ceph.osd.3.smithi059.stderr: 5: (KernelDevice::_aio_thread()+0x1686) [0x559d2e197196] 2023-09-21T05:58:20.262 INFO:tasks.ceph.osd.3.smithi059.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x559d2e19cbb1] 2023-09-21T05:58:20.262 INFO:tasks.ceph.osd.3.smithi059.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7f969ac851cf] 2023-09-21T05:58:20.263 INFO:tasks.ceph.osd.3.smithi059.stderr: 8: clone() 2023-09-21T05:58:20.263 INFO:tasks.ceph.osd.3.smithi059.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-09-21T05:58:20.263 INFO:tasks.ceph.osd.3.smithi059.stderr: 2023-09-21T05:58:20.263 INFO:tasks.ceph.osd.3.smithi059.stderr: -9236> 2023-09-21T05:58:20.130+0000 7f968895f700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6213-gbf8a061f/rpm/el8/BUILD/ceph-18.0.0-6213-gbf8a061f/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f968895f700 time 2023-09-21T05:58:20.101807+0000 2023-09-21T05:58:20.264 INFO:tasks.ceph.osd.3.smithi059.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-6213-gbf8a061f/rpm/el8/BUILD/ceph-18.0.0-6213-gbf8a061f/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-09-21T05:58:20.264 INFO:tasks.ceph.osd.3.smithi059.stderr: 2023-09-21T05:58:20.264 INFO:tasks.ceph.osd.3.smithi059.stderr: ceph version 18.0.0-6213-gbf8a061f (bf8a061ff16ac1d393cf108f740d92dfa49f2e54) reef (dev) 2023-09-21T05:58:20.264 INFO:tasks.ceph.osd.3.smithi059.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x559d2d54f0cd] 2023-09-21T05:58:20.264 INFO:tasks.ceph.osd.3.smithi059.stderr: 2: (KernelDevice::_aio_thread()+0x1686) [0x559d2e197196] 2023-09-21T05:58:20.265 INFO:tasks.ceph.osd.3.smithi059.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x559d2e19cbb1] 2023-09-21T05:58:20.265 INFO:tasks.ceph.osd.3.smithi059.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7f969ac851cf] 2023-09-21T05:58:20.265 INFO:tasks.ceph.osd.3.smithi059.stderr: 5: clone() 2023-09-21T05:58:20.265 INFO:tasks.ceph.osd.3.smithi059.stderr: 2023-09-21T05:58:20.292 INFO:tasks.ceph.osd.3.smithi059.stderr: -54> 2023-09-21T05:58:20.229+0000 7f968895f700 -1 *** Caught signal (Aborted) ** 2023-09-21T05:58:20.293 INFO:tasks.ceph.osd.3.smithi059.stderr: in thread 7f968895f700 thread_name:bstore_aio 2023-09-21T05:58:20.293 INFO:tasks.ceph.osd.3.smithi059.stderr: 2023-09-21T05:58:20.293 INFO:tasks.ceph.osd.3.smithi059.stderr: ceph version 18.0.0-6213-gbf8a061f (bf8a061ff16ac1d393cf108f740d92dfa49f2e54) reef (dev) 2023-09-21T05:58:20.293 INFO:tasks.ceph.osd.3.smithi059.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f969ac8fce0] 2023-09-21T05:58:20.293 INFO:tasks.ceph.osd.3.smithi059.stderr: 2: gsignal() 2023-09-21T05:58:20.294 INFO:tasks.ceph.osd.3.smithi059.stderr: 3: abort() 2023-09-21T05:58:20.294 INFO:tasks.ceph.osd.3.smithi059.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x559d2d54f18d] 2023-09-21T05:58:20.294 INFO:tasks.ceph.osd.3.smithi059.stderr: 5: (KernelDevice::_aio_thread()+0x1686) [0x559d2e197196] 2023-09-21T05:58:20.294 INFO:tasks.ceph.osd.3.smithi059.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x559d2e19cbb1] 2023-09-21T05:58:20.294 INFO:tasks.ceph.osd.3.smithi059.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7f969ac851cf] 2023-09-21T05:58:20.295 INFO:tasks.ceph.osd.3.smithi059.stderr: 8: clone() 2023-09-21T05:58:20.295 INFO:tasks.ceph.osd.3.smithi059.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-09-21T05:58:20.295 INFO:tasks.ceph.osd.3.smithi059.stderr: 2023-09-21T05:58:20.508 INFO:tasks.ceph.osd.3.smithi059.stderr:daemon-helper: command failed with exit status 5 2023-09-21T05:58:24.486 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-09-21T05:58:31.122 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~7s 2023-09-21T05:58:37.734 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~13s 2023-09-21T05:58:44.348 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~20s 2023-09-21T05:58:50.960 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~26s 2023-09-21T05:58:57.574 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~33s 2023-09-21T05:59:04.186 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~40s 2023-09-21T05:59:10.798 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~46s 2023-09-21T05:59:17.410 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~53s 2023-09-21T05:59:24.023 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~60s 2023-09-21T05:59:30.634 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~66s 2023-09-21T05:59:37.246 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~73s 2023-09-21T05:59:43.858 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~79s 2023-09-21T05:59:50.470 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~86s 2023-09-21T05:59:57.083 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~93s 2023-09-21T06:00:03.693 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~99s 2023-09-21T06:00:10.304 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~106s 2023-09-21T06:00:16.916 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~112s 2023-09-21T06:00:23.528 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~119s 2023-09-21T06:00:30.140 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~126s 2023-09-21T06:00:36.752 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~132s 2023-09-21T06:00:43.364 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~139s 2023-09-21T06:00:49.976 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~145s 2023-09-21T06:00:56.589 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~152s 2023-09-21T06:01:01.391 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:01:01.393 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:01:03.201 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~159s 2023-09-21T06:01:09.813 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~165s 2023-09-21T06:01:16.425 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~172s 2023-09-21T06:01:23.036 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~179s 2023-09-21T06:01:29.647 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~185s 2023-09-21T06:01:31.496 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:01:31.499 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:01:36.259 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~192s 2023-09-21T06:01:42.871 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~198s 2023-09-21T06:01:49.482 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~205s 2023-09-21T06:01:56.093 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~212s 2023-09-21T06:02:02.088 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:02:02.091 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:02:02.703 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~218s 2023-09-21T06:02:09.314 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~225s 2023-09-21T06:02:15.926 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~231s 2023-09-21T06:02:22.538 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~238s 2023-09-21T06:02:29.150 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~245s 2023-09-21T06:02:32.429 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:02:32.432 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:02:35.764 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~251s 2023-09-21T06:02:42.377 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~258s 2023-09-21T06:02:48.989 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~265s 2023-09-21T06:02:55.601 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~271s 2023-09-21T06:03:02.215 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~278s 2023-09-21T06:03:02.720 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:03:02.723 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:03:08.827 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~284s 2023-09-21T06:03:15.438 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~291s 2023-09-21T06:03:22.050 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~298s 2023-09-21T06:03:28.662 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~304s 2023-09-21T06:03:28.662 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-09-21T06:03:28.663 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-21T06:03:28.663 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-21T06:03:28.700 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-21T06:03:28.700 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-21T06:03:28.760 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T06:03:29.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.345+0000 7f0fd56ca700 1 Processor -- start 2023-09-21T06:03:29.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.345+0000 7f0fd56ca700 1 -- start start 2023-09-21T06:03:29.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.346+0000 7f0fd56ca700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0fd00cc960 0x7f0fd0166280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T06:03:29.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.346+0000 7f0fd56ca700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fd015ecf0 con 0x7f0fd00b54a0 2023-09-21T06:03:29.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.346+0000 7f0fd56ca700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fd006d290 con 0x7f0fd015e910 2023-09-21T06:03:29.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.346+0000 7f0fd56ca700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fd006d080 con 0x7f0fd00cc960 2023-09-21T06:03:29.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.347+0000 7f0fce7fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0fd00b54a0 0x7f0fd00cc250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41846/0 (socket says 172.21.15.59:41846) 2023-09-21T06:03:29.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.347+0000 7f0fcf7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0fd00cc960 0x7f0fd0166280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T06:03:29.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.347+0000 7f0fce7fc700 1 -- 172.21.15.59:0/498387266 learned_addr learned my addr 172.21.15.59:0/498387266 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T06:03:29.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.347+0000 7f0fcf7fe700 1 -- 172.21.15.59:0/498387266 >> v1:172.21.15.83:6789/0 conn(0x7f0fd015e910 legacy=0x7f0fd015f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T06:03:29.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.347+0000 7f0fcf7fe700 1 -- 172.21.15.59:0/498387266 >> v1:172.21.15.59:6789/0 conn(0x7f0fd00b54a0 legacy=0x7f0fd00cc250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T06:03:29.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.347+0000 7f0fcdffb700 1 -- 172.21.15.59:0/498387266 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 363660417 0 0) 0x7f0fd015ecf0 con 0x7f0fd00b54a0 2023-09-21T06:03:29.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.347+0000 7f0fcf7fe700 1 -- 172.21.15.59:0/498387266 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd006d570 con 0x7f0fd00cc960 2023-09-21T06:03:29.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.347+0000 7f0fcf7fe700 1 --2- 172.21.15.59:0/498387266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fd00cc960 0x7f0fd0166280 secure :-1 s=READY pgs=2586 cs=0 l=1 rev1=1 crypto rx=0x7f0fc8009d90 tx=0x7f0fc800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20981bac4221a873 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T06:03:29.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.347+0000 7f0fcdffb700 1 -- 172.21.15.59:0/498387266 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc800e070 con 0x7f0fd00cc960 2023-09-21T06:03:29.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.348+0000 7f0fcdffb700 1 -- 172.21.15.59:0/498387266 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc800bad0 con 0x7f0fd00cc960 2023-09-21T06:03:29.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.348+0000 7f0fcdffb700 1 -- 172.21.15.59:0/498387266 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc800be80 con 0x7f0fd00cc960 2023-09-21T06:03:29.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.348+0000 7f0fd56ca700 1 -- 172.21.15.59:0/498387266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fd00cc960 msgr2=0x7f0fd0166280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T06:03:29.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.348+0000 7f0fd56ca700 1 --2- 172.21.15.59:0/498387266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fd00cc960 0x7f0fd0166280 secure :-1 s=READY pgs=2586 cs=0 l=1 rev1=1 crypto rx=0x7f0fc8009d90 tx=0x7f0fc800b330 comp rx=0 tx=0).stop 2023-09-21T06:03:29.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.349+0000 7f0fd56ca700 1 -- 172.21.15.59:0/498387266 shutdown_connections 2023-09-21T06:03:29.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.349+0000 7f0fd56ca700 1 --2- 172.21.15.59:0/498387266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fd00cc960 0x7f0fd0166280 unknown :-1 s=CLOSED pgs=2586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T06:03:29.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.349+0000 7f0fd56ca700 1 -- 172.21.15.59:0/498387266 >> 172.21.15.59:0/498387266 conn(0x7f0fd006a780 msgr2=0x7f0fd006ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T06:03:29.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.349+0000 7f0fd56ca700 1 -- 172.21.15.59:0/498387266 shutdown_connections 2023-09-21T06:03:29.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.349+0000 7f0fd56ca700 1 -- 172.21.15.59:0/498387266 wait complete. 2023-09-21T06:03:29.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.350+0000 7f0fd56ca700 1 Processor -- start 2023-09-21T06:03:29.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.350+0000 7f0fd56ca700 1 -- start start 2023-09-21T06:03:29.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.351+0000 7f0fd56ca700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0fd00b54a0 0x7f0fd014a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T06:03:29.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.351+0000 7f0fd56ca700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fd00cc960 0x7f0fd0144610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T06:03:29.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.351+0000 7f0fd56ca700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0fd015e910 0x7f0fd0144b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T06:03:29.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.351+0000 7f0fd56ca700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd0136210 con 0x7f0fd00cc960 2023-09-21T06:03:29.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.351+0000 7f0fd56ca700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd0143070 con 0x7f0fd00b54a0 2023-09-21T06:03:29.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.351+0000 7f0fd56ca700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd0145bd0 con 0x7f0fd015e910 2023-09-21T06:03:29.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.351+0000 7f0fce7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fd00cc960 0x7f0fd0144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T06:03:29.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.351+0000 7f0fce7fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fd00cc960 0x7f0fd0144610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36286/0 (socket says 172.21.15.59:36286) 2023-09-21T06:03:29.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.351+0000 7f0fce7fc700 1 -- 172.21.15.59:0/2561134284 learned_addr learned my addr 172.21.15.59:0/2561134284 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T06:03:29.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.351+0000 7f0fceffd700 1 --2- 172.21.15.59:0/2561134284 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0fd00b54a0 0x7f0fd014a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T06:03:29.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.351+0000 7f0fce7fc700 1 -- 172.21.15.59:0/2561134284 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0fd015e910 msgr2=0x7f0fd0144b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T06:03:29.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.351+0000 7f0fce7fc700 1 --2- 172.21.15.59:0/2561134284 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0fd015e910 0x7f0fd0144b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T06:03:29.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.351+0000 7f0fce7fc700 1 -- 172.21.15.59:0/2561134284 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0fd00b54a0 msgr2=0x7f0fd014a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T06:03:29.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.351+0000 7f0fce7fc700 1 --2- 172.21.15.59:0/2561134284 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0fd00b54a0 0x7f0fd014a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T06:03:29.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.351+0000 7f0fce7fc700 1 -- 172.21.15.59:0/2561134284 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc8009a70 con 0x7f0fd00cc960 2023-09-21T06:03:29.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.351+0000 7f0fce7fc700 1 --2- 172.21.15.59:0/2561134284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fd00cc960 0x7f0fd0144610 secure :-1 s=READY pgs=2587 cs=0 l=1 rev1=1 crypto rx=0x7f0fc400c550 tx=0x7f0fc400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T06:03:29.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.351+0000 7f0fb77fe700 1 -- 172.21.15.59:0/2561134284 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc4004c80 con 0x7f0fd00cc960 2023-09-21T06:03:29.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.351+0000 7f0fb77fe700 1 -- 172.21.15.59:0/2561134284 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc4004de0 con 0x7f0fd00cc960 2023-09-21T06:03:29.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.352+0000 7f0fd56ca700 1 -- 172.21.15.59:0/2561134284 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fd01517d0 con 0x7f0fd00cc960 2023-09-21T06:03:29.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.352+0000 7f0fb77fe700 1 -- 172.21.15.59:0/2561134284 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc40072d0 con 0x7f0fd00cc960 2023-09-21T06:03:29.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.352+0000 7f0fd56ca700 1 -- 172.21.15.59:0/2561134284 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fd0143280 con 0x7f0fd00cc960 2023-09-21T06:03:29.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.353+0000 7f0fd56ca700 1 -- 172.21.15.59:0/2561134284 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fd006b780 con 0x7f0fd00cc960 2023-09-21T06:03:29.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.353+0000 7f0fb77fe700 1 -- 172.21.15.59:0/2561134284 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f0fc4007430 con 0x7f0fd00cc960 2023-09-21T06:03:29.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.353+0000 7f0fb77fe700 1 --2- 172.21.15.59:0/2561134284 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f0fbc06ae00 0x7f0fbc06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T06:03:29.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.354+0000 7f0fb77fe700 1 -- 172.21.15.59:0/2561134284 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0fc4089360 con 0x7f0fd00cc960 2023-09-21T06:03:29.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.355+0000 7f0fceffd700 1 --2- 172.21.15.59:0/2561134284 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f0fbc06ae00 0x7f0fbc06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T06:03:29.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.356+0000 7f0fceffd700 1 --2- 172.21.15.59:0/2561134284 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f0fbc06ae00 0x7f0fbc06d2c0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f0fc00017e0 tx=0x7f0fc0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T06:03:29.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.359+0000 7f0fb77fe700 1 -- 172.21.15.59:0/2561134284 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f0fc4054320 con 0x7f0fd00cc960 2023-09-21T06:03:29.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.653+0000 7f0fd56ca700 1 -- 172.21.15.59:0/2561134284 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0fd0067e50 con 0x7f0fd00cc960 2023-09-21T06:03:29.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.654+0000 7f0fb77fe700 1 -- 172.21.15.59:0/2561134284 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+16824 (secure 0 0 0) 0x7f0fc4057940 con 0x7f0fd00cc960 2023-09-21T06:03:29.655 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-09-21T06:03:29.655 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":42,"fsid":"dd69925c-6e25-42fe-880b-2f60fc6f384b","created":"2023-09-21T00:16:43.074489+0000","modified":"2023-09-21T05:58:22.572176+0000","last_up_change":"2023-09-21T05:58:21.321578+0000","last_in_change":"2023-09-21T00:16:45.987089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T00:16:54.796248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-09-21T00:18:25.534473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.4900000095367432,"score_stable":1.4900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-09-21T00:18:26.494284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.4900000095367432,"score_stable":1.4900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d4b18344-74c0-4f75-920b-7a9247e48914","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6809","nonce":2418314235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6811","nonce":2418314235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6815","nonce":2418314235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2418314235},{"type":"v1","addr":"172.21.15.59:6813","nonce":2418314235}]},"public_addr":"172.21.15.59:6809/2418314235","cluster_addr":"172.21.15.59:6811/2418314235","heartbeat_back_addr":"172.21.15.59:6815/2418314235","heartbeat_front_addr":"172.21.15.59:6813/2418314235","state":["exists","up"]},{"osd":1,"uuid":"80940d50-a248-4e64-a282-7ffcdad790ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6801","nonce":869668251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6803","nonce":869668251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6807","nonce":869668251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":869668251},{"type":"v1","addr":"172.21.15.59:6805","nonce":869668251}]},"public_addr":"172.21.15.59:6801/869668251","cluster_addr":"172.21.15.59:6803/869668251","heartbeat_back_addr":"172.21.15.59:6807/869668251","heartbeat_front_addr":"172.21.15.59:6805/869668251","state":["exists","up"]},{"osd":2,"uuid":"55f2eceb-c54a-4879-a6ce-968c1c548b5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6817","nonce":372517778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6819","nonce":372517778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6823","nonce":372517778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":372517778},{"type":"v1","addr":"172.21.15.59:6821","nonce":372517778}]},"public_addr":"172.21.15.59:6817/372517778","cluster_addr":"172.21.15.59:6819/372517778","heartbeat_back_addr":"172.21.15.59:6823/372517778","heartbeat_front_addr":"172.21.15.59:6821/372517778","state":["exists","up"]},{"osd":3,"uuid":"92b89cd0-869c-49b9-a9f9-97ac8423f304","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":41,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6825","nonce":575188498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6827","nonce":575188498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6831","nonce":575188498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":575188498},{"type":"v1","addr":"172.21.15.59:6829","nonce":575188498}]},"public_addr":"172.21.15.59:6825/575188498","cluster_addr":"172.21.15.59:6827/575188498","heartbeat_back_addr":"172.21.15.59:6831/575188498","heartbeat_front_addr":"172.21.15.59:6829/575188498","state":["exists"]},{"osd":4,"uuid":"25b80e94-e0e6-403d-b69f-61542f289637","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6803","nonce":1741219098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6805","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6807","nonce":1741219098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6815","nonce":1741219098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":1741219098},{"type":"v1","addr":"172.21.15.83:6811","nonce":1741219098}]},"public_addr":"172.21.15.83:6803/1741219098","cluster_addr":"172.21.15.83:6807/1741219098","heartbeat_back_addr":"172.21.15.83:6815/1741219098","heartbeat_front_addr":"172.21.15.83:6811/1741219098","state":["exists","up"]},{"osd":5,"uuid":"5498d9ab-1086-4796-a199-9051e6dfea91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6817","nonce":156730565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6819","nonce":156730565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6823","nonce":156730565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":156730565},{"type":"v1","addr":"172.21.15.83:6821","nonce":156730565}]},"public_addr":"172.21.15.83:6817/156730565","cluster_addr":"172.21.15.83:6819/156730565","heartbeat_back_addr":"172.21.15.83:6823/156730565","heartbeat_front_addr":"172.21.15.83:6821/156730565","state":["exists","up"]},{"osd":6,"uuid":"cfd810c0-5015-4d60-9a75-7efc93a32e09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6801","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6800","nonce":1337723778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6806","nonce":1337723778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6814","nonce":1337723778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":1337723778},{"type":"v1","addr":"172.21.15.83:6810","nonce":1337723778}]},"public_addr":"172.21.15.83:6800/1337723778","cluster_addr":"172.21.15.83:6806/1337723778","heartbeat_back_addr":"172.21.15.83:6814/1337723778","heartbeat_front_addr":"172.21.15.83:6810/1337723778","state":["exists","up"]},{"osd":7,"uuid":"e992c8fa-0a3d-4b3c-85b5-2c511223dee4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6825","nonce":4204859272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6827","nonce":4204859272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6831","nonce":4204859272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":4204859272},{"type":"v1","addr":"172.21.15.83:6829","nonce":4204859272}]},"public_addr":"172.21.15.83:6825/4204859272","cluster_addr":"172.21.15.83:6827/4204859272","heartbeat_back_addr":"172.21.15.83:6831/4204859272","heartbeat_front_addr":"172.21.15.83:6829/4204859272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.156498+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.882707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.093978+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.158565+0000","dead_epoch":41},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.173933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:50.888606+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.135525+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T00:16:51.149712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.26","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T06:03:29.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.657+0000 7f0fd56ca700 1 -- 172.21.15.59:0/2561134284 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f0fbc06ae00 msgr2=0x7f0fbc06d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T06:03:29.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.657+0000 7f0fd56ca700 1 --2- 172.21.15.59:0/2561134284 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f0fbc06ae00 0x7f0fbc06d2c0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f0fc00017e0 tx=0x7f0fc0009040 comp rx=0 tx=0).stop 2023-09-21T06:03:29.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.657+0000 7f0fd56ca700 1 -- 172.21.15.59:0/2561134284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fd00cc960 msgr2=0x7f0fd0144610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T06:03:29.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.657+0000 7f0fd56ca700 1 --2- 172.21.15.59:0/2561134284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fd00cc960 0x7f0fd0144610 secure :-1 s=READY pgs=2587 cs=0 l=1 rev1=1 crypto rx=0x7f0fc400c550 tx=0x7f0fc400c910 comp rx=0 tx=0).stop 2023-09-21T06:03:29.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.658+0000 7f0fd56ca700 1 -- 172.21.15.59:0/2561134284 shutdown_connections 2023-09-21T06:03:29.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.658+0000 7f0fd56ca700 1 --2- 172.21.15.59:0/2561134284 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f0fbc06ae00 0x7f0fbc06d2c0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T06:03:29.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.658+0000 7f0fd56ca700 1 --2- 172.21.15.59:0/2561134284 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0fd015e910 0x7f0fd0144b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T06:03:29.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.658+0000 7f0fd56ca700 1 --2- 172.21.15.59:0/2561134284 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0fd00b54a0 0x7f0fd014a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T06:03:29.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.658+0000 7f0fd56ca700 1 --2- 172.21.15.59:0/2561134284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fd00cc960 0x7f0fd0144610 unknown :-1 s=CLOSED pgs=2587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T06:03:29.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.658+0000 7f0fd56ca700 1 -- 172.21.15.59:0/2561134284 >> 172.21.15.59:0/2561134284 conn(0x7f0fd006a780 msgr2=0x7f0fd00cd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T06:03:29.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.658+0000 7f0fd56ca700 1 -- 172.21.15.59:0/2561134284 shutdown_connections 2023-09-21T06:03:29.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.658+0000 7f0fd56ca700 1 -- 172.21.15.59:0/2561134284 wait complete. 2023-09-21T06:03:29.676 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-21T00:16:54.796248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-21T00:18:25.534473+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.4900000095367432, 'score_stable': 1.4900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-09-21T00:18:26.494284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.4900000095367432, 'score_stable': 1.4900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-21T06:03:29.677 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-21T06:03:29.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.859+0000 7fcd2a53e700 1 Processor -- start 2023-09-21T06:03:29.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.860+0000 7fcd2a53e700 1 -- start start 2023-09-21T06:03:29.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.861+0000 7fcd2a53e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcd2406c670 0x7fcd24162a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T06:03:29.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.861+0000 7fcd2a53e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd241654c0 con 0x7fcd240c9870 2023-09-21T06:03:29.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.861+0000 7fcd2a53e700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd24165a80 con 0x7fcd24165f10 2023-09-21T06:03:29.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.861+0000 7fcd2a53e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd240c9cf0 con 0x7fcd2406c670 2023-09-21T06:03:29.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.861+0000 7fcd23fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcd2406c670 0x7fcd24162a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T06:03:29.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.861+0000 7fcd23fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcd2406c670 0x7fcd24162a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36292/0 (socket says 172.21.15.59:36292) 2023-09-21T06:03:29.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.861+0000 7fcd23fff700 1 -- 172.21.15.59:0/2089435979 learned_addr learned my addr 172.21.15.59:0/2089435979 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T06:03:29.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.861+0000 7fcd237fe700 1 --1- 172.21.15.59:0/2089435979 >> v1:172.21.15.59:6789/0 conn(0x7fcd240c9870 0x7fcd2406ca50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41860/0 (socket says 172.21.15.59:41860) 2023-09-21T06:03:29.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.861+0000 7fcd22ffd700 1 -- 172.21.15.59:0/2089435979 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1032993028 0 0) 0x7fcd241654c0 con 0x7fcd240c9870 2023-09-21T06:03:29.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.862+0000 7fcd22ffd700 1 -- 172.21.15.59:0/2089435979 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd0c0035b0 con 0x7fcd240c9870 2023-09-21T06:03:29.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.862+0000 7fcd23fff700 1 -- 172.21.15.59:0/2089435979 >> v1:172.21.15.83:6789/0 conn(0x7fcd24165f10 legacy=0x7fcd2406de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T06:03:29.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.862+0000 7fcd23fff700 1 -- 172.21.15.59:0/2089435979 >> v1:172.21.15.59:6789/0 conn(0x7fcd240c9870 legacy=0x7fcd2406ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T06:03:29.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.862+0000 7fcd23fff700 1 -- 172.21.15.59:0/2089435979 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd240c9fa0 con 0x7fcd2406c670 2023-09-21T06:03:29.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.862+0000 7fcd23fff700 1 --2- 172.21.15.59:0/2089435979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd2406c670 0x7fcd24162a00 secure :-1 s=READY pgs=2589 cs=0 l=1 rev1=1 crypto rx=0x7fcd14009920 tx=0x7fcd14009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72a8b691fa333a0f server_cookie=0 in_seq=0 out_seq=0 2023-09-21T06:03:29.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.862+0000 7fcd22ffd700 1 -- 172.21.15.59:0/2089435979 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd14004230 con 0x7fcd2406c670 2023-09-21T06:03:29.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.862+0000 7fcd22ffd700 1 -- 172.21.15.59:0/2089435979 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd14004390 con 0x7fcd2406c670 2023-09-21T06:03:29.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.862+0000 7fcd22ffd700 1 -- 172.21.15.59:0/2089435979 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd140036a0 con 0x7fcd2406c670 2023-09-21T06:03:29.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.863+0000 7fcd2a53e700 1 -- 172.21.15.59:0/2089435979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd2406c670 msgr2=0x7fcd24162a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T06:03:29.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.863+0000 7fcd2a53e700 1 --2- 172.21.15.59:0/2089435979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd2406c670 0x7fcd24162a00 secure :-1 s=READY pgs=2589 cs=0 l=1 rev1=1 crypto rx=0x7fcd14009920 tx=0x7fcd14009c30 comp rx=0 tx=0).stop 2023-09-21T06:03:29.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.863+0000 7fcd2a53e700 1 -- 172.21.15.59:0/2089435979 shutdown_connections 2023-09-21T06:03:29.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.863+0000 7fcd2a53e700 1 --2- 172.21.15.59:0/2089435979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd2406c670 0x7fcd24162a00 unknown :-1 s=CLOSED pgs=2589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T06:03:29.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.863+0000 7fcd2a53e700 1 -- 172.21.15.59:0/2089435979 >> 172.21.15.59:0/2089435979 conn(0x7fcd240cf220 msgr2=0x7fcd240cf600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T06:03:29.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.863+0000 7fcd2a53e700 1 -- 172.21.15.59:0/2089435979 shutdown_connections 2023-09-21T06:03:29.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.863+0000 7fcd2a53e700 1 -- 172.21.15.59:0/2089435979 wait complete. 2023-09-21T06:03:29.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.865+0000 7fcd2a53e700 1 Processor -- start 2023-09-21T06:03:29.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.865+0000 7fcd2a53e700 1 -- start start 2023-09-21T06:03:29.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.866+0000 7fcd2a53e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd2406c670 0x7fcd2415c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T06:03:29.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.866+0000 7fcd2a53e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd240c9870 0x7fcd240c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T06:03:29.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.866+0000 7fcd2a53e700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcd24165f10 0x7fcd240c9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T06:03:29.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.866+0000 7fcd2a53e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd240c3c90 con 0x7fcd240c9870 2023-09-21T06:03:29.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.866+0000 7fcd2a53e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd240c3010 con 0x7fcd2406c670 2023-09-21T06:03:29.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.866+0000 7fcd2a53e700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd240c32f0 con 0x7fcd24165f10 2023-09-21T06:03:29.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.866+0000 7fcd237fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd240c9870 0x7fcd240c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T06:03:29.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.866+0000 7fcd237fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd240c9870 0x7fcd240c8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36302/0 (socket says 172.21.15.59:36302) 2023-09-21T06:03:29.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.866+0000 7fcd237fe700 1 -- 172.21.15.59:0/3354662505 learned_addr learned my addr 172.21.15.59:0/3354662505 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T06:03:29.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.866+0000 7fcd28adb700 1 --2- 172.21.15.59:0/3354662505 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcd24165f10 0x7fcd240c9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T06:03:29.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.867+0000 7fcd237fe700 1 -- 172.21.15.59:0/3354662505 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcd24165f10 msgr2=0x7fcd240c9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T06:03:29.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.867+0000 7fcd237fe700 1 --2- 172.21.15.59:0/3354662505 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcd24165f10 0x7fcd240c9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T06:03:29.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.867+0000 7fcd237fe700 1 -- 172.21.15.59:0/3354662505 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd2406c670 msgr2=0x7fcd2415c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T06:03:29.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.867+0000 7fcd237fe700 1 --2- 172.21.15.59:0/3354662505 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd2406c670 0x7fcd2415c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T06:03:29.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.867+0000 7fcd237fe700 1 -- 172.21.15.59:0/3354662505 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd14009550 con 0x7fcd240c9870 2023-09-21T06:03:29.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.867+0000 7fcd237fe700 1 --2- 172.21.15.59:0/3354662505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd240c9870 0x7fcd240c8b10 secure :-1 s=READY pgs=2590 cs=0 l=1 rev1=1 crypto rx=0x7fcd1800c500 tx=0x7fcd1800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T06:03:29.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.867+0000 7fcd20ff9700 1 -- 172.21.15.59:0/3354662505 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd18005cb0 con 0x7fcd240c9870 2023-09-21T06:03:29.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.867+0000 7fcd20ff9700 1 -- 172.21.15.59:0/3354662505 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd18005e10 con 0x7fcd240c9870 2023-09-21T06:03:29.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.867+0000 7fcd20ff9700 1 -- 172.21.15.59:0/3354662505 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd180072f0 con 0x7fcd240c9870 2023-09-21T06:03:29.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.867+0000 7fcd2a53e700 1 -- 172.21.15.59:0/3354662505 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd240c35d0 con 0x7fcd240c9870 2023-09-21T06:03:29.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.867+0000 7fcd2a53e700 1 -- 172.21.15.59:0/3354662505 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd2415cb30 con 0x7fcd240c9870 2023-09-21T06:03:29.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.870+0000 7fcd20ff9700 1 -- 172.21.15.59:0/3354662505 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fcd18007450 con 0x7fcd240c9870 2023-09-21T06:03:29.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.871+0000 7fcd20ff9700 1 --2- 172.21.15.59:0/3354662505 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fcd1006ae00 0x7fcd1006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T06:03:29.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.871+0000 7fcd20ff9700 1 -- 172.21.15.59:0/3354662505 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcd18088ae0 con 0x7fcd240c9870 2023-09-21T06:03:29.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.871+0000 7fcd2a53e700 1 -- 172.21.15.59:0/3354662505 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd2406eaa0 con 0x7fcd240c9870 2023-09-21T06:03:29.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.871+0000 7fcd23fff700 1 --2- 172.21.15.59:0/3354662505 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fcd1006ae00 0x7fcd1006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T06:03:29.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.872+0000 7fcd23fff700 1 --2- 172.21.15.59:0/3354662505 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fcd1006ae00 0x7fcd1006d2c0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fcd241fae80 tx=0x7fcd14010000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T06:03:29.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:29.876+0000 7fcd20ff9700 1 -- 172.21.15.59:0/3354662505 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fcd18017020 con 0x7fcd240c9870 2023-09-21T06:03:30.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.157+0000 7fcd2a53e700 1 -- 172.21.15.59:0/3354662505 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcd240c3dd0 con 0x7fcd240c9870 2023-09-21T06:03:30.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.158+0000 7fcd20ff9700 1 -- 172.21.15.59:0/3354662505 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcd240c3dd0 con 0x7fcd240c9870 2023-09-21T06:03:30.158 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-09-21T06:03:30.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.160+0000 7fcd2a53e700 1 -- 172.21.15.59:0/3354662505 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fcd1006ae00 msgr2=0x7fcd1006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T06:03:30.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.160+0000 7fcd2a53e700 1 --2- 172.21.15.59:0/3354662505 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fcd1006ae00 0x7fcd1006d2c0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fcd241fae80 tx=0x7fcd14010000 comp rx=0 tx=0).stop 2023-09-21T06:03:30.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.160+0000 7fcd2a53e700 1 -- 172.21.15.59:0/3354662505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd240c9870 msgr2=0x7fcd240c8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T06:03:30.161 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.160+0000 7fcd2a53e700 1 --2- 172.21.15.59:0/3354662505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd240c9870 0x7fcd240c8b10 secure :-1 s=READY pgs=2590 cs=0 l=1 rev1=1 crypto rx=0x7fcd1800c500 tx=0x7fcd1800c810 comp rx=0 tx=0).stop 2023-09-21T06:03:30.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.165+0000 7fcd2a53e700 1 -- 172.21.15.59:0/3354662505 shutdown_connections 2023-09-21T06:03:30.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.165+0000 7fcd2a53e700 1 --2- 172.21.15.59:0/3354662505 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fcd1006ae00 0x7fcd1006d2c0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T06:03:30.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.165+0000 7fcd2a53e700 1 --2- 172.21.15.59:0/3354662505 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcd24165f10 0x7fcd240c9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T06:03:30.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.165+0000 7fcd2a53e700 1 --2- 172.21.15.59:0/3354662505 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd2406c670 0x7fcd2415c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T06:03:30.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.165+0000 7fcd2a53e700 1 --2- 172.21.15.59:0/3354662505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd240c9870 0x7fcd240c8b10 unknown :-1 s=CLOSED pgs=2590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T06:03:30.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.165+0000 7fcd2a53e700 1 -- 172.21.15.59:0/3354662505 >> 172.21.15.59:0/3354662505 conn(0x7fcd240cf220 msgr2=0x7fcd2406de60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T06:03:30.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.165+0000 7fcd2a53e700 1 -- 172.21.15.59:0/3354662505 shutdown_connections 2023-09-21T06:03:30.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.165+0000 7fcd2a53e700 1 -- 172.21.15.59:0/3354662505 wait complete. 2023-09-21T06:03:30.182 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-21T06:03:30.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.357+0000 7f18e9f88700 1 Processor -- start 2023-09-21T06:03:30.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.357+0000 7f18e9f88700 1 -- start start 2023-09-21T06:03:30.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.358+0000 7f18e9f88700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f18e415d100 0x7f18e4071c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T06:03:30.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.358+0000 7f18e9f88700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f18e4070e90 0x7f18e4071320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T06:03:30.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.358+0000 7f18e9f88700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e4072180 con 0x7f18e40ce990 2023-09-21T06:03:30.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.358+0000 7f18e9f88700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e40cf7a0 con 0x7f18e4070e90 2023-09-21T06:03:30.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.358+0000 7f18e9f88700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e4071860 con 0x7f18e415d100 2023-09-21T06:03:30.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.358+0000 7f18e37fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f18e415d100 0x7f18e4071c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T06:03:30.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.358+0000 7f18e37fe700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f18e415d100 0x7f18e4071c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.59:36922/0 (socket says 172.21.15.59:36922) 2023-09-21T06:03:30.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.358+0000 7f18e37fe700 1 -- 172.21.15.59:0/3048055332 learned_addr learned my addr 172.21.15.59:0/3048055332 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T06:03:30.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.358+0000 7f18e2ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f18e40ce990 0x7f18e40cb320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41876/0 (socket says 172.21.15.59:41876) 2023-09-21T06:03:30.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.358+0000 7f18e3fff700 1 --2- 172.21.15.59:0/3048055332 >> v2:172.21.15.59:3300/0 conn(0x7f18e4070e90 0x7f18e4071320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T06:03:30.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.359+0000 7f18e3fff700 1 -- 172.21.15.59:0/3048055332 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f18e415d100 msgr2=0x7f18e4071c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T06:03:30.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.359+0000 7f18e3fff700 1 --2- 172.21.15.59:0/3048055332 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f18e415d100 0x7f18e4071c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T06:03:30.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.359+0000 7f18e3fff700 1 -- 172.21.15.59:0/3048055332 >> v1:172.21.15.59:6789/0 conn(0x7f18e40ce990 legacy=0x7f18e40cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T06:03:30.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.359+0000 7f18e3fff700 1 -- 172.21.15.59:0/3048055332 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e40cef00 con 0x7f18e4070e90 2023-09-21T06:03:30.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.359+0000 7f18e3fff700 1 --2- 172.21.15.59:0/3048055332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18e4070e90 0x7f18e4071320 secure :-1 s=READY pgs=2592 cs=0 l=1 rev1=1 crypto rx=0x7f18d8009840 tx=0x7f18d8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d76a8f78cc3bd16e server_cookie=0 in_seq=0 out_seq=0 2023-09-21T06:03:30.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.362+0000 7f18e27fc700 1 -- 172.21.15.59:0/3048055332 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d8011830 con 0x7f18e4070e90 2023-09-21T06:03:30.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.362+0000 7f18e27fc700 1 -- 172.21.15.59:0/3048055332 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d8011990 con 0x7f18e4070e90 2023-09-21T06:03:30.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.362+0000 7f18e27fc700 1 -- 172.21.15.59:0/3048055332 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d8011d00 con 0x7f18e4070e90 2023-09-21T06:03:30.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.362+0000 7f18e9f88700 1 -- 172.21.15.59:0/3048055332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18e4070e90 msgr2=0x7f18e4071320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T06:03:30.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.362+0000 7f18e9f88700 1 --2- 172.21.15.59:0/3048055332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18e4070e90 0x7f18e4071320 secure :-1 s=READY pgs=2592 cs=0 l=1 rev1=1 crypto rx=0x7f18d8009840 tx=0x7f18d8009b50 comp rx=0 tx=0).stop 2023-09-21T06:03:30.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.363+0000 7f18e9f88700 1 -- 172.21.15.59:0/3048055332 shutdown_connections 2023-09-21T06:03:30.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.363+0000 7f18e9f88700 1 --2- 172.21.15.59:0/3048055332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18e4070e90 0x7f18e4071320 unknown :-1 s=CLOSED pgs=2592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T06:03:30.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.363+0000 7f18e9f88700 1 --2- 172.21.15.59:0/3048055332 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f18e415d100 0x7f18e4071c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T06:03:30.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.363+0000 7f18e9f88700 1 -- 172.21.15.59:0/3048055332 >> 172.21.15.59:0/3048055332 conn(0x7f18e40cf8e0 msgr2=0x7f18e40cfcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T06:03:30.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.363+0000 7f18e9f88700 1 -- 172.21.15.59:0/3048055332 shutdown_connections 2023-09-21T06:03:30.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.363+0000 7f18e9f88700 1 -- 172.21.15.59:0/3048055332 wait complete. 2023-09-21T06:03:30.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.364+0000 7f18e9f88700 1 Processor -- start 2023-09-21T06:03:30.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.364+0000 7f18e9f88700 1 -- start start 2023-09-21T06:03:30.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.365+0000 7f18e9f88700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f18e4070e90 0x7f18e40afc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T06:03:30.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.365+0000 7f18e9f88700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18e40ce990 0x7f18e40b0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T06:03:30.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.365+0000 7f18e9f88700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f18e415d100 0x7f18e40b3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T06:03:30.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.365+0000 7f18e9f88700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e40af590 con 0x7f18e40ce990 2023-09-21T06:03:30.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.365+0000 7f18e9f88700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e40af2b0 con 0x7f18e415d100 2023-09-21T06:03:30.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.365+0000 7f18e9f88700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e40ace60 con 0x7f18e4070e90 2023-09-21T06:03:30.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.365+0000 7f18e2ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18e40ce990 0x7f18e40b0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T06:03:30.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.365+0000 7f18e2ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18e40ce990 0x7f18e40b0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36314/0 (socket says 172.21.15.59:36314) 2023-09-21T06:03:30.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.366+0000 7f18e2ffd700 1 -- 172.21.15.59:0/2441442187 learned_addr learned my addr 172.21.15.59:0/2441442187 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T06:03:30.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.366+0000 7f18e3fff700 1 --2- 172.21.15.59:0/2441442187 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f18e415d100 0x7f18e40b3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T06:03:30.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.366+0000 7f18e37fe700 1 --2- 172.21.15.59:0/2441442187 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f18e4070e90 0x7f18e40afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T06:03:30.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.366+0000 7f18e2ffd700 1 -- 172.21.15.59:0/2441442187 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f18e4070e90 msgr2=0x7f18e40afc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T06:03:30.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.366+0000 7f18e2ffd700 1 --2- 172.21.15.59:0/2441442187 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f18e4070e90 0x7f18e40afc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T06:03:30.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.366+0000 7f18e2ffd700 1 -- 172.21.15.59:0/2441442187 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f18e415d100 msgr2=0x7f18e40b3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T06:03:30.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.366+0000 7f18e2ffd700 1 --2- 172.21.15.59:0/2441442187 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f18e415d100 0x7f18e40b3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T06:03:30.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.366+0000 7f18e2ffd700 1 -- 172.21.15.59:0/2441442187 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d80094a0 con 0x7f18e40ce990 2023-09-21T06:03:30.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.366+0000 7f18e2ffd700 1 --2- 172.21.15.59:0/2441442187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18e40ce990 0x7f18e40b0150 secure :-1 s=READY pgs=2593 cs=0 l=1 rev1=1 crypto rx=0x7f18d400c4d0 tx=0x7f18d400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T06:03:30.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.366+0000 7f18cbfff700 1 -- 172.21.15.59:0/2441442187 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d4005cb0 con 0x7f18e40ce990 2023-09-21T06:03:30.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.366+0000 7f18cbfff700 1 -- 172.21.15.59:0/2441442187 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d4005e10 con 0x7f18e40ce990 2023-09-21T06:03:30.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.366+0000 7f18e9f88700 1 -- 172.21.15.59:0/2441442187 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e40ad140 con 0x7f18e40ce990 2023-09-21T06:03:30.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.366+0000 7f18cbfff700 1 -- 172.21.15.59:0/2441442187 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d40072f0 con 0x7f18e40ce990 2023-09-21T06:03:30.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.366+0000 7f18e9f88700 1 -- 172.21.15.59:0/2441442187 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e41548d0 con 0x7f18e40ce990 2023-09-21T06:03:30.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.367+0000 7f18e9f88700 1 -- 172.21.15.59:0/2441442187 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e4067e50 con 0x7f18e40ce990 2023-09-21T06:03:30.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.368+0000 7f18cbfff700 1 -- 172.21.15.59:0/2441442187 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f18d4007450 con 0x7f18e40ce990 2023-09-21T06:03:30.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.368+0000 7f18cbfff700 1 --2- 172.21.15.59:0/2441442187 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f18d006ae00 0x7f18d006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T06:03:30.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.368+0000 7f18cbfff700 1 -- 172.21.15.59:0/2441442187 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f18d4088930 con 0x7f18e40ce990 2023-09-21T06:03:30.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.368+0000 7f18e37fe700 1 --2- 172.21.15.59:0/2441442187 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f18d006ae00 0x7f18d006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T06:03:30.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.369+0000 7f18e37fe700 1 --2- 172.21.15.59:0/2441442187 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f18d006ae00 0x7f18d006d2c0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f18dc003cb0 tx=0x7f18dc009490 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T06:03:30.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.373+0000 7f18cbfff700 1 -- 172.21.15.59:0/2441442187 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f18d4053980 con 0x7f18e40ce990 2023-09-21T06:03:30.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.628+0000 7f18e9f88700 1 -- 172.21.15.59:0/2441442187 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f18e40749a0 con 0x7f18e40ce990 2023-09-21T06:03:30.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.628+0000 7f18cbfff700 1 -- 172.21.15.59:0/2441442187 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) v1 ==== 104+0+11 (secure 0 0 0) 0x7f18d40170a0 con 0x7f18e40ce990 2023-09-21T06:03:30.629 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-09-21T06:03:30.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.630+0000 7f18e9f88700 1 -- 172.21.15.59:0/2441442187 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f18d006ae00 msgr2=0x7f18d006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T06:03:30.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.630+0000 7f18e9f88700 1 --2- 172.21.15.59:0/2441442187 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f18d006ae00 0x7f18d006d2c0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f18dc003cb0 tx=0x7f18dc009490 comp rx=0 tx=0).stop 2023-09-21T06:03:30.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.630+0000 7f18e9f88700 1 -- 172.21.15.59:0/2441442187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18e40ce990 msgr2=0x7f18e40b0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T06:03:30.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.630+0000 7f18e9f88700 1 --2- 172.21.15.59:0/2441442187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18e40ce990 0x7f18e40b0150 secure :-1 s=READY pgs=2593 cs=0 l=1 rev1=1 crypto rx=0x7f18d400c4d0 tx=0x7f18d400c7e0 comp rx=0 tx=0).stop 2023-09-21T06:03:30.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.630+0000 7f18e9f88700 1 -- 172.21.15.59:0/2441442187 shutdown_connections 2023-09-21T06:03:30.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.630+0000 7f18e9f88700 1 --2- 172.21.15.59:0/2441442187 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f18e415d100 0x7f18e40b3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T06:03:30.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.630+0000 7f18e9f88700 1 --2- 172.21.15.59:0/2441442187 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f18d006ae00 0x7f18d006d2c0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T06:03:30.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.630+0000 7f18e9f88700 1 --2- 172.21.15.59:0/2441442187 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f18e4070e90 0x7f18e40afc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T06:03:30.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.630+0000 7f18e9f88700 1 --2- 172.21.15.59:0/2441442187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18e40ce990 0x7f18e40b0150 unknown :-1 s=CLOSED pgs=2593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T06:03:30.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.630+0000 7f18e9f88700 1 -- 172.21.15.59:0/2441442187 >> 172.21.15.59:0/2441442187 conn(0x7f18e40cf8e0 msgr2=0x7f18e40cb170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T06:03:30.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.631+0000 7f18e9f88700 1 -- 172.21.15.59:0/2441442187 shutdown_connections 2023-09-21T06:03:30.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.631+0000 7f18e9f88700 1 -- 172.21.15.59:0/2441442187 wait complete. 2023-09-21T06:03:30.645 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-21T06:03:30.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.861+0000 7f8e7a67f700 1 Processor -- start 2023-09-21T06:03:30.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.861+0000 7f8e7a67f700 1 -- start start 2023-09-21T06:03:30.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.862+0000 7f8e7a67f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e7415ac90 0x7f8e74070de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T06:03:30.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.862+0000 7f8e7a67f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8e74071320 0x7f8e740b3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T06:03:30.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.862+0000 7f8e7a67f700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e74159f70 con 0x7f8e740cc250 2023-09-21T06:03:30.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.862+0000 7f8e7a67f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e7406d2c0 con 0x7f8e74071320 2023-09-21T06:03:30.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.862+0000 7f8e7a67f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7415a800 con 0x7f8e7415ac90 2023-09-21T06:03:30.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.863+0000 7f8e78c1c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8e74071320 0x7f8e740b3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T06:03:30.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.863+0000 7f8e78c1c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8e74071320 0x7f8e740b3950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36322/0 (socket says 172.21.15.59:36322) 2023-09-21T06:03:30.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.863+0000 7f8e78c1c700 1 -- 172.21.15.59:0/1553463690 learned_addr learned my addr 172.21.15.59:0/1553463690 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T06:03:30.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.863+0000 7f8e78c1c700 1 -- 172.21.15.59:0/1553463690 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e7415ac90 msgr2=0x7f8e74070de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T06:03:30.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.863+0000 7f8e78c1c700 1 --2- 172.21.15.59:0/1553463690 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e7415ac90 0x7f8e74070de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T06:03:30.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.863+0000 7f8e78c1c700 1 -- 172.21.15.59:0/1553463690 >> v1:172.21.15.83:6789/0 conn(0x7f8e740cc250 legacy=0x7f8e740cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T06:03:30.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.863+0000 7f8e78c1c700 1 -- 172.21.15.59:0/1553463690 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e740717b0 con 0x7f8e74071320 2023-09-21T06:03:30.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.864+0000 7f8e78c1c700 1 --2- 172.21.15.59:0/1553463690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e74071320 0x7f8e740b3950 secure :-1 s=READY pgs=2594 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c00d150 tx=0x7f8e6c00d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89e7ccadfac08d4c server_cookie=0 in_seq=0 out_seq=0 2023-09-21T06:03:30.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.864+0000 7f8e72ffd700 1 -- 172.21.15.59:0/1553463690 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c010070 con 0x7f8e74071320 2023-09-21T06:03:30.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.864+0000 7f8e72ffd700 1 -- 172.21.15.59:0/1553463690 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e6c00db70 con 0x7f8e74071320 2023-09-21T06:03:30.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.864+0000 7f8e72ffd700 1 -- 172.21.15.59:0/1553463690 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c003a70 con 0x7f8e74071320 2023-09-21T06:03:30.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.865+0000 7f8e7a67f700 1 -- 172.21.15.59:0/1553463690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e74071320 msgr2=0x7f8e740b3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T06:03:30.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.865+0000 7f8e7a67f700 1 --2- 172.21.15.59:0/1553463690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e74071320 0x7f8e740b3950 secure :-1 s=READY pgs=2594 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c00d150 tx=0x7f8e6c00d460 comp rx=0 tx=0).stop 2023-09-21T06:03:30.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.865+0000 7f8e7a67f700 1 -- 172.21.15.59:0/1553463690 shutdown_connections 2023-09-21T06:03:30.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.865+0000 7f8e7a67f700 1 --2- 172.21.15.59:0/1553463690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e74071320 0x7f8e740b3950 unknown :-1 s=CLOSED pgs=2594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T06:03:30.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.865+0000 7f8e7a67f700 1 --2- 172.21.15.59:0/1553463690 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e7415ac90 0x7f8e74070de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T06:03:30.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.865+0000 7f8e7a67f700 1 -- 172.21.15.59:0/1553463690 >> 172.21.15.59:0/1553463690 conn(0x7f8e7406a780 msgr2=0x7f8e7406ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T06:03:30.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.865+0000 7f8e7a67f700 1 -- 172.21.15.59:0/1553463690 shutdown_connections 2023-09-21T06:03:30.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.865+0000 7f8e7a67f700 1 -- 172.21.15.59:0/1553463690 wait complete. 2023-09-21T06:03:30.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.867+0000 7f8e7a67f700 1 Processor -- start 2023-09-21T06:03:30.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.867+0000 7f8e7a67f700 1 -- start start 2023-09-21T06:03:30.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.868+0000 7f8e7a67f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e74071320 0x7f8e7413d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T06:03:30.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.868+0000 7f8e7a67f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e740cc250 0x7f8e74150a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T06:03:30.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.868+0000 7f8e7a67f700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e7415ac90 0x7f8e74150fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T06:03:30.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.868+0000 7f8e7a67f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e74153ff0 con 0x7f8e74071320 2023-09-21T06:03:30.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.868+0000 7f8e7a67f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7413d7f0 con 0x7f8e740cc250 2023-09-21T06:03:30.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.868+0000 7f8e7a67f700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e741e3190 con 0x7f8e7415ac90 2023-09-21T06:03:30.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.868+0000 7f8e73fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e74071320 0x7f8e7413d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T06:03:30.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.868+0000 7f8e73fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e74071320 0x7f8e7413d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36326/0 (socket says 172.21.15.59:36326) 2023-09-21T06:03:30.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.868+0000 7f8e73fff700 1 -- 172.21.15.59:0/2527141297 learned_addr learned my addr 172.21.15.59:0/2527141297 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T06:03:30.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.869+0000 7f8e73fff700 1 -- 172.21.15.59:0/2527141297 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e7415ac90 msgr2=0x7f8e74150fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T06:03:30.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.869+0000 7f8e73fff700 1 --2- 172.21.15.59:0/2527141297 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e7415ac90 0x7f8e74150fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T06:03:30.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.869+0000 7f8e73fff700 1 -- 172.21.15.59:0/2527141297 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e740cc250 msgr2=0x7f8e74150a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T06:03:30.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.869+0000 7f8e73fff700 1 --2- 172.21.15.59:0/2527141297 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e740cc250 0x7f8e74150a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T06:03:30.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.869+0000 7f8e73fff700 1 -- 172.21.15.59:0/2527141297 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e6c00bd40 con 0x7f8e74071320 2023-09-21T06:03:30.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.869+0000 7f8e73fff700 1 --2- 172.21.15.59:0/2527141297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e74071320 0x7f8e7413d2b0 secure :-1 s=READY pgs=2595 cs=0 l=1 rev1=1 crypto rx=0x7f8e6400c4a0 tx=0x7f8e6400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T06:03:30.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.869+0000 7f8e70ff9700 1 -- 172.21.15.59:0/2527141297 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e640054e0 con 0x7f8e74071320 2023-09-21T06:03:30.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.869+0000 7f8e70ff9700 1 -- 172.21.15.59:0/2527141297 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e64003680 con 0x7f8e74071320 2023-09-21T06:03:30.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.869+0000 7f8e7a67f700 1 -- 172.21.15.59:0/2527141297 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e741e3470 con 0x7f8e74071320 2023-09-21T06:03:30.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.869+0000 7f8e70ff9700 1 -- 172.21.15.59:0/2527141297 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e64003a30 con 0x7f8e74071320 2023-09-21T06:03:30.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.869+0000 7f8e7a67f700 1 -- 172.21.15.59:0/2527141297 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e741e3a30 con 0x7f8e74071320 2023-09-21T06:03:30.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.871+0000 7f8e7a67f700 1 -- 172.21.15.59:0/2527141297 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e74154160 con 0x7f8e74071320 2023-09-21T06:03:30.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.871+0000 7f8e70ff9700 1 -- 172.21.15.59:0/2527141297 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7f8e64003b90 con 0x7f8e74071320 2023-09-21T06:03:30.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.872+0000 7f8e70ff9700 1 --2- 172.21.15.59:0/2527141297 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f8e6006ae00 0x7f8e6006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T06:03:30.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.872+0000 7f8e70ff9700 1 -- 172.21.15.59:0/2527141297 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8e640887f0 con 0x7f8e74071320 2023-09-21T06:03:30.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.873+0000 7f8e737fe700 1 --2- 172.21.15.59:0/2527141297 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f8e6006ae00 0x7f8e6006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T06:03:30.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.874+0000 7f8e737fe700 1 --2- 172.21.15.59:0/2527141297 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f8e6006ae00 0x7f8e6006d2c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f8e740cc6a0 tx=0x7f8e68006d20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T06:03:30.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:30.879+0000 7f8e70ff9700 1 -- 172.21.15.59:0/2527141297 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7f8e74154160 con 0x7f8e74071320 2023-09-21T06:03:31.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.120+0000 7f8e7a67f700 1 -- 172.21.15.59:0/2527141297 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8e741e3c50 con 0x7f8e74071320 2023-09-21T06:03:31.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.121+0000 7f8e70ff9700 1 -- 172.21.15.59:0/2527141297 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8e64053730 con 0x7f8e74071320 2023-09-21T06:03:31.121 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-09-21T06:03:31.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.123+0000 7f8e7a67f700 1 -- 172.21.15.59:0/2527141297 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f8e6006ae00 msgr2=0x7f8e6006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T06:03:31.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.123+0000 7f8e7a67f700 1 --2- 172.21.15.59:0/2527141297 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f8e6006ae00 0x7f8e6006d2c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f8e740cc6a0 tx=0x7f8e68006d20 comp rx=0 tx=0).stop 2023-09-21T06:03:31.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.123+0000 7f8e7a67f700 1 -- 172.21.15.59:0/2527141297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e74071320 msgr2=0x7f8e7413d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T06:03:31.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.123+0000 7f8e7a67f700 1 --2- 172.21.15.59:0/2527141297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e74071320 0x7f8e7413d2b0 secure :-1 s=READY pgs=2595 cs=0 l=1 rev1=1 crypto rx=0x7f8e6400c4a0 tx=0x7f8e6400c860 comp rx=0 tx=0).stop 2023-09-21T06:03:31.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.123+0000 7f8e7a67f700 1 -- 172.21.15.59:0/2527141297 shutdown_connections 2023-09-21T06:03:31.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.123+0000 7f8e7a67f700 1 --2- 172.21.15.59:0/2527141297 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7f8e6006ae00 0x7f8e6006d2c0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T06:03:31.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.123+0000 7f8e7a67f700 1 --2- 172.21.15.59:0/2527141297 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e7415ac90 0x7f8e74150fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T06:03:31.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.123+0000 7f8e7a67f700 1 --2- 172.21.15.59:0/2527141297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e74071320 0x7f8e7413d2b0 unknown :-1 s=CLOSED pgs=2595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T06:03:31.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.123+0000 7f8e7a67f700 1 --2- 172.21.15.59:0/2527141297 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e740cc250 0x7f8e74150a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T06:03:31.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.123+0000 7f8e7a67f700 1 -- 172.21.15.59:0/2527141297 >> 172.21.15.59:0/2527141297 conn(0x7f8e7406a780 msgr2=0x7f8e740ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T06:03:31.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.123+0000 7f8e7a67f700 1 -- 172.21.15.59:0/2527141297 shutdown_connections 2023-09-21T06:03:31.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.123+0000 7f8e7a67f700 1 -- 172.21.15.59:0/2527141297 wait complete. 2023-09-21T06:03:31.136 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-21T06:03:31.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.303+0000 7fa770c5c700 1 Processor -- start 2023-09-21T06:03:31.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.304+0000 7fa770c5c700 1 -- start start 2023-09-21T06:03:31.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.304+0000 7fa770c5c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa76c0aff90 0x7fa76c0b0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T06:03:31.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.304+0000 7fa770c5c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa76c158e90 con 0x7fa76c158ab0 2023-09-21T06:03:31.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.304+0000 7fa770c5c700 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa76c0b08d0 con 0x7fa76c161ee0 2023-09-21T06:03:31.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.304+0000 7fa770c5c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa76c071c60 con 0x7fa76c0aff90 2023-09-21T06:03:31.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.305+0000 7fa76a59c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa76c158ab0 0x7fa76c165520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41902/0 (socket says 172.21.15.59:41902) 2023-09-21T06:03:31.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.305+0000 7fa76a59c700 1 -- 172.21.15.59:0/3309300413 learned_addr learned my addr 172.21.15.59:0/3309300413 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-09-21T06:03:31.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.305+0000 7fa76ad9d700 1 --2- 172.21.15.59:0/3309300413 >> v2:172.21.15.59:3300/0 conn(0x7fa76c0aff90 0x7fa76c0b0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T06:03:31.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.305+0000 7fa76ad9d700 1 -- 172.21.15.59:0/3309300413 >> v1:172.21.15.83:6789/0 conn(0x7fa76c161ee0 legacy=0x7fa76c071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T06:03:31.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.305+0000 7fa76ad9d700 1 -- 172.21.15.59:0/3309300413 >> v1:172.21.15.59:6789/0 conn(0x7fa76c158ab0 legacy=0x7fa76c165520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T06:03:31.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.305+0000 7fa76ad9d700 1 -- 172.21.15.59:0/3309300413 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa76c165d50 con 0x7fa76c0aff90 2023-09-21T06:03:31.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.305+0000 7fa76ad9d700 1 --2- 172.21.15.59:0/3309300413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa76c0aff90 0x7fa76c0b0390 secure :-1 s=READY pgs=2597 cs=0 l=1 rev1=1 crypto rx=0x7fa764009d90 tx=0x7fa76400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f36e156f32ce0c91 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T06:03:31.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.305+0000 7fa76959a700 1 -- 172.21.15.59:0/3309300413 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76400e070 con 0x7fa76c0aff90 2023-09-21T06:03:31.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.306+0000 7fa76959a700 1 -- 172.21.15.59:0/3309300413 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa76400bb90 con 0x7fa76c0aff90 2023-09-21T06:03:31.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.306+0000 7fa76959a700 1 -- 172.21.15.59:0/3309300413 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa764003a20 con 0x7fa76c0aff90 2023-09-21T06:03:31.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.307+0000 7fa770c5c700 1 -- 172.21.15.59:0/3309300413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa76c0aff90 msgr2=0x7fa76c0b0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T06:03:31.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.307+0000 7fa770c5c700 1 --2- 172.21.15.59:0/3309300413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa76c0aff90 0x7fa76c0b0390 secure :-1 s=READY pgs=2597 cs=0 l=1 rev1=1 crypto rx=0x7fa764009d90 tx=0x7fa76400b330 comp rx=0 tx=0).stop 2023-09-21T06:03:31.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.307+0000 7fa770c5c700 1 -- 172.21.15.59:0/3309300413 shutdown_connections 2023-09-21T06:03:31.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.307+0000 7fa770c5c700 1 --2- 172.21.15.59:0/3309300413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa76c0aff90 0x7fa76c0b0390 unknown :-1 s=CLOSED pgs=2597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T06:03:31.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.307+0000 7fa770c5c700 1 -- 172.21.15.59:0/3309300413 >> 172.21.15.59:0/3309300413 conn(0x7fa76c06a780 msgr2=0x7fa76c06ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T06:03:31.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.307+0000 7fa770c5c700 1 -- 172.21.15.59:0/3309300413 shutdown_connections 2023-09-21T06:03:31.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.307+0000 7fa770c5c700 1 -- 172.21.15.59:0/3309300413 wait complete. 2023-09-21T06:03:31.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.309+0000 7fa770c5c700 1 Processor -- start 2023-09-21T06:03:31.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.309+0000 7fa770c5c700 1 -- start start 2023-09-21T06:03:31.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.310+0000 7fa770c5c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa76c0aff90 0x7fa76c14de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T06:03:31.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.310+0000 7fa770c5c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa76c158ab0 0x7fa76c0b4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T06:03:31.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.310+0000 7fa770c5c700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa76c161ee0 0x7fa76c0b4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T06:03:31.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.310+0000 7fa770c5c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c0b3850 con 0x7fa76c158ab0 2023-09-21T06:03:31.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.310+0000 7fa770c5c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c0b3b30 con 0x7fa76c0aff90 2023-09-21T06:03:31.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.310+0000 7fa770c5c700 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c15a1d0 con 0x7fa76c161ee0 2023-09-21T06:03:31.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.311+0000 7fa76ad9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa76c161ee0 0x7fa76c0b4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T06:03:31.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.311+0000 7fa769d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa76c158ab0 0x7fa76c0b4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T06:03:31.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.311+0000 7fa76ad9d700 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa76c161ee0 0x7fa76c0b4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.59:36960/0 (socket says 172.21.15.59:36960) 2023-09-21T06:03:31.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.311+0000 7fa769d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa76c158ab0 0x7fa76c0b4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36342/0 (socket says 172.21.15.59:36342) 2023-09-21T06:03:31.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.311+0000 7fa76ad9d700 1 -- 172.21.15.59:0/2582690424 learned_addr learned my addr 172.21.15.59:0/2582690424 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-09-21T06:03:31.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.311+0000 7fa769d9b700 1 -- 172.21.15.59:0/2582690424 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa76c161ee0 msgr2=0x7fa76c0b4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T06:03:31.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.311+0000 7fa769d9b700 1 --2- 172.21.15.59:0/2582690424 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa76c161ee0 0x7fa76c0b4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T06:03:31.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.311+0000 7fa769d9b700 1 -- 172.21.15.59:0/2582690424 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa76c0aff90 msgr2=0x7fa76c14de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T06:03:31.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.311+0000 7fa769d9b700 1 --2- 172.21.15.59:0/2582690424 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa76c0aff90 0x7fa76c14de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T06:03:31.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.311+0000 7fa769d9b700 1 -- 172.21.15.59:0/2582690424 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa764009a70 con 0x7fa76c158ab0 2023-09-21T06:03:31.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.311+0000 7fa769d9b700 1 --2- 172.21.15.59:0/2582690424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa76c158ab0 0x7fa76c0b4860 secure :-1 s=READY pgs=2598 cs=0 l=1 rev1=1 crypto rx=0x7fa76000c400 tx=0x7fa76000c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T06:03:31.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.312+0000 7fa75affd700 1 -- 172.21.15.59:0/2582690424 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa760011790 con 0x7fa76c158ab0 2023-09-21T06:03:31.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.312+0000 7fa770c5c700 1 -- 172.21.15.59:0/2582690424 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa76c15a4b0 con 0x7fa76c158ab0 2023-09-21T06:03:31.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.312+0000 7fa770c5c700 1 -- 172.21.15.59:0/2582690424 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa76c0b3520 con 0x7fa76c158ab0 2023-09-21T06:03:31.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.312+0000 7fa75affd700 1 -- 172.21.15.59:0/2582690424 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa760003910 con 0x7fa76c158ab0 2023-09-21T06:03:31.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.312+0000 7fa75affd700 1 -- 172.21.15.59:0/2582690424 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa760011af0 con 0x7fa76c158ab0 2023-09-21T06:03:31.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.314+0000 7fa75affd700 1 -- 172.21.15.59:0/2582690424 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89307+0+0 (secure 0 0 0) 0x7fa760011c50 con 0x7fa76c158ab0 2023-09-21T06:03:31.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.314+0000 7fa75affd700 1 --2- 172.21.15.59:0/2582690424 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa74c07be10 0x7fa74c07e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T06:03:31.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.315+0000 7fa75affd700 1 -- 172.21.15.59:0/2582690424 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa760089420 con 0x7fa76c158ab0 2023-09-21T06:03:31.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.315+0000 7fa76a59c700 1 --2- 172.21.15.59:0/2582690424 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa74c07be10 0x7fa74c07e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T06:03:31.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.315+0000 7fa76a59c700 1 --2- 172.21.15.59:0/2582690424 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa74c07be10 0x7fa74c07e2d0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa75c000f60 tx=0x7fa75c007b10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T06:03:31.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.316+0000 7fa770c5c700 1 -- 172.21.15.59:0/2582690424 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7500052f0 con 0x7fa76c158ab0 2023-09-21T06:03:31.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.321+0000 7fa75affd700 1 -- 172.21.15.59:0/2582690424 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178588 (secure 0 0 0) 0x7fa760054340 con 0x7fa76c158ab0 2023-09-21T06:03:31.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.618+0000 7fa770c5c700 1 -- 172.21.15.59:0/2582690424 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa750005b20 con 0x7fa76c158ab0 2023-09-21T06:03:31.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.619+0000 7fa75affd700 1 -- 172.21.15.59:0/2582690424 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v42) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa760057960 con 0x7fa76c158ab0 2023-09-21T06:03:31.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.622+0000 7fa770c5c700 1 -- 172.21.15.59:0/2582690424 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa74c07be10 msgr2=0x7fa74c07e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T06:03:31.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.622+0000 7fa770c5c700 1 --2- 172.21.15.59:0/2582690424 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa74c07be10 0x7fa74c07e2d0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa75c000f60 tx=0x7fa75c007b10 comp rx=0 tx=0).stop 2023-09-21T06:03:31.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.622+0000 7fa770c5c700 1 -- 172.21.15.59:0/2582690424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa76c158ab0 msgr2=0x7fa76c0b4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T06:03:31.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.622+0000 7fa770c5c700 1 --2- 172.21.15.59:0/2582690424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa76c158ab0 0x7fa76c0b4860 secure :-1 s=READY pgs=2598 cs=0 l=1 rev1=1 crypto rx=0x7fa76000c400 tx=0x7fa76000c710 comp rx=0 tx=0).stop 2023-09-21T06:03:31.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.622+0000 7fa770c5c700 1 -- 172.21.15.59:0/2582690424 shutdown_connections 2023-09-21T06:03:31.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.622+0000 7fa770c5c700 1 --2- 172.21.15.59:0/2582690424 >> [v2:172.21.15.83:6832/1736808576,v1:172.21.15.83:6833/1736808576] conn(0x7fa74c07be10 0x7fa74c07e2d0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T06:03:31.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.622+0000 7fa770c5c700 1 --2- 172.21.15.59:0/2582690424 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa76c161ee0 0x7fa76c0b4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T06:03:31.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.622+0000 7fa770c5c700 1 --2- 172.21.15.59:0/2582690424 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa76c0aff90 0x7fa76c14de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T06:03:31.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.622+0000 7fa770c5c700 1 --2- 172.21.15.59:0/2582690424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa76c158ab0 0x7fa76c0b4860 unknown :-1 s=CLOSED pgs=2598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T06:03:31.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.622+0000 7fa770c5c700 1 -- 172.21.15.59:0/2582690424 >> 172.21.15.59:0/2582690424 conn(0x7fa76c06a780 msgr2=0x7fa76c071410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T06:03:31.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.622+0000 7fa770c5c700 1 -- 172.21.15.59:0/2582690424 shutdown_connections 2023-09-21T06:03:31.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-09-21T06:03:31.622+0000 7fa770c5c700 1 -- 172.21.15.59:0/2582690424 wait complete. 2023-09-21T06:03:31.625 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2023-09-21T06:03:31.641 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-09-21T06:03:31.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T06:03:31.642 DEBUG:teuthology.orchestra.run.smithi059:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-09-21T06:03:31.698 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2023-09-21T06:03:31.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T06:03:31.698 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-09-21T06:03:31.739 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-09-21T06:03:31.739 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-21T06:03:31.806 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19840 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 172.21.15.59:6789:/test /tmp/tmp.3HPsqub1xdtest ceph rw,context=system_u:object_r:root_t:s0,relatime,name=admin,secret=,fsid=dd69925c-6e25-42fe-880b-2f60fc6f384b,acl 0 0 172.21.15.59:6789:/scratch /tmp/tmp.ent7E9UExKscratch ceph rw,context=system_u:object_r:root_t:s0,relatime,name=admin,secret=,fsid=dd69925c-6e25-42fe-880b-2f60fc6f384b,acl 0 0 2023-09-21T06:03:31.807 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2023-09-21T06:03:31.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T06:03:31.807 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-09-21T06:03:31.874 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-21T06:03:31.874 INFO:teuthology.orchestra.run.smithi059.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-09-21T06:03:31.875 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-09-21T06:03:31.875 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-21T06:03:32.030 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284264k,nr_inodes=4071066,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=44,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18063 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-09-21T06:03:32.030 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi083.front.sepia.ceph.com 2023-09-21T06:03:32.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T06:03:32.031 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-09-21T06:03:32.076 INFO:teuthology.orchestra.run.smithi083.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-09-21T06:03:32.077 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-21T06:03:32.077 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2023-09-21T06:03:32.077 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-21T06:03:32.169 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284264k,nr_inodes=4071066,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=44,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18063 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-09-21T06:03:32.169 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi083.front.sepia.ceph.com 2023-09-21T06:03:32.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T06:03:32.170 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-09-21T06:03:32.234 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-21T06:03:32.235 INFO:teuthology.orchestra.run.smithi083.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-09-21T06:03:32.814 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:03:32.818 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:03:33.845 INFO:tasks.ceph.osd.0:Sent signal 15 2023-09-21T06:03:33.846 INFO:tasks.ceph.osd.1:Sent signal 15 2023-09-21T06:03:33.846 INFO:tasks.ceph.osd.2:Sent signal 15 2023-09-21T06:03:33.846 INFO:tasks.ceph.osd.4:Sent signal 15 2023-09-21T06:03:33.847 INFO:tasks.ceph.osd.5:Sent signal 15 2023-09-21T06:03:33.847 INFO:tasks.ceph.osd.6:Sent signal 15 2023-09-21T06:03:33.847 INFO:tasks.ceph.osd.7:Sent signal 15 2023-09-21T06:03:33.848 INFO:tasks.ceph.mds.a:Sent signal 15 2023-09-21T06:03:33.848 INFO:tasks.ceph.mds.c:Sent signal 15 2023-09-21T06:03:33.848 INFO:tasks.ceph.mds.b:Sent signal 15 2023-09-21T06:03:33.849 INFO:tasks.ceph.mds.d:Sent signal 15 2023-09-21T06:03:33.849 INFO:tasks.ceph.mon.a:Sent signal 15 2023-09-21T06:03:33.849 INFO:tasks.ceph.mon.b:Sent signal 15 2023-09-21T06:03:33.850 INFO:tasks.ceph.mon.c:Sent signal 15 2023-09-21T06:03:33.850 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-09-21T06:03:33.851 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-09-21T06:03:33.851 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-09-21T06:03:33.848+0000 7f6a304c5700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 103564) UID: 0 2023-09-21T06:03:33.852 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-09-21T06:03:33.848+0000 7f6a304c5700 -1 osd.5 42 *** Got signal Terminated *** 2023-09-21T06:03:33.852 INFO:tasks.ceph.osd.5.smithi083.stderr:2023-09-21T06:03:33.848+0000 7f6a304c5700 -1 osd.5 42 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-21T06:03:33.852 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-09-21T06:03:33.846+0000 7f7948a08700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 103265) UID: 0 2023-09-21T06:03:33.852 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-09-21T06:03:33.846+0000 7f7948a08700 -1 osd.0 42 *** Got signal Terminated *** 2023-09-21T06:03:33.853 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-09-21T06:03:33.846+0000 7f7948a08700 -1 osd.0 42 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-21T06:03:33.853 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-09-21T06:03:33.847+0000 7fadc2fd5700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 103276) UID: 0 2023-09-21T06:03:33.853 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-09-21T06:03:33.847+0000 7fadc2fd5700 -1 osd.1 42 *** Got signal Terminated *** 2023-09-21T06:03:33.854 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-09-21T06:03:33.847+0000 7fadc2fd5700 -1 osd.1 42 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-21T06:03:33.854 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-09-21T06:03:33.847+0000 7fc5c83b6700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 103281) UID: 0 2023-09-21T06:03:33.854 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-09-21T06:03:33.847+0000 7fc5c83b6700 -1 osd.2 42 *** Got signal Terminated *** 2023-09-21T06:03:33.854 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-09-21T06:03:33.847+0000 7fc5c83b6700 -1 osd.2 42 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-21T06:03:33.855 INFO:tasks.ceph.mds.a.smithi059.stderr:2023-09-21T06:03:33.849+0000 7facd961b700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 119018) UID: 0 2023-09-21T06:03:33.855 INFO:tasks.ceph.mds.a.smithi059.stderr:2023-09-21T06:03:33.849+0000 7facd961b700 -1 mds.a *** got signal Terminated *** 2023-09-21T06:03:33.855 INFO:tasks.ceph.mds.c.smithi059.stderr:2023-09-21T06:03:33.849+0000 7fa085432700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i c (PID: 119017) UID: 0 2023-09-21T06:03:33.856 INFO:tasks.ceph.mds.c.smithi059.stderr:2023-09-21T06:03:33.849+0000 7fa085432700 -1 mds.c *** got signal Terminated *** 2023-09-21T06:03:33.856 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-09-21T06:03:33.851+0000 7fae7ed95700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 103568) UID: 0 2023-09-21T06:03:33.856 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-09-21T06:03:33.851+0000 7fae7ed95700 -1 osd.6 42 *** Got signal Terminated *** 2023-09-21T06:03:33.857 INFO:tasks.ceph.osd.6.smithi083.stderr:2023-09-21T06:03:33.851+0000 7fae7ed95700 -1 osd.6 42 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-21T06:03:33.857 INFO:tasks.ceph.mon.c.smithi083.stderr:2023-09-21T06:03:33.854+0000 7fdaa481d700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 102912) UID: 0 2023-09-21T06:03:33.857 INFO:tasks.ceph.mon.c.smithi083.stderr:2023-09-21T06:03:33.854+0000 7fdaa481d700 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-09-21T06:03:33.858 INFO:tasks.ceph.mds.d.smithi083.stderr:2023-09-21T06:03:33.854+0000 7fee065a9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i d (PID: 111370) UID: 0 2023-09-21T06:03:33.858 INFO:tasks.ceph.mds.d.smithi083.stderr:2023-09-21T06:03:33.854+0000 7fee065a9700 -1 mds.d *** got signal Terminated *** 2023-09-21T06:03:33.858 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-09-21T06:03:33.854+0000 7fceb8335700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 103571) UID: 0 2023-09-21T06:03:33.859 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-09-21T06:03:33.854+0000 7fceb8335700 -1 osd.7 42 *** Got signal Terminated *** 2023-09-21T06:03:33.859 INFO:tasks.ceph.osd.7.smithi083.stderr:2023-09-21T06:03:33.854+0000 7fceb8335700 -1 osd.7 42 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-21T06:03:33.859 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-09-21T06:03:33.848+0000 7fe56ff7b700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 103563) UID: 0 2023-09-21T06:03:33.859 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-09-21T06:03:33.848+0000 7fe56ff7b700 -1 osd.4 42 *** Got signal Terminated *** 2023-09-21T06:03:33.860 INFO:tasks.ceph.osd.4.smithi083.stderr:2023-09-21T06:03:33.848+0000 7fe56ff7b700 -1 osd.4 42 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-21T06:03:33.860 INFO:tasks.ceph.mds.b.smithi083.stderr:2023-09-21T06:03:33.857+0000 7f7b7b17f700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 111371) UID: 0 2023-09-21T06:03:33.860 INFO:tasks.ceph.mds.b.smithi083.stderr:2023-09-21T06:03:33.857+0000 7f7b7b17f700 -1 mds.b *** got signal Terminated *** 2023-09-21T06:03:33.861 INFO:tasks.ceph.mon.b.smithi083.stderr:2023-09-21T06:03:33.857+0000 7fedcc245700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 102909) UID: 0 2023-09-21T06:03:33.861 INFO:tasks.ceph.mon.b.smithi083.stderr:2023-09-21T06:03:33.857+0000 7fedcc245700 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-09-21T06:03:33.883 INFO:tasks.ceph.mon.a.smithi059.stderr:2023-09-21T06:03:33.850+0000 7fa1e5b53700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 102944) UID: 0 2023-09-21T06:03:33.883 INFO:tasks.ceph.mon.a.smithi059.stderr:2023-09-21T06:03:33.883+0000 7fa1e5b53700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-09-21T06:03:33.895 INFO:tasks.ceph.mon.a.smithi059.stderr:2023-09-21T06:03:33.896+0000 7fa1e0348700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-09-21T06:03:34.083 INFO:tasks.ceph.mgr.y.smithi059.stderr:daemon-helper: command crashed with signal 15 2023-09-21T06:04:02.913 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:04:02.916 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:04:33.060 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:04:33.063 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:05:03.208 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:05:03.211 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:05:33.353 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:05:33.357 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:06:03.492 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:06:03.495 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:06:33.639 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:06:33.642 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:07:03.777 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:07:03.780 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:07:33.915 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:07:33.918 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:08:04.053 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:08:04.057 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:08:34.183 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:08:34.187 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:09:04.337 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:09:04.341 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:09:34.459 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:09:34.462 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:10:04.589 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:10:04.592 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:10:34.835 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:10:34.839 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:11:04.983 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:11:04.986 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:11:35.145 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:11:35.149 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:12:05.283 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:12:05.287 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:12:35.432 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:12:35.436 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:13:05.574 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:13:05.578 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:13:35.783 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:13:35.787 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:14:05.905 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:14:05.908 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:14:36.070 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:14:36.073 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:15:06.206 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:15:06.209 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:15:36.362 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:15:36.372 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:16:06.482 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:16:06.486 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:16:36.620 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:16:36.624 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:17:06.767 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:17:06.770 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:17:36.931 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:17:36.934 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:18:07.094 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:18:07.097 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:18:37.239 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:18:37.243 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:19:07.378 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:19:07.382 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:19:37.499 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:19:37.504 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:20:07.654 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:20:07.658 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:20:37.780 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:20:37.796 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:21:07.939 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:21:07.942 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:21:38.088 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:21:38.091 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:22:08.307 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:22:08.310 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:22:38.383 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:22:38.386 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:23:08.508 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:23:08.512 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:23:38.638 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:23:38.650 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:24:08.801 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:24:08.805 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:24:38.956 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:24:38.959 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:25:09.094 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:25:09.097 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:25:39.308 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:25:39.312 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:26:09.406 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:26:09.409 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:26:39.575 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:26:39.578 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:27:09.739 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:27:09.742 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:27:39.877 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:27:39.880 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:28:10.023 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:28:10.027 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:28:40.161 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:28:40.164 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:29:10.333 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:29:10.336 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:29:40.412 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:29:40.416 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:30:10.551 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:30:10.555 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:30:40.689 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:30:40.693 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:31:10.836 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:31:10.839 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:31:40.982 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:31:40.986 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:32:11.128 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:32:11.132 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:32:41.275 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:32:41.279 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:33:11.422 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:33:11.425 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:33:41.571 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:33:41.575 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:34:11.723 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:34:11.727 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:34:41.887 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:34:41.891 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:35:12.032 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:35:12.036 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:35:42.171 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:35:42.175 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:36:12.334 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:36:12.338 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:36:42.489 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:36:42.493 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:37:12.635 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:37:12.639 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:37:42.757 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:37:42.760 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:38:12.911 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:38:12.915 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:38:43.050 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:38:43.054 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:39:13.188 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:39:13.192 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:39:43.351 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:39:43.354 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:40:13.515 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:40:13.519 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:40:43.586 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:40:43.589 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:41:13.665 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:41:13.668 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:41:43.804 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:41:43.808 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:42:13.884 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:42:13.887 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:42:44.047 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:42:44.051 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:43:14.193 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:43:14.197 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:43:44.323 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:43:44.326 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:44:14.469 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:44:14.473 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:44:44.609 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:44:44.613 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:45:14.738 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:45:14.742 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:45:44.893 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:45:44.896 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:46:15.047 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:46:15.051 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:46:45.202 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:46:45.206 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:47:15.349 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:47:15.353 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:47:45.504 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:47:45.508 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:48:15.651 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:48:15.654 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:48:45.788 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:48:45.792 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:49:15.902 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:49:15.905 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:49:46.015 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:49:46.018 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:50:16.170 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:50:16.174 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:50:46.300 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:50:46.304 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:51:16.455 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:51:16.459 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:51:46.601 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:51:46.605 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:52:16.757 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:52:16.760 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:52:46.878 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:52:46.882 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:53:17.008 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:53:17.011 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:53:47.129 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:53:47.133 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:54:17.250 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:54:17.254 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:54:47.380 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:54:47.385 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:55:17.511 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:55:17.515 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:55:47.632 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:55:47.636 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:56:17.770 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:56:17.774 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:56:47.908 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:56:47.911 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:57:18.039 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:57:18.042 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:57:48.168 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:57:48.172 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:58:18.308 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:58:18.311 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:58:48.461 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:58:48.467 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:59:18.607 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:59:18.611 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:59:48.746 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T06:59:48.750 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:00:18.859 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:00:18.863 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:00:49.014 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:00:49.018 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:01:19.152 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:01:19.156 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:01:49.299 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:01:49.303 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:02:19.446 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:02:19.449 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:02:49.575 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:02:49.579 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:03:19.705 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:03:19.709 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:03:49.856 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:03:49.860 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:04:20.006 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:04:20.009 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:04:50.145 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:04:50.148 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:05:20.266 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:05:20.269 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:05:50.396 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:05:50.400 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:06:20.535 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:06:20.538 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:06:50.681 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:06:50.685 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:07:20.810 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:07:20.813 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:07:50.932 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:07:50.936 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:08:21.054 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:08:21.057 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:08:51.192 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:08:51.196 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:09:21.321 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:09:21.324 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:09:51.477 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:09:51.480 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:10:21.640 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:10:21.643 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:10:51.778 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:10:51.785 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:11:21.942 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:11:21.968 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:11:52.122 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:11:52.125 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:12:22.259 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:12:22.263 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:12:52.397 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:12:52.401 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:13:22.544 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:13:22.547 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:13:52.690 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:13:52.694 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:14:22.855 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:14:22.858 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:14:53.008 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:14:53.012 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:15:23.147 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:15:23.150 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:15:53.288 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:15:53.292 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:16:23.424 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:16:23.427 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:16:53.604 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:16:53.607 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:17:23.750 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:17:23.754 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:17:53.905 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:17:53.909 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:18:24.068 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:18:24.071 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:18:54.214 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:18:54.217 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:19:24.369 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:19:24.373 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:19:54.508 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:19:54.511 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:20:24.654 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:20:24.658 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:20:54.792 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:20:54.796 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:21:24.914 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:21:24.918 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:21:55.086 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:21:55.089 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:22:25.241 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:22:25.244 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:22:55.388 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:22:55.391 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:23:25.534 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:23:25.538 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:23:55.672 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:23:55.675 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:24:25.853 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:24:25.856 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:24:55.932 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:24:55.935 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:25:26.095 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:25:26.099 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:25:56.242 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:25:56.246 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:26:26.371 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:26:26.375 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:26:56.510 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:26:56.514 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:27:26.632 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:27:26.635 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:27:56.782 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:27:56.785 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:28:26.900 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:28:26.904 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:28:57.063 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:28:57.066 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:29:27.226 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:29:27.229 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:29:57.365 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:29:57.369 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:30:27.519 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:30:27.523 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:30:57.658 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:30:57.661 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:31:27.796 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:31:27.800 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:31:57.934 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:31:57.938 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:32:28.081 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:32:28.084 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:32:58.235 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:32:58.238 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:33:28.358 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:33:28.361 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:33:58.486 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:33:58.489 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:34:28.564 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:34:28.567 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:34:58.740 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:34:58.743 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:35:28.895 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:35:28.899 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:35:59.017 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:35:59.020 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:36:29.139 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:36:29.142 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:36:59.294 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:36:59.298 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:37:29.423 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:37:29.427 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:37:59.553 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:37:59.557 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:38:29.708 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:38:29.712 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:38:59.854 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:38:59.857 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:39:29.993 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:39:29.996 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:40:00.140 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:40:00.144 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:40:30.279 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:40:30.282 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:41:00.425 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:41:00.429 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:41:30.553 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:41:30.557 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:42:00.700 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:42:00.703 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:42:30.839 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:42:30.842 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:43:00.977 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:43:00.981 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:43:31.123 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:43:31.127 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:44:01.270 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:44:01.273 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:44:31.391 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:44:31.395 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:45:01.554 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:45:01.558 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:45:31.684 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:45:31.688 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:46:01.831 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:46:01.834 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:46:31.969 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:46:31.973 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:47:02.108 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:47:02.111 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:47:32.263 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:47:32.267 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:48:02.392 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:48:02.396 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:48:32.514 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:48:32.518 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:49:02.643 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:49:02.647 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:49:32.798 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:49:32.802 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:50:02.953 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:50:02.956 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:50:33.108 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:50:33.112 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:51:03.237 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:51:03.241 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:51:33.393 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:51:33.396 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:52:03.547 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:52:03.550 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:52:33.677 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:52:33.681 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:53:03.815 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:53:03.819 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:53:33.962 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:53:33.966 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:54:04.134 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:54:04.137 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:54:34.281 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:54:34.284 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:55:04.427 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:55:04.431 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:55:34.549 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:55:34.553 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:56:04.703 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:56:04.707 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:56:34.841 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:56:34.845 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:57:04.988 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:57:04.991 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:57:35.062 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:57:35.066 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:58:05.223 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:58:05.226 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:58:35.368 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:58:35.371 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:59:05.524 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:59:05.528 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:59:35.596 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T07:59:35.599 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:00:05.726 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:00:05.731 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:00:35.881 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:00:35.889 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:01:06.027 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:01:06.030 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:01:36.164 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:01:36.168 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:02:06.345 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:02:06.349 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:02:36.484 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:02:36.488 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:03:06.605 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:03:06.608 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:03:36.737 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:03:36.741 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:04:06.873 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:04:06.876 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:04:36.994 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:04:36.997 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:05:07.141 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:05:07.145 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:05:37.288 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:05:37.291 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:06:07.426 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:06:07.430 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:06:37.564 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:06:37.567 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:07:07.719 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:07:07.722 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:07:37.865 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:07:37.869 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:08:07.978 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:08:07.982 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:08:38.116 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:08:38.120 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:09:08.246 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:09:08.249 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:09:38.384 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:09:38.388 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:10:08.506 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:10:08.509 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:10:38.653 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:10:38.657 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:11:08.791 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:11:08.794 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:11:38.938 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:11:38.942 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:12:09.092 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:12:09.095 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:12:39.230 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:12:39.233 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:13:09.377 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:13:09.381 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:13:39.507 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:13:39.511 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:14:09.628 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:14:09.632 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:14:39.759 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:14:39.763 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:15:09.830 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:15:09.833 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:15:39.960 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:15:39.964 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:16:10.090 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:16:10.094 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:16:40.236 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:16:40.240 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:17:10.399 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:17:10.402 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:17:40.562 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:17:40.565 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:18:10.700 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:18:10.704 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:18:40.830 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:18:40.833 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:19:10.944 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:19:10.948 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:19:41.017 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:19:41.021 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:20:11.137 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:20:11.147 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:20:41.259 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:20:41.263 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:21:11.397 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:21:11.401 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:21:41.544 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:21:41.548 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:22:11.723 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:22:11.727 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:22:41.856 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:22:41.860 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:23:11.926 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:23:11.929 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:23:42.091 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:23:42.095 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:24:12.217 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:24:12.221 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:24:42.306 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:24:42.310 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:25:12.469 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:25:12.473 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:25:42.616 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:25:42.620 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:26:12.771 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:26:12.774 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:26:42.908 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:26:42.912 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:27:13.080 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:27:13.084 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:27:43.227 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:27:43.230 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:28:13.373 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:28:13.377 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:28:43.528 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:28:43.532 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:29:13.658 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:29:13.661 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:29:43.805 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:29:43.808 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:30:13.926 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:30:13.929 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:30:44.047 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:30:44.051 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:31:14.119 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:31:14.122 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:31:44.265 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:31:44.269 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:32:14.420 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:32:14.424 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:32:44.508 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:32:44.511 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:33:14.657 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:33:14.661 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:33:44.809 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:33:44.812 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:34:14.948 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:34:14.951 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:34:45.086 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:34:45.089 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:35:15.222 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:35:15.225 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:35:45.354 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:35:45.358 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:36:15.500 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:36:15.503 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:36:45.646 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:36:45.649 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:37:15.827 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:37:15.830 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:37:45.898 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:37:45.901 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:38:16.080 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:38:16.084 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:38:46.215 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:38:46.219 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:39:16.354 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:39:16.358 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:39:46.517 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:39:46.521 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:40:16.663 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:40:16.667 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:40:46.802 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:40:46.806 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:41:16.939 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:41:16.942 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:41:47.061 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:41:47.064 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:42:17.191 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:42:17.195 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:42:47.329 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:42:47.333 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:43:17.475 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:43:17.479 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:43:47.614 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:43:47.618 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:44:17.754 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:44:17.757 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:44:47.899 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:44:47.903 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:45:18.045 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:45:18.049 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:45:48.200 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:45:48.204 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:46:18.338 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:46:18.341 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:46:48.484 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:46:48.489 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:47:18.631 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:47:18.635 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:47:48.777 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:47:48.781 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:48:18.924 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:48:18.928 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:48:49.053 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:48:49.057 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:49:19.174 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:49:19.178 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:49:49.314 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:49:49.317 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:50:19.443 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:50:19.448 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:50:49.586 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:50:49.589 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:51:19.711 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:51:19.715 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:51:49.858 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:51:49.861 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:52:20.012 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:52:20.016 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:52:50.167 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:52:50.173 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:53:20.306 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:53:20.309 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:53:50.444 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:53:50.449 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:54:20.565 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:54:20.569 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:54:50.720 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:54:50.724 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:55:20.860 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:55:20.864 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:55:51.021 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:55:51.025 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:56:21.142 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:56:21.146 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:56:51.273 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:56:51.276 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:57:21.436 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:57:21.439 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:57:51.574 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:57:51.577 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:58:21.695 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:58:21.700 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:58:51.825 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:58:51.829 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:59:21.955 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:59:21.959 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:59:52.078 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T08:59:52.081 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:00:22.223 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:00:22.226 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:00:52.345 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:00:52.349 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:01:22.482 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:01:22.486 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:01:52.638 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:01:52.642 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:02:22.801 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:02:22.805 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:02:52.869 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:02:52.874 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:03:23.019 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:03:23.022 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:03:53.149 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:03:53.153 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:04:23.278 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:04:23.282 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:04:53.418 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:04:53.423 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:05:23.556 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:05:23.560 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:05:53.677 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:05:53.681 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:06:23.799 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:06:23.802 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:06:53.962 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:06:53.965 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:07:24.143 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:07:24.147 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:07:54.297 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:07:54.301 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:08:24.435 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:08:24.439 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:08:54.574 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:08:54.578 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:09:24.645 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:09:24.649 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:09:54.767 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:09:54.771 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:10:24.898 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:10:24.901 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:10:55.020 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:10:55.023 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:11:25.084 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:11:25.088 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:11:55.262 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:11:55.266 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:12:25.401 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:12:25.404 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:12:55.542 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:12:55.545 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:13:25.660 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:13:25.663 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:13:55.798 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:13:55.801 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:14:25.945 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:14:25.949 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:14:56.092 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:14:56.096 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:15:26.206 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:15:26.209 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:15:56.344 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:15:56.347 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:16:26.482 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:16:26.485 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:16:56.637 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:16:56.641 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:17:26.800 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:17:26.803 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:17:56.955 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:17:56.958 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:18:27.076 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:18:27.080 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:18:57.206 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:18:57.209 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:19:27.370 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:19:27.373 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:19:57.524 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:19:57.528 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:20:27.662 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:20:27.666 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:20:57.793 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:20:57.796 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:21:27.948 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:21:27.951 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:21:58.102 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:21:58.105 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:22:28.249 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:22:28.253 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:22:58.320 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:22:58.323 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:23:28.450 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:23:28.453 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:23:58.589 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:23:58.593 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:24:28.735 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:24:28.738 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:24:58.891 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:24:58.894 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:25:29.020 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:25:29.024 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:25:59.159 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:25:59.162 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:26:29.290 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:26:29.293 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:26:59.443 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:26:59.447 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:27:29.606 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:27:29.610 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:27:59.761 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:27:59.765 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:28:29.917 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:28:29.920 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:29:00.038 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:29:00.041 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:29:30.193 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:29:30.196 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:30:00.323 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:30:00.327 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:30:30.478 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:30:30.482 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:31:00.599 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:31:00.602 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:31:30.713 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:31:30.717 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:32:00.843 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:32:00.846 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:32:30.996 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:32:31.000 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:33:01.110 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:33:01.114 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:33:31.265 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:33:31.269 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:34:01.395 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:34:01.398 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:34:31.508 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:34:31.512 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:35:01.647 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:35:01.650 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:35:31.785 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:35:31.790 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:36:01.932 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:36:01.936 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:36:32.086 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:36:32.089 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:37:02.207 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:37:02.211 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:37:32.291 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:37:32.294 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:38:02.361 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:38:02.365 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:38:32.497 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:38:32.500 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:39:02.635 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:39:02.640 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:39:32.765 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:39:32.769 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:40:02.912 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:40:02.916 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:40:33.059 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:40:33.063 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:41:03.190 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:41:03.193 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:41:33.344 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:41:33.348 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:42:03.474 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:42:03.477 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:42:33.621 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:42:33.625 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:43:03.742 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:43:03.745 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:43:33.880 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:43:33.884 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:44:04.026 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:44:04.030 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:44:34.165 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:44:34.168 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:45:04.287 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:45:04.290 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:45:34.416 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:45:34.420 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:46:04.545 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:46:04.549 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:46:34.692 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:46:34.696 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:47:04.841 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:47:04.845 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:47:34.985 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:47:34.989 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:48:05.106 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:48:05.109 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:48:35.237 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:48:35.240 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:49:05.367 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:49:05.370 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:49:35.438 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:49:35.441 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:50:05.559 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:50:05.563 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:50:35.706 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:50:35.710 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:51:05.836 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:51:05.839 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:51:35.992 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:51:35.995 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:52:06.112 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:52:06.115 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:52:36.251 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:52:36.255 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:53:06.388 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:53:06.392 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:53:36.535 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:53:36.539 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:54:06.685 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:54:06.689 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:54:36.804 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:54:36.808 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:55:06.941 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:55:06.945 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:55:37.088 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:55:37.091 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:56:07.234 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:56:07.237 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:56:37.389 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:56:37.393 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:57:07.577 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:57:07.581 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:57:37.732 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:57:37.736 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:58:07.878 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:58:07.881 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:58:38.017 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:58:38.020 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:59:08.146 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:59:08.150 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:59:38.284 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T09:59:38.287 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:00:08.406 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:00:08.410 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:00:38.544 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:00:38.548 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:01:08.701 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:01:08.705 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:01:38.846 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:01:38.850 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:02:08.993 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:02:08.996 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:02:39.148 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:02:39.151 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:03:09.277 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:03:09.281 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:03:39.432 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:03:39.435 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:04:09.587 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:04:09.590 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:04:39.674 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:04:39.677 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:05:09.797 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:05:09.800 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:05:39.918 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:05:39.921 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:06:10.047 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:06:10.051 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:06:40.211 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:06:40.214 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:07:10.349 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:07:10.352 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:07:40.529 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:07:40.532 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:08:10.659 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:08:10.663 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:08:40.817 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:08:40.821 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:09:10.994 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:09:11.000 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:09:41.064 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:09:41.069 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:10:11.195 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:10:11.198 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:10:41.335 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:10:41.339 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:11:11.429 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:11:11.432 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:11:41.560 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:11:41.563 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:12:11.689 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:12:11.692 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:12:41.819 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:12:41.822 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:13:11.957 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:13:11.960 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:13:42.087 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:13:42.093 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:14:12.233 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:14:12.237 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:14:42.372 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:14:42.375 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:15:12.560 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:15:12.563 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:15:42.740 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:15:42.743 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:16:12.895 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:16:12.900 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:16:43.066 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:16:43.070 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:17:13.204 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:17:13.208 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:17:43.342 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:17:43.345 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:18:13.456 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:18:13.459 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:18:43.586 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:18:43.589 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:19:13.731 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:19:13.735 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:19:43.879 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:19:43.882 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:20:14.009 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:20:14.012 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:20:44.139 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:20:44.142 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:21:14.276 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:21:14.281 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:21:44.415 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:21:44.418 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:22:14.561 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:22:14.570 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:22:44.708 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:22:44.711 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:23:14.854 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:23:14.858 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:23:45.001 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:23:45.004 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:24:15.139 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:24:15.142 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:24:45.271 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:24:45.274 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:25:15.399 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:25:15.403 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:25:45.529 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:25:45.533 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:26:15.675 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:26:15.678 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:26:45.830 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:26:45.834 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:27:15.952 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:27:15.955 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:27:46.115 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:27:46.118 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:28:16.230 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:28:16.233 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:28:46.349 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:28:46.353 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:29:16.504 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:29:16.508 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:29:46.642 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:29:46.645 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:30:16.791 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:30:16.796 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:30:46.927 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:30:46.931 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:31:17.082 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:31:17.086 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:31:47.212 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:31:47.215 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:32:17.358 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:32:17.369 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:32:47.513 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:32:47.516 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:33:17.652 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:33:17.657 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:33:47.789 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:33:47.793 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:34:17.870 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:34:17.873 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:34:48.008 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:34:48.011 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:35:18.138 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:35:18.141 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:35:48.292 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:35:48.296 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:36:18.369 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:36:18.373 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:36:48.528 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:36:48.532 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:37:18.648 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:37:18.652 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:37:48.803 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:37:48.807 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:38:18.950 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:38:18.954 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:38:49.079 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:38:49.083 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:39:19.209 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:39:19.212 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:39:49.339 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:39:49.342 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:40:19.478 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:40:19.481 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:40:49.642 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:40:49.646 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:41:19.796 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:41:19.799 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:41:49.934 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:41:49.937 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:42:20.099 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:42:20.102 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:42:50.252 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:42:50.255 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:43:20.381 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:43:20.385 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:43:50.503 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:43:50.506 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:44:20.625 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:44:20.629 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:44:50.754 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:44:50.757 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:45:20.943 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:45:20.947 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:45:51.072 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:45:51.076 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:46:21.194 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:46:21.197 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:46:51.324 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:46:51.327 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:47:21.402 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:47:21.406 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:47:51.558 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:47:51.561 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:48:21.704 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:48:21.707 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:48:51.841 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:48:51.845 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:49:21.962 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:49:21.965 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:49:52.118 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:49:52.122 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:50:22.255 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:50:22.259 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:50:52.376 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:50:52.380 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:51:22.539 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:51:22.543 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:51:52.669 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:51:52.672 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:52:22.799 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:52:22.802 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:52:53.005 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:52:53.008 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:53:23.157 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:53:23.161 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:53:53.311 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:53:53.315 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:54:23.405 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:54:23.409 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:54:53.538 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:54:53.542 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:55:23.676 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:55:23.680 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:55:53.806 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:55:53.809 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:56:23.969 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:56:23.973 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:56:54.125 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:56:54.128 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:57:24.261 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:57:24.265 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:57:54.408 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:57:54.411 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:58:24.529 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:58:24.533 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:58:54.683 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:58:54.687 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:59:24.822 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:59:24.826 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:59:54.943 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T10:59:54.947 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:00:25.014 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:00:25.017 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:00:55.161 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:00:55.168 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:01:25.332 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:01:25.337 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:01:55.470 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:01:55.473 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:02:25.611 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:02:25.614 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:02:55.738 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:02:55.742 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:03:25.851 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:03:25.855 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:03:56.014 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:03:56.018 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:04:26.169 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:04:26.173 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:04:56.324 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:04:56.328 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:05:26.454 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:05:26.458 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:05:56.600 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:05:56.604 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:06:26.746 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:06:26.763 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:06:56.885 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:06:56.888 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:07:27.023 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:07:27.026 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:07:57.202 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:07:57.205 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:08:27.357 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:08:27.361 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:08:57.512 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:08:57.515 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:09:27.650 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:09:27.654 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:09:57.798 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:09:57.801 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:10:27.927 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:10:27.933 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:10:58.006 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:10:58.010 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:11:28.070 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:11:28.074 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:11:58.199 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:11:58.202 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:12:28.328 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:12:28.332 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:12:58.483 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:12:58.487 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:13:28.554 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:13:28.558 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:13:58.639 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:13:58.643 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:14:28.705 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:14:28.709 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:14:58.819 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:14:58.825 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:15:28.949 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:15:28.953 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:15:59.080 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:15:59.084 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:16:29.183 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:16:29.186 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:16:59.330 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:16:59.334 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:17:29.485 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:17:29.488 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:17:59.632 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:17:59.635 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:18:29.752 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:18:29.756 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:18:59.891 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:18:59.894 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:19:30.029 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:19:30.032 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:20:00.167 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:20:00.170 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:20:30.334 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:20:30.338 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:21:00.472 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:21:00.475 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:21:30.599 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:21:30.603 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:22:00.739 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:22:00.743 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:22:30.876 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:22:30.879 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:23:01.040 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:23:01.044 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:23:31.170 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:23:31.174 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:24:01.317 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:24:01.321 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:24:31.441 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:24:31.444 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:25:01.594 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:25:01.598 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:25:31.715 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:25:31.719 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:26:01.854 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:26:01.858 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:26:32.001 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:26:32.005 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:27:02.165 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:27:02.168 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:27:32.311 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:27:32.314 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:28:02.457 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:28:02.461 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:28:32.588 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:28:32.592 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:29:02.718 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:29:02.721 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:29:32.873 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:29:32.877 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:30:03.020 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:30:03.023 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:30:33.166 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:30:33.170 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:31:03.313 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:31:03.317 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:31:33.435 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:31:33.439 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:32:03.581 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:32:03.585 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:32:33.737 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:32:33.740 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:33:03.875 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:33:03.878 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:33:34.087 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:33:34.090 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:34:04.160 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:34:04.164 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:34:34.305 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:34:34.308 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:35:04.455 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:35:04.459 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:35:34.593 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:35:34.596 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:36:04.740 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:36:04.744 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:36:34.861 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:36:34.865 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:37:04.983 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:37:04.987 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:37:35.138 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:37:35.141 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:38:05.267 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:38:05.271 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:38:35.398 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:38:35.401 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:39:05.561 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:39:05.565 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:39:35.638 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:39:35.642 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:40:05.814 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:40:05.818 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:40:35.943 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:40:35.947 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:41:06.090 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:41:06.097 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:41:36.236 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:41:36.239 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:42:06.365 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:42:06.369 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:42:36.487 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:42:36.491 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:43:06.626 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:43:06.630 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:43:36.764 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:43:36.767 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:44:06.919 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:44:06.923 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:44:37.074 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:44:37.078 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:45:07.204 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:45:07.208 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:45:37.334 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:45:37.337 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:46:07.471 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:46:07.475 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:46:37.626 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:46:37.629 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:47:07.756 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:47:07.760 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:47:37.861 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:47:37.865 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:48:07.991 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:48:07.996 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:48:38.114 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:48:38.118 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:49:08.268 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:49:08.272 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:49:38.396 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:49:38.400 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:50:08.536 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:50:08.540 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:50:38.666 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:50:38.669 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:51:08.804 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:51:08.808 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:51:38.934 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:51:38.937 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:52:09.081 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:52:09.085 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:52:39.211 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:52:39.215 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:53:09.374 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:53:09.378 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:53:39.521 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:53:39.524 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:54:09.659 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:54:09.662 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:54:39.764 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:54:39.767 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:55:09.893 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:55:09.897 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:55:40.052 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:55:40.055 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:56:10.178 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:56:10.181 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:56:40.317 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:56:40.321 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:57:10.446 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:57:10.449 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:57:40.592 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:57:40.595 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:58:10.755 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:58:10.759 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:58:40.840 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:58:40.844 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:59:10.990 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:59:10.994 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:59:41.077 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T11:59:41.080 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T12:00:11.233 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T12:00:11.237 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T12:00:41.379 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T12:00:41.383 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T12:01:11.534 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T12:01:11.544 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T12:01:41.688 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T12:01:41.692 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T12:02:11.756 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T12:02:11.760 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T12:02:41.897 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T12:02:41.922 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T12:03:12.078 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T12:03:12.082 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T12:03:42.198 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T12:03:42.202 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T12:04:12.354 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T12:04:12.358 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T12:04:42.483 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T12:04:42.502 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T12:05:12.647 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T12:05:12.651 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T12:05:42.794 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T12:05:42.797 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-21T12:05:43.204 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-09-21T12:05:43.205 DEBUG:teuthology.task.console_log:Killing console logger for smithi059 2023-09-21T12:05:43.206 DEBUG:teuthology.task.console_log:Killing console logger for smithi083 2023-09-21T12:05:43.207 DEBUG:teuthology.exit:Finished running handlers